Jul 24 04:00:18.126978 ip-10-0-138-155 systemd[1]: Starting Kubernetes Kubelet... Jul 24 04:00:18.575574 ip-10-0-138-155 kubenswrapper[2563]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 04:00:18.575574 ip-10-0-138-155 kubenswrapper[2563]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 24 04:00:18.575574 ip-10-0-138-155 kubenswrapper[2563]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 04:00:18.575574 ip-10-0-138-155 kubenswrapper[2563]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 24 04:00:18.575574 ip-10-0-138-155 kubenswrapper[2563]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 24 04:00:18.575574 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.570459 2563 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 24 04:00:18.595622 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.577959 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 04:00:18.595622 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.577973 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 04:00:18.595622 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.577977 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 04:00:18.595622 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.577981 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 04:00:18.595622 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.577984 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 04:00:18.595622 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.577987 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 04:00:18.595622 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.577990 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 04:00:18.595622 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.577993 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 04:00:18.595622 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.577996 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 04:00:18.595622 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578006 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 04:00:18.595622 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578009 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 04:00:18.595622 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578012 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 04:00:18.595622 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578016 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 04:00:18.595622 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578019 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 04:00:18.595622 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578022 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 04:00:18.595622 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578024 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 04:00:18.595622 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578027 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 04:00:18.595622 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578031 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 04:00:18.595622 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578033 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 04:00:18.595622 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578036 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 04:00:18.610501 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578039 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 04:00:18.610501 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578042 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 04:00:18.610501 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578044 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 04:00:18.610501 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578047 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 04:00:18.610501 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578050 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 04:00:18.610501 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578052 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 04:00:18.610501 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578055 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 04:00:18.610501 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578057 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 04:00:18.610501 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578060 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 04:00:18.610501 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578062 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 04:00:18.610501 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578065 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 04:00:18.610501 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578069 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 04:00:18.610501 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578072 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 04:00:18.610501 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578075 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 04:00:18.610501 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578077 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 04:00:18.610501 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578081 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 04:00:18.610501 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578083 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 04:00:18.610501 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578086 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 04:00:18.610501 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578091 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 04:00:18.610501 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578094 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 04:00:18.612550 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578096 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 04:00:18.612550 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578099 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 04:00:18.612550 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578101 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 04:00:18.612550 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578104 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 04:00:18.612550 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578107 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 04:00:18.612550 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578110 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 04:00:18.612550 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578112 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 04:00:18.612550 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578116 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 04:00:18.612550 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578120 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 04:00:18.612550 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578122 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 04:00:18.612550 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578125 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 04:00:18.612550 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578129 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 04:00:18.612550 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578133 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 04:00:18.612550 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578136 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 04:00:18.612550 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578139 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 04:00:18.612550 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578142 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 04:00:18.612550 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578145 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 04:00:18.612550 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578147 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 04:00:18.612550 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578151 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 04:00:18.614876 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578154 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 04:00:18.614876 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578156 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 04:00:18.614876 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578159 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 04:00:18.614876 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578162 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 04:00:18.614876 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578165 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 04:00:18.614876 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578167 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 04:00:18.614876 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578170 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 04:00:18.614876 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578172 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 04:00:18.614876 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578175 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 04:00:18.614876 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578177 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 04:00:18.614876 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578180 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 04:00:18.614876 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578182 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 04:00:18.614876 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578185 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 04:00:18.614876 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578187 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 04:00:18.614876 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578190 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 04:00:18.614876 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578192 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 04:00:18.614876 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578196 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 04:00:18.614876 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578198 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 04:00:18.614876 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578201 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 04:00:18.629916 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578205 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 04:00:18.629916 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578207 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 04:00:18.629916 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578210 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 04:00:18.629916 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578212 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 04:00:18.629916 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578215 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 04:00:18.629916 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578218 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 04:00:18.629916 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578222 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 04:00:18.629916 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578227 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 04:00:18.629916 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578230 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 04:00:18.629916 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578234 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 04:00:18.629916 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578236 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 04:00:18.629916 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578240 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 04:00:18.629916 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578243 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 04:00:18.629916 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578246 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 04:00:18.629916 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578249 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 24 04:00:18.629916 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578252 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 04:00:18.629916 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578255 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 04:00:18.629916 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578257 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 04:00:18.629916 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578261 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 04:00:18.632395 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578263 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 04:00:18.632395 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.578267 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 04:00:18.632395 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579023 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 04:00:18.632395 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579030 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 04:00:18.632395 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579033 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 04:00:18.632395 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579037 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 04:00:18.632395 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579041 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 04:00:18.632395 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579045 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 04:00:18.632395 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579048 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 04:00:18.632395 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579051 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 04:00:18.632395 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579054 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 04:00:18.632395 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579057 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 04:00:18.632395 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579060 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 04:00:18.632395 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579063 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 04:00:18.632395 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579066 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 04:00:18.632395 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579069 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 04:00:18.632395 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579071 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 04:00:18.632395 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579074 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 04:00:18.632395 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579077 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 04:00:18.632395 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579079 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 04:00:18.634290 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579082 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 04:00:18.634290 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579085 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 04:00:18.634290 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579088 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 04:00:18.634290 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579091 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 04:00:18.634290 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579094 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 04:00:18.634290 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579097 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 04:00:18.634290 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579099 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 04:00:18.634290 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579102 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 04:00:18.634290 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579105 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 04:00:18.634290 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579107 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 04:00:18.634290 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579113 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 04:00:18.634290 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579115 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 04:00:18.634290 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579118 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 04:00:18.634290 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579120 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 04:00:18.634290 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579123 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 04:00:18.634290 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579125 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 04:00:18.634290 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579128 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 04:00:18.634290 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579131 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 04:00:18.634290 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579134 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 04:00:18.634290 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579136 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 04:00:18.650293 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579139 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 04:00:18.650293 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579143 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 04:00:18.650293 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579147 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 04:00:18.650293 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579151 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 04:00:18.650293 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579154 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 04:00:18.650293 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579157 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 04:00:18.650293 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579160 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 04:00:18.650293 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579162 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 04:00:18.650293 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579165 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 04:00:18.650293 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579168 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 04:00:18.650293 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579171 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 04:00:18.650293 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579173 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 04:00:18.650293 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579176 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 04:00:18.650293 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579178 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 04:00:18.650293 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579181 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 04:00:18.650293 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579184 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 04:00:18.650293 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579186 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 04:00:18.650293 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579189 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 04:00:18.650293 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579191 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 04:00:18.647033 ip-10-0-138-155 systemd[1]: Started Kubernetes Kubelet. Jul 24 04:00:18.658003 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579194 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 04:00:18.658003 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579198 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 04:00:18.658003 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579201 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 04:00:18.658003 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579206 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 04:00:18.658003 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579209 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 04:00:18.658003 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579212 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 04:00:18.658003 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579215 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 04:00:18.658003 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579218 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 04:00:18.658003 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579221 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 04:00:18.658003 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579223 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 04:00:18.658003 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579226 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 04:00:18.658003 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579228 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 04:00:18.658003 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579231 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 04:00:18.658003 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579233 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 04:00:18.658003 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579237 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 04:00:18.658003 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579240 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 04:00:18.658003 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579243 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 04:00:18.658003 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579245 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 04:00:18.658003 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579248 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 04:00:18.660888 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579250 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 04:00:18.660888 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579252 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 04:00:18.660888 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579255 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 04:00:18.660888 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579258 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 04:00:18.660888 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579260 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 04:00:18.660888 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579263 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 04:00:18.660888 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579265 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 04:00:18.660888 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579268 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 04:00:18.660888 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579270 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 04:00:18.660888 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579273 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 04:00:18.660888 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579276 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 04:00:18.660888 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579278 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 04:00:18.660888 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579281 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 04:00:18.660888 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579283 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 04:00:18.660888 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579286 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 04:00:18.660888 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579290 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 04:00:18.660888 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579295 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 04:00:18.660888 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579299 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 04:00:18.660888 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579301 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 04:00:18.660888 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579304 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 04:00:18.675008 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579306 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 04:00:18.675008 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579310 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 24 04:00:18.675008 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579312 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 04:00:18.675008 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579733 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 04:00:18.675008 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579738 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 04:00:18.675008 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579741 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 04:00:18.675008 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579744 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 04:00:18.675008 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579747 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 04:00:18.675008 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579751 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 04:00:18.675008 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579754 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 04:00:18.675008 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579757 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 04:00:18.675008 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579760 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 04:00:18.675008 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579763 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 04:00:18.675008 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579766 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 04:00:18.675008 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579768 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 04:00:18.675008 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579771 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 04:00:18.675008 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579774 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 04:00:18.675008 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579777 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 04:00:18.675008 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579779 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 04:00:18.675008 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579782 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 04:00:18.677417 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579784 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 04:00:18.677417 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579787 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 04:00:18.677417 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579790 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 04:00:18.677417 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579792 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 04:00:18.677417 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579795 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 04:00:18.677417 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579798 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 04:00:18.677417 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579800 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 04:00:18.677417 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579803 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 04:00:18.677417 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579807 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 04:00:18.677417 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579810 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 04:00:18.677417 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579813 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 04:00:18.677417 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579815 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 04:00:18.677417 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579818 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 04:00:18.677417 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579821 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 04:00:18.677417 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579823 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 04:00:18.677417 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579828 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 04:00:18.677417 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579831 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 04:00:18.677417 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579835 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 04:00:18.677417 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579838 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 04:00:18.689904 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579841 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 04:00:18.689904 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579844 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 04:00:18.689904 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579847 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 04:00:18.689904 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579850 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 04:00:18.689904 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579853 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 04:00:18.689904 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579856 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 04:00:18.689904 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579859 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 04:00:18.689904 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579863 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 04:00:18.689904 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579866 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 04:00:18.689904 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579868 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 04:00:18.689904 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579870 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 04:00:18.689904 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579873 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 04:00:18.689904 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579875 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 04:00:18.689904 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579878 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 04:00:18.689904 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579881 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 04:00:18.689904 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579883 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 04:00:18.689904 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579886 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 04:00:18.689904 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579888 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 04:00:18.689904 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579890 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 04:00:18.689904 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579893 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 04:00:18.707050 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579895 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 04:00:18.707050 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579900 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 04:00:18.707050 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579902 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 04:00:18.707050 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579905 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 04:00:18.707050 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579907 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 04:00:18.707050 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579910 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 04:00:18.707050 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579912 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 04:00:18.707050 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579915 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 04:00:18.707050 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579918 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 04:00:18.707050 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579920 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 04:00:18.707050 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579922 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 04:00:18.707050 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579927 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 04:00:18.707050 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579931 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 04:00:18.707050 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579933 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 04:00:18.707050 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579936 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 04:00:18.707050 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579939 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 04:00:18.707050 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579941 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 24 04:00:18.707050 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579944 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 04:00:18.707050 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579946 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 04:00:18.859764 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579953 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 04:00:18.859764 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579955 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 04:00:18.859764 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579958 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 04:00:18.859764 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579961 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 04:00:18.859764 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579963 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 04:00:18.859764 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579966 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 04:00:18.859764 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579970 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 04:00:18.859764 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579973 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 04:00:18.859764 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579975 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 04:00:18.859764 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579978 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 04:00:18.859764 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579980 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 04:00:18.859764 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579983 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 04:00:18.859764 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579985 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 04:00:18.859764 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579988 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 04:00:18.859764 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579993 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 04:00:18.859764 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579996 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 04:00:18.859764 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.579999 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 04:00:18.859764 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580001 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 04:00:18.859764 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580004 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580006 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580009 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580011 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580014 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580016 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580092 2563 flags.go:64] FLAG: --address="0.0.0.0" Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580100 2563 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580109 2563 flags.go:64] FLAG: --anonymous-auth="true" Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580115 2563 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580123 2563 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580128 2563 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580134 2563 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580138 2563 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580143 2563 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580146 2563 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580150 2563 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580153 2563 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580156 2563 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580159 2563 flags.go:64] FLAG: --cgroup-root="" Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580162 2563 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580165 2563 flags.go:64] FLAG: --client-ca-file="" Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580168 2563 flags.go:64] FLAG: --cloud-provider="external" Jul 24 04:00:18.874992 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580171 2563 flags.go:64] FLAG: --cluster-dns="[]" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580175 2563 flags.go:64] FLAG: --cluster-domain="" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580179 2563 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580182 2563 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580185 2563 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580189 2563 flags.go:64] FLAG: --container-log-max-files="5" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580193 2563 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580196 2563 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580199 2563 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580203 2563 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580207 2563 flags.go:64] FLAG: --contention-profiling="false" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580210 2563 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580213 2563 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580216 2563 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580219 2563 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580224 2563 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580227 2563 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580230 2563 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580233 2563 flags.go:64] FLAG: --enable-load-reader="false" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580236 2563 flags.go:64] FLAG: --enable-server="true" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580239 2563 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580245 2563 flags.go:64] FLAG: --event-burst="100" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580248 2563 flags.go:64] FLAG: --event-qps="50" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580252 2563 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 24 04:00:18.887870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580255 2563 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580258 2563 flags.go:64] FLAG: --eviction-hard="" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580262 2563 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580265 2563 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580268 2563 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580271 2563 flags.go:64] FLAG: --eviction-soft="" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580274 2563 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580277 2563 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580280 2563 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580283 2563 flags.go:64] FLAG: --experimental-mounter-path="" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580286 2563 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580289 2563 flags.go:64] FLAG: --fail-swap-on="true" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580291 2563 flags.go:64] FLAG: --feature-gates="" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580297 2563 flags.go:64] FLAG: --file-check-frequency="20s" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580300 2563 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580303 2563 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580306 2563 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580309 2563 flags.go:64] FLAG: --healthz-port="10248" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580312 2563 flags.go:64] FLAG: --help="false" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580315 2563 flags.go:64] FLAG: --hostname-override="ip-10-0-138-155.ec2.internal" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580318 2563 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580321 2563 flags.go:64] FLAG: --http-check-frequency="20s" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580324 2563 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580327 2563 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 24 04:00:18.888701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580331 2563 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580333 2563 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580336 2563 flags.go:64] FLAG: --image-service-endpoint="" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580340 2563 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580342 2563 flags.go:64] FLAG: --kube-api-burst="100" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580346 2563 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580349 2563 flags.go:64] FLAG: --kube-api-qps="50" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580353 2563 flags.go:64] FLAG: --kube-reserved="" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580356 2563 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580359 2563 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580362 2563 flags.go:64] FLAG: --kubelet-cgroups="" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580365 2563 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580368 2563 flags.go:64] FLAG: --lock-file="" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580371 2563 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580374 2563 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580376 2563 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580382 2563 flags.go:64] FLAG: --log-json-split-stream="false" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580385 2563 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580388 2563 flags.go:64] FLAG: --log-text-split-stream="false" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580391 2563 flags.go:64] FLAG: --logging-format="text" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580393 2563 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580398 2563 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580401 2563 flags.go:64] FLAG: --manifest-url="" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580404 2563 flags.go:64] FLAG: --manifest-url-header="" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580408 2563 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 24 04:00:18.889753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580411 2563 flags.go:64] FLAG: --max-open-files="1000000" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580415 2563 flags.go:64] FLAG: --max-pods="110" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580418 2563 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580422 2563 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580424 2563 flags.go:64] FLAG: --memory-manager-policy="None" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580427 2563 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580430 2563 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580433 2563 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580436 2563 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580450 2563 flags.go:64] FLAG: --node-status-max-images="50" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580453 2563 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580456 2563 flags.go:64] FLAG: --oom-score-adj="-999" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580460 2563 flags.go:64] FLAG: --pod-cidr="" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580488 2563 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580496 2563 flags.go:64] FLAG: --pod-manifest-path="" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580499 2563 flags.go:64] FLAG: --pod-max-pids="-1" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580502 2563 flags.go:64] FLAG: --pods-per-core="0" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580504 2563 flags.go:64] FLAG: --port="10250" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580508 2563 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580510 2563 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0ed185893e235262a" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580514 2563 flags.go:64] FLAG: --qos-reserved="" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580517 2563 flags.go:64] FLAG: --read-only-port="10255" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580519 2563 flags.go:64] FLAG: --register-node="true" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580522 2563 flags.go:64] FLAG: --register-with-taints="" Jul 24 04:00:18.890795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580526 2563 flags.go:64] FLAG: --registry-burst="10" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580529 2563 flags.go:64] FLAG: --registry-qps="5" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580532 2563 flags.go:64] FLAG: --reserved-cpus="" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580535 2563 flags.go:64] FLAG: --reserved-memory="" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580538 2563 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580542 2563 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580546 2563 flags.go:64] FLAG: --rotate-certificates="false" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580549 2563 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580551 2563 flags.go:64] FLAG: --runonce="false" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580555 2563 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580558 2563 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580567 2563 flags.go:64] FLAG: --seccomp-default="false" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580571 2563 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580574 2563 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580577 2563 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580580 2563 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580583 2563 flags.go:64] FLAG: --storage-driver-password="root" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580586 2563 flags.go:64] FLAG: --storage-driver-secure="false" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580589 2563 flags.go:64] FLAG: --storage-driver-table="stats" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580592 2563 flags.go:64] FLAG: --storage-driver-user="root" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580595 2563 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580598 2563 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580603 2563 flags.go:64] FLAG: --system-cgroups="" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580606 2563 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580611 2563 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 24 04:00:18.891520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580614 2563 flags.go:64] FLAG: --tls-cert-file="" Jul 24 04:00:18.892220 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580618 2563 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 24 04:00:18.892220 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580622 2563 flags.go:64] FLAG: --tls-min-version="" Jul 24 04:00:18.892220 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580625 2563 flags.go:64] FLAG: --tls-private-key-file="" Jul 24 04:00:18.892220 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580628 2563 flags.go:64] FLAG: --topology-manager-policy="none" Jul 24 04:00:18.892220 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580630 2563 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 24 04:00:18.892220 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580633 2563 flags.go:64] FLAG: --topology-manager-scope="container" Jul 24 04:00:18.892220 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580637 2563 flags.go:64] FLAG: --v="2" Jul 24 04:00:18.892220 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580641 2563 flags.go:64] FLAG: --version="false" Jul 24 04:00:18.892220 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580646 2563 flags.go:64] FLAG: --vmodule="" Jul 24 04:00:18.892220 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580649 2563 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 24 04:00:18.892220 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.580653 2563 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 24 04:00:18.892220 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580795 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 04:00:18.892220 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580800 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 04:00:18.892220 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580803 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 04:00:18.892220 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580806 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 04:00:18.892220 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580809 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 04:00:18.892220 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580812 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 04:00:18.892220 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580815 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 04:00:18.892220 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580818 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 04:00:18.892220 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580821 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 04:00:18.892220 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580823 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 04:00:18.892220 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580826 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 04:00:18.893064 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580829 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 04:00:18.893064 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580832 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 04:00:18.893064 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580834 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 04:00:18.893064 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580837 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 04:00:18.893064 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580840 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 04:00:18.893064 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580842 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 04:00:18.893064 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580847 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 04:00:18.893064 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580856 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 04:00:18.893064 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580859 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 04:00:18.893064 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580862 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 04:00:18.893064 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580864 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 04:00:18.893064 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580867 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 04:00:18.893064 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580870 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 04:00:18.893064 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580873 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 04:00:18.893064 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580876 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 04:00:18.893064 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580878 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 04:00:18.893064 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580881 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 04:00:18.893064 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580884 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 04:00:18.893064 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580886 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 04:00:18.893064 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580889 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 04:00:18.893715 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580892 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 04:00:18.893715 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580896 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 24 04:00:18.893715 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580899 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 04:00:18.893715 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580901 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 04:00:18.893715 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580904 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 04:00:18.893715 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580907 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 04:00:18.893715 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580909 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 04:00:18.893715 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580912 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 04:00:18.893715 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580914 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 04:00:18.893715 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580919 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 04:00:18.893715 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580922 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 04:00:18.893715 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580925 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 04:00:18.893715 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580928 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 04:00:18.893715 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580931 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 04:00:18.893715 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580934 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 04:00:18.893715 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580937 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 04:00:18.893715 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580940 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 04:00:18.893715 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580942 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 04:00:18.893715 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580946 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 04:00:18.893715 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580949 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 04:00:18.894367 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580958 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 04:00:18.894367 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580961 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 04:00:18.894367 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580963 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 04:00:18.894367 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580966 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 04:00:18.894367 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580968 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 04:00:18.894367 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580971 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 04:00:18.894367 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580974 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 04:00:18.894367 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580976 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 04:00:18.894367 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580979 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 04:00:18.894367 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580981 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 04:00:18.894367 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580984 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 04:00:18.894367 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580986 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 04:00:18.894367 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580989 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 04:00:18.894367 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580993 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 04:00:18.894367 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580996 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 04:00:18.894367 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.580998 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 04:00:18.894367 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581001 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 04:00:18.894367 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581003 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 04:00:18.894367 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581006 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 04:00:18.894994 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581009 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 04:00:18.894994 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581011 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 04:00:18.894994 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581014 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 04:00:18.894994 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581016 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 04:00:18.894994 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581019 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 04:00:18.894994 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581021 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 04:00:18.894994 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581024 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 04:00:18.894994 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581026 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 04:00:18.894994 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581029 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 04:00:18.894994 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581033 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 04:00:18.894994 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581036 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 04:00:18.894994 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581041 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 04:00:18.894994 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581043 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 04:00:18.894994 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581046 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 04:00:18.894994 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581049 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 04:00:18.894994 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581052 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 04:00:18.894994 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581054 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 04:00:18.894994 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581058 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 04:00:18.894994 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581061 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 04:00:18.895817 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581064 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 04:00:18.895817 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581067 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 04:00:18.895817 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581070 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 04:00:18.895817 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581073 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 04:00:18.895817 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581075 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 04:00:18.895817 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581078 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 04:00:18.895817 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581081 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 04:00:18.895817 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581085 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 04:00:18.895817 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581087 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 04:00:18.895817 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.581090 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 04:00:18.895817 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.581096 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 04:00:18.895817 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.588116 2563 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 24 04:00:18.895817 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.588142 2563 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 24 04:00:18.895817 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.588164 2563 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 24 04:00:18.895817 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.588170 2563 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 24 04:00:18.896429 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588229 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 04:00:18.896429 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588235 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 04:00:18.896429 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588238 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 04:00:18.896429 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588241 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 04:00:18.896429 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588244 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 04:00:18.896429 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588246 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 04:00:18.896429 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588249 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 04:00:18.896429 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588252 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 04:00:18.896429 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588255 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 04:00:18.896429 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588257 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 04:00:18.896429 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588261 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 04:00:18.896429 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588266 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 04:00:18.896429 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588268 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 04:00:18.896429 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588273 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 04:00:18.896429 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588277 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 04:00:18.896429 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588280 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 04:00:18.896429 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588283 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 04:00:18.896429 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588286 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 04:00:18.896429 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588289 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 04:00:18.897056 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588292 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 04:00:18.897056 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588296 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 04:00:18.897056 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588299 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 04:00:18.897056 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588302 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 04:00:18.897056 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588305 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 04:00:18.897056 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588308 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 04:00:18.897056 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588311 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 04:00:18.897056 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588313 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 04:00:18.897056 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588316 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 04:00:18.897056 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588319 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 04:00:18.897056 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588322 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 04:00:18.897056 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588325 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 04:00:18.897056 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588328 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 04:00:18.897056 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588330 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 04:00:18.897056 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588333 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 04:00:18.897056 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588335 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 04:00:18.897056 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588338 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 04:00:18.897056 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588341 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 04:00:18.897056 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588344 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 04:00:18.897056 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588347 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 04:00:18.897678 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588349 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 04:00:18.897678 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588352 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 04:00:18.897678 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588355 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 04:00:18.897678 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588357 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 04:00:18.897678 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588360 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 04:00:18.897678 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588363 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 04:00:18.897678 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588366 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 04:00:18.897678 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588368 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 04:00:18.897678 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588371 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 04:00:18.897678 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588374 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 04:00:18.897678 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588376 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 04:00:18.897678 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588379 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 04:00:18.897678 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588382 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 04:00:18.897678 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588385 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 04:00:18.897678 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588388 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 04:00:18.897678 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588391 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 04:00:18.897678 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588393 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 04:00:18.897678 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588396 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 04:00:18.897678 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588398 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 04:00:18.898291 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588401 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 04:00:18.898291 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588403 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 04:00:18.898291 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588406 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 04:00:18.898291 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588408 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 04:00:18.898291 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588415 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 04:00:18.898291 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588418 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 04:00:18.898291 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588421 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 04:00:18.898291 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588423 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 04:00:18.898291 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588426 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 04:00:18.898291 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588428 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 04:00:18.898291 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588431 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 04:00:18.898291 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588434 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 04:00:18.898291 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588436 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 04:00:18.898291 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588439 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 04:00:18.898291 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588442 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 04:00:18.898291 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588444 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 04:00:18.898291 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588449 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 04:00:18.898291 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588451 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 04:00:18.898291 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588454 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 04:00:18.898291 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588457 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 04:00:18.898917 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588459 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 04:00:18.898917 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588462 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 04:00:18.898917 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588465 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 04:00:18.898917 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588468 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 04:00:18.898917 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588489 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 04:00:18.898917 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588492 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 04:00:18.898917 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588495 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 04:00:18.898917 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588498 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 24 04:00:18.898917 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588501 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 04:00:18.898917 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588503 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 04:00:18.898917 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588506 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 04:00:18.898917 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588509 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 04:00:18.898917 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588511 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 04:00:18.898917 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588514 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 04:00:18.898917 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588516 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 04:00:18.898917 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588519 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 04:00:18.898917 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588525 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 04:00:18.898917 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588529 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 04:00:18.898917 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588532 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 04:00:18.898917 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588535 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 04:00:18.899505 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588537 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 04:00:18.899505 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.588543 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 04:00:18.899505 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588693 2563 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 24 04:00:18.899505 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588699 2563 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 24 04:00:18.899505 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588702 2563 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 24 04:00:18.899505 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588705 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 24 04:00:18.899505 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588708 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 24 04:00:18.899505 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588712 2563 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 24 04:00:18.899505 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588717 2563 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 24 04:00:18.899505 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588722 2563 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 24 04:00:18.899505 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588725 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 24 04:00:18.899505 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588728 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 24 04:00:18.899505 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588730 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 24 04:00:18.899505 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588734 2563 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 24 04:00:18.899505 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588736 2563 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 24 04:00:18.899969 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588739 2563 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 24 04:00:18.899969 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588742 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 24 04:00:18.899969 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588745 2563 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 24 04:00:18.899969 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588747 2563 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 24 04:00:18.899969 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588750 2563 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 24 04:00:18.899969 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588752 2563 feature_gate.go:328] unrecognized feature gate: Example2 Jul 24 04:00:18.899969 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588755 2563 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 24 04:00:18.899969 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588758 2563 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 24 04:00:18.899969 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588760 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 24 04:00:18.899969 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588763 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 24 04:00:18.899969 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588765 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 24 04:00:18.899969 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588768 2563 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 24 04:00:18.899969 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588771 2563 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 24 04:00:18.899969 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588774 2563 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 24 04:00:18.899969 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588777 2563 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 24 04:00:18.899969 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588780 2563 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 24 04:00:18.899969 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588783 2563 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 24 04:00:18.899969 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588786 2563 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 24 04:00:18.899969 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588789 2563 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 24 04:00:18.900481 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588792 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 24 04:00:18.900481 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588794 2563 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 24 04:00:18.900481 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588797 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 24 04:00:18.900481 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588799 2563 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 24 04:00:18.900481 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588802 2563 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 24 04:00:18.900481 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588804 2563 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 24 04:00:18.900481 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588807 2563 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 24 04:00:18.900481 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588811 2563 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 24 04:00:18.900481 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588814 2563 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 24 04:00:18.900481 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588817 2563 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 24 04:00:18.900481 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588820 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 24 04:00:18.900481 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588822 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 24 04:00:18.900481 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588825 2563 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 24 04:00:18.900481 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588828 2563 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 24 04:00:18.900481 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588831 2563 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 24 04:00:18.900481 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588833 2563 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 24 04:00:18.900481 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588836 2563 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 24 04:00:18.900481 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588840 2563 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 24 04:00:18.900481 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588843 2563 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 24 04:00:18.900481 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588847 2563 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 24 04:00:18.901109 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588849 2563 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 24 04:00:18.901109 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588852 2563 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 24 04:00:18.901109 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588855 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 24 04:00:18.901109 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588858 2563 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 24 04:00:18.901109 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588860 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 24 04:00:18.901109 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588863 2563 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 24 04:00:18.901109 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588867 2563 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 24 04:00:18.901109 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588869 2563 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 24 04:00:18.901109 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588872 2563 feature_gate.go:328] unrecognized feature gate: Example Jul 24 04:00:18.901109 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588875 2563 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 24 04:00:18.901109 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588878 2563 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 24 04:00:18.901109 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588880 2563 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 24 04:00:18.901109 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588883 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 24 04:00:18.901109 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588885 2563 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 24 04:00:18.901109 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588888 2563 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 24 04:00:18.901109 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588891 2563 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 24 04:00:18.901109 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588893 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 24 04:00:18.901109 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588897 2563 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 24 04:00:18.901109 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588900 2563 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 24 04:00:19.043040 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588904 2563 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 24 04:00:19.043040 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588907 2563 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 24 04:00:19.043040 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588910 2563 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 24 04:00:19.043040 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588913 2563 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 24 04:00:19.043040 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588915 2563 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 24 04:00:19.043040 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588918 2563 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 24 04:00:19.043040 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588921 2563 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 24 04:00:19.043040 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588923 2563 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 24 04:00:19.043040 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588926 2563 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 24 04:00:19.043040 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588928 2563 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 24 04:00:19.043040 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588931 2563 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 24 04:00:19.043040 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588933 2563 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 24 04:00:19.043040 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588936 2563 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 24 04:00:19.043040 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588938 2563 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 24 04:00:19.043040 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588941 2563 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 24 04:00:19.043040 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588943 2563 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 24 04:00:19.043040 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588946 2563 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 24 04:00:19.043040 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588948 2563 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 24 04:00:19.043040 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588951 2563 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 24 04:00:19.043040 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588955 2563 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 24 04:00:19.043870 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588958 2563 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 24 04:00:19.043870 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588960 2563 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 24 04:00:19.043870 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588963 2563 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 24 04:00:19.043870 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588966 2563 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 24 04:00:19.043870 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588969 2563 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 24 04:00:19.043870 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588971 2563 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 24 04:00:19.043870 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588974 2563 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 24 04:00:19.043870 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:18.588976 2563 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 24 04:00:19.043870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.588981 2563 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 24 04:00:19.043870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.589119 2563 server.go:962] "Client rotation is on, will bootstrap in background" Jul 24 04:00:19.043870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.591336 2563 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 24 04:00:19.043870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.592685 2563 server.go:1019] "Starting client certificate rotation" Jul 24 04:00:19.043870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.592788 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 04:00:19.047255 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.592862 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 24 04:00:19.047255 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.595828 2563 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 04:00:19.047255 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.601289 2563 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 24 04:00:19.047255 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.610506 2563 log.go:25] "Validated CRI v1 runtime API" Jul 24 04:00:19.047255 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.612737 2563 log.go:25] "Validated CRI v1 image API" Jul 24 04:00:19.047255 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.614044 2563 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 24 04:00:19.047255 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.616590 2563 fs.go:135] Filesystem UUIDs: map[386de3db-3930-4973-b34f-a8832b2d9d0a:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c997ed30-3f06-4199-b4e3-d6ccd3209bfb:/dev/nvme0n1p4] Jul 24 04:00:19.047255 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.616612 2563 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 24 04:00:19.047255 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.621498 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 04:00:19.047684 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.621739 2563 manager.go:216] Machine: {Timestamp:2026-07-24 04:00:18.620295046 +0000 UTC m=+0.366668619 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099982 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2c731c65af8fbb4f369e1a932da745 SystemUUID:ec2c731c-65af-8fbb-4f36-9e1a932da745 BootID:4b1b914f-a226-4b02-9457-76a221a53db5 Filesystems:[{Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8a:f9:7a:e4:53 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8a:f9:7a:e4:53 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:02:6b:9d:a3:74:e3 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 24 04:00:19.047684 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.621852 2563 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 24 04:00:19.047684 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.621942 2563 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 24 04:00:19.047684 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.624844 2563 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 24 04:00:19.047684 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.624870 2563 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-155.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 24 04:00:19.047684 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.626141 2563 topology_manager.go:138] "Creating topology manager with none policy" Jul 24 04:00:19.047684 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.626152 2563 container_manager_linux.go:309] "Creating device plugin manager" Jul 24 04:00:19.047684 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.626160 2563 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 04:00:19.047684 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.626857 2563 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 24 04:00:19.047684 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.627634 2563 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 24 04:00:19.047684 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.629907 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 24 04:00:19.047684 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.630041 2563 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 24 04:00:19.047684 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.630072 2563 kubelet.go:486] "Attempting to sync node with API server" Jul 24 04:00:19.047684 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.630082 2563 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 24 04:00:19.047684 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.630095 2563 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 24 04:00:19.047684 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.630105 2563 kubelet.go:398] "Adding apiserver pod source" Jul 24 04:00:19.047684 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.630118 2563 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 24 04:00:19.047684 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.630592 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.630607 2563 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.633382 2563 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.635626 2563 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.635654 2563 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.637378 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.637398 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.637404 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.637409 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.637418 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.637423 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.637432 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.637439 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.637449 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.637458 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.637481 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.637493 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.638344 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.638356 2563 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.639673 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tqgjf" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:18.640177 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:18.640300 2563 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-155.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.642011 2563 server.go:1268] "Started kubelet" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.642093 2563 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.642107 2563 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.646118 2563 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.647886 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-tqgjf" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.649007 2563 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.652183 2563 server.go:310] "Adding debug handlers to kubelet server" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:18.652438 2563 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.654129 2563 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-155.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:18.654153 2563 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-155.ec2.internal.18c51dd2d2f68da9 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-155.ec2.internal,UID:ip-10-0-138-155.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-155.ec2.internal,},FirstTimestamp:2026-07-24 04:00:18.641980841 +0000 UTC m=+0.388354416,LastTimestamp:2026-07-24 04:00:18.641980841 +0000 UTC m=+0.388354416,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-155.ec2.internal,}" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.656190 2563 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.656199 2563 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:18.656296 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-155.ec2.internal\" not found" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.657101 2563 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.657121 2563 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.657103 2563 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.657262 2563 reconstruct.go:97] "Volume reconstruction finished" Jul 24 04:00:19.048380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.657272 2563 reconciler.go:29] "Reconciler: start to sync state" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.659494 2563 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.659505 2563 factory.go:55] Registering systemd factory Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.659511 2563 factory.go:223] Registration of the systemd container factory successfully Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.660913 2563 factory.go:153] Registering CRI-O factory Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.660927 2563 factory.go:223] Registration of the crio container factory successfully Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.660952 2563 factory.go:103] Registering Raw factory Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.660965 2563 manager.go:1196] Started watching for new ooms in manager Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.661511 2563 manager.go:349] Starting recovery of all containers Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.664919 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.664910 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:18.667166 2563 nodelease.go:49] "Failed to get node when trying to set owner ref to the node lease" err="nodes \"ip-10-0-138-155.ec2.internal\" not found" node="ip-10-0-138-155.ec2.internal" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.669258 2563 manager.go:354] Recovery completed Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.673787 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.675886 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-155.ec2.internal" event="NodeHasSufficientMemory" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.675934 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.675944 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-155.ec2.internal" event="NodeHasSufficientPID" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.677879 2563 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.677888 2563 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.677914 2563 state_mem.go:36] "Initialized new in-memory state store" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.677923 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.678696 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-155.ec2.internal" event="NodeHasSufficientMemory" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.678718 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.678729 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-155.ec2.internal" event="NodeHasSufficientPID" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.679727 2563 policy_none.go:49] "None policy: Start" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.679744 2563 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.679758 2563 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.680859 2563 policy_none.go:47] "Start" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.721128 2563 manager.go:337] "Starting Device Plugin manager" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:18.721163 2563 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.721173 2563 server.go:87] "Starting device plugin registration server" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.721542 2563 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.721558 2563 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.721647 2563 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.721729 2563 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.721738 2563 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:18.722215 2563 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:18.722266 2563 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-155.ec2.internal\" not found" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.822245 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.823241 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-155.ec2.internal" event="NodeHasSufficientMemory" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.823273 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.823284 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-155.ec2.internal" event="NodeHasSufficientPID" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.823312 2563 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-155.ec2.internal" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.828740 2563 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-155.ec2.internal" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:18.828761 2563 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-155.ec2.internal\": node \"ip-10-0-138-155.ec2.internal\" not found" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:18.841775 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-155.ec2.internal\" not found" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.936297 2563 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.936468 2563 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.936512 2563 kubelet.go:2448] "Starting kubelet main sync loop" Jul 24 04:00:19.049599 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:18.936552 2563 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 24 04:00:19.051082 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:18.938417 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 04:00:19.051082 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:18.942451 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-155.ec2.internal\" not found" Jul 24 04:00:19.051082 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.036940 2563 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-155.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-155.ec2.internal"] Jul 24 04:00:19.051082 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.037017 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 04:00:19.051082 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.040640 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-155.ec2.internal" event="NodeHasSufficientMemory" Jul 24 04:00:19.051082 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.040668 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 04:00:19.051082 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.040679 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-155.ec2.internal" event="NodeHasSufficientPID" Jul 24 04:00:19.051082 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.041848 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 04:00:19.051082 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.041988 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-155.ec2.internal" Jul 24 04:00:19.051082 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.042024 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 04:00:19.051082 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:19.042499 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-155.ec2.internal\" not found" Jul 24 04:00:19.051082 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.042660 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-155.ec2.internal" event="NodeHasSufficientMemory" Jul 24 04:00:19.051082 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.042686 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 04:00:19.051082 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.042662 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-155.ec2.internal" event="NodeHasSufficientMemory" Jul 24 04:00:19.051082 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.042695 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-155.ec2.internal" event="NodeHasSufficientPID" Jul 24 04:00:19.051082 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.042709 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 04:00:19.051082 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.042755 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-155.ec2.internal" event="NodeHasSufficientPID" Jul 24 04:00:19.051082 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.044042 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-155.ec2.internal" Jul 24 04:00:19.051082 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.044072 2563 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 24 04:00:19.051082 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.044925 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-155.ec2.internal" event="NodeHasSufficientMemory" Jul 24 04:00:19.051082 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.044956 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-155.ec2.internal" event="NodeHasNoDiskPressure" Jul 24 04:00:19.051082 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.044970 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-155.ec2.internal" event="NodeHasSufficientPID" Jul 24 04:00:19.174037 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.059503 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59d92ebdc5bf904b7abced8e297b1794-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-155.ec2.internal\" (UID: \"59d92ebdc5bf904b7abced8e297b1794\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-155.ec2.internal" Jul 24 04:00:19.174037 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.059527 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/68b5c35a661317b944b4a5969fbb303c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-155.ec2.internal\" (UID: \"68b5c35a661317b944b4a5969fbb303c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-155.ec2.internal" Jul 24 04:00:19.174037 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.059545 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59d92ebdc5bf904b7abced8e297b1794-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-155.ec2.internal\" (UID: \"59d92ebdc5bf904b7abced8e297b1794\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-155.ec2.internal" Jul 24 04:00:19.174037 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:19.077314 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-155.ec2.internal\" not found" node="ip-10-0-138-155.ec2.internal" Jul 24 04:00:19.174037 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:19.082113 2563 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-155.ec2.internal\" not found" node="ip-10-0-138-155.ec2.internal" Jul 24 04:00:19.174037 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:19.143588 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-155.ec2.internal\" not found" Jul 24 04:00:19.174037 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.159985 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59d92ebdc5bf904b7abced8e297b1794-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-155.ec2.internal\" (UID: \"59d92ebdc5bf904b7abced8e297b1794\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-155.ec2.internal" Jul 24 04:00:19.174037 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.160011 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59d92ebdc5bf904b7abced8e297b1794-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-155.ec2.internal\" (UID: \"59d92ebdc5bf904b7abced8e297b1794\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-155.ec2.internal" Jul 24 04:00:19.174037 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.160027 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/68b5c35a661317b944b4a5969fbb303c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-155.ec2.internal\" (UID: \"68b5c35a661317b944b4a5969fbb303c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-155.ec2.internal" Jul 24 04:00:19.174037 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.160072 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/68b5c35a661317b944b4a5969fbb303c-config\") pod \"kube-apiserver-proxy-ip-10-0-138-155.ec2.internal\" (UID: \"68b5c35a661317b944b4a5969fbb303c\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-155.ec2.internal" Jul 24 04:00:19.174037 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.160090 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/59d92ebdc5bf904b7abced8e297b1794-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-155.ec2.internal\" (UID: \"59d92ebdc5bf904b7abced8e297b1794\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-155.ec2.internal" Jul 24 04:00:19.174037 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.160116 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/59d92ebdc5bf904b7abced8e297b1794-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-155.ec2.internal\" (UID: \"59d92ebdc5bf904b7abced8e297b1794\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-155.ec2.internal" Jul 24 04:00:19.324627 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:19.244156 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-155.ec2.internal\" not found" Jul 24 04:00:19.468188 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:19.347569 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-155.ec2.internal\" not found" Jul 24 04:00:19.468188 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.381080 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-155.ec2.internal" Jul 24 04:00:19.468188 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.385353 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-155.ec2.internal" Jul 24 04:00:19.468188 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:19.448545 2563 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-155.ec2.internal\" not found" Jul 24 04:00:19.475088 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.471836 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 04:00:19.631536 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.515427 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 04:00:19.631536 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.556941 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-155.ec2.internal" Jul 24 04:00:19.631536 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.567665 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 04:00:19.631536 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.568920 2563 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-155.ec2.internal" Jul 24 04:00:19.631536 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.574532 2563 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 24 04:00:19.631536 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.593062 2563 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 24 04:00:19.631536 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.593241 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 04:00:19.631536 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.593262 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 04:00:19.631536 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.593268 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 04:00:19.631536 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.593314 2563 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 24 04:00:19.632704 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.632322 2563 apiserver.go:52] "Watching apiserver" Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.649781 2563 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.650817 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ovn-kubernetes/ovnkube-node-gl4b9","kube-system/kube-apiserver-proxy-ip-10-0-138-155.ec2.internal","openshift-cluster-node-tuning-operator/tuned-8vdhv","openshift-dns/node-resolver-lbhzg","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-155.ec2.internal","openshift-multus/multus-bxt4g","openshift-network-diagnostics/network-check-target-5sckg","kube-system/global-pull-secret-syncer-7v47c","kube-system/konnectivity-agent-8d6fk","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb","openshift-image-registry/node-ca-xh2m8","openshift-multus/multus-additional-cni-plugins-ccdmw","openshift-multus/network-metrics-daemon-l9w8m","openshift-network-operator/iptables-alerter-mtg67"] Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.652249 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:19.652337 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.653435 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xh2m8" Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.654840 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-23 03:55:19 +0000 UTC" deadline="2028-04-06 13:59:54.556884168 +0000 UTC" Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.654866 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14937h59m34.902024065s" Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.655383 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.661251 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.661332 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-bmtrd\"" Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.661925 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.662116 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.662521 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.662569 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.662604 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9lwdt\"" Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.662641 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lbhzg" Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.662972 2563 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.663399 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ccq2h\" (UniqueName: \"kubernetes.io/projected/b17287b6-146d-437d-9990-c1a8969178d7-kube-api-access-ccq2h\") pod \"iptables-alerter-mtg67\" (UID: \"b17287b6-146d-437d-9990-c1a8969178d7\") " pod="openshift-network-operator/iptables-alerter-mtg67" Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.663431 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-sys\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.663465 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-lib-modules\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.663497 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-host\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.663527 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e354fb6a-d916-4ba7-bbea-05d240a23dbb-etc-tuned\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.776924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.663587 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/97f262a1-d4fd-4990-9e85-86dd2530dbb3-hosts-file\") pod \"node-resolver-lbhzg\" (UID: \"97f262a1-d4fd-4990-9e85-86dd2530dbb3\") " pod="openshift-dns/node-resolver-lbhzg" Jul 24 04:00:19.777949 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.663772 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b17287b6-146d-437d-9990-c1a8969178d7-host-slash\") pod \"iptables-alerter-mtg67\" (UID: \"b17287b6-146d-437d-9990-c1a8969178d7\") " pod="openshift-network-operator/iptables-alerter-mtg67" Jul 24 04:00:19.777949 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.663811 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6ks57\" (UniqueName: \"kubernetes.io/projected/5696a323-4908-4da2-9496-8112032a1012-kube-api-access-6ks57\") pod \"node-ca-xh2m8\" (UID: \"5696a323-4908-4da2-9496-8112032a1012\") " pod="openshift-image-registry/node-ca-xh2m8" Jul 24 04:00:19.777949 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.663847 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-etc-modprobe-d\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.777949 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.663874 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-etc-kubernetes\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.777949 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.663905 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-run\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.777949 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.663940 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-var-lib-kubelet\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.777949 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.663980 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97f262a1-d4fd-4990-9e85-86dd2530dbb3-tmp-dir\") pod \"node-resolver-lbhzg\" (UID: \"97f262a1-d4fd-4990-9e85-86dd2530dbb3\") " pod="openshift-dns/node-resolver-lbhzg" Jul 24 04:00:19.777949 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.664018 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5696a323-4908-4da2-9496-8112032a1012-serviceca\") pod \"node-ca-xh2m8\" (UID: \"5696a323-4908-4da2-9496-8112032a1012\") " pod="openshift-image-registry/node-ca-xh2m8" Jul 24 04:00:19.777949 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.664101 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mtg67" Jul 24 04:00:19.777949 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.664141 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e354fb6a-d916-4ba7-bbea-05d240a23dbb-tmp\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.777949 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.664202 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nbwqr\" (UniqueName: \"kubernetes.io/projected/97f262a1-d4fd-4990-9e85-86dd2530dbb3-kube-api-access-nbwqr\") pod \"node-resolver-lbhzg\" (UID: \"97f262a1-d4fd-4990-9e85-86dd2530dbb3\") " pod="openshift-dns/node-resolver-lbhzg" Jul 24 04:00:19.777949 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.664310 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b17287b6-146d-437d-9990-c1a8969178d7-iptables-alerter-script\") pod \"iptables-alerter-mtg67\" (UID: \"b17287b6-146d-437d-9990-c1a8969178d7\") " pod="openshift-network-operator/iptables-alerter-mtg67" Jul 24 04:00:19.777949 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.664371 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mkqn\" (UniqueName: \"kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn\") pod \"network-check-target-5sckg\" (UID: \"b37181f3-c3b8-478d-825d-6c9582911304\") " pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:19.777949 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.664421 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5696a323-4908-4da2-9496-8112032a1012-host\") pod \"node-ca-xh2m8\" (UID: \"5696a323-4908-4da2-9496-8112032a1012\") " pod="openshift-image-registry/node-ca-xh2m8" Jul 24 04:00:19.777949 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.664464 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-etc-sysconfig\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.777949 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.664529 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-etc-sysctl-d\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.777949 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.664567 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-etc-sysctl-conf\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.664619 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-etc-systemd\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.664685 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4spwm\" (UniqueName: \"kubernetes.io/projected/e354fb6a-d916-4ba7-bbea-05d240a23dbb-kube-api-access-4spwm\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.665463 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.665752 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-wnbbs\"" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.665896 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.665990 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.666434 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-h4hf7\"" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.666456 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.666730 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.666767 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.666796 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8d6fk" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.667634 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.667639 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.667669 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.668165 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-w9nkz\"" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.668173 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.668217 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:19.668240 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.669129 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-zqfm4\"" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.669150 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.669418 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:19.669503 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.669569 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.671860 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.673308 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.673788 2563 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.673941 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-95vw8\"" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.674669 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.675243 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.675244 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.675443 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 24 04:00:19.778513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.675932 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.675969 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.675987 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.675969 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-ggnv8\"" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.678381 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.678568 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.678598 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.679226 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-6l4kl\"" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.679457 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.679894 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.700721 2563 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-78nzj" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.709343 2563 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-78nzj" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.758207 2563 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765093 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-etc-kubernetes\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765124 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-hostroot\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765144 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-etc-kubernetes\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765161 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/705d69cd-a48a-4d8d-9f5a-a5c088697878-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ctbfb\" (UID: \"705d69cd-a48a-4d8d-9f5a-a5c088697878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765200 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-node-log\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765225 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-host-run-ovn-kubernetes\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765237 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-etc-kubernetes\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765257 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cf4b914a-d9a8-4d59-a86a-1912f05699e3-ovnkube-script-lib\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765277 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qb9gl\" (UniqueName: \"kubernetes.io/projected/cf4b914a-d9a8-4d59-a86a-1912f05699e3-kube-api-access-qb9gl\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765307 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-cnibin\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765348 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22f4cfa7-8834-4275-8d7f-a979f6912d7c-cni-binary-copy\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.782024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765391 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/38538035-14dc-4f67-9a68-3b265171eedb-agent-certs\") pod \"konnectivity-agent-8d6fk\" (UID: \"38538035-14dc-4f67-9a68-3b265171eedb\") " pod="kube-system/konnectivity-agent-8d6fk" Jul 24 04:00:19.783105 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765418 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-etc-sysconfig\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.783105 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765447 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5880389d-2038-4693-b674-5f81ec273823-cni-binary-copy\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.783105 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765472 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrpd4\" (UniqueName: \"kubernetes.io/projected/5880389d-2038-4693-b674-5f81ec273823-kube-api-access-lrpd4\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.783105 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765513 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmnbt\" (UniqueName: \"kubernetes.io/projected/705d69cd-a48a-4d8d-9f5a-a5c088697878-kube-api-access-fmnbt\") pod \"aws-ebs-csi-driver-node-ctbfb\" (UID: \"705d69cd-a48a-4d8d-9f5a-a5c088697878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:19.783105 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765513 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-etc-sysconfig\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.783105 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765528 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cf4b914a-d9a8-4d59-a86a-1912f05699e3-env-overrides\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.783105 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765544 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cf4b914a-d9a8-4d59-a86a-1912f05699e3-ovn-node-metrics-cert\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.783105 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765565 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-system-cni-dir\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.783105 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765599 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-etc-modprobe-d\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.783105 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765623 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-var-lib-kubelet\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.783105 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765642 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5880389d-2038-4693-b674-5f81ec273823-system-cni-dir\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.783105 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-os-release\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.783105 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765687 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-var-lib-kubelet\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.783105 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765700 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-host-var-lib-cni-bin\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.783105 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765722 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e354fb6a-d916-4ba7-bbea-05d240a23dbb-tmp\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.783105 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765740 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nbwqr\" (UniqueName: \"kubernetes.io/projected/97f262a1-d4fd-4990-9e85-86dd2530dbb3-kube-api-access-nbwqr\") pod \"node-resolver-lbhzg\" (UID: \"97f262a1-d4fd-4990-9e85-86dd2530dbb3\") " pod="openshift-dns/node-resolver-lbhzg" Jul 24 04:00:19.783105 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765761 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mkqn\" (UniqueName: \"kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn\") pod \"network-check-target-5sckg\" (UID: \"b37181f3-c3b8-478d-825d-6c9582911304\") " pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:19.783797 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765769 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-etc-modprobe-d\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.783797 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765780 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5696a323-4908-4da2-9496-8112032a1012-host\") pod \"node-ca-xh2m8\" (UID: \"5696a323-4908-4da2-9496-8112032a1012\") " pod="openshift-image-registry/node-ca-xh2m8" Jul 24 04:00:19.783797 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765809 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e98f98aa-332c-44a4-912f-985762f6a84f-kubelet-config\") pod \"global-pull-secret-syncer-7v47c\" (UID: \"e98f98aa-332c-44a4-912f-985762f6a84f\") " pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:19.783797 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765845 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret\") pod \"global-pull-secret-syncer-7v47c\" (UID: \"e98f98aa-332c-44a4-912f-985762f6a84f\") " pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:19.783797 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765869 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-host-var-lib-cni-multus\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.783797 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765896 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4spwm\" (UniqueName: \"kubernetes.io/projected/e354fb6a-d916-4ba7-bbea-05d240a23dbb-kube-api-access-4spwm\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.783797 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765921 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ccq2h\" (UniqueName: \"kubernetes.io/projected/b17287b6-146d-437d-9990-c1a8969178d7-kube-api-access-ccq2h\") pod \"iptables-alerter-mtg67\" (UID: \"b17287b6-146d-437d-9990-c1a8969178d7\") " pod="openshift-network-operator/iptables-alerter-mtg67" Jul 24 04:00:19.783797 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765953 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5696a323-4908-4da2-9496-8112032a1012-host\") pod \"node-ca-xh2m8\" (UID: \"5696a323-4908-4da2-9496-8112032a1012\") " pod="openshift-image-registry/node-ca-xh2m8" Jul 24 04:00:19.783797 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.765986 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5880389d-2038-4693-b674-5f81ec273823-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.783797 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766009 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5880389d-2038-4693-b674-5f81ec273823-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.783797 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766109 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e98f98aa-332c-44a4-912f-985762f6a84f-dbus\") pod \"global-pull-secret-syncer-7v47c\" (UID: \"e98f98aa-332c-44a4-912f-985762f6a84f\") " pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:19.783797 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766133 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/705d69cd-a48a-4d8d-9f5a-a5c088697878-etc-selinux\") pod \"aws-ebs-csi-driver-node-ctbfb\" (UID: \"705d69cd-a48a-4d8d-9f5a-a5c088697878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:19.783797 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766155 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-host-cni-netd\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.783797 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766182 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/22f4cfa7-8834-4275-8d7f-a979f6912d7c-multus-daemon-config\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.783797 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766223 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b17287b6-146d-437d-9990-c1a8969178d7-host-slash\") pod \"iptables-alerter-mtg67\" (UID: \"b17287b6-146d-437d-9990-c1a8969178d7\") " pod="openshift-network-operator/iptables-alerter-mtg67" Jul 24 04:00:19.783797 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766247 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/705d69cd-a48a-4d8d-9f5a-a5c088697878-registration-dir\") pod \"aws-ebs-csi-driver-node-ctbfb\" (UID: \"705d69cd-a48a-4d8d-9f5a-a5c088697878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:19.784401 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766271 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/b17287b6-146d-437d-9990-c1a8969178d7-host-slash\") pod \"iptables-alerter-mtg67\" (UID: \"b17287b6-146d-437d-9990-c1a8969178d7\") " pod="openshift-network-operator/iptables-alerter-mtg67" Jul 24 04:00:19.784401 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766299 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/705d69cd-a48a-4d8d-9f5a-a5c088697878-device-dir\") pod \"aws-ebs-csi-driver-node-ctbfb\" (UID: \"705d69cd-a48a-4d8d-9f5a-a5c088697878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:19.784401 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766315 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-run-ovn\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.784401 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766332 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-run\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.784401 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766358 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97f262a1-d4fd-4990-9e85-86dd2530dbb3-tmp-dir\") pod \"node-resolver-lbhzg\" (UID: \"97f262a1-d4fd-4990-9e85-86dd2530dbb3\") " pod="openshift-dns/node-resolver-lbhzg" Jul 24 04:00:19.784401 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766401 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-host-run-netns\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.784401 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766455 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-run\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.784401 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766457 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-run-systemd\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.784401 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766503 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.784401 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766520 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cf4b914a-d9a8-4d59-a86a-1912f05699e3-ovnkube-config\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.784401 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766541 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-multus-socket-dir-parent\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.784401 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766572 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-host-run-netns\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.784401 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766601 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b17287b6-146d-437d-9990-c1a8969178d7-iptables-alerter-script\") pod \"iptables-alerter-mtg67\" (UID: \"b17287b6-146d-437d-9990-c1a8969178d7\") " pod="openshift-network-operator/iptables-alerter-mtg67" Jul 24 04:00:19.784401 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766633 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-systemd-units\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.784401 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766655 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-host-var-lib-kubelet\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.784401 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766677 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-multus-conf-dir\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.784401 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766694 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/38538035-14dc-4f67-9a68-3b265171eedb-konnectivity-ca\") pod \"konnectivity-agent-8d6fk\" (UID: \"38538035-14dc-4f67-9a68-3b265171eedb\") " pod="kube-system/konnectivity-agent-8d6fk" Jul 24 04:00:19.785046 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766719 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-etc-systemd\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.785046 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766735 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5880389d-2038-4693-b674-5f81ec273823-os-release\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.785046 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766753 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-host-run-k8s-cni-cncf-io\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.785046 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766777 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q62s6\" (UniqueName: \"kubernetes.io/projected/22f4cfa7-8834-4275-8d7f-a979f6912d7c-kube-api-access-q62s6\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.785046 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766792 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-etc-systemd\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.785046 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766797 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-host\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.785046 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766818 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e354fb6a-d916-4ba7-bbea-05d240a23dbb-etc-tuned\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.785046 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766856 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-host\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.785046 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766878 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/97f262a1-d4fd-4990-9e85-86dd2530dbb3-hosts-file\") pod \"node-resolver-lbhzg\" (UID: \"97f262a1-d4fd-4990-9e85-86dd2530dbb3\") " pod="openshift-dns/node-resolver-lbhzg" Jul 24 04:00:19.785046 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766896 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6ks57\" (UniqueName: \"kubernetes.io/projected/5696a323-4908-4da2-9496-8112032a1012-kube-api-access-6ks57\") pod \"node-ca-xh2m8\" (UID: \"5696a323-4908-4da2-9496-8112032a1012\") " pod="openshift-image-registry/node-ca-xh2m8" Jul 24 04:00:19.785046 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766934 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5880389d-2038-4693-b674-5f81ec273823-cnibin\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.785046 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766953 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-run-openvswitch\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.785046 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766953 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/97f262a1-d4fd-4990-9e85-86dd2530dbb3-hosts-file\") pod \"node-resolver-lbhzg\" (UID: \"97f262a1-d4fd-4990-9e85-86dd2530dbb3\") " pod="openshift-dns/node-resolver-lbhzg" Jul 24 04:00:19.785046 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.766980 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs\") pod \"network-metrics-daemon-l9w8m\" (UID: \"c7fb9480-376d-487f-bfdf-386603ce759c\") " pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:19.785046 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767016 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5696a323-4908-4da2-9496-8112032a1012-serviceca\") pod \"node-ca-xh2m8\" (UID: \"5696a323-4908-4da2-9496-8112032a1012\") " pod="openshift-image-registry/node-ca-xh2m8" Jul 24 04:00:19.785046 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767078 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-multus-cni-dir\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.785046 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767107 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6wpnq\" (UniqueName: \"kubernetes.io/projected/c7fb9480-376d-487f-bfdf-386603ce759c-kube-api-access-6wpnq\") pod \"network-metrics-daemon-l9w8m\" (UID: \"c7fb9480-376d-487f-bfdf-386603ce759c\") " pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:19.785610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767130 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/705d69cd-a48a-4d8d-9f5a-a5c088697878-socket-dir\") pod \"aws-ebs-csi-driver-node-ctbfb\" (UID: \"705d69cd-a48a-4d8d-9f5a-a5c088697878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:19.785610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767154 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-host-slash\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.785610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767187 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-var-lib-openvswitch\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.785610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767205 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-log-socket\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.785610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767220 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-host-cni-bin\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.785610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767250 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-etc-sysctl-d\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.785610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767277 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-etc-sysctl-conf\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.785610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767294 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/705d69cd-a48a-4d8d-9f5a-a5c088697878-sys-fs\") pod \"aws-ebs-csi-driver-node-ctbfb\" (UID: \"705d69cd-a48a-4d8d-9f5a-a5c088697878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:19.785610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767313 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-host-run-multus-certs\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.785610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767336 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-sys\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.785610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767374 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-lib-modules\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.785610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767408 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5880389d-2038-4693-b674-5f81ec273823-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.785610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767424 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-etc-sysctl-d\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.785610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767462 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-sys\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.785610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767510 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-host-kubelet\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.785610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767536 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-etc-openvswitch\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.785610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767546 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-lib-modules\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.786302 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767574 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/e354fb6a-d916-4ba7-bbea-05d240a23dbb-etc-sysctl-conf\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.786302 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767588 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97f262a1-d4fd-4990-9e85-86dd2530dbb3-tmp-dir\") pod \"node-resolver-lbhzg\" (UID: \"97f262a1-d4fd-4990-9e85-86dd2530dbb3\") " pod="openshift-dns/node-resolver-lbhzg" Jul 24 04:00:19.786302 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.767859 2563 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 24 04:00:19.786302 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.768223 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5696a323-4908-4da2-9496-8112032a1012-serviceca\") pod \"node-ca-xh2m8\" (UID: \"5696a323-4908-4da2-9496-8112032a1012\") " pod="openshift-image-registry/node-ca-xh2m8" Jul 24 04:00:19.786302 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.768333 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/b17287b6-146d-437d-9990-c1a8969178d7-iptables-alerter-script\") pod \"iptables-alerter-mtg67\" (UID: \"b17287b6-146d-437d-9990-c1a8969178d7\") " pod="openshift-network-operator/iptables-alerter-mtg67" Jul 24 04:00:19.786302 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.771346 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e354fb6a-d916-4ba7-bbea-05d240a23dbb-tmp\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.786302 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:19.772198 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 04:00:19.786302 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:19.772220 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 04:00:19.786302 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:19.772237 2563 projected.go:196] Error preparing data for projected volume kube-api-access-6mkqn for pod openshift-network-diagnostics/network-check-target-5sckg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:19.786302 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:19.772327 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn podName:b37181f3-c3b8-478d-825d-6c9582911304 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:20.272298753 +0000 UTC m=+2.018672337 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-6mkqn" (UniqueName: "kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn") pod "network-check-target-5sckg" (UID: "b37181f3-c3b8-478d-825d-6c9582911304") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:19.786302 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.774407 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4spwm\" (UniqueName: \"kubernetes.io/projected/e354fb6a-d916-4ba7-bbea-05d240a23dbb-kube-api-access-4spwm\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.786302 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.774470 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ccq2h\" (UniqueName: \"kubernetes.io/projected/b17287b6-146d-437d-9990-c1a8969178d7-kube-api-access-ccq2h\") pod \"iptables-alerter-mtg67\" (UID: \"b17287b6-146d-437d-9990-c1a8969178d7\") " pod="openshift-network-operator/iptables-alerter-mtg67" Jul 24 04:00:19.786302 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.774476 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nbwqr\" (UniqueName: \"kubernetes.io/projected/97f262a1-d4fd-4990-9e85-86dd2530dbb3-kube-api-access-nbwqr\") pod \"node-resolver-lbhzg\" (UID: \"97f262a1-d4fd-4990-9e85-86dd2530dbb3\") " pod="openshift-dns/node-resolver-lbhzg" Jul 24 04:00:19.786302 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.775080 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6ks57\" (UniqueName: \"kubernetes.io/projected/5696a323-4908-4da2-9496-8112032a1012-kube-api-access-6ks57\") pod \"node-ca-xh2m8\" (UID: \"5696a323-4908-4da2-9496-8112032a1012\") " pod="openshift-image-registry/node-ca-xh2m8" Jul 24 04:00:19.786302 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.778096 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/e354fb6a-d916-4ba7-bbea-05d240a23dbb-etc-tuned\") pod \"tuned-8vdhv\" (UID: \"e354fb6a-d916-4ba7-bbea-05d240a23dbb\") " pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:19.927167 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:19.800987 2563 helpers.go:245] readString: Failed to read "/sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod705d69cd_a48a_4d8d_9f5a_a5c088697878.slice/cpuset.cpus.effective": read /sys/fs/cgroup/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod705d69cd_a48a_4d8d_9f5a_a5c088697878.slice/cpuset.cpus.effective: no such device Jul 24 04:00:19.927167 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868098 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/705d69cd-a48a-4d8d-9f5a-a5c088697878-sys-fs\") pod \"aws-ebs-csi-driver-node-ctbfb\" (UID: \"705d69cd-a48a-4d8d-9f5a-a5c088697878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:19.927167 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868138 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-host-run-multus-certs\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.927167 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868167 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5880389d-2038-4693-b674-5f81ec273823-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.927167 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868192 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-host-kubelet\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.927167 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868217 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-etc-openvswitch\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.927167 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868220 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-host-run-multus-certs\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.927167 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868222 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/705d69cd-a48a-4d8d-9f5a-a5c088697878-sys-fs\") pod \"aws-ebs-csi-driver-node-ctbfb\" (UID: \"705d69cd-a48a-4d8d-9f5a-a5c088697878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:19.927167 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868264 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-hostroot\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.927167 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868292 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-etc-kubernetes\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.927167 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868293 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-host-kubelet\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.927167 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868301 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-etc-openvswitch\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.927167 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868318 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/705d69cd-a48a-4d8d-9f5a-a5c088697878-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ctbfb\" (UID: \"705d69cd-a48a-4d8d-9f5a-a5c088697878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:19.927167 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868343 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-node-log\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.927167 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868342 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-hostroot\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.927167 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868357 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-etc-kubernetes\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.927167 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868376 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-host-run-ovn-kubernetes\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.927955 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868402 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cf4b914a-d9a8-4d59-a86a-1912f05699e3-ovnkube-script-lib\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.927955 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868400 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/705d69cd-a48a-4d8d-9f5a-a5c088697878-kubelet-dir\") pod \"aws-ebs-csi-driver-node-ctbfb\" (UID: \"705d69cd-a48a-4d8d-9f5a-a5c088697878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:19.927955 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868403 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-node-log\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.927955 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868439 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-host-run-ovn-kubernetes\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.927955 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868470 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qb9gl\" (UniqueName: \"kubernetes.io/projected/cf4b914a-d9a8-4d59-a86a-1912f05699e3-kube-api-access-qb9gl\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.927955 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868516 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-cnibin\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.927955 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868539 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22f4cfa7-8834-4275-8d7f-a979f6912d7c-cni-binary-copy\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.927955 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868561 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/38538035-14dc-4f67-9a68-3b265171eedb-agent-certs\") pod \"konnectivity-agent-8d6fk\" (UID: \"38538035-14dc-4f67-9a68-3b265171eedb\") " pod="kube-system/konnectivity-agent-8d6fk" Jul 24 04:00:19.927955 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868572 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-cnibin\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.927955 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868592 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5880389d-2038-4693-b674-5f81ec273823-cni-binary-copy\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.927955 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868621 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrpd4\" (UniqueName: \"kubernetes.io/projected/5880389d-2038-4693-b674-5f81ec273823-kube-api-access-lrpd4\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.927955 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868652 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmnbt\" (UniqueName: \"kubernetes.io/projected/705d69cd-a48a-4d8d-9f5a-a5c088697878-kube-api-access-fmnbt\") pod \"aws-ebs-csi-driver-node-ctbfb\" (UID: \"705d69cd-a48a-4d8d-9f5a-a5c088697878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:19.927955 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868678 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cf4b914a-d9a8-4d59-a86a-1912f05699e3-env-overrides\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.927955 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868703 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cf4b914a-d9a8-4d59-a86a-1912f05699e3-ovn-node-metrics-cert\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.927955 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868726 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-system-cni-dir\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.927955 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868755 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5880389d-2038-4693-b674-5f81ec273823-system-cni-dir\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.927955 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868781 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-os-release\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.928524 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868806 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-host-var-lib-cni-bin\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.928524 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868847 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/5880389d-2038-4693-b674-5f81ec273823-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.928524 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868851 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e98f98aa-332c-44a4-912f-985762f6a84f-kubelet-config\") pod \"global-pull-secret-syncer-7v47c\" (UID: \"e98f98aa-332c-44a4-912f-985762f6a84f\") " pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:19.928524 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868910 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/e98f98aa-332c-44a4-912f-985762f6a84f-kubelet-config\") pod \"global-pull-secret-syncer-7v47c\" (UID: \"e98f98aa-332c-44a4-912f-985762f6a84f\") " pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:19.928524 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868914 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret\") pod \"global-pull-secret-syncer-7v47c\" (UID: \"e98f98aa-332c-44a4-912f-985762f6a84f\") " pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:19.928524 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868948 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-host-var-lib-cni-multus\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.928524 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868984 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5880389d-2038-4693-b674-5f81ec273823-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.928524 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869011 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-os-release\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.928524 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869020 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5880389d-2038-4693-b674-5f81ec273823-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.928524 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869054 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e98f98aa-332c-44a4-912f-985762f6a84f-dbus\") pod \"global-pull-secret-syncer-7v47c\" (UID: \"e98f98aa-332c-44a4-912f-985762f6a84f\") " pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:19.928524 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869063 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-host-var-lib-cni-bin\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.928524 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868912 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-system-cni-dir\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.928524 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:19.869056 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:19.928524 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869132 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/22f4cfa7-8834-4275-8d7f-a979f6912d7c-cni-binary-copy\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.928524 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:19.869148 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret podName:e98f98aa-332c-44a4-912f-985762f6a84f nodeName:}" failed. No retries permitted until 2026-07-24 04:00:20.369130261 +0000 UTC m=+2.115503840 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret") pod "global-pull-secret-syncer-7v47c" (UID: "e98f98aa-332c-44a4-912f-985762f6a84f") : object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:19.928524 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869195 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/5880389d-2038-4693-b674-5f81ec273823-cni-binary-copy\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.928524 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869226 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/5880389d-2038-4693-b674-5f81ec273823-tuning-conf-dir\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.929188 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.868949 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/5880389d-2038-4693-b674-5f81ec273823-system-cni-dir\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.929188 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869255 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-host-var-lib-cni-multus\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.929188 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869275 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/705d69cd-a48a-4d8d-9f5a-a5c088697878-etc-selinux\") pod \"aws-ebs-csi-driver-node-ctbfb\" (UID: \"705d69cd-a48a-4d8d-9f5a-a5c088697878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:19.929188 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869326 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-host-cni-netd\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.929188 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869351 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/22f4cfa7-8834-4275-8d7f-a979f6912d7c-multus-daemon-config\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.929188 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869379 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/705d69cd-a48a-4d8d-9f5a-a5c088697878-registration-dir\") pod \"aws-ebs-csi-driver-node-ctbfb\" (UID: \"705d69cd-a48a-4d8d-9f5a-a5c088697878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:19.929188 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869402 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/705d69cd-a48a-4d8d-9f5a-a5c088697878-device-dir\") pod \"aws-ebs-csi-driver-node-ctbfb\" (UID: \"705d69cd-a48a-4d8d-9f5a-a5c088697878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:19.929188 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869420 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/e98f98aa-332c-44a4-912f-985762f6a84f-dbus\") pod \"global-pull-secret-syncer-7v47c\" (UID: \"e98f98aa-332c-44a4-912f-985762f6a84f\") " pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:19.929188 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869429 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-run-ovn\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.929188 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869425 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/705d69cd-a48a-4d8d-9f5a-a5c088697878-etc-selinux\") pod \"aws-ebs-csi-driver-node-ctbfb\" (UID: \"705d69cd-a48a-4d8d-9f5a-a5c088697878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:19.929188 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869477 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-run-ovn\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.929188 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869480 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-host-cni-netd\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.929188 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869507 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/705d69cd-a48a-4d8d-9f5a-a5c088697878-registration-dir\") pod \"aws-ebs-csi-driver-node-ctbfb\" (UID: \"705d69cd-a48a-4d8d-9f5a-a5c088697878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:19.929188 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869524 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/705d69cd-a48a-4d8d-9f5a-a5c088697878-device-dir\") pod \"aws-ebs-csi-driver-node-ctbfb\" (UID: \"705d69cd-a48a-4d8d-9f5a-a5c088697878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:19.929188 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869569 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-host-run-netns\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.929188 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869612 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-host-run-netns\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.929188 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869628 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-run-systemd\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.930337 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869659 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.930337 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869687 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cf4b914a-d9a8-4d59-a86a-1912f05699e3-ovnkube-config\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.930337 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869686 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-run-systemd\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.930337 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869715 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/cf4b914a-d9a8-4d59-a86a-1912f05699e3-env-overrides\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.930337 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869724 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.930337 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869723 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/5880389d-2038-4693-b674-5f81ec273823-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.930337 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869728 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-multus-socket-dir-parent\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.930337 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869778 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-host-run-netns\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.930337 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869791 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-multus-socket-dir-parent\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.930337 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869807 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-systemd-units\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.930337 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869834 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-host-var-lib-kubelet\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.930337 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869862 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-multus-conf-dir\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.930337 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869876 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-systemd-units\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.930337 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869888 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/38538035-14dc-4f67-9a68-3b265171eedb-konnectivity-ca\") pod \"konnectivity-agent-8d6fk\" (UID: \"38538035-14dc-4f67-9a68-3b265171eedb\") " pod="kube-system/konnectivity-agent-8d6fk" Jul 24 04:00:19.930337 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869893 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-host-var-lib-kubelet\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.930337 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869835 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-host-run-netns\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.930337 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869935 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-multus-conf-dir\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.930930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869941 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5880389d-2038-4693-b674-5f81ec273823-os-release\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.930930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869984 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-host-run-k8s-cni-cncf-io\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.930930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.869995 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/5880389d-2038-4693-b674-5f81ec273823-os-release\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.930930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870016 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q62s6\" (UniqueName: \"kubernetes.io/projected/22f4cfa7-8834-4275-8d7f-a979f6912d7c-kube-api-access-q62s6\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.930930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870035 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-host-run-k8s-cni-cncf-io\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.930930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870037 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/22f4cfa7-8834-4275-8d7f-a979f6912d7c-multus-daemon-config\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.930930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870052 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5880389d-2038-4693-b674-5f81ec273823-cnibin\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.930930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870087 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-run-openvswitch\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.930930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870098 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/5880389d-2038-4693-b674-5f81ec273823-cnibin\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.930930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870115 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs\") pod \"network-metrics-daemon-l9w8m\" (UID: \"c7fb9480-376d-487f-bfdf-386603ce759c\") " pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:19.930930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870141 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-run-openvswitch\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.930930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870146 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/cf4b914a-d9a8-4d59-a86a-1912f05699e3-ovnkube-script-lib\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.930930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870142 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-multus-cni-dir\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.930930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870184 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6wpnq\" (UniqueName: \"kubernetes.io/projected/c7fb9480-376d-487f-bfdf-386603ce759c-kube-api-access-6wpnq\") pod \"network-metrics-daemon-l9w8m\" (UID: \"c7fb9480-376d-487f-bfdf-386603ce759c\") " pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:19.930930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870201 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/22f4cfa7-8834-4275-8d7f-a979f6912d7c-multus-cni-dir\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:19.930930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870215 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/705d69cd-a48a-4d8d-9f5a-a5c088697878-socket-dir\") pod \"aws-ebs-csi-driver-node-ctbfb\" (UID: \"705d69cd-a48a-4d8d-9f5a-a5c088697878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:19.930930 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:19.870226 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:19.931479 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:19.870273 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs podName:c7fb9480-376d-487f-bfdf-386603ce759c nodeName:}" failed. No retries permitted until 2026-07-24 04:00:20.370257188 +0000 UTC m=+2.116630750 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs") pod "network-metrics-daemon-l9w8m" (UID: "c7fb9480-376d-487f-bfdf-386603ce759c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:19.931479 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870291 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/cf4b914a-d9a8-4d59-a86a-1912f05699e3-ovnkube-config\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.931479 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870334 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-host-slash\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.931479 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870394 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-var-lib-openvswitch\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.931479 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870402 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-host-slash\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.931479 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870411 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/705d69cd-a48a-4d8d-9f5a-a5c088697878-socket-dir\") pod \"aws-ebs-csi-driver-node-ctbfb\" (UID: \"705d69cd-a48a-4d8d-9f5a-a5c088697878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:19.931479 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870423 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-log-socket\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.931479 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870434 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/38538035-14dc-4f67-9a68-3b265171eedb-konnectivity-ca\") pod \"konnectivity-agent-8d6fk\" (UID: \"38538035-14dc-4f67-9a68-3b265171eedb\") " pod="kube-system/konnectivity-agent-8d6fk" Jul 24 04:00:19.931479 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870456 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-var-lib-openvswitch\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.931479 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870471 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-host-cni-bin\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.931479 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870508 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-log-socket\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.931479 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.870548 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/cf4b914a-d9a8-4d59-a86a-1912f05699e3-host-cni-bin\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.931479 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.871419 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/cf4b914a-d9a8-4d59-a86a-1912f05699e3-ovn-node-metrics-cert\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.931479 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.871608 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/38538035-14dc-4f67-9a68-3b265171eedb-agent-certs\") pod \"konnectivity-agent-8d6fk\" (UID: \"38538035-14dc-4f67-9a68-3b265171eedb\") " pod="kube-system/konnectivity-agent-8d6fk" Jul 24 04:00:19.931479 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.881032 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrpd4\" (UniqueName: \"kubernetes.io/projected/5880389d-2038-4693-b674-5f81ec273823-kube-api-access-lrpd4\") pod \"multus-additional-cni-plugins-ccdmw\" (UID: \"5880389d-2038-4693-b674-5f81ec273823\") " pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:19.931479 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.881973 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmnbt\" (UniqueName: \"kubernetes.io/projected/705d69cd-a48a-4d8d-9f5a-a5c088697878-kube-api-access-fmnbt\") pod \"aws-ebs-csi-driver-node-ctbfb\" (UID: \"705d69cd-a48a-4d8d-9f5a-a5c088697878\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:19.932109 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.882395 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6wpnq\" (UniqueName: \"kubernetes.io/projected/c7fb9480-376d-487f-bfdf-386603ce759c-kube-api-access-6wpnq\") pod \"network-metrics-daemon-l9w8m\" (UID: \"c7fb9480-376d-487f-bfdf-386603ce759c\") " pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:19.932109 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.882478 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qb9gl\" (UniqueName: \"kubernetes.io/projected/cf4b914a-d9a8-4d59-a86a-1912f05699e3-kube-api-access-qb9gl\") pod \"ovnkube-node-gl4b9\" (UID: \"cf4b914a-d9a8-4d59-a86a-1912f05699e3\") " pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:19.932109 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.883689 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q62s6\" (UniqueName: \"kubernetes.io/projected/22f4cfa7-8834-4275-8d7f-a979f6912d7c-kube-api-access-q62s6\") pod \"multus-bxt4g\" (UID: \"22f4cfa7-8834-4275-8d7f-a979f6912d7c\") " pod="openshift-multus/multus-bxt4g" Jul 24 04:00:20.056150 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:19.981774 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xh2m8" Jul 24 04:00:20.056150 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:20.013313 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" Jul 24 04:00:20.056150 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:20.038004 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-lbhzg" Jul 24 04:00:20.056150 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:20.047692 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-mtg67" Jul 24 04:00:20.195425 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:20.083269 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-bxt4g" Jul 24 04:00:20.195425 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:20.096317 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-8d6fk" Jul 24 04:00:20.195425 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:20.128667 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" Jul 24 04:00:20.195425 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:20.140025 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59d92ebdc5bf904b7abced8e297b1794.slice/crio-1b5759dc45670c39790451a6770144ffdfd480da3985b461ad1a3154c3e798ff WatchSource:0}: Error finding container 1b5759dc45670c39790451a6770144ffdfd480da3985b461ad1a3154c3e798ff: Status 404 returned error can't find the container with id 1b5759dc45670c39790451a6770144ffdfd480da3985b461ad1a3154c3e798ff Jul 24 04:00:20.195425 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:20.140300 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38538035_14dc_4f67_9a68_3b265171eedb.slice/crio-ac199f05cb7a468d818aa06bc41ab12e7022a611acbe0ab290936f2020b7f2f9 WatchSource:0}: Error finding container ac199f05cb7a468d818aa06bc41ab12e7022a611acbe0ab290936f2020b7f2f9: Status 404 returned error can't find the container with id ac199f05cb7a468d818aa06bc41ab12e7022a611acbe0ab290936f2020b7f2f9 Jul 24 04:00:20.195425 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:20.140788 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod68b5c35a661317b944b4a5969fbb303c.slice/crio-a7e007409a3243c4108622c5fe6c111163f7cafc11a32cee954b0fdf157da598 WatchSource:0}: Error finding container a7e007409a3243c4108622c5fe6c111163f7cafc11a32cee954b0fdf157da598: Status 404 returned error can't find the container with id a7e007409a3243c4108622c5fe6c111163f7cafc11a32cee954b0fdf157da598 Jul 24 04:00:20.195425 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:20.145433 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod705d69cd_a48a_4d8d_9f5a_a5c088697878.slice/crio-d118866c19578f10a9d20a49f895d94958ab86be706b58adb62f6cd67b18a80e WatchSource:0}: Error finding container d118866c19578f10a9d20a49f895d94958ab86be706b58adb62f6cd67b18a80e: Status 404 returned error can't find the container with id d118866c19578f10a9d20a49f895d94958ab86be706b58adb62f6cd67b18a80e Jul 24 04:00:20.195425 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:20.148838 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 04:00:20.195425 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:20.155073 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:20.195425 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:20.160174 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-ccdmw" Jul 24 04:00:20.195425 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:20.164021 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcf4b914a_d9a8_4d59_a86a_1912f05699e3.slice/crio-c6cca687bda3db6aa6e363dcd34b87bb20f3fa1f235286f9815b022ae8424be8 WatchSource:0}: Error finding container c6cca687bda3db6aa6e363dcd34b87bb20f3fa1f235286f9815b022ae8424be8: Status 404 returned error can't find the container with id c6cca687bda3db6aa6e363dcd34b87bb20f3fa1f235286f9815b022ae8424be8 Jul 24 04:00:20.195425 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:20.171773 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5880389d_2038_4693_b674_5f81ec273823.slice/crio-678c3e6993255a772e61769a3ca04f59c89668e2c85dbc2cdd939ede5de11774 WatchSource:0}: Error finding container 678c3e6993255a772e61769a3ca04f59c89668e2c85dbc2cdd939ede5de11774: Status 404 returned error can't find the container with id 678c3e6993255a772e61769a3ca04f59c89668e2c85dbc2cdd939ede5de11774 Jul 24 04:00:20.369082 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:20.273230 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mkqn\" (UniqueName: \"kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn\") pod \"network-check-target-5sckg\" (UID: \"b37181f3-c3b8-478d-825d-6c9582911304\") " pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:20.369082 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:20.273392 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 04:00:20.369082 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:20.273415 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 04:00:20.369082 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:20.273425 2563 projected.go:196] Error preparing data for projected volume kube-api-access-6mkqn for pod openshift-network-diagnostics/network-check-target-5sckg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:20.369082 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:20.273478 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn podName:b37181f3-c3b8-478d-825d-6c9582911304 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:21.273462958 +0000 UTC m=+3.019836525 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-6mkqn" (UniqueName: "kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn") pod "network-check-target-5sckg" (UID: "b37181f3-c3b8-478d-825d-6c9582911304") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:20.491160 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:20.373693 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret\") pod \"global-pull-secret-syncer-7v47c\" (UID: \"e98f98aa-332c-44a4-912f-985762f6a84f\") " pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:20.491160 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:20.373756 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs\") pod \"network-metrics-daemon-l9w8m\" (UID: \"c7fb9480-376d-487f-bfdf-386603ce759c\") " pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:20.491160 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:20.373856 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:20.491160 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:20.373918 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret podName:e98f98aa-332c-44a4-912f-985762f6a84f nodeName:}" failed. No retries permitted until 2026-07-24 04:00:21.37390229 +0000 UTC m=+3.120275853 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret") pod "global-pull-secret-syncer-7v47c" (UID: "e98f98aa-332c-44a4-912f-985762f6a84f") : object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:20.491160 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:20.373861 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:20.491160 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:20.374006 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs podName:c7fb9480-376d-487f-bfdf-386603ce759c nodeName:}" failed. No retries permitted until 2026-07-24 04:00:21.373984288 +0000 UTC m=+3.120357867 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs") pod "network-metrics-daemon-l9w8m" (UID: "c7fb9480-376d-487f-bfdf-386603ce759c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:20.491160 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:20.397689 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5696a323_4908_4da2_9496_8112032a1012.slice/crio-084db6200b6721bf3d157cec87c91f3109dc3d0365642f4ce18a93342c59a287 WatchSource:0}: Error finding container 084db6200b6721bf3d157cec87c91f3109dc3d0365642f4ce18a93342c59a287: Status 404 returned error can't find the container with id 084db6200b6721bf3d157cec87c91f3109dc3d0365642f4ce18a93342c59a287 Jul 24 04:00:20.491160 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:20.403808 2563 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 04:00:20.491160 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:20.425141 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode354fb6a_d916_4ba7_bbea_05d240a23dbb.slice/crio-e111aa3c56da7e3e1a5c1afd069074f65b98781a7e0d7cbf1e21d937569915e2 WatchSource:0}: Error finding container e111aa3c56da7e3e1a5c1afd069074f65b98781a7e0d7cbf1e21d937569915e2: Status 404 returned error can't find the container with id e111aa3c56da7e3e1a5c1afd069074f65b98781a7e0d7cbf1e21d937569915e2 Jul 24 04:00:20.491160 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:20.454345 2563 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 04:00:20.618402 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:20.497333 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb17287b6_146d_437d_9990_c1a8969178d7.slice/crio-e55e41050b44f06d0505c2a9fcabbd75fbb5c495d54082d9243bef2f2fe13043 WatchSource:0}: Error finding container e55e41050b44f06d0505c2a9fcabbd75fbb5c495d54082d9243bef2f2fe13043: Status 404 returned error can't find the container with id e55e41050b44f06d0505c2a9fcabbd75fbb5c495d54082d9243bef2f2fe13043 Jul 24 04:00:20.618402 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:00:20.554309 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22f4cfa7_8834_4275_8d7f_a979f6912d7c.slice/crio-e388a7b464ca0558862b7e2ea593e3b59ff6bbd2f46d4f1717481b21b9a6bcd4 WatchSource:0}: Error finding container e388a7b464ca0558862b7e2ea593e3b59ff6bbd2f46d4f1717481b21b9a6bcd4: Status 404 returned error can't find the container with id e388a7b464ca0558862b7e2ea593e3b59ff6bbd2f46d4f1717481b21b9a6bcd4 Jul 24 04:00:20.717261 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:20.711169 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 03:55:20 +0000 UTC" deadline="2028-04-29 21:44:16.990841988 +0000 UTC" Jul 24 04:00:20.717261 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:20.711229 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15497h43m56.279617173s" Jul 24 04:00:20.988603 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:20.988526 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8d6fk" event={"ID":"38538035-14dc-4f67-9a68-3b265171eedb","Type":"ContainerStarted","Data":"ac199f05cb7a468d818aa06bc41ab12e7022a611acbe0ab290936f2020b7f2f9"} Jul 24 04:00:21.002327 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:21.002111 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lbhzg" event={"ID":"97f262a1-d4fd-4990-9e85-86dd2530dbb3","Type":"ContainerStarted","Data":"f4b59c44aaa8a51488f20cb5b929f66f2834d255a8bf4e28f115d8f8b0e78148"} Jul 24 04:00:21.005922 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:21.005851 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" event={"ID":"e354fb6a-d916-4ba7-bbea-05d240a23dbb","Type":"ContainerStarted","Data":"e111aa3c56da7e3e1a5c1afd069074f65b98781a7e0d7cbf1e21d937569915e2"} Jul 24 04:00:21.010651 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:21.010593 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xh2m8" event={"ID":"5696a323-4908-4da2-9496-8112032a1012","Type":"ContainerStarted","Data":"084db6200b6721bf3d157cec87c91f3109dc3d0365642f4ce18a93342c59a287"} Jul 24 04:00:21.014838 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:21.014806 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ccdmw" event={"ID":"5880389d-2038-4693-b674-5f81ec273823","Type":"ContainerStarted","Data":"678c3e6993255a772e61769a3ca04f59c89668e2c85dbc2cdd939ede5de11774"} Jul 24 04:00:21.019930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:21.019898 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-155.ec2.internal" event={"ID":"68b5c35a661317b944b4a5969fbb303c","Type":"ContainerStarted","Data":"a7e007409a3243c4108622c5fe6c111163f7cafc11a32cee954b0fdf157da598"} Jul 24 04:00:21.026053 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:21.025998 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bxt4g" event={"ID":"22f4cfa7-8834-4275-8d7f-a979f6912d7c","Type":"ContainerStarted","Data":"e388a7b464ca0558862b7e2ea593e3b59ff6bbd2f46d4f1717481b21b9a6bcd4"} Jul 24 04:00:21.029676 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:21.029646 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mtg67" event={"ID":"b17287b6-146d-437d-9990-c1a8969178d7","Type":"ContainerStarted","Data":"e55e41050b44f06d0505c2a9fcabbd75fbb5c495d54082d9243bef2f2fe13043"} Jul 24 04:00:21.032996 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:21.032970 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" event={"ID":"cf4b914a-d9a8-4d59-a86a-1912f05699e3","Type":"ContainerStarted","Data":"c6cca687bda3db6aa6e363dcd34b87bb20f3fa1f235286f9815b022ae8424be8"} Jul 24 04:00:21.034914 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:21.034781 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" event={"ID":"705d69cd-a48a-4d8d-9f5a-a5c088697878","Type":"ContainerStarted","Data":"d118866c19578f10a9d20a49f895d94958ab86be706b58adb62f6cd67b18a80e"} Jul 24 04:00:21.037392 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:21.037320 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-155.ec2.internal" event={"ID":"59d92ebdc5bf904b7abced8e297b1794","Type":"ContainerStarted","Data":"1b5759dc45670c39790451a6770144ffdfd480da3985b461ad1a3154c3e798ff"} Jul 24 04:00:21.280885 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:21.280847 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mkqn\" (UniqueName: \"kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn\") pod \"network-check-target-5sckg\" (UID: \"b37181f3-c3b8-478d-825d-6c9582911304\") " pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:21.281200 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:21.281173 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 04:00:21.281308 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:21.281206 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 04:00:21.281308 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:21.281221 2563 projected.go:196] Error preparing data for projected volume kube-api-access-6mkqn for pod openshift-network-diagnostics/network-check-target-5sckg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:21.281308 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:21.281285 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn podName:b37181f3-c3b8-478d-825d-6c9582911304 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:23.281264321 +0000 UTC m=+5.027637907 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-6mkqn" (UniqueName: "kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn") pod "network-check-target-5sckg" (UID: "b37181f3-c3b8-478d-825d-6c9582911304") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:21.381949 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:21.381890 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret\") pod \"global-pull-secret-syncer-7v47c\" (UID: \"e98f98aa-332c-44a4-912f-985762f6a84f\") " pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:21.382156 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:21.381992 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs\") pod \"network-metrics-daemon-l9w8m\" (UID: \"c7fb9480-376d-487f-bfdf-386603ce759c\") " pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:21.382221 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:21.382159 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:21.382282 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:21.382235 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs podName:c7fb9480-376d-487f-bfdf-386603ce759c nodeName:}" failed. No retries permitted until 2026-07-24 04:00:23.382211515 +0000 UTC m=+5.128585086 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs") pod "network-metrics-daemon-l9w8m" (UID: "c7fb9480-376d-487f-bfdf-386603ce759c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:21.382341 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:21.382306 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:21.382398 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:21.382342 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret podName:e98f98aa-332c-44a4-912f-985762f6a84f nodeName:}" failed. No retries permitted until 2026-07-24 04:00:23.38232949 +0000 UTC m=+5.128703058 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret") pod "global-pull-secret-syncer-7v47c" (UID: "e98f98aa-332c-44a4-912f-985762f6a84f") : object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:21.712028 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:21.711959 2563 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-23 03:55:20 +0000 UTC" deadline="2028-01-07 16:38:12.09891907 +0000 UTC" Jul 24 04:00:21.712028 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:21.712025 2563 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12780h37m50.386898858s" Jul 24 04:00:21.845657 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:21.845237 2563 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 04:00:21.937189 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:21.937151 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:21.937387 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:21.937308 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:00:21.938142 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:21.937818 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:21.938142 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:21.937931 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:00:21.938142 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:21.937999 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:21.938142 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:21.938074 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:00:22.218951 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:22.218721 2563 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 24 04:00:23.299563 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:23.299510 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mkqn\" (UniqueName: \"kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn\") pod \"network-check-target-5sckg\" (UID: \"b37181f3-c3b8-478d-825d-6c9582911304\") " pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:23.300120 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:23.299792 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 04:00:23.300120 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:23.299815 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 04:00:23.300120 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:23.299829 2563 projected.go:196] Error preparing data for projected volume kube-api-access-6mkqn for pod openshift-network-diagnostics/network-check-target-5sckg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:23.300120 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:23.299897 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn podName:b37181f3-c3b8-478d-825d-6c9582911304 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:27.29987556 +0000 UTC m=+9.046249148 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-6mkqn" (UniqueName: "kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn") pod "network-check-target-5sckg" (UID: "b37181f3-c3b8-478d-825d-6c9582911304") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:23.400798 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:23.400648 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret\") pod \"global-pull-secret-syncer-7v47c\" (UID: \"e98f98aa-332c-44a4-912f-985762f6a84f\") " pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:23.400798 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:23.400726 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs\") pod \"network-metrics-daemon-l9w8m\" (UID: \"c7fb9480-376d-487f-bfdf-386603ce759c\") " pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:23.401111 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:23.400874 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:23.401111 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:23.400943 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs podName:c7fb9480-376d-487f-bfdf-386603ce759c nodeName:}" failed. No retries permitted until 2026-07-24 04:00:27.400922936 +0000 UTC m=+9.147296502 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs") pod "network-metrics-daemon-l9w8m" (UID: "c7fb9480-376d-487f-bfdf-386603ce759c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:23.401452 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:23.401427 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:23.401669 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:23.401501 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret podName:e98f98aa-332c-44a4-912f-985762f6a84f nodeName:}" failed. No retries permitted until 2026-07-24 04:00:27.401481475 +0000 UTC m=+9.147855056 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret") pod "global-pull-secret-syncer-7v47c" (UID: "e98f98aa-332c-44a4-912f-985762f6a84f") : object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:23.938226 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:23.937254 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:23.938226 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:23.937415 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:00:23.938226 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:23.937841 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:23.938226 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:23.937939 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:00:23.938226 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:23.937988 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:23.938226 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:23.938057 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:00:25.937639 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:25.936795 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:25.937639 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:25.936929 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:00:25.937639 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:25.937339 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:25.937639 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:25.937435 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:00:25.937639 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:25.937516 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:25.937639 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:25.937597 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:00:27.335357 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:27.335308 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mkqn\" (UniqueName: \"kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn\") pod \"network-check-target-5sckg\" (UID: \"b37181f3-c3b8-478d-825d-6c9582911304\") " pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:27.335835 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:27.335493 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 04:00:27.335835 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:27.335513 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 04:00:27.335835 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:27.335523 2563 projected.go:196] Error preparing data for projected volume kube-api-access-6mkqn for pod openshift-network-diagnostics/network-check-target-5sckg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:27.335835 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:27.335583 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn podName:b37181f3-c3b8-478d-825d-6c9582911304 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:35.335565788 +0000 UTC m=+17.081939349 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-6mkqn" (UniqueName: "kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn") pod "network-check-target-5sckg" (UID: "b37181f3-c3b8-478d-825d-6c9582911304") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:27.435858 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:27.435823 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret\") pod \"global-pull-secret-syncer-7v47c\" (UID: \"e98f98aa-332c-44a4-912f-985762f6a84f\") " pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:27.436044 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:27.435890 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs\") pod \"network-metrics-daemon-l9w8m\" (UID: \"c7fb9480-376d-487f-bfdf-386603ce759c\") " pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:27.436044 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:27.435942 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:27.436044 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:27.435989 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:27.436044 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:27.436021 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret podName:e98f98aa-332c-44a4-912f-985762f6a84f nodeName:}" failed. No retries permitted until 2026-07-24 04:00:35.435998373 +0000 UTC m=+17.182371949 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret") pod "global-pull-secret-syncer-7v47c" (UID: "e98f98aa-332c-44a4-912f-985762f6a84f") : object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:27.436044 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:27.436044 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs podName:c7fb9480-376d-487f-bfdf-386603ce759c nodeName:}" failed. No retries permitted until 2026-07-24 04:00:35.436033153 +0000 UTC m=+17.182406726 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs") pod "network-metrics-daemon-l9w8m" (UID: "c7fb9480-376d-487f-bfdf-386603ce759c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:27.937667 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:27.937635 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:27.937855 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:27.937766 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:00:27.937855 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:27.937796 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:27.937968 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:27.937893 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:00:27.937968 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:27.937921 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:27.938069 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:27.937989 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:00:29.937147 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:29.937108 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:29.937660 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:29.937240 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:00:29.937660 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:29.937112 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:29.937660 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:29.937336 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:00:29.937660 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:29.937109 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:29.937660 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:29.937425 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:00:31.937121 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:31.937081 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:31.937590 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:31.937081 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:31.937590 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:31.937215 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:00:31.937590 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:31.937097 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:31.937590 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:31.937311 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:00:31.937590 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:31.937379 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:00:33.937393 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:33.937354 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:33.937918 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:33.937355 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:33.937918 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:33.937495 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:00:33.937918 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:33.937362 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:33.937918 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:33.937554 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:00:33.937918 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:33.937692 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:00:35.396367 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:35.396331 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mkqn\" (UniqueName: \"kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn\") pod \"network-check-target-5sckg\" (UID: \"b37181f3-c3b8-478d-825d-6c9582911304\") " pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:35.396875 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:35.396538 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 04:00:35.396875 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:35.396568 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 04:00:35.396875 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:35.396583 2563 projected.go:196] Error preparing data for projected volume kube-api-access-6mkqn for pod openshift-network-diagnostics/network-check-target-5sckg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:35.396875 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:35.396658 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn podName:b37181f3-c3b8-478d-825d-6c9582911304 nodeName:}" failed. No retries permitted until 2026-07-24 04:00:51.396634994 +0000 UTC m=+33.143008559 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-6mkqn" (UniqueName: "kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn") pod "network-check-target-5sckg" (UID: "b37181f3-c3b8-478d-825d-6c9582911304") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:35.497190 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:35.497150 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs\") pod \"network-metrics-daemon-l9w8m\" (UID: \"c7fb9480-376d-487f-bfdf-386603ce759c\") " pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:35.497385 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:35.497244 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret\") pod \"global-pull-secret-syncer-7v47c\" (UID: \"e98f98aa-332c-44a4-912f-985762f6a84f\") " pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:35.497385 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:35.497318 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:35.497385 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:35.497361 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:35.497564 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:35.497398 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs podName:c7fb9480-376d-487f-bfdf-386603ce759c nodeName:}" failed. No retries permitted until 2026-07-24 04:00:51.49737455 +0000 UTC m=+33.243748123 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs") pod "network-metrics-daemon-l9w8m" (UID: "c7fb9480-376d-487f-bfdf-386603ce759c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:35.497564 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:35.497413 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret podName:e98f98aa-332c-44a4-912f-985762f6a84f nodeName:}" failed. No retries permitted until 2026-07-24 04:00:51.497407257 +0000 UTC m=+33.243780818 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret") pod "global-pull-secret-syncer-7v47c" (UID: "e98f98aa-332c-44a4-912f-985762f6a84f") : object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:35.937141 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:35.937094 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:35.937141 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:35.937126 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:35.937417 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:35.937253 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:00:35.937417 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:35.937318 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:00:35.937417 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:35.937337 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:35.937542 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:35.937440 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:00:37.937356 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:37.937315 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:37.937356 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:37.937332 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:37.937830 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:37.937315 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:37.937830 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:37.937456 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:00:37.937830 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:37.937589 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:00:37.937830 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:37.937697 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:00:39.937293 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:39.937258 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:39.937293 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:39.937275 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:39.937786 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:39.937275 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:39.937786 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:39.937369 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:00:39.937786 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:39.937499 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:00:39.937786 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:39.937536 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:00:41.099020 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:41.098982 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-155.ec2.internal" event={"ID":"68b5c35a661317b944b4a5969fbb303c","Type":"ContainerStarted","Data":"7a2419919c9b3bea01b781785834bee985ab2653c746df2fc7c8c879565b1943"} Jul 24 04:00:41.104239 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:41.103709 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" event={"ID":"e354fb6a-d916-4ba7-bbea-05d240a23dbb","Type":"ContainerStarted","Data":"16b50ab5ef2c5f77a853dae139822f4a946d65e921bbd5bd413a38a04320b892"} Jul 24 04:00:41.116063 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:41.115736 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-155.ec2.internal" podStartSLOduration=21.115716438 podStartE2EDuration="21.115716438s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:41.115319851 +0000 UTC m=+22.861693435" watchObservedRunningTime="2026-07-24 04:00:41.115716438 +0000 UTC m=+22.862090024" Jul 24 04:00:41.139486 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:41.138564 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-8vdhv" podStartSLOduration=1.630540297 podStartE2EDuration="22.138466615s" totalImagesPullingTime="20.507926318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:41.137648069 +0000 UTC m=+22.884021653" watchObservedRunningTime="2026-07-24 04:00:41.138466615 +0000 UTC m=+22.884840199" Jul 24 04:00:41.937991 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:41.937763 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:41.938228 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:41.937806 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:41.938228 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:41.938027 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:00:41.938228 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:41.937806 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:41.938228 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:41.938099 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:00:41.938228 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:41.938187 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:00:42.108078 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.108035 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" event={"ID":"705d69cd-a48a-4d8d-9f5a-a5c088697878","Type":"ContainerStarted","Data":"756ee05cbcc5b60b503b20eb48247c87e2a1b11351052dc5efce50b5781dd974"} Jul 24 04:00:42.112553 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.112521 2563 generic.go:356] "Generic (PLEG): container finished" podID="59d92ebdc5bf904b7abced8e297b1794" containerID="139de6b9c69cab38c778adc70b4936212856bc32ba49384b85bafa5d4e80c27a" exitCode=0 Jul 24 04:00:42.112691 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.112610 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-155.ec2.internal" event={"ID":"59d92ebdc5bf904b7abced8e297b1794","Type":"ContainerDied","Data":"139de6b9c69cab38c778adc70b4936212856bc32ba49384b85bafa5d4e80c27a"} Jul 24 04:00:42.114356 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.114327 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-8d6fk" event={"ID":"38538035-14dc-4f67-9a68-3b265171eedb","Type":"ContainerStarted","Data":"3606e477ac9fdfeddfffc3783d759d422bc3f8e92bc684c523446dcb095b88e6"} Jul 24 04:00:42.116489 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.116446 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-lbhzg" event={"ID":"97f262a1-d4fd-4990-9e85-86dd2530dbb3","Type":"ContainerStarted","Data":"b864d440e8f235cda9fc28dd716d466e81993f8fb4a3a0e89b484358cfcc3086"} Jul 24 04:00:42.118089 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.118063 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xh2m8" event={"ID":"5696a323-4908-4da2-9496-8112032a1012","Type":"ContainerStarted","Data":"9faa5121bd6c0597b1d5042fb76e4ca0bc080c6bbced42be6d2929ecca246c0b"} Jul 24 04:00:42.119739 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.119713 2563 generic.go:356] "Generic (PLEG): container finished" podID="5880389d-2038-4693-b674-5f81ec273823" containerID="04a82c1f294f0f2ce3cc8f5bac581df7a9417166e3317f6b91ad5748d8ba6910" exitCode=0 Jul 24 04:00:42.119839 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.119798 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ccdmw" event={"ID":"5880389d-2038-4693-b674-5f81ec273823","Type":"ContainerDied","Data":"04a82c1f294f0f2ce3cc8f5bac581df7a9417166e3317f6b91ad5748d8ba6910"} Jul 24 04:00:42.121514 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.121466 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-bxt4g" event={"ID":"22f4cfa7-8834-4275-8d7f-a979f6912d7c","Type":"ContainerStarted","Data":"671bd0000817ac42e8bd33523617bca43ff6ee990784ee9f6b9344cac64a0a84"} Jul 24 04:00:42.124952 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.124931 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" event={"ID":"cf4b914a-d9a8-4d59-a86a-1912f05699e3","Type":"ContainerStarted","Data":"ff8fe5743224315b91c573620beafbf057e9d8f5457f584678c40be254a19ddf"} Jul 24 04:00:42.125031 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.124986 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" event={"ID":"cf4b914a-d9a8-4d59-a86a-1912f05699e3","Type":"ContainerStarted","Data":"cc11231c55df6178419401aae9cfc07f731a6dde7cf0aac5d87a766309aad2ff"} Jul 24 04:00:42.125031 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.125016 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" event={"ID":"cf4b914a-d9a8-4d59-a86a-1912f05699e3","Type":"ContainerStarted","Data":"bdcb53bc1ea162e1350e77829bb2cc5ec4a77c4b3cbec0b0625d9d612d2a6d48"} Jul 24 04:00:42.125104 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.125043 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" event={"ID":"cf4b914a-d9a8-4d59-a86a-1912f05699e3","Type":"ContainerStarted","Data":"3a0036e42ad4375b41e9d78f71b627ec123d997a3d11bdb1d2ca4a22d583f4d1"} Jul 24 04:00:42.125104 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.125072 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" event={"ID":"cf4b914a-d9a8-4d59-a86a-1912f05699e3","Type":"ContainerStarted","Data":"70310a71e74f26593a9ab2aeee31a45a703af43ba21aa66b914b2c80b5315cc5"} Jul 24 04:00:42.125104 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.125099 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" event={"ID":"cf4b914a-d9a8-4d59-a86a-1912f05699e3","Type":"ContainerStarted","Data":"651f84862d5110e62e567c809d83265d29d897896aa5387c12487cb197d2783f"} Jul 24 04:00:42.139319 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.139270 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xh2m8" podStartSLOduration=2.6355051339999997 podStartE2EDuration="23.139256357s" totalImagesPullingTime="20.503751223s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:42.138982946 +0000 UTC m=+23.885356530" watchObservedRunningTime="2026-07-24 04:00:42.139256357 +0000 UTC m=+23.885629934" Jul 24 04:00:42.152613 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.152462 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-lbhzg" podStartSLOduration=3.06992819 podStartE2EDuration="23.152420925s" totalImagesPullingTime="20.082492735s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:42.1520321 +0000 UTC m=+23.898408243" watchObservedRunningTime="2026-07-24 04:00:42.152420925 +0000 UTC m=+23.898794508" Jul 24 04:00:42.188815 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.188675 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-bxt4g" podStartSLOduration=2.795976586 podStartE2EDuration="23.188657642s" totalImagesPullingTime="20.392681056s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:42.187870263 +0000 UTC m=+23.934243854" watchObservedRunningTime="2026-07-24 04:00:42.188657642 +0000 UTC m=+23.935031225" Jul 24 04:00:42.280496 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.280431 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:42.435270 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.435236 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:42.911200 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.911144 2563 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 24 04:00:42.926150 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.926125 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xh2m8_5696a323-4908-4da2-9496-8112032a1012/node-ca/0.log" Jul 24 04:00:42.995201 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:42.995162 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:43.128983 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:43.128895 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-mtg67" event={"ID":"b17287b6-146d-437d-9990-c1a8969178d7","Type":"ContainerStarted","Data":"af61a9d656fee848c95eefa35d97744edcd9a54f0728c67021a72f6d2dddedc3"} Jul 24 04:00:43.130692 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:43.130667 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" event={"ID":"705d69cd-a48a-4d8d-9f5a-a5c088697878","Type":"ContainerStarted","Data":"0a60832a5db7086a4ab9d8b411a04611776428f7ee3d977e2fbedf9faaa1c819"} Jul 24 04:00:43.131523 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:43.131497 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:43.132545 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:43.132518 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-155.ec2.internal" event={"ID":"59d92ebdc5bf904b7abced8e297b1794","Type":"ContainerStarted","Data":"241bfd5025e486ed2edd3bd92362762bc9b88063c0bf1ca19cf9ca09d36c4a7a"} Jul 24 04:00:43.142571 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:43.142531 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-8d6fk" podStartSLOduration=3.377772576 podStartE2EDuration="24.142516578s" totalImagesPullingTime="20.764744002s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:42.201890334 +0000 UTC m=+23.948263935" watchObservedRunningTime="2026-07-24 04:00:43.142516578 +0000 UTC m=+24.888890161" Jul 24 04:00:43.142937 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:43.142890 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-mtg67" podStartSLOduration=3.728286826 podStartE2EDuration="24.142878477s" totalImagesPullingTime="20.414591651s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:43.142235323 +0000 UTC m=+24.888608909" watchObservedRunningTime="2026-07-24 04:00:43.142878477 +0000 UTC m=+24.889252063" Jul 24 04:00:43.156620 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:43.156573 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-155.ec2.internal" podStartSLOduration=23.1565585 podStartE2EDuration="23.1565585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:43.155892622 +0000 UTC m=+24.902266205" watchObservedRunningTime="2026-07-24 04:00:43.1565585 +0000 UTC m=+24.902932082" Jul 24 04:00:43.333555 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:43.333514 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:43.430775 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:43.430699 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:43.504296 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:43.504264 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:43.735490 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:43.735373 2563 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-24T04:00:42.91116693Z","UUID":"74f09109-390f-4c4c-b9e6-b0faaee7895c","Handler":null,"Name":"","Endpoint":""} Jul 24 04:00:43.737220 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:43.737193 2563 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 24 04:00:43.737351 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:43.737238 2563 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 24 04:00:43.922657 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:43.922627 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:43.937507 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:43.937464 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:43.937640 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:43.937515 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:43.937693 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:43.937652 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:00:43.938086 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:43.937840 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:43.938086 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:43.937950 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:00:43.938086 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:43.938049 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:00:44.138877 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:44.138800 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" event={"ID":"cf4b914a-d9a8-4d59-a86a-1912f05699e3","Type":"ContainerStarted","Data":"8f9fbd5b5a32390c7701827a5b14deb23b1440e44e7e98a42e36c09abb9b7c21"} Jul 24 04:00:44.480222 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:44.480190 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:44.692234 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:44.692181 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:44.796524 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:44.796422 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:44.893572 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:44.893518 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:45.058896 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:45.058812 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:45.127242 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:45.127211 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:45.144521 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:45.144463 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" event={"ID":"705d69cd-a48a-4d8d-9f5a-a5c088697878","Type":"ContainerStarted","Data":"755a3cc71625949da9b88e4da0fea9d62cfcbffbbfa0b14fe5bcae9734c4a265"} Jul 24 04:00:45.163800 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:45.163736 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-ctbfb" podStartSLOduration=2.495646975 podStartE2EDuration="26.16371597s" totalImagesPullingTime="23.668068995s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:19 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:45.163563965 +0000 UTC m=+26.909937549" watchObservedRunningTime="2026-07-24 04:00:45.16371597 +0000 UTC m=+26.910089554" Jul 24 04:00:45.180997 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:45.180961 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:45.937664 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:45.937628 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:45.937664 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:45.937664 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:45.937902 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:45.937666 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:45.937902 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:45.937769 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:00:45.937902 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:45.937846 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:00:45.938034 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:45.937930 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:00:46.172431 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:46.172391 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:46.184744 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:46.184714 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-8d6fk" Jul 24 04:00:46.185398 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:46.185379 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-8d6fk" Jul 24 04:00:46.577555 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:46.577526 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:46.634775 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:46.634736 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:46.778780 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:46.778749 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:46.979972 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:46.979800 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:47.152681 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:47.152593 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" event={"ID":"cf4b914a-d9a8-4d59-a86a-1912f05699e3","Type":"ContainerStarted","Data":"3e1d0ab603246c4dda0d8abe58a096f8510190559f1163644dd109e81df84cb8"} Jul 24 04:00:47.152953 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:47.152911 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-8d6fk" Jul 24 04:00:47.153342 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:47.153325 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-8d6fk" Jul 24 04:00:47.182803 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:47.182753 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" podStartSLOduration=7.237721867 podStartE2EDuration="28.182735951s" totalImagesPullingTime="20.945014084s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:00:47.182448444 +0000 UTC m=+28.928822024" watchObservedRunningTime="2026-07-24 04:00:47.182735951 +0000 UTC m=+28.929109533" Jul 24 04:00:47.376055 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:47.376026 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:47.937146 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:47.937106 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:47.937146 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:47.937146 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:47.937398 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:47.937146 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:47.937398 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:47.937220 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:00:47.937398 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:47.937301 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:00:47.937398 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:47.937363 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:00:48.081156 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:48.081114 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:48.156433 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:48.156400 2563 generic.go:356] "Generic (PLEG): container finished" podID="5880389d-2038-4693-b674-5f81ec273823" containerID="066b220044b45b2d0eb621196b1a7bd4f65831f4502ce4215c1b854db479dca9" exitCode=0 Jul 24 04:00:48.156697 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:48.156506 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ccdmw" event={"ID":"5880389d-2038-4693-b674-5f81ec273823","Type":"ContainerDied","Data":"066b220044b45b2d0eb621196b1a7bd4f65831f4502ce4215c1b854db479dca9"} Jul 24 04:00:48.157902 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:48.157355 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:48.157902 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:48.157442 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:48.157902 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:48.157506 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:48.173095 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:48.173071 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:48.177961 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:48.177942 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:00:48.182798 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:48.182767 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:48.372196 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:48.372152 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:48.473407 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:48.473365 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:48.774932 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:48.774739 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:48.969423 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:48.969360 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:49.025162 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:49.025059 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:49.380792 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:49.380700 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:49.937536 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:49.937414 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:49.937536 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:49.937452 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:49.937536 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:49.937452 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:49.937812 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:49.937556 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:00:49.937812 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:49.937650 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:00:49.937812 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:49.937715 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:00:50.163170 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:50.163137 2563 generic.go:356] "Generic (PLEG): container finished" podID="5880389d-2038-4693-b674-5f81ec273823" containerID="a50d18ca418646363e0a566b76f077c600190e5afbb2885088533a89ad1acd6e" exitCode=0 Jul 24 04:00:50.163340 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:50.163205 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ccdmw" event={"ID":"5880389d-2038-4693-b674-5f81ec273823","Type":"ContainerDied","Data":"a50d18ca418646363e0a566b76f077c600190e5afbb2885088533a89ad1acd6e"} Jul 24 04:00:50.174934 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:50.174909 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:50.405230 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:50.405196 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:50.506159 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:50.506125 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:50.606584 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:50.606547 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:50.707629 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:50.707596 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:50.807896 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:50.807858 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:51.419901 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:51.419871 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mkqn\" (UniqueName: \"kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn\") pod \"network-check-target-5sckg\" (UID: \"b37181f3-c3b8-478d-825d-6c9582911304\") " pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:51.420286 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:51.420011 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 24 04:00:51.420286 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:51.420028 2563 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 24 04:00:51.420286 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:51.420037 2563 projected.go:196] Error preparing data for projected volume kube-api-access-6mkqn for pod openshift-network-diagnostics/network-check-target-5sckg: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:51.420286 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:51.420086 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn podName:b37181f3-c3b8-478d-825d-6c9582911304 nodeName:}" failed. No retries permitted until 2026-07-24 04:01:23.420069539 +0000 UTC m=+65.166443107 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-6mkqn" (UniqueName: "kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn") pod "network-check-target-5sckg" (UID: "b37181f3-c3b8-478d-825d-6c9582911304") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 24 04:00:51.520165 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:51.520134 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs\") pod \"network-metrics-daemon-l9w8m\" (UID: \"c7fb9480-376d-487f-bfdf-386603ce759c\") " pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:51.520327 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:51.520187 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret\") pod \"global-pull-secret-syncer-7v47c\" (UID: \"e98f98aa-332c-44a4-912f-985762f6a84f\") " pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:51.520327 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:51.520266 2563 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:51.520327 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:51.520267 2563 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:51.520327 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:51.520314 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret podName:e98f98aa-332c-44a4-912f-985762f6a84f nodeName:}" failed. No retries permitted until 2026-07-24 04:01:23.520301212 +0000 UTC m=+65.266674777 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret") pod "global-pull-secret-syncer-7v47c" (UID: "e98f98aa-332c-44a4-912f-985762f6a84f") : object "kube-system"/"original-pull-secret" not registered Jul 24 04:00:51.520327 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:51.520328 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs podName:c7fb9480-376d-487f-bfdf-386603ce759c nodeName:}" failed. No retries permitted until 2026-07-24 04:01:23.520320849 +0000 UTC m=+65.266694409 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs") pod "network-metrics-daemon-l9w8m" (UID: "c7fb9480-376d-487f-bfdf-386603ce759c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 24 04:00:51.572793 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:51.572683 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:51.937678 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:51.937597 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:51.937818 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:51.937598 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:51.937818 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:51.937704 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:00:51.937818 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:51.937599 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:51.937915 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:51.937773 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:00:51.937915 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:51.937896 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:00:52.015489 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:52.015442 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:52.169886 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:52.169851 2563 generic.go:356] "Generic (PLEG): container finished" podID="5880389d-2038-4693-b674-5f81ec273823" containerID="abeb0b11a3a3767c9dccbec928f98881fb25d2ddf9467eac9d6434b812dd1a1f" exitCode=0 Jul 24 04:00:52.170060 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:52.169914 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ccdmw" event={"ID":"5880389d-2038-4693-b674-5f81ec273823","Type":"ContainerDied","Data":"abeb0b11a3a3767c9dccbec928f98881fb25d2ddf9467eac9d6434b812dd1a1f"} Jul 24 04:00:52.657596 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:52.657529 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:52.829011 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:52.828973 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:53.044235 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:53.044202 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:53.398759 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:53.398668 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:53.788690 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:53.788653 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:53.936727 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:53.936683 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:53.936928 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:53.936684 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:53.936928 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:53.936797 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:00:53.936928 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:53.936694 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:53.936928 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:53.936877 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:00:53.937109 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:53.936992 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:00:53.972390 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:53.972350 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:54.370236 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:54.370195 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:54.572892 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:54.572863 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:54.972183 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:54.972146 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:55.573847 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:55.573811 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:55.937319 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:55.937234 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:55.937319 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:55.937254 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:55.937561 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:55.937353 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:55.937561 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:55.937367 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:00:55.937561 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:55.937428 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:00:55.937561 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:55.937544 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:00:57.184637 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:57.184602 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ccdmw" event={"ID":"5880389d-2038-4693-b674-5f81ec273823","Type":"ContainerStarted","Data":"13466f494cb0d254e5aca9fef281049ba292e9670c9293005532227366682da6"} Jul 24 04:00:57.937405 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:57.937369 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:57.937405 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:57.937404 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:57.937675 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:57.937378 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:57.937675 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:57.937513 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:00:57.937675 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:57.937601 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:00:57.937675 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:57.937648 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:00:58.189660 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:58.189584 2563 generic.go:356] "Generic (PLEG): container finished" podID="5880389d-2038-4693-b674-5f81ec273823" containerID="13466f494cb0d254e5aca9fef281049ba292e9670c9293005532227366682da6" exitCode=0 Jul 24 04:00:58.189660 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:58.189641 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ccdmw" event={"ID":"5880389d-2038-4693-b674-5f81ec273823","Type":"ContainerDied","Data":"13466f494cb0d254e5aca9fef281049ba292e9670c9293005532227366682da6"} Jul 24 04:00:59.194490 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:59.194439 2563 generic.go:356] "Generic (PLEG): container finished" podID="5880389d-2038-4693-b674-5f81ec273823" containerID="de4c03c5a62363375edea19dddecee9d4d6e43fe0a0ef592df7d7008b6503442" exitCode=0 Jul 24 04:00:59.194845 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:59.194519 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ccdmw" event={"ID":"5880389d-2038-4693-b674-5f81ec273823","Type":"ContainerDied","Data":"de4c03c5a62363375edea19dddecee9d4d6e43fe0a0ef592df7d7008b6503442"} Jul 24 04:00:59.810343 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:59.810314 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:59.866180 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:59.866149 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:00:59.937015 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:59.936978 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:00:59.937170 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:59.936991 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:00:59.937170 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:59.937091 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:00:59.937170 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:00:59.937092 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:00:59.937267 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:59.937178 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:00:59.937267 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:00:59.937231 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:01:00.200268 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:00.200241 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-ccdmw" event={"ID":"5880389d-2038-4693-b674-5f81ec273823","Type":"ContainerStarted","Data":"1d129c1ba0ef935fc32c673691d0e43d8ce1fea26ea4532ef24ffa3910624d75"} Jul 24 04:01:00.222585 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:00.222537 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-ccdmw" podStartSLOduration=7.951766943 podStartE2EDuration="41.222519172s" totalImagesPullingTime="33.270752229s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:19 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:00.222195743 +0000 UTC m=+41.968569325" watchObservedRunningTime="2026-07-24 04:01:00.222519172 +0000 UTC m=+41.968892756" Jul 24 04:01:01.936780 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:01.936746 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:01:01.937165 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:01.936848 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:01:01.937165 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:01.936865 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:01:01.937165 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:01.936746 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:01:01.937165 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:01.936969 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:01:01.937165 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:01.937035 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:01:03.311060 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:03.311026 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:03.365250 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:03.365218 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:03.937676 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:03.937640 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:01:03.937676 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:03.937675 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:01:03.938010 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:03.937751 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:01:03.938010 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:03.937772 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:01:03.938010 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:03.937816 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:01:03.938010 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:03.937896 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:01:05.064452 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:05.064418 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:05.165710 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:05.165674 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:05.265423 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:05.265395 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:05.937128 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:05.937098 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:01:05.937303 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:05.937191 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:01:05.937303 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:05.937199 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:01:05.937303 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:05.937198 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:01:05.937303 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:05.937286 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:01:05.937434 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:05.937340 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:01:05.956896 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:05.956865 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:06.587962 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:06.587923 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:06.667007 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:06.666980 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:06.767974 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:06.767944 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:06.866178 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:06.866098 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:06.965760 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:06.965729 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:07.937638 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:07.937607 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:01:07.937988 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:07.937667 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:01:07.937988 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:07.937781 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:01:07.937988 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:07.937804 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:01:07.937988 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:07.937857 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:01:07.937988 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:07.937905 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:01:08.247518 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:08.247303 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7v47c"] Jul 24 04:01:08.247730 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:08.247613 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:01:08.247806 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:08.247727 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:01:08.250796 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:08.250756 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5sckg"] Jul 24 04:01:08.250954 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:08.250865 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:01:08.251022 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:08.250991 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:01:08.251519 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:08.251494 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l9w8m"] Jul 24 04:01:08.251629 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:08.251588 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:01:08.251701 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:08.251682 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:01:09.937204 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:09.937170 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:01:09.937700 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:09.937205 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:01:09.937700 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:09.937209 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:01:09.937700 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:09.937282 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:01:09.937700 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:09.937358 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:01:09.937700 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:09.937424 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:01:11.937274 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:11.937234 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:01:11.937784 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:11.937286 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:01:11.937784 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:11.937286 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:01:11.937784 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:11.937360 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-l9w8m" podUID="c7fb9480-376d-487f-bfdf-386603ce759c" Jul 24 04:01:11.937784 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:11.937456 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-7v47c" podUID="e98f98aa-332c-44a4-912f-985762f6a84f" Jul 24 04:01:11.937784 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:11.937553 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-5sckg" podUID="b37181f3-c3b8-478d-825d-6c9582911304" Jul 24 04:01:12.510712 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:12.510679 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:12.612487 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:12.612417 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:13.061779 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.061745 2563 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-155.ec2.internal" event="NodeReady" Jul 24 04:01:13.062223 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.061881 2563 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 24 04:01:13.105598 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.105557 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-lq554"] Jul 24 04:01:13.115535 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.115507 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-pkk9l"] Jul 24 04:01:13.115673 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.115568 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lq554" Jul 24 04:01:13.118134 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.118107 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 24 04:01:13.118284 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.118107 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 24 04:01:13.118284 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.118108 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 24 04:01:13.118284 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.118161 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-gzt6l\"" Jul 24 04:01:13.127368 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.127343 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lq554"] Jul 24 04:01:13.127368 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.127373 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pkk9l"] Jul 24 04:01:13.127531 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.127405 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-wq5n4"] Jul 24 04:01:13.127566 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.127543 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pkk9l" Jul 24 04:01:13.130041 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.130019 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-tzqn7\"" Jul 24 04:01:13.130174 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.130092 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 24 04:01:13.130174 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.130148 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 24 04:01:13.130269 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.130190 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 24 04:01:13.130303 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.130276 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 24 04:01:13.141989 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.141960 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wq5n4"] Jul 24 04:01:13.142113 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.142080 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wq5n4" Jul 24 04:01:13.144357 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.144336 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-7mgjm\"" Jul 24 04:01:13.144501 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.144342 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 24 04:01:13.144501 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.144421 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 24 04:01:13.225238 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.225208 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:13.274658 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.274618 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1caca312-bb28-46db-ba00-89002a4d2f7f-cert\") pod \"ingress-canary-lq554\" (UID: \"1caca312-bb28-46db-ba00-89002a4d2f7f\") " pod="openshift-ingress-canary/ingress-canary-lq554" Jul 24 04:01:13.274658 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.274657 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f7lvc\" (UniqueName: \"kubernetes.io/projected/1caca312-bb28-46db-ba00-89002a4d2f7f-kube-api-access-f7lvc\") pod \"ingress-canary-lq554\" (UID: \"1caca312-bb28-46db-ba00-89002a4d2f7f\") " pod="openshift-ingress-canary/ingress-canary-lq554" Jul 24 04:01:13.274856 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.274679 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/646ab979-b371-4653-9751-5f26ec108eca-config-volume\") pod \"dns-default-wq5n4\" (UID: \"646ab979-b371-4653-9751-5f26ec108eca\") " pod="openshift-dns/dns-default-wq5n4" Jul 24 04:01:13.274856 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.274698 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76p49\" (UniqueName: \"kubernetes.io/projected/a3828b21-ec96-4f8d-b932-b4f06ced7add-kube-api-access-76p49\") pod \"insights-runtime-extractor-pkk9l\" (UID: \"a3828b21-ec96-4f8d-b932-b4f06ced7add\") " pod="openshift-insights/insights-runtime-extractor-pkk9l" Jul 24 04:01:13.274856 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.274746 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bzmkb\" (UniqueName: \"kubernetes.io/projected/646ab979-b371-4653-9751-5f26ec108eca-kube-api-access-bzmkb\") pod \"dns-default-wq5n4\" (UID: \"646ab979-b371-4653-9751-5f26ec108eca\") " pod="openshift-dns/dns-default-wq5n4" Jul 24 04:01:13.274856 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.274799 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3828b21-ec96-4f8d-b932-b4f06ced7add-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pkk9l\" (UID: \"a3828b21-ec96-4f8d-b932-b4f06ced7add\") " pod="openshift-insights/insights-runtime-extractor-pkk9l" Jul 24 04:01:13.274856 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.274819 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3828b21-ec96-4f8d-b932-b4f06ced7add-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pkk9l\" (UID: \"a3828b21-ec96-4f8d-b932-b4f06ced7add\") " pod="openshift-insights/insights-runtime-extractor-pkk9l" Jul 24 04:01:13.275015 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.274899 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/646ab979-b371-4653-9751-5f26ec108eca-metrics-tls\") pod \"dns-default-wq5n4\" (UID: \"646ab979-b371-4653-9751-5f26ec108eca\") " pod="openshift-dns/dns-default-wq5n4" Jul 24 04:01:13.275015 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.274917 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/646ab979-b371-4653-9751-5f26ec108eca-tmp-dir\") pod \"dns-default-wq5n4\" (UID: \"646ab979-b371-4653-9751-5f26ec108eca\") " pod="openshift-dns/dns-default-wq5n4" Jul 24 04:01:13.275015 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.274940 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a3828b21-ec96-4f8d-b932-b4f06ced7add-crio-socket\") pod \"insights-runtime-extractor-pkk9l\" (UID: \"a3828b21-ec96-4f8d-b932-b4f06ced7add\") " pod="openshift-insights/insights-runtime-extractor-pkk9l" Jul 24 04:01:13.275015 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.274966 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3828b21-ec96-4f8d-b932-b4f06ced7add-data-volume\") pod \"insights-runtime-extractor-pkk9l\" (UID: \"a3828b21-ec96-4f8d-b932-b4f06ced7add\") " pod="openshift-insights/insights-runtime-extractor-pkk9l" Jul 24 04:01:13.276609 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.276582 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:13.375620 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.375535 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/646ab979-b371-4653-9751-5f26ec108eca-metrics-tls\") pod \"dns-default-wq5n4\" (UID: \"646ab979-b371-4653-9751-5f26ec108eca\") " pod="openshift-dns/dns-default-wq5n4" Jul 24 04:01:13.375620 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.375578 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/646ab979-b371-4653-9751-5f26ec108eca-tmp-dir\") pod \"dns-default-wq5n4\" (UID: \"646ab979-b371-4653-9751-5f26ec108eca\") " pod="openshift-dns/dns-default-wq5n4" Jul 24 04:01:13.375620 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.375604 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a3828b21-ec96-4f8d-b932-b4f06ced7add-crio-socket\") pod \"insights-runtime-extractor-pkk9l\" (UID: \"a3828b21-ec96-4f8d-b932-b4f06ced7add\") " pod="openshift-insights/insights-runtime-extractor-pkk9l" Jul 24 04:01:13.375858 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.375630 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3828b21-ec96-4f8d-b932-b4f06ced7add-data-volume\") pod \"insights-runtime-extractor-pkk9l\" (UID: \"a3828b21-ec96-4f8d-b932-b4f06ced7add\") " pod="openshift-insights/insights-runtime-extractor-pkk9l" Jul 24 04:01:13.375858 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.375673 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1caca312-bb28-46db-ba00-89002a4d2f7f-cert\") pod \"ingress-canary-lq554\" (UID: \"1caca312-bb28-46db-ba00-89002a4d2f7f\") " pod="openshift-ingress-canary/ingress-canary-lq554" Jul 24 04:01:13.375858 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.375693 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f7lvc\" (UniqueName: \"kubernetes.io/projected/1caca312-bb28-46db-ba00-89002a4d2f7f-kube-api-access-f7lvc\") pod \"ingress-canary-lq554\" (UID: \"1caca312-bb28-46db-ba00-89002a4d2f7f\") " pod="openshift-ingress-canary/ingress-canary-lq554" Jul 24 04:01:13.375858 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.375718 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/646ab979-b371-4653-9751-5f26ec108eca-config-volume\") pod \"dns-default-wq5n4\" (UID: \"646ab979-b371-4653-9751-5f26ec108eca\") " pod="openshift-dns/dns-default-wq5n4" Jul 24 04:01:13.375858 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.375740 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76p49\" (UniqueName: \"kubernetes.io/projected/a3828b21-ec96-4f8d-b932-b4f06ced7add-kube-api-access-76p49\") pod \"insights-runtime-extractor-pkk9l\" (UID: \"a3828b21-ec96-4f8d-b932-b4f06ced7add\") " pod="openshift-insights/insights-runtime-extractor-pkk9l" Jul 24 04:01:13.375858 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.375760 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/a3828b21-ec96-4f8d-b932-b4f06ced7add-crio-socket\") pod \"insights-runtime-extractor-pkk9l\" (UID: \"a3828b21-ec96-4f8d-b932-b4f06ced7add\") " pod="openshift-insights/insights-runtime-extractor-pkk9l" Jul 24 04:01:13.375858 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.375770 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bzmkb\" (UniqueName: \"kubernetes.io/projected/646ab979-b371-4653-9751-5f26ec108eca-kube-api-access-bzmkb\") pod \"dns-default-wq5n4\" (UID: \"646ab979-b371-4653-9751-5f26ec108eca\") " pod="openshift-dns/dns-default-wq5n4" Jul 24 04:01:13.375858 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.375824 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3828b21-ec96-4f8d-b932-b4f06ced7add-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pkk9l\" (UID: \"a3828b21-ec96-4f8d-b932-b4f06ced7add\") " pod="openshift-insights/insights-runtime-extractor-pkk9l" Jul 24 04:01:13.375858 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.375852 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3828b21-ec96-4f8d-b932-b4f06ced7add-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pkk9l\" (UID: \"a3828b21-ec96-4f8d-b932-b4f06ced7add\") " pod="openshift-insights/insights-runtime-extractor-pkk9l" Jul 24 04:01:13.376277 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.375961 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/646ab979-b371-4653-9751-5f26ec108eca-tmp-dir\") pod \"dns-default-wq5n4\" (UID: \"646ab979-b371-4653-9751-5f26ec108eca\") " pod="openshift-dns/dns-default-wq5n4" Jul 24 04:01:13.376277 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.376030 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/a3828b21-ec96-4f8d-b932-b4f06ced7add-data-volume\") pod \"insights-runtime-extractor-pkk9l\" (UID: \"a3828b21-ec96-4f8d-b932-b4f06ced7add\") " pod="openshift-insights/insights-runtime-extractor-pkk9l" Jul 24 04:01:13.376381 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.376357 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/646ab979-b371-4653-9751-5f26ec108eca-config-volume\") pod \"dns-default-wq5n4\" (UID: \"646ab979-b371-4653-9751-5f26ec108eca\") " pod="openshift-dns/dns-default-wq5n4" Jul 24 04:01:13.376496 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.376457 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/a3828b21-ec96-4f8d-b932-b4f06ced7add-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-pkk9l\" (UID: \"a3828b21-ec96-4f8d-b932-b4f06ced7add\") " pod="openshift-insights/insights-runtime-extractor-pkk9l" Jul 24 04:01:13.380888 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.380858 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/a3828b21-ec96-4f8d-b932-b4f06ced7add-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-pkk9l\" (UID: \"a3828b21-ec96-4f8d-b932-b4f06ced7add\") " pod="openshift-insights/insights-runtime-extractor-pkk9l" Jul 24 04:01:13.381017 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.380982 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/646ab979-b371-4653-9751-5f26ec108eca-metrics-tls\") pod \"dns-default-wq5n4\" (UID: \"646ab979-b371-4653-9751-5f26ec108eca\") " pod="openshift-dns/dns-default-wq5n4" Jul 24 04:01:13.381061 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.381039 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/1caca312-bb28-46db-ba00-89002a4d2f7f-cert\") pod \"ingress-canary-lq554\" (UID: \"1caca312-bb28-46db-ba00-89002a4d2f7f\") " pod="openshift-ingress-canary/ingress-canary-lq554" Jul 24 04:01:13.383617 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.383595 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f7lvc\" (UniqueName: \"kubernetes.io/projected/1caca312-bb28-46db-ba00-89002a4d2f7f-kube-api-access-f7lvc\") pod \"ingress-canary-lq554\" (UID: \"1caca312-bb28-46db-ba00-89002a4d2f7f\") " pod="openshift-ingress-canary/ingress-canary-lq554" Jul 24 04:01:13.383722 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.383634 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bzmkb\" (UniqueName: \"kubernetes.io/projected/646ab979-b371-4653-9751-5f26ec108eca-kube-api-access-bzmkb\") pod \"dns-default-wq5n4\" (UID: \"646ab979-b371-4653-9751-5f26ec108eca\") " pod="openshift-dns/dns-default-wq5n4" Jul 24 04:01:13.383722 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.383655 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-76p49\" (UniqueName: \"kubernetes.io/projected/a3828b21-ec96-4f8d-b932-b4f06ced7add-kube-api-access-76p49\") pod \"insights-runtime-extractor-pkk9l\" (UID: \"a3828b21-ec96-4f8d-b932-b4f06ced7add\") " pod="openshift-insights/insights-runtime-extractor-pkk9l" Jul 24 04:01:13.426393 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.426359 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-lq554" Jul 24 04:01:13.435571 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.435549 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-pkk9l" Jul 24 04:01:13.451558 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.451527 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-wq5n4" Jul 24 04:01:13.617997 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.617818 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-pkk9l"] Jul 24 04:01:13.621824 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:01:13.621775 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda3828b21_ec96_4f8d_b932_b4f06ced7add.slice/crio-1d6237e0628d4876e52239a3daa18fff3be4cc373a65d9f582b054cdfd0dc16f WatchSource:0}: Error finding container 1d6237e0628d4876e52239a3daa18fff3be4cc373a65d9f582b054cdfd0dc16f: Status 404 returned error can't find the container with id 1d6237e0628d4876e52239a3daa18fff3be4cc373a65d9f582b054cdfd0dc16f Jul 24 04:01:13.622003 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.621973 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-lq554"] Jul 24 04:01:13.625338 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:01:13.625313 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1caca312_bb28_46db_ba00_89002a4d2f7f.slice/crio-8b9979bbcf153400da60848f61dfe8fd5a3e6d4d38b59e615c362b20dee56ade WatchSource:0}: Error finding container 8b9979bbcf153400da60848f61dfe8fd5a3e6d4d38b59e615c362b20dee56ade: Status 404 returned error can't find the container with id 8b9979bbcf153400da60848f61dfe8fd5a3e6d4d38b59e615c362b20dee56ade Jul 24 04:01:13.630595 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.630570 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-wq5n4"] Jul 24 04:01:13.633839 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:01:13.633812 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod646ab979_b371_4653_9751_5f26ec108eca.slice/crio-85cb8bfc1d65dee1079a5b923d3800be9db324a5ba79bd7b2acc3f41038f7043 WatchSource:0}: Error finding container 85cb8bfc1d65dee1079a5b923d3800be9db324a5ba79bd7b2acc3f41038f7043: Status 404 returned error can't find the container with id 85cb8bfc1d65dee1079a5b923d3800be9db324a5ba79bd7b2acc3f41038f7043 Jul 24 04:01:13.937366 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.937277 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:01:13.937578 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.937276 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:01:13.937578 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.937291 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:01:13.940862 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.940837 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 04:01:13.940862 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.940842 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j89kf\"" Jul 24 04:01:13.941064 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.940943 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 04:01:13.941064 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.941012 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 04:01:13.941064 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.941039 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 04:01:13.941195 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.941179 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dtpl8\"" Jul 24 04:01:13.996367 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:13.996334 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:14.096659 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.096624 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:14.203180 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.203087 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:14.229929 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.229899 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-xknpk"] Jul 24 04:01:14.235890 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.235864 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-xknpk" Jul 24 04:01:14.240506 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.240266 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 24 04:01:14.240650 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.240540 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 24 04:01:14.240650 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.240596 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-xtj52\"" Jul 24 04:01:14.241197 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.240828 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 24 04:01:14.241197 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.240869 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 24 04:01:14.241197 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.240828 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 24 04:01:14.241990 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.241707 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-xknpk"] Jul 24 04:01:14.251863 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.251829 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pkk9l" event={"ID":"a3828b21-ec96-4f8d-b932-b4f06ced7add","Type":"ContainerStarted","Data":"1d6237e0628d4876e52239a3daa18fff3be4cc373a65d9f582b054cdfd0dc16f"} Jul 24 04:01:14.258081 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.258050 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lq554" event={"ID":"1caca312-bb28-46db-ba00-89002a4d2f7f","Type":"ContainerStarted","Data":"8b9979bbcf153400da60848f61dfe8fd5a3e6d4d38b59e615c362b20dee56ade"} Jul 24 04:01:14.261876 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.261845 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wq5n4" event={"ID":"646ab979-b371-4653-9751-5f26ec108eca","Type":"ContainerStarted","Data":"85cb8bfc1d65dee1079a5b923d3800be9db324a5ba79bd7b2acc3f41038f7043"} Jul 24 04:01:14.265819 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.265788 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:14.330191 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.330154 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:14.383407 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.383369 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5603c6a-3a7a-4dd4-aa89-fd405d7757e8-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-xknpk\" (UID: \"b5603c6a-3a7a-4dd4-aa89-fd405d7757e8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xknpk" Jul 24 04:01:14.383633 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.383430 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mgszq\" (UniqueName: \"kubernetes.io/projected/b5603c6a-3a7a-4dd4-aa89-fd405d7757e8-kube-api-access-mgszq\") pod \"prometheus-operator-84d69f794d-xknpk\" (UID: \"b5603c6a-3a7a-4dd4-aa89-fd405d7757e8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xknpk" Jul 24 04:01:14.383633 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.383549 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5603c6a-3a7a-4dd4-aa89-fd405d7757e8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-xknpk\" (UID: \"b5603c6a-3a7a-4dd4-aa89-fd405d7757e8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xknpk" Jul 24 04:01:14.383633 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.383579 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5603c6a-3a7a-4dd4-aa89-fd405d7757e8-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-xknpk\" (UID: \"b5603c6a-3a7a-4dd4-aa89-fd405d7757e8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xknpk" Jul 24 04:01:14.484460 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.484358 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5603c6a-3a7a-4dd4-aa89-fd405d7757e8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-xknpk\" (UID: \"b5603c6a-3a7a-4dd4-aa89-fd405d7757e8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xknpk" Jul 24 04:01:14.484460 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.484426 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5603c6a-3a7a-4dd4-aa89-fd405d7757e8-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-xknpk\" (UID: \"b5603c6a-3a7a-4dd4-aa89-fd405d7757e8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xknpk" Jul 24 04:01:14.484720 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.484496 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5603c6a-3a7a-4dd4-aa89-fd405d7757e8-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-xknpk\" (UID: \"b5603c6a-3a7a-4dd4-aa89-fd405d7757e8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xknpk" Jul 24 04:01:14.484720 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.484531 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mgszq\" (UniqueName: \"kubernetes.io/projected/b5603c6a-3a7a-4dd4-aa89-fd405d7757e8-kube-api-access-mgszq\") pod \"prometheus-operator-84d69f794d-xknpk\" (UID: \"b5603c6a-3a7a-4dd4-aa89-fd405d7757e8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xknpk" Jul 24 04:01:14.485345 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.485318 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b5603c6a-3a7a-4dd4-aa89-fd405d7757e8-metrics-client-ca\") pod \"prometheus-operator-84d69f794d-xknpk\" (UID: \"b5603c6a-3a7a-4dd4-aa89-fd405d7757e8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xknpk" Jul 24 04:01:14.490646 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.490615 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b5603c6a-3a7a-4dd4-aa89-fd405d7757e8-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-84d69f794d-xknpk\" (UID: \"b5603c6a-3a7a-4dd4-aa89-fd405d7757e8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xknpk" Jul 24 04:01:14.493919 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.493867 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/b5603c6a-3a7a-4dd4-aa89-fd405d7757e8-prometheus-operator-tls\") pod \"prometheus-operator-84d69f794d-xknpk\" (UID: \"b5603c6a-3a7a-4dd4-aa89-fd405d7757e8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xknpk" Jul 24 04:01:14.503006 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.502976 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mgszq\" (UniqueName: \"kubernetes.io/projected/b5603c6a-3a7a-4dd4-aa89-fd405d7757e8-kube-api-access-mgszq\") pod \"prometheus-operator-84d69f794d-xknpk\" (UID: \"b5603c6a-3a7a-4dd4-aa89-fd405d7757e8\") " pod="openshift-monitoring/prometheus-operator-84d69f794d-xknpk" Jul 24 04:01:14.551034 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.550996 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-84d69f794d-xknpk" Jul 24 04:01:14.753087 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:14.752984 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-84d69f794d-xknpk"] Jul 24 04:01:14.763338 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:01:14.763305 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5603c6a_3a7a_4dd4_aa89_fd405d7757e8.slice/crio-b064af982e7239b3d0afc7c40a8a416e3b95b4f6882761c2bb7abafed98c067c WatchSource:0}: Error finding container b064af982e7239b3d0afc7c40a8a416e3b95b4f6882761c2bb7abafed98c067c: Status 404 returned error can't find the container with id b064af982e7239b3d0afc7c40a8a416e3b95b4f6882761c2bb7abafed98c067c Jul 24 04:01:15.266707 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:15.266664 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-xknpk" event={"ID":"b5603c6a-3a7a-4dd4-aa89-fd405d7757e8","Type":"ContainerStarted","Data":"b064af982e7239b3d0afc7c40a8a416e3b95b4f6882761c2bb7abafed98c067c"} Jul 24 04:01:15.882819 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:15.882786 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:17.275304 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:17.275268 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-lq554" event={"ID":"1caca312-bb28-46db-ba00-89002a4d2f7f","Type":"ContainerStarted","Data":"724f80bc3c5ddf8391e4c50f02f5254d73753ce1d11a45cfaa381d1783f2c083"} Jul 24 04:01:17.277233 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:17.277202 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wq5n4" event={"ID":"646ab979-b371-4653-9751-5f26ec108eca","Type":"ContainerStarted","Data":"26d42836a63808c3ae066fd66950ea05ceadfacfb5c80154302ab6a9ab5b79da"} Jul 24 04:01:17.279159 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:17.279135 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-xknpk" event={"ID":"b5603c6a-3a7a-4dd4-aa89-fd405d7757e8","Type":"ContainerStarted","Data":"e44538ded35743ad4ab959e9a39adffe04baa818337c2ec57ed5fb2450619012"} Jul 24 04:01:17.290831 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:17.289728 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-lq554" podStartSLOduration=0.867894483 podStartE2EDuration="4.289704713s" totalImagesPullingTime="3.42181023s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:17.289541274 +0000 UTC m=+59.035914859" watchObservedRunningTime="2026-07-24 04:01:17.289704713 +0000 UTC m=+59.036078297" Jul 24 04:01:17.371868 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:17.371838 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:17.480774 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:17.480732 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:17.535227 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:17.535198 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:17.901964 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:17.901930 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:17.951549 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:17.951501 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:20.174649 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:20.174624 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-gl4b9" Jul 24 04:01:20.292835 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:20.292794 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pkk9l" event={"ID":"a3828b21-ec96-4f8d-b932-b4f06ced7add","Type":"ContainerStarted","Data":"c13c8f6ca8e94bb912fa9066e56dbb97eea194842b4f1f3db784bbc9e4004198"} Jul 24 04:01:20.294740 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:20.294707 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-84d69f794d-xknpk" event={"ID":"b5603c6a-3a7a-4dd4-aa89-fd405d7757e8","Type":"ContainerStarted","Data":"90febde84cbc10785bc63a94efe4dd9f514e27cb1ce42f772d1105d9e13cc770"} Jul 24 04:01:20.296489 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:20.296451 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-wq5n4" event={"ID":"646ab979-b371-4653-9751-5f26ec108eca","Type":"ContainerStarted","Data":"78d750317726069a18a1babc7d50ece3a4e37ede76f1894f0e56ad608d389bbc"} Jul 24 04:01:20.296631 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:20.296580 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-wq5n4" Jul 24 04:01:20.312305 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:20.312250 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-84d69f794d-xknpk" podStartSLOduration=4.031675186 podStartE2EDuration="6.312234085s" totalImagesPullingTime="2.280558899s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:01:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:20.311313197 +0000 UTC m=+62.057686779" watchObservedRunningTime="2026-07-24 04:01:20.312234085 +0000 UTC m=+62.058607668" Jul 24 04:01:20.325671 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:20.325640 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:20.330628 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:20.330583 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-wq5n4" podStartSLOduration=3.922435274 podStartE2EDuration="7.330566838s" totalImagesPullingTime="3.408131564s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:01:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:20.329548789 +0000 UTC m=+62.075922371" watchObservedRunningTime="2026-07-24 04:01:20.330566838 +0000 UTC m=+62.076940465" Jul 24 04:01:20.535894 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:20.535865 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:22.111463 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.111426 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:22.211592 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.211552 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:22.317805 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.317768 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:22.418854 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.418762 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:22.558742 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.558709 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:22.567568 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.567505 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g"] Jul 24 04:01:22.585071 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.585036 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g"] Jul 24 04:01:22.585252 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.585220 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" Jul 24 04:01:22.588042 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.587984 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 24 04:01:22.588216 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.588074 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-pxgjc\"" Jul 24 04:01:22.589083 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.589008 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 24 04:01:22.589218 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.589114 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 24 04:01:22.592024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.591998 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-7cbxn"] Jul 24 04:01:22.596640 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.596619 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.598824 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.598775 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 24 04:01:22.598965 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.598944 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-rdgpg\"" Jul 24 04:01:22.599040 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.598967 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 24 04:01:22.599253 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.599233 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 24 04:01:22.689582 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.689503 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:22.755721 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.755679 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d08624c-3e69-41df-90cb-13713c13ed7c-metrics-client-ca\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.755877 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.755795 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7d08624c-3e69-41df-90cb-13713c13ed7c-node-exporter-wtmp\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.755877 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.755859 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6hht\" (UniqueName: \"kubernetes.io/projected/7d08624c-3e69-41df-90cb-13713c13ed7c-kube-api-access-c6hht\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.756034 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.755883 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b21856df-0512-432d-8d47-c80f296da089-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-8wp2g\" (UID: \"b21856df-0512-432d-8d47-c80f296da089\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" Jul 24 04:01:22.756034 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.755908 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b21856df-0512-432d-8d47-c80f296da089-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-8wp2g\" (UID: \"b21856df-0512-432d-8d47-c80f296da089\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" Jul 24 04:01:22.756034 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.755940 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d08624c-3e69-41df-90cb-13713c13ed7c-sys\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.756034 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.755962 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7d08624c-3e69-41df-90cb-13713c13ed7c-node-exporter-tls\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.756034 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.755979 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b21856df-0512-432d-8d47-c80f296da089-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-8wp2g\" (UID: \"b21856df-0512-432d-8d47-c80f296da089\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" Jul 24 04:01:22.756034 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.756005 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b21856df-0512-432d-8d47-c80f296da089-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-8wp2g\" (UID: \"b21856df-0512-432d-8d47-c80f296da089\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" Jul 24 04:01:22.756308 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.756075 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7d08624c-3e69-41df-90cb-13713c13ed7c-root\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.756308 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.756093 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7d08624c-3e69-41df-90cb-13713c13ed7c-node-exporter-textfile\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.756308 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.756163 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d08624c-3e69-41df-90cb-13713c13ed7c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.756308 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.756219 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7d08624c-3e69-41df-90cb-13713c13ed7c-node-exporter-accelerators-collector-config\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.756308 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.756247 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m7x5\" (UniqueName: \"kubernetes.io/projected/b21856df-0512-432d-8d47-c80f296da089-kube-api-access-6m7x5\") pod \"kube-state-metrics-56d9f944b4-8wp2g\" (UID: \"b21856df-0512-432d-8d47-c80f296da089\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" Jul 24 04:01:22.756308 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.756285 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b21856df-0512-432d-8d47-c80f296da089-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-8wp2g\" (UID: \"b21856df-0512-432d-8d47-c80f296da089\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" Jul 24 04:01:22.779755 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.779708 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:22.857448 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.857411 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d08624c-3e69-41df-90cb-13713c13ed7c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.857448 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.857454 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7d08624c-3e69-41df-90cb-13713c13ed7c-node-exporter-accelerators-collector-config\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.857708 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.857499 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m7x5\" (UniqueName: \"kubernetes.io/projected/b21856df-0512-432d-8d47-c80f296da089-kube-api-access-6m7x5\") pod \"kube-state-metrics-56d9f944b4-8wp2g\" (UID: \"b21856df-0512-432d-8d47-c80f296da089\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" Jul 24 04:01:22.857708 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.857536 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b21856df-0512-432d-8d47-c80f296da089-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-8wp2g\" (UID: \"b21856df-0512-432d-8d47-c80f296da089\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" Jul 24 04:01:22.857708 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.857596 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d08624c-3e69-41df-90cb-13713c13ed7c-metrics-client-ca\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.857708 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.857635 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7d08624c-3e69-41df-90cb-13713c13ed7c-node-exporter-wtmp\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.857708 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.857665 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6hht\" (UniqueName: \"kubernetes.io/projected/7d08624c-3e69-41df-90cb-13713c13ed7c-kube-api-access-c6hht\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.857708 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.857689 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b21856df-0512-432d-8d47-c80f296da089-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-8wp2g\" (UID: \"b21856df-0512-432d-8d47-c80f296da089\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" Jul 24 04:01:22.857999 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.857712 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b21856df-0512-432d-8d47-c80f296da089-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-8wp2g\" (UID: \"b21856df-0512-432d-8d47-c80f296da089\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" Jul 24 04:01:22.857999 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.857775 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d08624c-3e69-41df-90cb-13713c13ed7c-sys\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.857999 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.857803 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7d08624c-3e69-41df-90cb-13713c13ed7c-node-exporter-tls\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.857999 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.857826 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b21856df-0512-432d-8d47-c80f296da089-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-8wp2g\" (UID: \"b21856df-0512-432d-8d47-c80f296da089\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" Jul 24 04:01:22.857999 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.857857 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b21856df-0512-432d-8d47-c80f296da089-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-8wp2g\" (UID: \"b21856df-0512-432d-8d47-c80f296da089\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" Jul 24 04:01:22.857999 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.857864 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/7d08624c-3e69-41df-90cb-13713c13ed7c-node-exporter-wtmp\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.857999 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:22.857972 2563 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 24 04:01:22.858348 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:01:22.858040 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d08624c-3e69-41df-90cb-13713c13ed7c-node-exporter-tls podName:7d08624c-3e69-41df-90cb-13713c13ed7c nodeName:}" failed. No retries permitted until 2026-07-24 04:01:23.358019823 +0000 UTC m=+65.104393398 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/7d08624c-3e69-41df-90cb-13713c13ed7c-node-exporter-tls") pod "node-exporter-7cbxn" (UID: "7d08624c-3e69-41df-90cb-13713c13ed7c") : secret "node-exporter-tls" not found Jul 24 04:01:22.858348 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.858186 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/7d08624c-3e69-41df-90cb-13713c13ed7c-node-exporter-accelerators-collector-config\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.858348 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.858192 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7d08624c-3e69-41df-90cb-13713c13ed7c-root\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.858348 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.858255 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7d08624c-3e69-41df-90cb-13713c13ed7c-node-exporter-textfile\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.858348 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.858286 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/7d08624c-3e69-41df-90cb-13713c13ed7c-root\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.858348 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.858255 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/7d08624c-3e69-41df-90cb-13713c13ed7c-sys\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.858690 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.858406 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b21856df-0512-432d-8d47-c80f296da089-metrics-client-ca\") pod \"kube-state-metrics-56d9f944b4-8wp2g\" (UID: \"b21856df-0512-432d-8d47-c80f296da089\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" Jul 24 04:01:22.858690 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.858506 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/b21856df-0512-432d-8d47-c80f296da089-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-56d9f944b4-8wp2g\" (UID: \"b21856df-0512-432d-8d47-c80f296da089\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" Jul 24 04:01:22.858690 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.858569 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/7d08624c-3e69-41df-90cb-13713c13ed7c-node-exporter-textfile\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.858844 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.858729 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/b21856df-0512-432d-8d47-c80f296da089-volume-directive-shadow\") pod \"kube-state-metrics-56d9f944b4-8wp2g\" (UID: \"b21856df-0512-432d-8d47-c80f296da089\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" Jul 24 04:01:22.858949 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.858928 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d08624c-3e69-41df-90cb-13713c13ed7c-metrics-client-ca\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.860813 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.860787 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b21856df-0512-432d-8d47-c80f296da089-kube-state-metrics-tls\") pod \"kube-state-metrics-56d9f944b4-8wp2g\" (UID: \"b21856df-0512-432d-8d47-c80f296da089\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" Jul 24 04:01:22.860954 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.860823 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b21856df-0512-432d-8d47-c80f296da089-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-56d9f944b4-8wp2g\" (UID: \"b21856df-0512-432d-8d47-c80f296da089\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" Jul 24 04:01:22.860954 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.860885 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d08624c-3e69-41df-90cb-13713c13ed7c-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.865592 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.865567 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m7x5\" (UniqueName: \"kubernetes.io/projected/b21856df-0512-432d-8d47-c80f296da089-kube-api-access-6m7x5\") pod \"kube-state-metrics-56d9f944b4-8wp2g\" (UID: \"b21856df-0512-432d-8d47-c80f296da089\") " pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" Jul 24 04:01:22.865712 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.865652 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6hht\" (UniqueName: \"kubernetes.io/projected/7d08624c-3e69-41df-90cb-13713c13ed7c-kube-api-access-c6hht\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:22.878335 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.878312 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:22.897320 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.897276 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" Jul 24 04:01:22.997221 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:22.997186 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:23.085251 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.085210 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:23.262890 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.262800 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:23.363204 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.363168 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7d08624c-3e69-41df-90cb-13713c13ed7c-node-exporter-tls\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:23.365887 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.365858 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/7d08624c-3e69-41df-90cb-13713c13ed7c-node-exporter-tls\") pod \"node-exporter-7cbxn\" (UID: \"7d08624c-3e69-41df-90cb-13713c13ed7c\") " pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:23.464395 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.464328 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mkqn\" (UniqueName: \"kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn\") pod \"network-check-target-5sckg\" (UID: \"b37181f3-c3b8-478d-825d-6c9582911304\") " pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:01:23.467669 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.467648 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 24 04:01:23.477658 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.477630 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 24 04:01:23.488278 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.488244 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mkqn\" (UniqueName: \"kubernetes.io/projected/b37181f3-c3b8-478d-825d-6c9582911304-kube-api-access-6mkqn\") pod \"network-check-target-5sckg\" (UID: \"b37181f3-c3b8-478d-825d-6c9582911304\") " pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:01:23.507192 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.507164 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-7cbxn" Jul 24 04:01:23.556090 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.556018 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-j89kf\"" Jul 24 04:01:23.564303 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.564275 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:01:23.564994 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.564953 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret\") pod \"global-pull-secret-syncer-7v47c\" (UID: \"e98f98aa-332c-44a4-912f-985762f6a84f\") " pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:01:23.565130 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.564998 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs\") pod \"network-metrics-daemon-l9w8m\" (UID: \"c7fb9480-376d-487f-bfdf-386603ce759c\") " pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:01:23.565195 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:01:23.565122 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d08624c_3e69_41df_90cb_13713c13ed7c.slice/crio-4e3e30d7997060563ad7cf5ffc00d8e6e8ab2c67be0afa1a358ecb3c814f1286 WatchSource:0}: Error finding container 4e3e30d7997060563ad7cf5ffc00d8e6e8ab2c67be0afa1a358ecb3c814f1286: Status 404 returned error can't find the container with id 4e3e30d7997060563ad7cf5ffc00d8e6e8ab2c67be0afa1a358ecb3c814f1286 Jul 24 04:01:23.567768 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.567750 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 24 04:01:23.567858 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.567752 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 24 04:01:23.575115 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.575091 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:23.578077 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.578045 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/c7fb9480-376d-487f-bfdf-386603ce759c-metrics-certs\") pod \"network-metrics-daemon-l9w8m\" (UID: \"c7fb9480-376d-487f-bfdf-386603ce759c\") " pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:01:23.578176 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.578114 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/e98f98aa-332c-44a4-912f-985762f6a84f-original-pull-secret\") pod \"global-pull-secret-syncer-7v47c\" (UID: \"e98f98aa-332c-44a4-912f-985762f6a84f\") " pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:01:23.658054 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.658024 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:23.710604 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.710565 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g"] Jul 24 04:01:23.713970 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:01:23.713944 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb21856df_0512_432d_8d47_c80f296da089.slice/crio-8842d599d6cdb338c918d22386ece6a3baee9707b3ca8322ee7de88a61700e2d WatchSource:0}: Error finding container 8842d599d6cdb338c918d22386ece6a3baee9707b3ca8322ee7de88a61700e2d: Status 404 returned error can't find the container with id 8842d599d6cdb338c918d22386ece6a3baee9707b3ca8322ee7de88a61700e2d Jul 24 04:01:23.724410 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.724386 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-5sckg"] Jul 24 04:01:23.728083 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:01:23.728059 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb37181f3_c3b8_478d_825d_6c9582911304.slice/crio-f986c5c8bc45c733d79f3f1272b187da443b243652b8cfb2bd3535c88c50611a WatchSource:0}: Error finding container f986c5c8bc45c733d79f3f1272b187da443b243652b8cfb2bd3535c88c50611a: Status 404 returned error can't find the container with id f986c5c8bc45c733d79f3f1272b187da443b243652b8cfb2bd3535c88c50611a Jul 24 04:01:23.850908 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.850821 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-dtpl8\"" Jul 24 04:01:23.858934 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.858910 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-l9w8m" Jul 24 04:01:23.859043 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:23.859022 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-7v47c" Jul 24 04:01:24.003769 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:24.003467 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-7v47c"] Jul 24 04:01:24.006137 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:01:24.006104 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode98f98aa_332c_44a4_912f_985762f6a84f.slice/crio-c71baedfd5b61219346475a3aab2ff22f6b1ecde1afce9998c76736d593a8381 WatchSource:0}: Error finding container c71baedfd5b61219346475a3aab2ff22f6b1ecde1afce9998c76736d593a8381: Status 404 returned error can't find the container with id c71baedfd5b61219346475a3aab2ff22f6b1ecde1afce9998c76736d593a8381 Jul 24 04:01:24.017067 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:24.017043 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-l9w8m"] Jul 24 04:01:24.019655 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:01:24.019616 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc7fb9480_376d_487f_bfdf_386603ce759c.slice/crio-fbfc087a1ce4fc2d80368ee75bdaff3be2693790e49ef2f21ecb508550d247e8 WatchSource:0}: Error finding container fbfc087a1ce4fc2d80368ee75bdaff3be2693790e49ef2f21ecb508550d247e8: Status 404 returned error can't find the container with id fbfc087a1ce4fc2d80368ee75bdaff3be2693790e49ef2f21ecb508550d247e8 Jul 24 04:01:24.141366 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:24.141261 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:24.314257 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:24.314216 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l9w8m" event={"ID":"c7fb9480-376d-487f-bfdf-386603ce759c","Type":"ContainerStarted","Data":"fbfc087a1ce4fc2d80368ee75bdaff3be2693790e49ef2f21ecb508550d247e8"} Jul 24 04:01:24.318207 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:24.318174 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pkk9l" event={"ID":"a3828b21-ec96-4f8d-b932-b4f06ced7add","Type":"ContainerStarted","Data":"3dbb646ec85687aab0825d62fb7df1272c45725defc57dccd7c2f9b78689da34"} Jul 24 04:01:24.321378 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:24.321312 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7v47c" event={"ID":"e98f98aa-332c-44a4-912f-985762f6a84f","Type":"ContainerStarted","Data":"c71baedfd5b61219346475a3aab2ff22f6b1ecde1afce9998c76736d593a8381"} Jul 24 04:01:24.323385 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:24.323295 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5sckg" event={"ID":"b37181f3-c3b8-478d-825d-6c9582911304","Type":"ContainerStarted","Data":"f986c5c8bc45c733d79f3f1272b187da443b243652b8cfb2bd3535c88c50611a"} Jul 24 04:01:24.326302 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:24.326233 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7cbxn" event={"ID":"7d08624c-3e69-41df-90cb-13713c13ed7c","Type":"ContainerStarted","Data":"4e3e30d7997060563ad7cf5ffc00d8e6e8ab2c67be0afa1a358ecb3c814f1286"} Jul 24 04:01:24.328150 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:24.328077 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" event={"ID":"b21856df-0512-432d-8d47-c80f296da089","Type":"ContainerStarted","Data":"8842d599d6cdb338c918d22386ece6a3baee9707b3ca8322ee7de88a61700e2d"} Jul 24 04:01:24.943105 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:24.943063 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:25.335844 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:25.334917 2563 generic.go:356] "Generic (PLEG): container finished" podID="7d08624c-3e69-41df-90cb-13713c13ed7c" containerID="b1dd647004a45e49f7274da028db8648c570f71e619d900cc0ac9f337ffc8ebe" exitCode=0 Jul 24 04:01:25.335844 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:25.334965 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7cbxn" event={"ID":"7d08624c-3e69-41df-90cb-13713c13ed7c","Type":"ContainerDied","Data":"b1dd647004a45e49f7274da028db8648c570f71e619d900cc0ac9f337ffc8ebe"} Jul 24 04:01:25.516220 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:25.516131 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:25.620076 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:25.620041 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:25.741650 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:25.741589 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:25.855765 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:25.855668 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:25.936696 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:25.936658 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:26.054927 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:26.054884 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:26.347980 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:26.346883 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l9w8m" event={"ID":"c7fb9480-376d-487f-bfdf-386603ce759c","Type":"ContainerStarted","Data":"811d80cc532fab4b5c633569046e4dbc7af9e8b41cfe7f27723fcb2b9371e240"} Jul 24 04:01:26.347980 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:26.347022 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-l9w8m" event={"ID":"c7fb9480-376d-487f-bfdf-386603ce759c","Type":"ContainerStarted","Data":"a0725a3c43957295f4524fdf16de2b0b211ce96c2bd0ad740994cd3e86a3c604"} Jul 24 04:01:26.354171 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:26.353579 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7cbxn" event={"ID":"7d08624c-3e69-41df-90cb-13713c13ed7c","Type":"ContainerStarted","Data":"33620b5ee8b0278d99ad6d002e22c1ae2ad15ca3d040e4ddf7d9fdf0d87f1b8d"} Jul 24 04:01:26.354171 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:26.353636 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-7cbxn" event={"ID":"7d08624c-3e69-41df-90cb-13713c13ed7c","Type":"ContainerStarted","Data":"8064cf12ce6c96184fe8a4bf2a4544c534ef332179527339991824f430379dd8"} Jul 24 04:01:26.358563 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:26.358465 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" event={"ID":"b21856df-0512-432d-8d47-c80f296da089","Type":"ContainerStarted","Data":"3dc7b0f167da1386f5012d845d31508a297f6f038af8927a9bc6c24d720585b8"} Jul 24 04:01:26.358563 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:26.358530 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" event={"ID":"b21856df-0512-432d-8d47-c80f296da089","Type":"ContainerStarted","Data":"0b2a944af56994e2413f41ea49926882928e2918bce45bcbb50cdd5b6e648e03"} Jul 24 04:01:26.358563 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:26.358560 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" event={"ID":"b21856df-0512-432d-8d47-c80f296da089","Type":"ContainerStarted","Data":"6300118e7f95e3def9fb7a950456d9594c2e12b4cd6178535d192b6dd89a9263"} Jul 24 04:01:26.387484 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:26.386089 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-l9w8m" podStartSLOduration=65.688616947 podStartE2EDuration="1m7.38606745s" totalImagesPullingTime="1.697450503s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:26.365398692 +0000 UTC m=+68.111772301" watchObservedRunningTime="2026-07-24 04:01:26.38606745 +0000 UTC m=+68.132441034" Jul 24 04:01:26.387484 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:26.386661 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-56d9f944b4-8wp2g" podStartSLOduration=2.380523828 podStartE2EDuration="4.386648196s" totalImagesPullingTime="2.006124368s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:26.385511977 +0000 UTC m=+68.131885656" watchObservedRunningTime="2026-07-24 04:01:26.386648196 +0000 UTC m=+68.133021779" Jul 24 04:01:26.404893 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:26.404062 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-7cbxn" podStartSLOduration=3.124045673 podStartE2EDuration="4.404039602s" totalImagesPullingTime="1.192774238s" totalInitContainerRuntime="87.219691ms" isStatefulPod=true podCreationTimestamp="2026-07-24 04:01:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:26.403073607 +0000 UTC m=+68.149447194" watchObservedRunningTime="2026-07-24 04:01:26.404039602 +0000 UTC m=+68.150413187" Jul 24 04:01:26.454572 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:26.454514 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:26.509147 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:26.509108 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:26.913458 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:26.913418 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/metrics-server-6898dd96d7-67dkq"] Jul 24 04:01:26.928549 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:26.927259 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6898dd96d7-67dkq"] Jul 24 04:01:26.928549 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:26.927384 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:26.930121 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:26.930090 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-client-certs\"" Jul 24 04:01:26.930374 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:26.930355 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-dockercfg-64fvj\"" Jul 24 04:01:26.931203 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:26.931176 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-tls\"" Jul 24 04:01:26.931311 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:26.931232 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 24 04:01:26.931401 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:26.931388 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-server-audit-profiles\"" Jul 24 04:01:26.931848 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:26.931662 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-server-18eu8gdbfakaf\"" Jul 24 04:01:27.094455 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.094413 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/38a52b98-f0ba-4581-bff2-de37f4c61924-secret-metrics-server-tls\") pod \"metrics-server-6898dd96d7-67dkq\" (UID: \"38a52b98-f0ba-4581-bff2-de37f4c61924\") " pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:27.094654 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.094515 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/38a52b98-f0ba-4581-bff2-de37f4c61924-audit-log\") pod \"metrics-server-6898dd96d7-67dkq\" (UID: \"38a52b98-f0ba-4581-bff2-de37f4c61924\") " pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:27.094654 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.094558 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38a52b98-f0ba-4581-bff2-de37f4c61924-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6898dd96d7-67dkq\" (UID: \"38a52b98-f0ba-4581-bff2-de37f4c61924\") " pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:27.094654 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.094598 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk64l\" (UniqueName: \"kubernetes.io/projected/38a52b98-f0ba-4581-bff2-de37f4c61924-kube-api-access-lk64l\") pod \"metrics-server-6898dd96d7-67dkq\" (UID: \"38a52b98-f0ba-4581-bff2-de37f4c61924\") " pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:27.094799 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.094658 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/38a52b98-f0ba-4581-bff2-de37f4c61924-secret-metrics-server-client-certs\") pod \"metrics-server-6898dd96d7-67dkq\" (UID: \"38a52b98-f0ba-4581-bff2-de37f4c61924\") " pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:27.094799 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.094710 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38a52b98-f0ba-4581-bff2-de37f4c61924-client-ca-bundle\") pod \"metrics-server-6898dd96d7-67dkq\" (UID: \"38a52b98-f0ba-4581-bff2-de37f4c61924\") " pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:27.094799 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.094745 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/38a52b98-f0ba-4581-bff2-de37f4c61924-metrics-server-audit-profiles\") pod \"metrics-server-6898dd96d7-67dkq\" (UID: \"38a52b98-f0ba-4581-bff2-de37f4c61924\") " pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:27.112773 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.112734 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:27.195312 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.195279 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38a52b98-f0ba-4581-bff2-de37f4c61924-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6898dd96d7-67dkq\" (UID: \"38a52b98-f0ba-4581-bff2-de37f4c61924\") " pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:27.195561 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.195323 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk64l\" (UniqueName: \"kubernetes.io/projected/38a52b98-f0ba-4581-bff2-de37f4c61924-kube-api-access-lk64l\") pod \"metrics-server-6898dd96d7-67dkq\" (UID: \"38a52b98-f0ba-4581-bff2-de37f4c61924\") " pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:27.195561 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.195364 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/38a52b98-f0ba-4581-bff2-de37f4c61924-secret-metrics-server-client-certs\") pod \"metrics-server-6898dd96d7-67dkq\" (UID: \"38a52b98-f0ba-4581-bff2-de37f4c61924\") " pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:27.195561 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.195406 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38a52b98-f0ba-4581-bff2-de37f4c61924-client-ca-bundle\") pod \"metrics-server-6898dd96d7-67dkq\" (UID: \"38a52b98-f0ba-4581-bff2-de37f4c61924\") " pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:27.195561 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.195438 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/38a52b98-f0ba-4581-bff2-de37f4c61924-metrics-server-audit-profiles\") pod \"metrics-server-6898dd96d7-67dkq\" (UID: \"38a52b98-f0ba-4581-bff2-de37f4c61924\") " pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:27.195561 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.195517 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/38a52b98-f0ba-4581-bff2-de37f4c61924-secret-metrics-server-tls\") pod \"metrics-server-6898dd96d7-67dkq\" (UID: \"38a52b98-f0ba-4581-bff2-de37f4c61924\") " pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:27.195879 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.195563 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/38a52b98-f0ba-4581-bff2-de37f4c61924-audit-log\") pod \"metrics-server-6898dd96d7-67dkq\" (UID: \"38a52b98-f0ba-4581-bff2-de37f4c61924\") " pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:27.195989 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.195940 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"audit-log\" (UniqueName: \"kubernetes.io/empty-dir/38a52b98-f0ba-4581-bff2-de37f4c61924-audit-log\") pod \"metrics-server-6898dd96d7-67dkq\" (UID: \"38a52b98-f0ba-4581-bff2-de37f4c61924\") " pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:27.196132 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.196111 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/38a52b98-f0ba-4581-bff2-de37f4c61924-configmap-kubelet-serving-ca-bundle\") pod \"metrics-server-6898dd96d7-67dkq\" (UID: \"38a52b98-f0ba-4581-bff2-de37f4c61924\") " pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:27.197107 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.197075 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-server-audit-profiles\" (UniqueName: \"kubernetes.io/configmap/38a52b98-f0ba-4581-bff2-de37f4c61924-metrics-server-audit-profiles\") pod \"metrics-server-6898dd96d7-67dkq\" (UID: \"38a52b98-f0ba-4581-bff2-de37f4c61924\") " pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:27.198925 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.198899 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"client-ca-bundle\" (UniqueName: \"kubernetes.io/secret/38a52b98-f0ba-4581-bff2-de37f4c61924-client-ca-bundle\") pod \"metrics-server-6898dd96d7-67dkq\" (UID: \"38a52b98-f0ba-4581-bff2-de37f4c61924\") " pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:27.199137 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.199109 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-tls\" (UniqueName: \"kubernetes.io/secret/38a52b98-f0ba-4581-bff2-de37f4c61924-secret-metrics-server-tls\") pod \"metrics-server-6898dd96d7-67dkq\" (UID: \"38a52b98-f0ba-4581-bff2-de37f4c61924\") " pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:27.200102 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.200073 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-server-client-certs\" (UniqueName: \"kubernetes.io/secret/38a52b98-f0ba-4581-bff2-de37f4c61924-secret-metrics-server-client-certs\") pod \"metrics-server-6898dd96d7-67dkq\" (UID: \"38a52b98-f0ba-4581-bff2-de37f4c61924\") " pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:27.203628 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.203605 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk64l\" (UniqueName: \"kubernetes.io/projected/38a52b98-f0ba-4581-bff2-de37f4c61924-kube-api-access-lk64l\") pod \"metrics-server-6898dd96d7-67dkq\" (UID: \"38a52b98-f0ba-4581-bff2-de37f4c61924\") " pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:27.213908 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.213877 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:27.241507 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.241454 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:27.303160 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.303130 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-wq5n4" Jul 24 04:01:27.337176 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.337142 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-m6mb5"] Jul 24 04:01:27.344995 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.344913 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:27.354436 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.353686 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-m6mb5"] Jul 24 04:01:27.354436 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.353807 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m6mb5" Jul 24 04:01:27.358441 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.358415 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-v2ddz\"" Jul 24 04:01:27.358747 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.358730 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 24 04:01:27.402542 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.402507 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:27.501204 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.501108 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dppc9\" (UniqueName: \"kubernetes.io/projected/4375272d-87fe-4632-8ad8-4641ef1a7779-kube-api-access-dppc9\") pod \"monitoring-plugin-68b7fc9574-m6mb5\" (UID: \"4375272d-87fe-4632-8ad8-4641ef1a7779\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m6mb5" Jul 24 04:01:27.501372 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.501344 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4375272d-87fe-4632-8ad8-4641ef1a7779-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-m6mb5\" (UID: \"4375272d-87fe-4632-8ad8-4641ef1a7779\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m6mb5" Jul 24 04:01:27.602239 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.602193 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dppc9\" (UniqueName: \"kubernetes.io/projected/4375272d-87fe-4632-8ad8-4641ef1a7779-kube-api-access-dppc9\") pod \"monitoring-plugin-68b7fc9574-m6mb5\" (UID: \"4375272d-87fe-4632-8ad8-4641ef1a7779\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m6mb5" Jul 24 04:01:27.602436 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.602301 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4375272d-87fe-4632-8ad8-4641ef1a7779-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-m6mb5\" (UID: \"4375272d-87fe-4632-8ad8-4641ef1a7779\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m6mb5" Jul 24 04:01:27.605321 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.605289 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/4375272d-87fe-4632-8ad8-4641ef1a7779-monitoring-plugin-cert\") pod \"monitoring-plugin-68b7fc9574-m6mb5\" (UID: \"4375272d-87fe-4632-8ad8-4641ef1a7779\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m6mb5" Jul 24 04:01:27.611233 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.611175 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dppc9\" (UniqueName: \"kubernetes.io/projected/4375272d-87fe-4632-8ad8-4641ef1a7779-kube-api-access-dppc9\") pod \"monitoring-plugin-68b7fc9574-m6mb5\" (UID: \"4375272d-87fe-4632-8ad8-4641ef1a7779\") " pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m6mb5" Jul 24 04:01:27.667764 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.667724 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m6mb5" Jul 24 04:01:27.762403 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.762308 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-677c9d765b-8k949"] Jul 24 04:01:27.802456 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.802415 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-677c9d765b-8k949"] Jul 24 04:01:27.802673 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.802565 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:27.805586 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.805554 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 24 04:01:27.805746 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.805633 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 24 04:01:27.805746 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.805672 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 24 04:01:27.805746 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.805554 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-kckcm\"" Jul 24 04:01:27.805746 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.805554 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 24 04:01:27.805972 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.805554 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 24 04:01:27.811437 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.811391 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 24 04:01:27.904742 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.904703 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d40af9-154e-42d7-9b2b-0829f13bdbfb-serving-certs-ca-bundle\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:27.904742 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.904742 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/10d40af9-154e-42d7-9b2b-0829f13bdbfb-federate-client-tls\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:27.904958 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.904772 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/10d40af9-154e-42d7-9b2b-0829f13bdbfb-telemeter-client-tls\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:27.904958 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.904801 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10d40af9-154e-42d7-9b2b-0829f13bdbfb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:27.904958 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.904868 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/10d40af9-154e-42d7-9b2b-0829f13bdbfb-secret-telemeter-client\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:27.904958 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.904911 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d40af9-154e-42d7-9b2b-0829f13bdbfb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:27.905112 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.904979 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10d40af9-154e-42d7-9b2b-0829f13bdbfb-metrics-client-ca\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:27.905112 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:27.905002 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-k7cl4\" (UniqueName: \"kubernetes.io/projected/10d40af9-154e-42d7-9b2b-0829f13bdbfb-kube-api-access-k7cl4\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:28.006409 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.006369 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/10d40af9-154e-42d7-9b2b-0829f13bdbfb-secret-telemeter-client\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:28.006617 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.006448 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d40af9-154e-42d7-9b2b-0829f13bdbfb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:28.006617 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.006508 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10d40af9-154e-42d7-9b2b-0829f13bdbfb-metrics-client-ca\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:28.006617 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.006544 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-k7cl4\" (UniqueName: \"kubernetes.io/projected/10d40af9-154e-42d7-9b2b-0829f13bdbfb-kube-api-access-k7cl4\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:28.006617 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.006580 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d40af9-154e-42d7-9b2b-0829f13bdbfb-serving-certs-ca-bundle\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:28.006617 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.006609 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/10d40af9-154e-42d7-9b2b-0829f13bdbfb-federate-client-tls\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:28.006903 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.006654 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/10d40af9-154e-42d7-9b2b-0829f13bdbfb-telemeter-client-tls\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:28.006903 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.006680 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10d40af9-154e-42d7-9b2b-0829f13bdbfb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:28.008358 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.007379 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d40af9-154e-42d7-9b2b-0829f13bdbfb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:28.008358 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.007805 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/10d40af9-154e-42d7-9b2b-0829f13bdbfb-serving-certs-ca-bundle\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:28.008358 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.008325 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/10d40af9-154e-42d7-9b2b-0829f13bdbfb-metrics-client-ca\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:28.010065 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.010034 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/10d40af9-154e-42d7-9b2b-0829f13bdbfb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:28.010179 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.010150 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/10d40af9-154e-42d7-9b2b-0829f13bdbfb-telemeter-client-tls\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:28.010791 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.010766 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/10d40af9-154e-42d7-9b2b-0829f13bdbfb-secret-telemeter-client\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:28.011140 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.011119 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/10d40af9-154e-42d7-9b2b-0829f13bdbfb-federate-client-tls\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:28.016840 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.016783 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-k7cl4\" (UniqueName: \"kubernetes.io/projected/10d40af9-154e-42d7-9b2b-0829f13bdbfb-kube-api-access-k7cl4\") pod \"telemeter-client-677c9d765b-8k949\" (UID: \"10d40af9-154e-42d7-9b2b-0829f13bdbfb\") " pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:28.080283 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.080239 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:28.116633 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.116585 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" Jul 24 04:01:28.131518 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.131461 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:28.800144 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.800039 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:28.813554 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.813523 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-7c97dc4555-4dnhg"] Jul 24 04:01:28.820404 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.819857 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-4dnhg" Jul 24 04:01:28.822848 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.822825 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-5vkc2\"" Jul 24 04:01:28.822997 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.822827 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 24 04:01:28.823189 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.823176 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 24 04:01:28.827887 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.827862 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-4dnhg"] Jul 24 04:01:28.867377 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.867306 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:28.955366 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:28.955324 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:29.015449 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:29.015382 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4vd48\" (UniqueName: \"kubernetes.io/projected/6bf01f68-a821-4198-b02c-099d27d3669a-kube-api-access-4vd48\") pod \"downloads-7c97dc4555-4dnhg\" (UID: \"6bf01f68-a821-4198-b02c-099d27d3669a\") " pod="openshift-console/downloads-7c97dc4555-4dnhg" Jul 24 04:01:29.091064 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:29.090927 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:29.116978 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:29.116927 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4vd48\" (UniqueName: \"kubernetes.io/projected/6bf01f68-a821-4198-b02c-099d27d3669a-kube-api-access-4vd48\") pod \"downloads-7c97dc4555-4dnhg\" (UID: \"6bf01f68-a821-4198-b02c-099d27d3669a\") " pod="openshift-console/downloads-7c97dc4555-4dnhg" Jul 24 04:01:29.126273 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:29.126210 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4vd48\" (UniqueName: \"kubernetes.io/projected/6bf01f68-a821-4198-b02c-099d27d3669a-kube-api-access-4vd48\") pod \"downloads-7c97dc4555-4dnhg\" (UID: \"6bf01f68-a821-4198-b02c-099d27d3669a\") " pod="openshift-console/downloads-7c97dc4555-4dnhg" Jul 24 04:01:29.138240 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:29.137973 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-7c97dc4555-4dnhg" Jul 24 04:01:29.191865 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:29.191832 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:29.295861 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:29.295742 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:29.401246 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:29.401139 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:29.693900 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:29.693865 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:29.759642 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:29.759609 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:29.905451 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:29.905414 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:30.005748 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:30.005662 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:30.125930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:30.125894 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:30.597571 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:30.597531 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:30.698355 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:30.698322 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:31.132500 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:31.132410 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-68b7fc9574-m6mb5"] Jul 24 04:01:31.134999 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:01:31.134960 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4375272d_87fe_4632_8ad8_4641ef1a7779.slice/crio-6d4727a49c63177fc73a3b67dad6ed13264d92fb345845967273c4faafb28ea4 WatchSource:0}: Error finding container 6d4727a49c63177fc73a3b67dad6ed13264d92fb345845967273c4faafb28ea4: Status 404 returned error can't find the container with id 6d4727a49c63177fc73a3b67dad6ed13264d92fb345845967273c4faafb28ea4 Jul 24 04:01:31.146713 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:31.146571 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-7c97dc4555-4dnhg"] Jul 24 04:01:31.150892 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:01:31.150850 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6bf01f68_a821_4198_b02c_099d27d3669a.slice/crio-bcf65033d6cc690cb698e7e410d826c02026435bf74648d67d07ff9bf0ecc9ef WatchSource:0}: Error finding container bcf65033d6cc690cb698e7e410d826c02026435bf74648d67d07ff9bf0ecc9ef: Status 404 returned error can't find the container with id bcf65033d6cc690cb698e7e410d826c02026435bf74648d67d07ff9bf0ecc9ef Jul 24 04:01:31.163045 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:31.163013 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/metrics-server-6898dd96d7-67dkq"] Jul 24 04:01:31.166610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:31.166559 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-677c9d765b-8k949"] Jul 24 04:01:31.167967 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:01:31.167922 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod38a52b98_f0ba_4581_bff2_de37f4c61924.slice/crio-17949abf075e4768adcf633d43715ab53699f19eda5e167cc840e7ebcf04cd04 WatchSource:0}: Error finding container 17949abf075e4768adcf633d43715ab53699f19eda5e167cc840e7ebcf04cd04: Status 404 returned error can't find the container with id 17949abf075e4768adcf633d43715ab53699f19eda5e167cc840e7ebcf04cd04 Jul 24 04:01:31.171027 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:01:31.170957 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod10d40af9_154e_42d7_9b2b_0829f13bdbfb.slice/crio-87baabc29a0d2b3cf4b00dae63ee41a16a36ecfc30b5d0b6b13eac24a1f4bf69 WatchSource:0}: Error finding container 87baabc29a0d2b3cf4b00dae63ee41a16a36ecfc30b5d0b6b13eac24a1f4bf69: Status 404 returned error can't find the container with id 87baabc29a0d2b3cf4b00dae63ee41a16a36ecfc30b5d0b6b13eac24a1f4bf69 Jul 24 04:01:31.359205 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:31.359173 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:31.380231 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:31.380192 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" event={"ID":"10d40af9-154e-42d7-9b2b-0829f13bdbfb","Type":"ContainerStarted","Data":"87baabc29a0d2b3cf4b00dae63ee41a16a36ecfc30b5d0b6b13eac24a1f4bf69"} Jul 24 04:01:31.382287 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:31.382239 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-pkk9l" event={"ID":"a3828b21-ec96-4f8d-b932-b4f06ced7add","Type":"ContainerStarted","Data":"c52059cb9a3af950e60f26fb507b8815123d517241243ebf711081ffc0ace4c3"} Jul 24 04:01:31.383718 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:31.383693 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-7v47c" event={"ID":"e98f98aa-332c-44a4-912f-985762f6a84f","Type":"ContainerStarted","Data":"ec02788aa09459db8fbdaae2f76abe362b516de320dd7b33f4e1320965bc3365"} Jul 24 04:01:31.385148 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:31.385121 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-5sckg" event={"ID":"b37181f3-c3b8-478d-825d-6c9582911304","Type":"ContainerStarted","Data":"d935bcc78df0ba68bbf75d5ea683cecda5cad5ebd78ea17dc942d0ab0a376083"} Jul 24 04:01:31.385286 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:31.385228 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:01:31.386198 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:31.386177 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-4dnhg" event={"ID":"6bf01f68-a821-4198-b02c-099d27d3669a","Type":"ContainerStarted","Data":"bcf65033d6cc690cb698e7e410d826c02026435bf74648d67d07ff9bf0ecc9ef"} Jul 24 04:01:31.387416 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:31.387397 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" event={"ID":"38a52b98-f0ba-4581-bff2-de37f4c61924","Type":"ContainerStarted","Data":"17949abf075e4768adcf633d43715ab53699f19eda5e167cc840e7ebcf04cd04"} Jul 24 04:01:31.388460 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:31.388443 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m6mb5" event={"ID":"4375272d-87fe-4632-8ad8-4641ef1a7779","Type":"ContainerStarted","Data":"6d4727a49c63177fc73a3b67dad6ed13264d92fb345845967273c4faafb28ea4"} Jul 24 04:01:31.404973 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:31.404928 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-pkk9l" podStartSLOduration=1.243122392 podStartE2EDuration="18.404913903s" totalImagesPullingTime="17.161791511s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:01:13 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:31.40345085 +0000 UTC m=+73.149824435" watchObservedRunningTime="2026-07-24 04:01:31.404913903 +0000 UTC m=+73.151287487" Jul 24 04:01:31.420613 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:31.420556 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-5sckg" podStartSLOduration=65.211255895 podStartE2EDuration="1m12.420540215s" totalImagesPullingTime="7.20928432s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:31.419252708 +0000 UTC m=+73.165626285" watchObservedRunningTime="2026-07-24 04:01:31.420540215 +0000 UTC m=+73.166913798" Jul 24 04:01:31.433988 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:31.433931 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-7v47c" podStartSLOduration=65.495747704 podStartE2EDuration="1m12.433912785s" totalImagesPullingTime="6.938165081s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:00:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:31.433760546 +0000 UTC m=+73.180134133" watchObservedRunningTime="2026-07-24 04:01:31.433912785 +0000 UTC m=+73.180286372" Jul 24 04:01:31.438349 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:31.438322 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:32.331059 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:32.331024 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:32.594457 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:32.594368 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:33.513906 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:33.513864 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:33.613951 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:33.613905 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:34.181072 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:34.180983 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:34.274342 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:34.274307 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:34.374489 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:34.374447 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:34.406115 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:34.406085 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" event={"ID":"38a52b98-f0ba-4581-bff2-de37f4c61924","Type":"ContainerStarted","Data":"30b04e9cd50d01fd7fcdbd94d7bee06beb172723b70cb6befe88909a4b1a5153"} Jul 24 04:01:34.408068 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:34.408028 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m6mb5" event={"ID":"4375272d-87fe-4632-8ad8-4641ef1a7779","Type":"ContainerStarted","Data":"f76f891c6df6f3f006fac8f6d36af9247711b681b6e0dc75997d8ecf349a2581"} Jul 24 04:01:34.408245 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:34.408224 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m6mb5" Jul 24 04:01:34.409874 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:34.409848 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" event={"ID":"10d40af9-154e-42d7-9b2b-0829f13bdbfb","Type":"ContainerStarted","Data":"b9019a406a52bd42659033e781cd04fb2bf8925320ee704fe8e8ff5d145cc718"} Jul 24 04:01:34.414466 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:34.414448 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m6mb5" Jul 24 04:01:34.425281 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:34.425228 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" podStartSLOduration=5.722598009 podStartE2EDuration="8.425214223s" totalImagesPullingTime="2.702616214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:01:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:34.423410533 +0000 UTC m=+76.169784118" watchObservedRunningTime="2026-07-24 04:01:34.425214223 +0000 UTC m=+76.171587879" Jul 24 04:01:34.430503 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:34.430454 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:34.439311 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:34.439204 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-68b7fc9574-m6mb5" podStartSLOduration=4.704903878 podStartE2EDuration="7.439182584s" totalImagesPullingTime="2.734278706s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:01:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:34.43707699 +0000 UTC m=+76.183450573" watchObservedRunningTime="2026-07-24 04:01:34.439182584 +0000 UTC m=+76.185556168" Jul 24 04:01:35.416906 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:35.416864 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" event={"ID":"10d40af9-154e-42d7-9b2b-0829f13bdbfb","Type":"ContainerStarted","Data":"cf4ae3bb54f59500a16865ef84096e2370f31382244f333eaee7f0f974e17974"} Jul 24 04:01:35.417309 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:35.416933 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" event={"ID":"10d40af9-154e-42d7-9b2b-0829f13bdbfb","Type":"ContainerStarted","Data":"e76da914e0731507c7f60601891461ab15b5682cd5abf4ee778ddea1c1f9a3e4"} Jul 24 04:01:35.445326 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:35.445263 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-677c9d765b-8k949" podStartSLOduration=4.526354477 podStartE2EDuration="8.445245431s" totalImagesPullingTime="3.918890954s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:01:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:35.443549035 +0000 UTC m=+77.189922619" watchObservedRunningTime="2026-07-24 04:01:35.445245431 +0000 UTC m=+77.191619014" Jul 24 04:01:36.446874 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:36.446833 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:36.501140 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:36.501102 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:37.155784 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:37.155747 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:37.257327 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:37.257294 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:40.264096 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.264050 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5dd876cb7f-gtlm8"] Jul 24 04:01:40.266728 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.266697 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:01:40.271457 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.269872 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-7bfqr\"" Jul 24 04:01:40.271457 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.270186 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 24 04:01:40.271457 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.270661 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 24 04:01:40.271457 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.270727 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 24 04:01:40.271457 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.270975 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 24 04:01:40.271457 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.270992 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 24 04:01:40.278313 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.278219 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dd876cb7f-gtlm8"] Jul 24 04:01:40.307276 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.307240 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-console-oauth-config\") pod \"console-5dd876cb7f-gtlm8\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:01:40.307276 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.307285 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-console-config\") pod \"console-5dd876cb7f-gtlm8\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:01:40.307515 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.307318 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-oauth-serving-cert\") pod \"console-5dd876cb7f-gtlm8\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:01:40.307515 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.307413 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-console-serving-cert\") pod \"console-5dd876cb7f-gtlm8\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:01:40.307618 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.307517 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-service-ca\") pod \"console-5dd876cb7f-gtlm8\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:01:40.307618 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.307549 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-szxqz\" (UniqueName: \"kubernetes.io/projected/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-kube-api-access-szxqz\") pod \"console-5dd876cb7f-gtlm8\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:01:40.408865 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.408826 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-szxqz\" (UniqueName: \"kubernetes.io/projected/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-kube-api-access-szxqz\") pod \"console-5dd876cb7f-gtlm8\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:01:40.409040 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.408893 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-console-oauth-config\") pod \"console-5dd876cb7f-gtlm8\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:01:40.409040 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.408923 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-console-config\") pod \"console-5dd876cb7f-gtlm8\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:01:40.409040 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.408942 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-oauth-serving-cert\") pod \"console-5dd876cb7f-gtlm8\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:01:40.409040 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.408998 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-console-serving-cert\") pod \"console-5dd876cb7f-gtlm8\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:01:40.409267 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.409062 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-service-ca\") pod \"console-5dd876cb7f-gtlm8\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:01:40.409835 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.409759 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-oauth-serving-cert\") pod \"console-5dd876cb7f-gtlm8\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:01:40.409962 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.409851 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-service-ca\") pod \"console-5dd876cb7f-gtlm8\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:01:40.410010 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.409954 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-console-config\") pod \"console-5dd876cb7f-gtlm8\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:01:40.411573 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.411552 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-console-oauth-config\") pod \"console-5dd876cb7f-gtlm8\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:01:40.411786 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.411765 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-console-serving-cert\") pod \"console-5dd876cb7f-gtlm8\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:01:40.422825 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.422798 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-szxqz\" (UniqueName: \"kubernetes.io/projected/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-kube-api-access-szxqz\") pod \"console-5dd876cb7f-gtlm8\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:01:40.582418 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.582260 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:01:40.723560 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:40.723521 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5dd876cb7f-gtlm8"] Jul 24 04:01:40.727010 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:01:40.726960 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9ca1ce4e_7f10_4692_9c57_5e5ca983a709.slice/crio-b9d6e1450acc22272cc2cdb58a19f1c84cfdb746d0612ec361e9f4231f03aecf WatchSource:0}: Error finding container b9d6e1450acc22272cc2cdb58a19f1c84cfdb746d0612ec361e9f4231f03aecf: Status 404 returned error can't find the container with id b9d6e1450acc22272cc2cdb58a19f1c84cfdb746d0612ec361e9f4231f03aecf Jul 24 04:01:41.443394 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:41.443352 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dd876cb7f-gtlm8" event={"ID":"9ca1ce4e-7f10-4692-9c57-5e5ca983a709","Type":"ContainerStarted","Data":"b9d6e1450acc22272cc2cdb58a19f1c84cfdb746d0612ec361e9f4231f03aecf"} Jul 24 04:01:43.498181 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:43.498141 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:43.600300 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:43.600264 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:45.553017 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:45.552961 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:46.388343 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:46.388304 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:46.488396 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:46.488360 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:46.713513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:46.713464 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-57c7f69b74-xbktr"] Jul 24 04:01:46.900191 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:46.900125 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57c7f69b74-xbktr"] Jul 24 04:01:46.900191 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:46.900154 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:46.909266 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:46.908802 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 24 04:01:46.966344 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:46.966255 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nhzn4\" (UniqueName: \"kubernetes.io/projected/380cb918-aa72-41e0-83ba-9ad437959e35-kube-api-access-nhzn4\") pod \"console-57c7f69b74-xbktr\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:46.966534 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:46.966371 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/380cb918-aa72-41e0-83ba-9ad437959e35-console-oauth-config\") pod \"console-57c7f69b74-xbktr\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:46.966534 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:46.966430 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-service-ca\") pod \"console-57c7f69b74-xbktr\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:46.966534 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:46.966495 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/380cb918-aa72-41e0-83ba-9ad437959e35-console-serving-cert\") pod \"console-57c7f69b74-xbktr\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:46.966713 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:46.966590 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-oauth-serving-cert\") pod \"console-57c7f69b74-xbktr\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:46.966713 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:46.966635 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-console-config\") pod \"console-57c7f69b74-xbktr\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:46.966713 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:46.966661 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-trusted-ca-bundle\") pod \"console-57c7f69b74-xbktr\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:47.067602 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:47.067561 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/380cb918-aa72-41e0-83ba-9ad437959e35-console-oauth-config\") pod \"console-57c7f69b74-xbktr\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:47.067602 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:47.067609 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-service-ca\") pod \"console-57c7f69b74-xbktr\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:47.067883 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:47.067635 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/380cb918-aa72-41e0-83ba-9ad437959e35-console-serving-cert\") pod \"console-57c7f69b74-xbktr\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:47.067883 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:47.067677 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-oauth-serving-cert\") pod \"console-57c7f69b74-xbktr\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:47.067883 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:47.067706 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-console-config\") pod \"console-57c7f69b74-xbktr\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:47.067883 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:47.067731 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-trusted-ca-bundle\") pod \"console-57c7f69b74-xbktr\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:47.067883 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:47.067768 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nhzn4\" (UniqueName: \"kubernetes.io/projected/380cb918-aa72-41e0-83ba-9ad437959e35-kube-api-access-nhzn4\") pod \"console-57c7f69b74-xbktr\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:47.068461 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:47.068432 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-service-ca\") pod \"console-57c7f69b74-xbktr\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:47.068832 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:47.068805 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-oauth-serving-cert\") pod \"console-57c7f69b74-xbktr\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:47.068927 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:47.068805 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-console-config\") pod \"console-57c7f69b74-xbktr\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:47.069038 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:47.069015 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-trusted-ca-bundle\") pod \"console-57c7f69b74-xbktr\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:47.070730 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:47.070708 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/380cb918-aa72-41e0-83ba-9ad437959e35-console-serving-cert\") pod \"console-57c7f69b74-xbktr\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:47.070826 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:47.070741 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/380cb918-aa72-41e0-83ba-9ad437959e35-console-oauth-config\") pod \"console-57c7f69b74-xbktr\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:47.076185 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:47.076161 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nhzn4\" (UniqueName: \"kubernetes.io/projected/380cb918-aa72-41e0-83ba-9ad437959e35-kube-api-access-nhzn4\") pod \"console-57c7f69b74-xbktr\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:47.213060 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:47.213014 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:47.242270 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:47.242235 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:47.242436 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:47.242326 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:01:48.315725 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:48.315693 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:48.370880 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:48.370839 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:49.115939 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:49.115899 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:49.172536 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:49.172461 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:50.331291 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:50.331249 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:51.396769 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:51.396695 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-57c7f69b74-xbktr"] Jul 24 04:01:51.399488 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:01:51.399422 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod380cb918_aa72_41e0_83ba_9ad437959e35.slice/crio-ee1123f093f977892666283a4366f328b2b9a19aa0e252817398f429ffe321a3 WatchSource:0}: Error finding container ee1123f093f977892666283a4366f328b2b9a19aa0e252817398f429ffe321a3: Status 404 returned error can't find the container with id ee1123f093f977892666283a4366f328b2b9a19aa0e252817398f429ffe321a3 Jul 24 04:01:51.489086 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:51.489049 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dd876cb7f-gtlm8" event={"ID":"9ca1ce4e-7f10-4692-9c57-5e5ca983a709","Type":"ContainerStarted","Data":"74e87992ff49a8460ef68d3b5fd8055e75222dfcfe52bb8b6c86d49aaec83a1b"} Jul 24 04:01:51.491008 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:51.490976 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-7c97dc4555-4dnhg" event={"ID":"6bf01f68-a821-4198-b02c-099d27d3669a","Type":"ContainerStarted","Data":"5b10c8ee70804827e4c1e5bbb2eeb6ded2c77cda8c65f286e40fc526be8c3963"} Jul 24 04:01:51.491155 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:51.491038 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-7c97dc4555-4dnhg" Jul 24 04:01:51.492732 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:51.492686 2563 patch_prober.go:28] interesting pod/downloads-7c97dc4555-4dnhg container/download-server namespace/openshift-console: Readiness probe status=failure output="Get \"http://10.133.0.14:8080/\": dial tcp 10.133.0.14:8080: connect: connection refused" start-of-body= Jul 24 04:01:51.492848 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:51.492750 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console/downloads-7c97dc4555-4dnhg" podUID="6bf01f68-a821-4198-b02c-099d27d3669a" containerName="download-server" probeResult="failure" output="Get \"http://10.133.0.14:8080/\": dial tcp 10.133.0.14:8080: connect: connection refused" Jul 24 04:01:51.493209 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:51.493186 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c7f69b74-xbktr" event={"ID":"380cb918-aa72-41e0-83ba-9ad437959e35","Type":"ContainerStarted","Data":"c4f7ef875a434455b3c016f8795cf6af38237631af40cc5c97b2b7980e4a5375"} Jul 24 04:01:51.493292 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:51.493228 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c7f69b74-xbktr" event={"ID":"380cb918-aa72-41e0-83ba-9ad437959e35","Type":"ContainerStarted","Data":"ee1123f093f977892666283a4366f328b2b9a19aa0e252817398f429ffe321a3"} Jul 24 04:01:51.506000 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:51.505938 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5dd876cb7f-gtlm8" podStartSLOduration=0.976299475 podStartE2EDuration="11.505917964s" totalImagesPullingTime="10.529618489s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:51.504867123 +0000 UTC m=+93.251240706" watchObservedRunningTime="2026-07-24 04:01:51.505917964 +0000 UTC m=+93.252291586" Jul 24 04:01:51.521178 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:51.521121 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-7c97dc4555-4dnhg" podStartSLOduration=3.3474653930000002 podStartE2EDuration="23.521100314s" totalImagesPullingTime="20.173634921s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:01:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:51.519690975 +0000 UTC m=+93.266064561" watchObservedRunningTime="2026-07-24 04:01:51.521100314 +0000 UTC m=+93.267473956" Jul 24 04:01:51.536093 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:51.536031 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-57c7f69b74-xbktr" podStartSLOduration=5.53600775 podStartE2EDuration="5.53600775s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:01:46 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:01:51.535109594 +0000 UTC m=+93.281483178" watchObservedRunningTime="2026-07-24 04:01:51.53600775 +0000 UTC m=+93.282381335" Jul 24 04:01:52.511333 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:52.511292 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-7c97dc4555-4dnhg" Jul 24 04:01:57.213420 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:57.213381 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:57.213939 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:57.213519 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:57.219325 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:57.219301 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:57.523893 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:57.523814 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:01:57.569364 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:57.569327 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dd876cb7f-gtlm8"] Jul 24 04:01:57.707704 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:57.707665 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:57.807911 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:57.807823 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:57.862326 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:57.862289 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:58.538026 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:58.537989 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:01:58.591182 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:01:58.591145 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:02:00.582783 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:00.582747 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:02:02.400509 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:02.400463 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-5sckg" Jul 24 04:02:07.247686 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:07.247650 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:02:07.251573 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:07.251549 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/metrics-server-6898dd96d7-67dkq" Jul 24 04:02:18.312445 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:18.312414 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:02:18.413285 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:18.413242 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:02:22.592842 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:22.592798 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-5dd876cb7f-gtlm8" podUID="9ca1ce4e-7f10-4692-9c57-5e5ca983a709" containerName="console" containerID="cri-o://74e87992ff49a8460ef68d3b5fd8055e75222dfcfe52bb8b6c86d49aaec83a1b" gracePeriod=15 Jul 24 04:02:22.830537 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:22.830512 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:02:22.877235 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:22.877143 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-console-config\") pod \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " Jul 24 04:02:22.877235 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:22.877179 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-oauth-serving-cert\") pod \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " Jul 24 04:02:22.877235 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:22.877216 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-console-oauth-config\") pod \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " Jul 24 04:02:22.877556 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:22.877244 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-console-serving-cert\") pod \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " Jul 24 04:02:22.877556 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:22.877267 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-service-ca\") pod \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " Jul 24 04:02:22.877556 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:22.877312 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-szxqz\" (UniqueName: \"kubernetes.io/projected/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-kube-api-access-szxqz\") pod \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\" (UID: \"9ca1ce4e-7f10-4692-9c57-5e5ca983a709\") " Jul 24 04:02:22.877693 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:22.877600 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "9ca1ce4e-7f10-4692-9c57-5e5ca983a709" (UID: "9ca1ce4e-7f10-4692-9c57-5e5ca983a709"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:02:22.877693 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:22.877633 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-console-config" (OuterVolumeSpecName: "console-config") pod "9ca1ce4e-7f10-4692-9c57-5e5ca983a709" (UID: "9ca1ce4e-7f10-4692-9c57-5e5ca983a709"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:02:22.877763 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:22.877699 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-service-ca" (OuterVolumeSpecName: "service-ca") pod "9ca1ce4e-7f10-4692-9c57-5e5ca983a709" (UID: "9ca1ce4e-7f10-4692-9c57-5e5ca983a709"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:02:22.879670 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:22.879637 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-kube-api-access-szxqz" (OuterVolumeSpecName: "kube-api-access-szxqz") pod "9ca1ce4e-7f10-4692-9c57-5e5ca983a709" (UID: "9ca1ce4e-7f10-4692-9c57-5e5ca983a709"). InnerVolumeSpecName "kube-api-access-szxqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:02:22.879670 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:22.879649 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "9ca1ce4e-7f10-4692-9c57-5e5ca983a709" (UID: "9ca1ce4e-7f10-4692-9c57-5e5ca983a709"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:02:22.879809 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:22.879670 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "9ca1ce4e-7f10-4692-9c57-5e5ca983a709" (UID: "9ca1ce4e-7f10-4692-9c57-5e5ca983a709"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:02:22.978164 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:22.978132 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-szxqz\" (UniqueName: \"kubernetes.io/projected/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-kube-api-access-szxqz\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:02:22.978164 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:22.978160 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-console-config\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:02:22.978164 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:22.978170 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-oauth-serving-cert\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:02:22.978372 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:22.978179 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-console-oauth-config\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:02:22.978372 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:22.978187 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-console-serving-cert\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:02:22.978372 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:22.978195 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/9ca1ce4e-7f10-4692-9c57-5e5ca983a709-service-ca\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:02:23.635318 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:23.635283 2563 generic.go:356] "Generic (PLEG): container finished" podID="9ca1ce4e-7f10-4692-9c57-5e5ca983a709" containerID="74e87992ff49a8460ef68d3b5fd8055e75222dfcfe52bb8b6c86d49aaec83a1b" exitCode=0 Jul 24 04:02:23.635737 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:23.635347 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5dd876cb7f-gtlm8" Jul 24 04:02:23.635737 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:23.635363 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dd876cb7f-gtlm8" event={"ID":"9ca1ce4e-7f10-4692-9c57-5e5ca983a709","Type":"ContainerDied","Data":"74e87992ff49a8460ef68d3b5fd8055e75222dfcfe52bb8b6c86d49aaec83a1b"} Jul 24 04:02:23.635737 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:23.635448 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5dd876cb7f-gtlm8" event={"ID":"9ca1ce4e-7f10-4692-9c57-5e5ca983a709","Type":"ContainerDied","Data":"b9d6e1450acc22272cc2cdb58a19f1c84cfdb746d0612ec361e9f4231f03aecf"} Jul 24 04:02:23.635737 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:23.635500 2563 scope.go:117] "RemoveContainer" containerID="74e87992ff49a8460ef68d3b5fd8055e75222dfcfe52bb8b6c86d49aaec83a1b" Jul 24 04:02:23.643513 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:23.643494 2563 scope.go:117] "RemoveContainer" containerID="74e87992ff49a8460ef68d3b5fd8055e75222dfcfe52bb8b6c86d49aaec83a1b" Jul 24 04:02:23.643777 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:02:23.643757 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"74e87992ff49a8460ef68d3b5fd8055e75222dfcfe52bb8b6c86d49aaec83a1b\": container with ID starting with 74e87992ff49a8460ef68d3b5fd8055e75222dfcfe52bb8b6c86d49aaec83a1b not found: ID does not exist" containerID="74e87992ff49a8460ef68d3b5fd8055e75222dfcfe52bb8b6c86d49aaec83a1b" Jul 24 04:02:23.643825 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:23.643793 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"74e87992ff49a8460ef68d3b5fd8055e75222dfcfe52bb8b6c86d49aaec83a1b"} err="failed to get container status \"74e87992ff49a8460ef68d3b5fd8055e75222dfcfe52bb8b6c86d49aaec83a1b\": rpc error: code = NotFound desc = could not find container \"74e87992ff49a8460ef68d3b5fd8055e75222dfcfe52bb8b6c86d49aaec83a1b\": container with ID starting with 74e87992ff49a8460ef68d3b5fd8055e75222dfcfe52bb8b6c86d49aaec83a1b not found: ID does not exist" Jul 24 04:02:23.658159 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:23.658127 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-5dd876cb7f-gtlm8"] Jul 24 04:02:23.663094 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:23.663070 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-5dd876cb7f-gtlm8"] Jul 24 04:02:24.941712 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:24.941679 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9ca1ce4e-7f10-4692-9c57-5e5ca983a709" path="/var/lib/kubelet/pods/9ca1ce4e-7f10-4692-9c57-5e5ca983a709/volumes" Jul 24 04:02:38.751754 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:38.751711 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:02:38.853096 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:38.853061 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:02:44.513324 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.513291 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 04:02:44.513711 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.513572 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9ca1ce4e-7f10-4692-9c57-5e5ca983a709" containerName="console" Jul 24 04:02:44.513711 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.513585 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9ca1ce4e-7f10-4692-9c57-5e5ca983a709" containerName="console" Jul 24 04:02:44.513711 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.513648 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9ca1ce4e-7f10-4692-9c57-5e5ca983a709" containerName="console" Jul 24 04:02:44.532790 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.532753 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 04:02:44.532939 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.532871 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.535939 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.535913 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 24 04:02:44.536086 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.535948 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-rql55\"" Jul 24 04:02:44.536245 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.536226 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 24 04:02:44.536491 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.536453 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 24 04:02:44.536491 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.536468 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 24 04:02:44.536657 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.536511 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 24 04:02:44.536657 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.536521 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 24 04:02:44.536748 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.536671 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 24 04:02:44.536985 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.536967 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 24 04:02:44.540930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.540910 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 24 04:02:44.637237 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.637197 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/41c44cd8-7a6c-4333-902f-0f97d0446a22-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.637237 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.637243 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41c44cd8-7a6c-4333-902f-0f97d0446a22-tls-assets\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.637504 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.637261 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41c44cd8-7a6c-4333-902f-0f97d0446a22-web-config\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.637504 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.637344 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/41c44cd8-7a6c-4333-902f-0f97d0446a22-config-volume\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.637504 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.637374 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41c44cd8-7a6c-4333-902f-0f97d0446a22-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.637504 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.637401 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/41c44cd8-7a6c-4333-902f-0f97d0446a22-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.637661 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.637511 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41c44cd8-7a6c-4333-902f-0f97d0446a22-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.637661 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.637535 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41c44cd8-7a6c-4333-902f-0f97d0446a22-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.637661 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.637560 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41c44cd8-7a6c-4333-902f-0f97d0446a22-config-out\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.637661 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.637604 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/41c44cd8-7a6c-4333-902f-0f97d0446a22-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.637661 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.637623 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gc88p\" (UniqueName: \"kubernetes.io/projected/41c44cd8-7a6c-4333-902f-0f97d0446a22-kube-api-access-gc88p\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.637821 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.637662 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/41c44cd8-7a6c-4333-902f-0f97d0446a22-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.637821 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.637681 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41c44cd8-7a6c-4333-902f-0f97d0446a22-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.738860 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.738819 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41c44cd8-7a6c-4333-902f-0f97d0446a22-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.738860 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.738860 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41c44cd8-7a6c-4333-902f-0f97d0446a22-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.739121 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.738887 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41c44cd8-7a6c-4333-902f-0f97d0446a22-config-out\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.739121 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.738910 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/41c44cd8-7a6c-4333-902f-0f97d0446a22-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.739121 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.738927 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gc88p\" (UniqueName: \"kubernetes.io/projected/41c44cd8-7a6c-4333-902f-0f97d0446a22-kube-api-access-gc88p\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.739121 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.738951 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/41c44cd8-7a6c-4333-902f-0f97d0446a22-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.739121 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.738981 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41c44cd8-7a6c-4333-902f-0f97d0446a22-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.739121 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.739022 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/41c44cd8-7a6c-4333-902f-0f97d0446a22-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.739121 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.739061 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41c44cd8-7a6c-4333-902f-0f97d0446a22-tls-assets\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.739121 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.739084 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41c44cd8-7a6c-4333-902f-0f97d0446a22-web-config\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.739121 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.739118 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/41c44cd8-7a6c-4333-902f-0f97d0446a22-config-volume\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.739610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.739138 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41c44cd8-7a6c-4333-902f-0f97d0446a22-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.739610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.739168 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/41c44cd8-7a6c-4333-902f-0f97d0446a22-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.739718 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.739605 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/41c44cd8-7a6c-4333-902f-0f97d0446a22-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.740217 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.740184 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/41c44cd8-7a6c-4333-902f-0f97d0446a22-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.740535 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.740508 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/41c44cd8-7a6c-4333-902f-0f97d0446a22-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.742005 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.741978 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/41c44cd8-7a6c-4333-902f-0f97d0446a22-config-out\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.742243 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.742217 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/41c44cd8-7a6c-4333-902f-0f97d0446a22-tls-assets\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.742593 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.742334 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/41c44cd8-7a6c-4333-902f-0f97d0446a22-web-config\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.742693 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.742656 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/41c44cd8-7a6c-4333-902f-0f97d0446a22-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.742759 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.742711 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/41c44cd8-7a6c-4333-902f-0f97d0446a22-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.742759 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.742724 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/41c44cd8-7a6c-4333-902f-0f97d0446a22-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.743000 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.742972 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/41c44cd8-7a6c-4333-902f-0f97d0446a22-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.743367 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.743347 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/41c44cd8-7a6c-4333-902f-0f97d0446a22-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.744020 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.743997 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/41c44cd8-7a6c-4333-902f-0f97d0446a22-config-volume\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.746790 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.746769 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gc88p\" (UniqueName: \"kubernetes.io/projected/41c44cd8-7a6c-4333-902f-0f97d0446a22-kube-api-access-gc88p\") pod \"alertmanager-main-0\" (UID: \"41c44cd8-7a6c-4333-902f-0f97d0446a22\") " pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:44.843409 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:44.843314 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 24 04:02:45.005765 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:45.005729 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 24 04:02:45.008262 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:02:45.008230 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod41c44cd8_7a6c_4333_902f_0f97d0446a22.slice/crio-db2483c95f6a8398bf1e74d451039cd6d6b1ab85936ef78493a70cd2ec7c84d0 WatchSource:0}: Error finding container db2483c95f6a8398bf1e74d451039cd6d6b1ab85936ef78493a70cd2ec7c84d0: Status 404 returned error can't find the container with id db2483c95f6a8398bf1e74d451039cd6d6b1ab85936ef78493a70cd2ec7c84d0 Jul 24 04:02:45.717070 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:45.717038 2563 generic.go:356] "Generic (PLEG): container finished" podID="41c44cd8-7a6c-4333-902f-0f97d0446a22" containerID="c5fdfe0ca208ac922f6f1949b4440b9fdf5d8da23164c34404b91932e71da0ad" exitCode=0 Jul 24 04:02:45.717435 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:45.717132 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41c44cd8-7a6c-4333-902f-0f97d0446a22","Type":"ContainerDied","Data":"c5fdfe0ca208ac922f6f1949b4440b9fdf5d8da23164c34404b91932e71da0ad"} Jul 24 04:02:45.717435 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:45.717221 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41c44cd8-7a6c-4333-902f-0f97d0446a22","Type":"ContainerStarted","Data":"db2483c95f6a8398bf1e74d451039cd6d6b1ab85936ef78493a70cd2ec7c84d0"} Jul 24 04:02:47.730784 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:47.730743 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41c44cd8-7a6c-4333-902f-0f97d0446a22","Type":"ContainerStarted","Data":"0d73ccad38cb62fe4b3a49c6467c3f7e7180557ff0ba35e3a6fa2c5a371d6778"} Jul 24 04:02:47.731280 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:47.730834 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41c44cd8-7a6c-4333-902f-0f97d0446a22","Type":"ContainerStarted","Data":"d7bca7ef9a71ad07019f0ea60f7459d19313ef4498a9dac6d3da9b0ac7821b3d"} Jul 24 04:02:47.731280 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:47.730878 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41c44cd8-7a6c-4333-902f-0f97d0446a22","Type":"ContainerStarted","Data":"c8de89af647e79633e95fc610d11f8b9948300224e1956f9b8acfd8f037cdaed"} Jul 24 04:02:47.731280 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:47.730916 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41c44cd8-7a6c-4333-902f-0f97d0446a22","Type":"ContainerStarted","Data":"f05d0a7728fe8d82df6ab2e1e319d0bd369421f894334c0ac611c05b59645acb"} Jul 24 04:02:47.731280 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:47.730962 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41c44cd8-7a6c-4333-902f-0f97d0446a22","Type":"ContainerStarted","Data":"1a8d40005f20824c85dbe037557eef48aff057b0a129e59fa4fa973695e964c5"} Jul 24 04:02:48.738794 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:48.738755 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"41c44cd8-7a6c-4333-902f-0f97d0446a22","Type":"ContainerStarted","Data":"f006f72ea9af75325a75b9ef90064164acd010a6380e31e633fd28d34fe1b6eb"} Jul 24 04:02:48.764579 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:48.764519 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.741414755 podStartE2EDuration="4.764500924s" totalImagesPullingTime="2.005402777s" totalInitContainerRuntime="17.683392ms" isStatefulPod=false podCreationTimestamp="2026-07-24 04:02:44 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:02:48.762713428 +0000 UTC m=+150.509087052" watchObservedRunningTime="2026-07-24 04:02:48.764500924 +0000 UTC m=+150.510874507" Jul 24 04:02:50.482280 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:50.482240 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:02:50.540411 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:50.540367 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:02:52.206659 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.206625 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69d5bf9758-vbwvp"] Jul 24 04:02:52.209027 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.209002 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.220026 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.220004 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69d5bf9758-vbwvp"] Jul 24 04:02:52.260199 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.260167 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:02:52.306646 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.306611 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-service-ca\") pod \"console-69d5bf9758-vbwvp\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.306811 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.306660 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-console-serving-cert\") pod \"console-69d5bf9758-vbwvp\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.306811 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.306684 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-oauth-serving-cert\") pod \"console-69d5bf9758-vbwvp\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.306811 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.306704 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-console-config\") pod \"console-69d5bf9758-vbwvp\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.306811 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.306721 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-trusted-ca-bundle\") pod \"console-69d5bf9758-vbwvp\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.306811 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.306792 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-92zg5\" (UniqueName: \"kubernetes.io/projected/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-kube-api-access-92zg5\") pod \"console-69d5bf9758-vbwvp\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.306973 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.306825 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-console-oauth-config\") pod \"console-69d5bf9758-vbwvp\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.317982 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.317937 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:02:52.407645 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.407611 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-service-ca\") pod \"console-69d5bf9758-vbwvp\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.407856 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.407668 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-console-serving-cert\") pod \"console-69d5bf9758-vbwvp\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.407856 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.407698 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-oauth-serving-cert\") pod \"console-69d5bf9758-vbwvp\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.407856 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.407725 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-console-config\") pod \"console-69d5bf9758-vbwvp\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.407856 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.407747 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-trusted-ca-bundle\") pod \"console-69d5bf9758-vbwvp\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.407856 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.407789 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-92zg5\" (UniqueName: \"kubernetes.io/projected/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-kube-api-access-92zg5\") pod \"console-69d5bf9758-vbwvp\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.407856 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.407815 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-console-oauth-config\") pod \"console-69d5bf9758-vbwvp\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.408458 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.408426 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-console-config\") pod \"console-69d5bf9758-vbwvp\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.408607 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.408492 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-oauth-serving-cert\") pod \"console-69d5bf9758-vbwvp\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.408711 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.408688 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-trusted-ca-bundle\") pod \"console-69d5bf9758-vbwvp\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.408750 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.408695 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-service-ca\") pod \"console-69d5bf9758-vbwvp\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.410320 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.410297 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-console-serving-cert\") pod \"console-69d5bf9758-vbwvp\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.410430 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.410320 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-console-oauth-config\") pod \"console-69d5bf9758-vbwvp\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.415714 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.415690 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-92zg5\" (UniqueName: \"kubernetes.io/projected/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-kube-api-access-92zg5\") pod \"console-69d5bf9758-vbwvp\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.456867 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.456794 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:02:52.517718 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.517682 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:02:52.557781 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.557747 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:02:52.645369 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.645293 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69d5bf9758-vbwvp"] Jul 24 04:02:52.650761 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:02:52.650725 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc8b749ef_f3c8_4d9b_ae2e_02df9fe20ed0.slice/crio-2b80e6cd652e940a1845e3d5f7a9969716a23b23d01acfa2d0bbeea9fe3b768e WatchSource:0}: Error finding container 2b80e6cd652e940a1845e3d5f7a9969716a23b23d01acfa2d0bbeea9fe3b768e: Status 404 returned error can't find the container with id 2b80e6cd652e940a1845e3d5f7a9969716a23b23d01acfa2d0bbeea9fe3b768e Jul 24 04:02:52.756700 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.756616 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d5bf9758-vbwvp" event={"ID":"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0","Type":"ContainerStarted","Data":"30f39f731c3e1c9de587c3721748960eec211bd1436212ba956a2b11e5f7bee5"} Jul 24 04:02:52.756700 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.756668 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d5bf9758-vbwvp" event={"ID":"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0","Type":"ContainerStarted","Data":"2b80e6cd652e940a1845e3d5f7a9969716a23b23d01acfa2d0bbeea9fe3b768e"} Jul 24 04:02:52.777005 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:52.775552 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69d5bf9758-vbwvp" podStartSLOduration=0.775524269 podStartE2EDuration="775.524269ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:02:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:02:52.773350321 +0000 UTC m=+154.519723904" watchObservedRunningTime="2026-07-24 04:02:52.775524269 +0000 UTC m=+154.521897853" Jul 24 04:02:53.010455 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:02:53.010371 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:03:02.517836 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:02.517794 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:03:02.517836 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:02.517850 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:03:02.522637 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:02.522615 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:03:02.799939 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:02.799859 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:03:02.843971 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:02.843936 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57c7f69b74-xbktr"] Jul 24 04:03:02.957510 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:02.957456 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:03:03.024862 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:03.024824 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:03:03.102594 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:03.102446 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:03:03.333459 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:03.333422 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:03:03.431642 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:03.431554 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:03:27.864993 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:27.864943 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-57c7f69b74-xbktr" podUID="380cb918-aa72-41e0-83ba-9ad437959e35" containerName="console" containerID="cri-o://c4f7ef875a434455b3c016f8795cf6af38237631af40cc5c97b2b7980e4a5375" gracePeriod=15 Jul 24 04:03:28.111717 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.111692 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:03:28.212903 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.212863 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-service-ca\") pod \"380cb918-aa72-41e0-83ba-9ad437959e35\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " Jul 24 04:03:28.213096 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.212947 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/380cb918-aa72-41e0-83ba-9ad437959e35-console-oauth-config\") pod \"380cb918-aa72-41e0-83ba-9ad437959e35\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " Jul 24 04:03:28.213096 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.212978 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-oauth-serving-cert\") pod \"380cb918-aa72-41e0-83ba-9ad437959e35\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " Jul 24 04:03:28.213096 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.213003 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-trusted-ca-bundle\") pod \"380cb918-aa72-41e0-83ba-9ad437959e35\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " Jul 24 04:03:28.213096 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.213049 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-console-config\") pod \"380cb918-aa72-41e0-83ba-9ad437959e35\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " Jul 24 04:03:28.213096 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.213074 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/380cb918-aa72-41e0-83ba-9ad437959e35-console-serving-cert\") pod \"380cb918-aa72-41e0-83ba-9ad437959e35\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " Jul 24 04:03:28.213352 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.213116 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nhzn4\" (UniqueName: \"kubernetes.io/projected/380cb918-aa72-41e0-83ba-9ad437959e35-kube-api-access-nhzn4\") pod \"380cb918-aa72-41e0-83ba-9ad437959e35\" (UID: \"380cb918-aa72-41e0-83ba-9ad437959e35\") " Jul 24 04:03:28.213415 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.213380 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-service-ca" (OuterVolumeSpecName: "service-ca") pod "380cb918-aa72-41e0-83ba-9ad437959e35" (UID: "380cb918-aa72-41e0-83ba-9ad437959e35"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:03:28.213504 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.213460 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-console-config" (OuterVolumeSpecName: "console-config") pod "380cb918-aa72-41e0-83ba-9ad437959e35" (UID: "380cb918-aa72-41e0-83ba-9ad437959e35"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:03:28.213570 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.213509 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "380cb918-aa72-41e0-83ba-9ad437959e35" (UID: "380cb918-aa72-41e0-83ba-9ad437959e35"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:03:28.213619 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.213574 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "380cb918-aa72-41e0-83ba-9ad437959e35" (UID: "380cb918-aa72-41e0-83ba-9ad437959e35"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:03:28.215222 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.215180 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/380cb918-aa72-41e0-83ba-9ad437959e35-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "380cb918-aa72-41e0-83ba-9ad437959e35" (UID: "380cb918-aa72-41e0-83ba-9ad437959e35"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:03:28.215222 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.215215 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/380cb918-aa72-41e0-83ba-9ad437959e35-kube-api-access-nhzn4" (OuterVolumeSpecName: "kube-api-access-nhzn4") pod "380cb918-aa72-41e0-83ba-9ad437959e35" (UID: "380cb918-aa72-41e0-83ba-9ad437959e35"). InnerVolumeSpecName "kube-api-access-nhzn4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:03:28.215369 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.215216 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/380cb918-aa72-41e0-83ba-9ad437959e35-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "380cb918-aa72-41e0-83ba-9ad437959e35" (UID: "380cb918-aa72-41e0-83ba-9ad437959e35"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:03:28.313851 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.313809 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-service-ca\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:03:28.313851 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.313841 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/380cb918-aa72-41e0-83ba-9ad437959e35-console-oauth-config\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:03:28.313851 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.313851 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-oauth-serving-cert\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:03:28.313851 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.313862 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-trusted-ca-bundle\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:03:28.314107 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.313871 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/380cb918-aa72-41e0-83ba-9ad437959e35-console-config\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:03:28.314107 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.313879 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/380cb918-aa72-41e0-83ba-9ad437959e35-console-serving-cert\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:03:28.314107 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.313888 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nhzn4\" (UniqueName: \"kubernetes.io/projected/380cb918-aa72-41e0-83ba-9ad437959e35-kube-api-access-nhzn4\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:03:28.895076 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.895038 2563 generic.go:356] "Generic (PLEG): container finished" podID="380cb918-aa72-41e0-83ba-9ad437959e35" containerID="c4f7ef875a434455b3c016f8795cf6af38237631af40cc5c97b2b7980e4a5375" exitCode=0 Jul 24 04:03:28.895670 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.895091 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-57c7f69b74-xbktr" Jul 24 04:03:28.895670 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.895124 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c7f69b74-xbktr" event={"ID":"380cb918-aa72-41e0-83ba-9ad437959e35","Type":"ContainerDied","Data":"c4f7ef875a434455b3c016f8795cf6af38237631af40cc5c97b2b7980e4a5375"} Jul 24 04:03:28.895670 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.895179 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-57c7f69b74-xbktr" event={"ID":"380cb918-aa72-41e0-83ba-9ad437959e35","Type":"ContainerDied","Data":"ee1123f093f977892666283a4366f328b2b9a19aa0e252817398f429ffe321a3"} Jul 24 04:03:28.895670 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.895203 2563 scope.go:117] "RemoveContainer" containerID="c4f7ef875a434455b3c016f8795cf6af38237631af40cc5c97b2b7980e4a5375" Jul 24 04:03:28.904180 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.904160 2563 scope.go:117] "RemoveContainer" containerID="c4f7ef875a434455b3c016f8795cf6af38237631af40cc5c97b2b7980e4a5375" Jul 24 04:03:28.904508 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:03:28.904486 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c4f7ef875a434455b3c016f8795cf6af38237631af40cc5c97b2b7980e4a5375\": container with ID starting with c4f7ef875a434455b3c016f8795cf6af38237631af40cc5c97b2b7980e4a5375 not found: ID does not exist" containerID="c4f7ef875a434455b3c016f8795cf6af38237631af40cc5c97b2b7980e4a5375" Jul 24 04:03:28.904578 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.904523 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c4f7ef875a434455b3c016f8795cf6af38237631af40cc5c97b2b7980e4a5375"} err="failed to get container status \"c4f7ef875a434455b3c016f8795cf6af38237631af40cc5c97b2b7980e4a5375\": rpc error: code = NotFound desc = could not find container \"c4f7ef875a434455b3c016f8795cf6af38237631af40cc5c97b2b7980e4a5375\": container with ID starting with c4f7ef875a434455b3c016f8795cf6af38237631af40cc5c97b2b7980e4a5375 not found: ID does not exist" Jul 24 04:03:28.915179 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.915150 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-57c7f69b74-xbktr"] Jul 24 04:03:28.918075 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.918049 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-57c7f69b74-xbktr"] Jul 24 04:03:28.942853 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:28.942819 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="380cb918-aa72-41e0-83ba-9ad437959e35" path="/var/lib/kubelet/pods/380cb918-aa72-41e0-83ba-9ad437959e35/volumes" Jul 24 04:03:30.142184 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:30.142146 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:03:31.793941 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:31.793901 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:03:31.858188 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:31.858156 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:03:38.654942 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:38.654900 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:03:45.187953 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:45.187915 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:03:45.285271 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:45.285230 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:03:45.988576 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:45.988540 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9"] Jul 24 04:03:45.988877 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:45.988864 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="380cb918-aa72-41e0-83ba-9ad437959e35" containerName="console" Jul 24 04:03:45.988928 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:45.988879 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="380cb918-aa72-41e0-83ba-9ad437959e35" containerName="console" Jul 24 04:03:45.988962 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:45.988929 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="380cb918-aa72-41e0-83ba-9ad437959e35" containerName="console" Jul 24 04:03:45.991659 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:45.991642 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9" Jul 24 04:03:45.994145 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:45.994122 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 24 04:03:45.994267 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:45.994122 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 24 04:03:45.995050 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:45.995026 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xfj6m\"" Jul 24 04:03:46.000179 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:46.000131 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9"] Jul 24 04:03:46.049550 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:46.049510 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed473b65-2ea1-49fc-b02a-c0cd662e2435-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9\" (UID: \"ed473b65-2ea1-49fc-b02a-c0cd662e2435\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9" Jul 24 04:03:46.049550 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:46.049551 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g85wd\" (UniqueName: \"kubernetes.io/projected/ed473b65-2ea1-49fc-b02a-c0cd662e2435-kube-api-access-g85wd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9\" (UID: \"ed473b65-2ea1-49fc-b02a-c0cd662e2435\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9" Jul 24 04:03:46.049813 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:46.049616 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed473b65-2ea1-49fc-b02a-c0cd662e2435-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9\" (UID: \"ed473b65-2ea1-49fc-b02a-c0cd662e2435\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9" Jul 24 04:03:46.151158 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:46.151120 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed473b65-2ea1-49fc-b02a-c0cd662e2435-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9\" (UID: \"ed473b65-2ea1-49fc-b02a-c0cd662e2435\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9" Jul 24 04:03:46.151158 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:46.151162 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g85wd\" (UniqueName: \"kubernetes.io/projected/ed473b65-2ea1-49fc-b02a-c0cd662e2435-kube-api-access-g85wd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9\" (UID: \"ed473b65-2ea1-49fc-b02a-c0cd662e2435\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9" Jul 24 04:03:46.151394 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:46.151185 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed473b65-2ea1-49fc-b02a-c0cd662e2435-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9\" (UID: \"ed473b65-2ea1-49fc-b02a-c0cd662e2435\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9" Jul 24 04:03:46.151528 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:46.151508 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed473b65-2ea1-49fc-b02a-c0cd662e2435-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9\" (UID: \"ed473b65-2ea1-49fc-b02a-c0cd662e2435\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9" Jul 24 04:03:46.151595 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:46.151528 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed473b65-2ea1-49fc-b02a-c0cd662e2435-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9\" (UID: \"ed473b65-2ea1-49fc-b02a-c0cd662e2435\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9" Jul 24 04:03:46.159013 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:46.158986 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g85wd\" (UniqueName: \"kubernetes.io/projected/ed473b65-2ea1-49fc-b02a-c0cd662e2435-kube-api-access-g85wd\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9\" (UID: \"ed473b65-2ea1-49fc-b02a-c0cd662e2435\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9" Jul 24 04:03:46.302386 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:46.302284 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9" Jul 24 04:03:46.438013 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:46.437932 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9"] Jul 24 04:03:46.440923 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:03:46.440877 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded473b65_2ea1_49fc_b02a_c0cd662e2435.slice/crio-75266d90c80a6b9e3df66a622683310b19c92663a43d1b49043ba9acb2c3cac9 WatchSource:0}: Error finding container 75266d90c80a6b9e3df66a622683310b19c92663a43d1b49043ba9acb2c3cac9: Status 404 returned error can't find the container with id 75266d90c80a6b9e3df66a622683310b19c92663a43d1b49043ba9acb2c3cac9 Jul 24 04:03:46.965739 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:46.965705 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9" event={"ID":"ed473b65-2ea1-49fc-b02a-c0cd662e2435","Type":"ContainerStarted","Data":"75266d90c80a6b9e3df66a622683310b19c92663a43d1b49043ba9acb2c3cac9"} Jul 24 04:03:52.991708 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:52.991663 2563 generic.go:356] "Generic (PLEG): container finished" podID="ed473b65-2ea1-49fc-b02a-c0cd662e2435" containerID="42593e49874ac5204366df176cc16f858c1ed537203745b0c3ac90cc5e15a9d3" exitCode=0 Jul 24 04:03:52.992081 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:52.991716 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9" event={"ID":"ed473b65-2ea1-49fc-b02a-c0cd662e2435","Type":"ContainerDied","Data":"42593e49874ac5204366df176cc16f858c1ed537203745b0c3ac90cc5e15a9d3"} Jul 24 04:03:56.006136 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:56.006097 2563 generic.go:356] "Generic (PLEG): container finished" podID="ed473b65-2ea1-49fc-b02a-c0cd662e2435" containerID="bb13f874fd91ea2d7bf17e3972cec881b455a3b2dc96452d37136d73229f8ee3" exitCode=0 Jul 24 04:03:56.006620 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:03:56.006145 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9" event={"ID":"ed473b65-2ea1-49fc-b02a-c0cd662e2435","Type":"ContainerDied","Data":"bb13f874fd91ea2d7bf17e3972cec881b455a3b2dc96452d37136d73229f8ee3"} Jul 24 04:04:04.041258 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:04.041223 2563 generic.go:356] "Generic (PLEG): container finished" podID="ed473b65-2ea1-49fc-b02a-c0cd662e2435" containerID="c3c731485bd574f835a96391166c8e333bcbb62e0e16e78a00b94e8b768abc03" exitCode=0 Jul 24 04:04:04.041685 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:04.041297 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9" event={"ID":"ed473b65-2ea1-49fc-b02a-c0cd662e2435","Type":"ContainerDied","Data":"c3c731485bd574f835a96391166c8e333bcbb62e0e16e78a00b94e8b768abc03"} Jul 24 04:04:05.213900 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:05.213864 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9" Jul 24 04:04:05.319923 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:05.319824 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed473b65-2ea1-49fc-b02a-c0cd662e2435-util\") pod \"ed473b65-2ea1-49fc-b02a-c0cd662e2435\" (UID: \"ed473b65-2ea1-49fc-b02a-c0cd662e2435\") " Jul 24 04:04:05.319923 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:05.319871 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g85wd\" (UniqueName: \"kubernetes.io/projected/ed473b65-2ea1-49fc-b02a-c0cd662e2435-kube-api-access-g85wd\") pod \"ed473b65-2ea1-49fc-b02a-c0cd662e2435\" (UID: \"ed473b65-2ea1-49fc-b02a-c0cd662e2435\") " Jul 24 04:04:05.320142 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:05.319929 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed473b65-2ea1-49fc-b02a-c0cd662e2435-bundle\") pod \"ed473b65-2ea1-49fc-b02a-c0cd662e2435\" (UID: \"ed473b65-2ea1-49fc-b02a-c0cd662e2435\") " Jul 24 04:04:05.320722 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:05.320697 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed473b65-2ea1-49fc-b02a-c0cd662e2435-bundle" (OuterVolumeSpecName: "bundle") pod "ed473b65-2ea1-49fc-b02a-c0cd662e2435" (UID: "ed473b65-2ea1-49fc-b02a-c0cd662e2435"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 04:04:05.322192 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:05.322173 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ed473b65-2ea1-49fc-b02a-c0cd662e2435-kube-api-access-g85wd" (OuterVolumeSpecName: "kube-api-access-g85wd") pod "ed473b65-2ea1-49fc-b02a-c0cd662e2435" (UID: "ed473b65-2ea1-49fc-b02a-c0cd662e2435"). InnerVolumeSpecName "kube-api-access-g85wd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:04:05.325427 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:05.325394 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ed473b65-2ea1-49fc-b02a-c0cd662e2435-util" (OuterVolumeSpecName: "util") pod "ed473b65-2ea1-49fc-b02a-c0cd662e2435" (UID: "ed473b65-2ea1-49fc-b02a-c0cd662e2435"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 04:04:05.420810 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:05.420769 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ed473b65-2ea1-49fc-b02a-c0cd662e2435-util\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:04:05.420810 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:05.420803 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g85wd\" (UniqueName: \"kubernetes.io/projected/ed473b65-2ea1-49fc-b02a-c0cd662e2435-kube-api-access-g85wd\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:04:05.420810 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:05.420814 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ed473b65-2ea1-49fc-b02a-c0cd662e2435-bundle\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:04:06.050785 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:06.050745 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9" event={"ID":"ed473b65-2ea1-49fc-b02a-c0cd662e2435","Type":"ContainerDied","Data":"75266d90c80a6b9e3df66a622683310b19c92663a43d1b49043ba9acb2c3cac9"} Jul 24 04:04:06.050785 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:06.050778 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e675404q8p9" Jul 24 04:04:06.050990 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:06.050800 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="75266d90c80a6b9e3df66a622683310b19c92663a43d1b49043ba9acb2c3cac9" Jul 24 04:04:12.041750 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:12.041714 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:12.821032 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:12.821000 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:13.989124 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:13.989087 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-h7chb"] Jul 24 04:04:13.989539 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:13.989378 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed473b65-2ea1-49fc-b02a-c0cd662e2435" containerName="extract" Jul 24 04:04:13.989539 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:13.989388 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed473b65-2ea1-49fc-b02a-c0cd662e2435" containerName="extract" Jul 24 04:04:13.989539 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:13.989405 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed473b65-2ea1-49fc-b02a-c0cd662e2435" containerName="pull" Jul 24 04:04:13.989539 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:13.989411 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed473b65-2ea1-49fc-b02a-c0cd662e2435" containerName="pull" Jul 24 04:04:13.989539 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:13.989418 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ed473b65-2ea1-49fc-b02a-c0cd662e2435" containerName="util" Jul 24 04:04:13.989539 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:13.989423 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="ed473b65-2ea1-49fc-b02a-c0cd662e2435" containerName="util" Jul 24 04:04:13.989539 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:13.989468 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="ed473b65-2ea1-49fc-b02a-c0cd662e2435" containerName="extract" Jul 24 04:04:13.991378 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:13.991362 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-h7chb" Jul 24 04:04:13.994125 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:13.994089 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 24 04:04:13.994305 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:13.994138 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 24 04:04:13.994430 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:13.994413 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-bfp7n\"" Jul 24 04:04:14.005093 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:14.005065 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-h7chb"] Jul 24 04:04:14.098641 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:14.098605 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e9342ce-05be-4df3-ab34-4834a588f893-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-h7chb\" (UID: \"1e9342ce-05be-4df3-ab34-4834a588f893\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-h7chb" Jul 24 04:04:14.098849 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:14.098665 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j82d\" (UniqueName: \"kubernetes.io/projected/1e9342ce-05be-4df3-ab34-4834a588f893-kube-api-access-8j82d\") pod \"cert-manager-operator-controller-manager-55c444bf86-h7chb\" (UID: \"1e9342ce-05be-4df3-ab34-4834a588f893\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-h7chb" Jul 24 04:04:14.200073 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:14.200032 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e9342ce-05be-4df3-ab34-4834a588f893-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-h7chb\" (UID: \"1e9342ce-05be-4df3-ab34-4834a588f893\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-h7chb" Jul 24 04:04:14.200282 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:14.200133 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j82d\" (UniqueName: \"kubernetes.io/projected/1e9342ce-05be-4df3-ab34-4834a588f893-kube-api-access-8j82d\") pod \"cert-manager-operator-controller-manager-55c444bf86-h7chb\" (UID: \"1e9342ce-05be-4df3-ab34-4834a588f893\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-h7chb" Jul 24 04:04:14.200459 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:14.200440 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/1e9342ce-05be-4df3-ab34-4834a588f893-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-h7chb\" (UID: \"1e9342ce-05be-4df3-ab34-4834a588f893\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-h7chb" Jul 24 04:04:14.208353 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:14.208326 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j82d\" (UniqueName: \"kubernetes.io/projected/1e9342ce-05be-4df3-ab34-4834a588f893-kube-api-access-8j82d\") pod \"cert-manager-operator-controller-manager-55c444bf86-h7chb\" (UID: \"1e9342ce-05be-4df3-ab34-4834a588f893\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-h7chb" Jul 24 04:04:14.301134 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:14.301046 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-h7chb" Jul 24 04:04:14.437168 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:14.437141 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-h7chb"] Jul 24 04:04:14.439881 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:04:14.439854 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e9342ce_05be_4df3_ab34_4834a588f893.slice/crio-0eec89d0fb88f1410e59b60d9e4d8e432a9e0ad084bcb94f002113f08fe88e2c WatchSource:0}: Error finding container 0eec89d0fb88f1410e59b60d9e4d8e432a9e0ad084bcb94f002113f08fe88e2c: Status 404 returned error can't find the container with id 0eec89d0fb88f1410e59b60d9e4d8e432a9e0ad084bcb94f002113f08fe88e2c Jul 24 04:04:15.086080 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:15.086040 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-h7chb" event={"ID":"1e9342ce-05be-4df3-ab34-4834a588f893","Type":"ContainerStarted","Data":"0eec89d0fb88f1410e59b60d9e4d8e432a9e0ad084bcb94f002113f08fe88e2c"} Jul 24 04:04:15.648968 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:15.648924 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:15.752744 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:15.752709 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:17.097714 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:17.097678 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-h7chb" event={"ID":"1e9342ce-05be-4df3-ab34-4834a588f893","Type":"ContainerStarted","Data":"5c0ccc2b295dcd4004746fab10c9953dbcd831c605e8e6052145da7507e53809"} Jul 24 04:04:17.118450 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:17.118390 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-h7chb" podStartSLOduration=2.225581346 podStartE2EDuration="4.118371064s" totalImagesPullingTime="1.892789718s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:04:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:04:17.116236551 +0000 UTC m=+238.862610133" watchObservedRunningTime="2026-07-24 04:04:17.118371064 +0000 UTC m=+238.864744646" Jul 24 04:04:17.401223 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:17.401141 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:17.500995 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:17.500960 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:17.613875 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:17.613839 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:17.627522 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:17.627487 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4fgnr"] Jul 24 04:04:17.629636 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:17.629615 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4fgnr" Jul 24 04:04:17.630864 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:17.630842 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff5211cb-b9f4-482d-8802-677428b7de30-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4fgnr\" (UID: \"ff5211cb-b9f4-482d-8802-677428b7de30\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4fgnr" Jul 24 04:04:17.630969 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:17.630893 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j9rvn\" (UniqueName: \"kubernetes.io/projected/ff5211cb-b9f4-482d-8802-677428b7de30-kube-api-access-j9rvn\") pod \"cert-manager-webhook-6486ffd997-4fgnr\" (UID: \"ff5211cb-b9f4-482d-8802-677428b7de30\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4fgnr" Jul 24 04:04:17.632455 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:17.632433 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-tnqq9\"" Jul 24 04:04:17.632589 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:17.632438 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 24 04:04:17.632754 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:17.632738 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 24 04:04:17.642690 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:17.642661 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4fgnr"] Jul 24 04:04:17.731760 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:17.731726 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff5211cb-b9f4-482d-8802-677428b7de30-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4fgnr\" (UID: \"ff5211cb-b9f4-482d-8802-677428b7de30\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4fgnr" Jul 24 04:04:17.731953 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:17.731789 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j9rvn\" (UniqueName: \"kubernetes.io/projected/ff5211cb-b9f4-482d-8802-677428b7de30-kube-api-access-j9rvn\") pod \"cert-manager-webhook-6486ffd997-4fgnr\" (UID: \"ff5211cb-b9f4-482d-8802-677428b7de30\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4fgnr" Jul 24 04:04:17.748739 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:17.748702 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j9rvn\" (UniqueName: \"kubernetes.io/projected/ff5211cb-b9f4-482d-8802-677428b7de30-kube-api-access-j9rvn\") pod \"cert-manager-webhook-6486ffd997-4fgnr\" (UID: \"ff5211cb-b9f4-482d-8802-677428b7de30\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4fgnr" Jul 24 04:04:17.756426 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:17.756391 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ff5211cb-b9f4-482d-8802-677428b7de30-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-4fgnr\" (UID: \"ff5211cb-b9f4-482d-8802-677428b7de30\") " pod="cert-manager/cert-manager-webhook-6486ffd997-4fgnr" Jul 24 04:04:17.773422 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:17.773391 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:17.949001 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:17.948956 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-4fgnr" Jul 24 04:04:18.084852 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:18.084828 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-4fgnr"] Jul 24 04:04:18.086778 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:04:18.086750 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podff5211cb_b9f4_482d_8802_677428b7de30.slice/crio-7a274958b201697393aa71d9b136a171838659d56e93e325a2f1d5dfa5f7b4b5 WatchSource:0}: Error finding container 7a274958b201697393aa71d9b136a171838659d56e93e325a2f1d5dfa5f7b4b5: Status 404 returned error can't find the container with id 7a274958b201697393aa71d9b136a171838659d56e93e325a2f1d5dfa5f7b4b5 Jul 24 04:04:18.103080 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:18.103044 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4fgnr" event={"ID":"ff5211cb-b9f4-482d-8802-677428b7de30","Type":"ContainerStarted","Data":"7a274958b201697393aa71d9b136a171838659d56e93e325a2f1d5dfa5f7b4b5"} Jul 24 04:04:18.256905 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:18.256800 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr"] Jul 24 04:04:18.260078 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:18.260054 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr" Jul 24 04:04:18.263348 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:18.263313 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 24 04:04:18.263510 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:18.263370 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xfj6m\"" Jul 24 04:04:18.263574 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:18.263558 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 24 04:04:18.269826 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:18.269802 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr"] Jul 24 04:04:18.337357 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:18.337318 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr\" (UID: \"9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr" Jul 24 04:04:18.337545 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:18.337373 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr\" (UID: \"9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr" Jul 24 04:04:18.337545 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:18.337400 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nkx8s\" (UniqueName: \"kubernetes.io/projected/9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e-kube-api-access-nkx8s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr\" (UID: \"9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr" Jul 24 04:04:18.437892 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:18.437857 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr\" (UID: \"9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr" Jul 24 04:04:18.438088 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:18.437913 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr\" (UID: \"9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr" Jul 24 04:04:18.438088 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:18.437948 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nkx8s\" (UniqueName: \"kubernetes.io/projected/9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e-kube-api-access-nkx8s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr\" (UID: \"9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr" Jul 24 04:04:18.438274 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:18.438251 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr\" (UID: \"9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr" Jul 24 04:04:18.438334 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:18.438301 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr\" (UID: \"9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr" Jul 24 04:04:18.446113 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:18.446087 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nkx8s\" (UniqueName: \"kubernetes.io/projected/9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e-kube-api-access-nkx8s\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr\" (UID: \"9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr" Jul 24 04:04:18.571719 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:18.571629 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr" Jul 24 04:04:18.706353 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:18.706326 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr"] Jul 24 04:04:18.708717 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:04:18.708693 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9c61a9f8_b4ee_4ef5_9be0_7f4ff2a5cf2e.slice/crio-e927ce623949d050d30a94c72e032c989e44122ed602a1ef982afa11b4258bda WatchSource:0}: Error finding container e927ce623949d050d30a94c72e032c989e44122ed602a1ef982afa11b4258bda: Status 404 returned error can't find the container with id e927ce623949d050d30a94c72e032c989e44122ed602a1ef982afa11b4258bda Jul 24 04:04:19.006334 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:19.006293 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:19.090305 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:19.090272 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:19.110279 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:19.110217 2563 generic.go:356] "Generic (PLEG): container finished" podID="9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e" containerID="c40dbb6955af5c956aa9edeadf28493ab73ce8283395eb77fb80fdc835c36824" exitCode=0 Jul 24 04:04:19.110279 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:19.110257 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr" event={"ID":"9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e","Type":"ContainerDied","Data":"c40dbb6955af5c956aa9edeadf28493ab73ce8283395eb77fb80fdc835c36824"} Jul 24 04:04:19.110279 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:19.110315 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr" event={"ID":"9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e","Type":"ContainerStarted","Data":"e927ce623949d050d30a94c72e032c989e44122ed602a1ef982afa11b4258bda"} Jul 24 04:04:19.797305 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:19.797248 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:22.126822 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:22.126783 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-4fgnr" event={"ID":"ff5211cb-b9f4-482d-8802-677428b7de30","Type":"ContainerStarted","Data":"3e0ee46ff82f44f2b5e0f0d4a48fa040b17795fdf04b92254408af700baccd78"} Jul 24 04:04:22.127286 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:22.126886 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4fgnr" Jul 24 04:04:22.128572 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:22.128549 2563 generic.go:356] "Generic (PLEG): container finished" podID="9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e" containerID="1dfcb988d154af828c3ae4a1a75dcb5d1c768521ad07b0142d5128757f99dc96" exitCode=0 Jul 24 04:04:22.128697 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:22.128626 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr" event={"ID":"9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e","Type":"ContainerDied","Data":"1dfcb988d154af828c3ae4a1a75dcb5d1c768521ad07b0142d5128757f99dc96"} Jul 24 04:04:22.143199 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:22.143152 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-4fgnr" podStartSLOduration=1.629544488 podStartE2EDuration="5.143134452s" totalImagesPullingTime="3.513589964s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:04:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:04:22.141725471 +0000 UTC m=+243.888099064" watchObservedRunningTime="2026-07-24 04:04:22.143134452 +0000 UTC m=+243.889508034" Jul 24 04:04:22.419381 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:22.419285 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:22.474680 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:22.474648 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:23.135354 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:23.135306 2563 generic.go:356] "Generic (PLEG): container finished" podID="9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e" containerID="cfd9c1e9679332d15ff8663f1d45309d9a6bffcc72cd74b4dab449e7908f04c3" exitCode=0 Jul 24 04:04:23.136132 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:23.136095 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr" event={"ID":"9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e","Type":"ContainerDied","Data":"cfd9c1e9679332d15ff8663f1d45309d9a6bffcc72cd74b4dab449e7908f04c3"} Jul 24 04:04:24.271491 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:24.271445 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr" Jul 24 04:04:24.289295 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:24.289266 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e-util\") pod \"9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e\" (UID: \"9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e\") " Jul 24 04:04:24.289460 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:24.289355 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e-bundle\") pod \"9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e\" (UID: \"9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e\") " Jul 24 04:04:24.289460 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:24.289384 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nkx8s\" (UniqueName: \"kubernetes.io/projected/9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e-kube-api-access-nkx8s\") pod \"9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e\" (UID: \"9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e\") " Jul 24 04:04:24.289913 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:24.289883 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e-bundle" (OuterVolumeSpecName: "bundle") pod "9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e" (UID: "9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 04:04:24.291971 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:24.291941 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e-kube-api-access-nkx8s" (OuterVolumeSpecName: "kube-api-access-nkx8s") pod "9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e" (UID: "9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e"). InnerVolumeSpecName "kube-api-access-nkx8s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:04:24.297065 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:24.297033 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e-util" (OuterVolumeSpecName: "util") pod "9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e" (UID: "9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 04:04:24.390829 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:24.390719 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e-util\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:04:24.390829 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:24.390764 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e-bundle\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:04:24.390829 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:24.390779 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nkx8s\" (UniqueName: \"kubernetes.io/projected/9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e-kube-api-access-nkx8s\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:04:25.146054 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:25.146028 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr" Jul 24 04:04:25.146224 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:25.146050 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fz6xpr" event={"ID":"9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e","Type":"ContainerDied","Data":"e927ce623949d050d30a94c72e032c989e44122ed602a1ef982afa11b4258bda"} Jul 24 04:04:25.146224 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:25.146102 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e927ce623949d050d30a94c72e032c989e44122ed602a1ef982afa11b4258bda" Jul 24 04:04:25.981756 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:25.981720 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rz85k"] Jul 24 04:04:25.982165 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:25.982028 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e" containerName="extract" Jul 24 04:04:25.982165 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:25.982041 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e" containerName="extract" Jul 24 04:04:25.982165 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:25.982053 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e" containerName="util" Jul 24 04:04:25.982165 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:25.982059 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e" containerName="util" Jul 24 04:04:25.982165 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:25.982077 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e" containerName="pull" Jul 24 04:04:25.982165 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:25.982082 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e" containerName="pull" Jul 24 04:04:25.982165 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:25.982124 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="9c61a9f8-b4ee-4ef5-9be0-7f4ff2a5cf2e" containerName="extract" Jul 24 04:04:25.985924 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:25.985904 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rz85k" Jul 24 04:04:25.988231 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:25.988210 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-bflqr\"" Jul 24 04:04:25.991813 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:25.991776 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rz85k"] Jul 24 04:04:26.102789 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:26.102748 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bd382c2-f614-4883-9490-850d30d9ccfd-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rz85k\" (UID: \"9bd382c2-f614-4883-9490-850d30d9ccfd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rz85k" Jul 24 04:04:26.102983 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:26.102878 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-462hl\" (UniqueName: \"kubernetes.io/projected/9bd382c2-f614-4883-9490-850d30d9ccfd-kube-api-access-462hl\") pod \"cert-manager-cainjector-559cdd8c87-rz85k\" (UID: \"9bd382c2-f614-4883-9490-850d30d9ccfd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rz85k" Jul 24 04:04:26.204170 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:26.204124 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-462hl\" (UniqueName: \"kubernetes.io/projected/9bd382c2-f614-4883-9490-850d30d9ccfd-kube-api-access-462hl\") pod \"cert-manager-cainjector-559cdd8c87-rz85k\" (UID: \"9bd382c2-f614-4883-9490-850d30d9ccfd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rz85k" Jul 24 04:04:26.204382 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:26.204187 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bd382c2-f614-4883-9490-850d30d9ccfd-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rz85k\" (UID: \"9bd382c2-f614-4883-9490-850d30d9ccfd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rz85k" Jul 24 04:04:26.212639 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:26.212615 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-462hl\" (UniqueName: \"kubernetes.io/projected/9bd382c2-f614-4883-9490-850d30d9ccfd-kube-api-access-462hl\") pod \"cert-manager-cainjector-559cdd8c87-rz85k\" (UID: \"9bd382c2-f614-4883-9490-850d30d9ccfd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rz85k" Jul 24 04:04:26.212855 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:26.212837 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9bd382c2-f614-4883-9490-850d30d9ccfd-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-rz85k\" (UID: \"9bd382c2-f614-4883-9490-850d30d9ccfd\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-rz85k" Jul 24 04:04:26.296189 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:26.296093 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rz85k" Jul 24 04:04:26.431463 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:26.431432 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-rz85k"] Jul 24 04:04:26.433513 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:04:26.433467 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9bd382c2_f614_4883_9490_850d30d9ccfd.slice/crio-6391210cb962b5d20f29623388fbe651282e5e34cbd7e64add41fab6046e37cd WatchSource:0}: Error finding container 6391210cb962b5d20f29623388fbe651282e5e34cbd7e64add41fab6046e37cd: Status 404 returned error can't find the container with id 6391210cb962b5d20f29623388fbe651282e5e34cbd7e64add41fab6046e37cd Jul 24 04:04:27.156837 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:27.156799 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rz85k" event={"ID":"9bd382c2-f614-4883-9490-850d30d9ccfd","Type":"ContainerStarted","Data":"acb5454d0a433146009718444f84dcc506ba3f4016b355460b09ba98a5ecddb1"} Jul 24 04:04:27.156837 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:27.156845 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rz85k" event={"ID":"9bd382c2-f614-4883-9490-850d30d9ccfd","Type":"ContainerStarted","Data":"6391210cb962b5d20f29623388fbe651282e5e34cbd7e64add41fab6046e37cd"} Jul 24 04:04:27.173086 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:27.173022 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-rz85k" podStartSLOduration=2.17300514 podStartE2EDuration="2.17300514s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:04:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:04:27.170767555 +0000 UTC m=+248.917141129" watchObservedRunningTime="2026-07-24 04:04:27.17300514 +0000 UTC m=+248.919378723" Jul 24 04:04:27.227368 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:27.227333 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:27.288320 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:27.288287 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:28.137993 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:28.137960 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-4fgnr" Jul 24 04:04:29.008626 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:29.008592 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:30.098917 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:30.098872 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:30.199420 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:30.199388 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:30.454116 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:30.454087 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qhbwl"] Jul 24 04:04:30.456387 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:30.456369 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qhbwl" Jul 24 04:04:30.458887 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:30.458858 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-dp5ch\"" Jul 24 04:04:30.466090 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:30.466066 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qhbwl"] Jul 24 04:04:30.542719 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:30.542673 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6bt9l\" (UniqueName: \"kubernetes.io/projected/f641d9cc-a0ef-475d-a995-41ea78b8104a-kube-api-access-6bt9l\") pod \"cert-manager-55b4d954d5-qhbwl\" (UID: \"f641d9cc-a0ef-475d-a995-41ea78b8104a\") " pod="cert-manager/cert-manager-55b4d954d5-qhbwl" Jul 24 04:04:30.542892 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:30.542810 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f641d9cc-a0ef-475d-a995-41ea78b8104a-bound-sa-token\") pod \"cert-manager-55b4d954d5-qhbwl\" (UID: \"f641d9cc-a0ef-475d-a995-41ea78b8104a\") " pod="cert-manager/cert-manager-55b4d954d5-qhbwl" Jul 24 04:04:30.643533 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:30.643463 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6bt9l\" (UniqueName: \"kubernetes.io/projected/f641d9cc-a0ef-475d-a995-41ea78b8104a-kube-api-access-6bt9l\") pod \"cert-manager-55b4d954d5-qhbwl\" (UID: \"f641d9cc-a0ef-475d-a995-41ea78b8104a\") " pod="cert-manager/cert-manager-55b4d954d5-qhbwl" Jul 24 04:04:30.643715 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:30.643595 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f641d9cc-a0ef-475d-a995-41ea78b8104a-bound-sa-token\") pod \"cert-manager-55b4d954d5-qhbwl\" (UID: \"f641d9cc-a0ef-475d-a995-41ea78b8104a\") " pod="cert-manager/cert-manager-55b4d954d5-qhbwl" Jul 24 04:04:30.651904 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:30.651867 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/f641d9cc-a0ef-475d-a995-41ea78b8104a-bound-sa-token\") pod \"cert-manager-55b4d954d5-qhbwl\" (UID: \"f641d9cc-a0ef-475d-a995-41ea78b8104a\") " pod="cert-manager/cert-manager-55b4d954d5-qhbwl" Jul 24 04:04:30.652099 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:30.652072 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6bt9l\" (UniqueName: \"kubernetes.io/projected/f641d9cc-a0ef-475d-a995-41ea78b8104a-kube-api-access-6bt9l\") pod \"cert-manager-55b4d954d5-qhbwl\" (UID: \"f641d9cc-a0ef-475d-a995-41ea78b8104a\") " pod="cert-manager/cert-manager-55b4d954d5-qhbwl" Jul 24 04:04:30.766390 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:30.766283 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-qhbwl" Jul 24 04:04:30.896683 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:30.896655 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-qhbwl"] Jul 24 04:04:30.899080 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:04:30.899055 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podf641d9cc_a0ef_475d_a995_41ea78b8104a.slice/crio-b78e91a3477d09eff021a5dd5ea9bb56d8f3c8b4bb900cb5c219db35b6ee451b WatchSource:0}: Error finding container b78e91a3477d09eff021a5dd5ea9bb56d8f3c8b4bb900cb5c219db35b6ee451b: Status 404 returned error can't find the container with id b78e91a3477d09eff021a5dd5ea9bb56d8f3c8b4bb900cb5c219db35b6ee451b Jul 24 04:04:31.175730 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:31.175633 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qhbwl" event={"ID":"f641d9cc-a0ef-475d-a995-41ea78b8104a","Type":"ContainerStarted","Data":"19f4631d792934b5cef6e7b176da32962343a8a22f8deb2c73755c9fa6eabcc0"} Jul 24 04:04:31.175730 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:31.175680 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-qhbwl" event={"ID":"f641d9cc-a0ef-475d-a995-41ea78b8104a","Type":"ContainerStarted","Data":"b78e91a3477d09eff021a5dd5ea9bb56d8f3c8b4bb900cb5c219db35b6ee451b"} Jul 24 04:04:31.191382 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:31.191326 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-qhbwl" podStartSLOduration=1.191273821 podStartE2EDuration="1.191273821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:04:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:04:31.190405539 +0000 UTC m=+252.936779120" watchObservedRunningTime="2026-07-24 04:04:31.191273821 +0000 UTC m=+252.937647403" Jul 24 04:04:35.534522 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:35.534460 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:35.648686 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:35.648650 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:37.326993 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:37.326958 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw"] Jul 24 04:04:37.370916 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:37.370880 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw"] Jul 24 04:04:37.371104 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:37.371021 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw" Jul 24 04:04:37.373732 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:37.373701 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 24 04:04:37.373863 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:37.373749 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-xfj6m\"" Jul 24 04:04:37.375257 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:37.375229 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 24 04:04:37.447956 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:37.447924 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:37.505409 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:37.505371 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28eb5550-c34e-4bc6-9fbb-aea697362d74-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw\" (UID: \"28eb5550-c34e-4bc6-9fbb-aea697362d74\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw" Jul 24 04:04:37.505600 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:37.505421 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh6gg\" (UniqueName: \"kubernetes.io/projected/28eb5550-c34e-4bc6-9fbb-aea697362d74-kube-api-access-nh6gg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw\" (UID: \"28eb5550-c34e-4bc6-9fbb-aea697362d74\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw" Jul 24 04:04:37.505643 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:37.505593 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28eb5550-c34e-4bc6-9fbb-aea697362d74-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw\" (UID: \"28eb5550-c34e-4bc6-9fbb-aea697362d74\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw" Jul 24 04:04:37.606936 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:37.606836 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28eb5550-c34e-4bc6-9fbb-aea697362d74-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw\" (UID: \"28eb5550-c34e-4bc6-9fbb-aea697362d74\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw" Jul 24 04:04:37.606936 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:37.606890 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28eb5550-c34e-4bc6-9fbb-aea697362d74-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw\" (UID: \"28eb5550-c34e-4bc6-9fbb-aea697362d74\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw" Jul 24 04:04:37.606936 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:37.606916 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh6gg\" (UniqueName: \"kubernetes.io/projected/28eb5550-c34e-4bc6-9fbb-aea697362d74-kube-api-access-nh6gg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw\" (UID: \"28eb5550-c34e-4bc6-9fbb-aea697362d74\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw" Jul 24 04:04:37.607267 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:37.607246 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28eb5550-c34e-4bc6-9fbb-aea697362d74-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw\" (UID: \"28eb5550-c34e-4bc6-9fbb-aea697362d74\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw" Jul 24 04:04:37.607326 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:37.607305 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28eb5550-c34e-4bc6-9fbb-aea697362d74-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw\" (UID: \"28eb5550-c34e-4bc6-9fbb-aea697362d74\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw" Jul 24 04:04:37.616583 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:37.616551 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh6gg\" (UniqueName: \"kubernetes.io/projected/28eb5550-c34e-4bc6-9fbb-aea697362d74-kube-api-access-nh6gg\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw\" (UID: \"28eb5550-c34e-4bc6-9fbb-aea697362d74\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw" Jul 24 04:04:37.686537 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:37.686498 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw" Jul 24 04:04:37.839838 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:37.839742 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw"] Jul 24 04:04:37.842385 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:04:37.842359 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28eb5550_c34e_4bc6_9fbb_aea697362d74.slice/crio-7d5b46648f6f12078585b034ffd9d831ccfb7c479ce49c96ff36aa3a6cfd1f3e WatchSource:0}: Error finding container 7d5b46648f6f12078585b034ffd9d831ccfb7c479ce49c96ff36aa3a6cfd1f3e: Status 404 returned error can't find the container with id 7d5b46648f6f12078585b034ffd9d831ccfb7c479ce49c96ff36aa3a6cfd1f3e Jul 24 04:04:38.207207 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:38.207171 2563 generic.go:356] "Generic (PLEG): container finished" podID="28eb5550-c34e-4bc6-9fbb-aea697362d74" containerID="16b57669e609b41fef97375c4e3b3aeaeeb3634afe35a099dc0d0e3f7c25e2c5" exitCode=0 Jul 24 04:04:38.207389 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:38.207251 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw" event={"ID":"28eb5550-c34e-4bc6-9fbb-aea697362d74","Type":"ContainerDied","Data":"16b57669e609b41fef97375c4e3b3aeaeeb3634afe35a099dc0d0e3f7c25e2c5"} Jul 24 04:04:38.207389 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:38.207311 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw" event={"ID":"28eb5550-c34e-4bc6-9fbb-aea697362d74","Type":"ContainerStarted","Data":"7d5b46648f6f12078585b034ffd9d831ccfb7c479ce49c96ff36aa3a6cfd1f3e"} Jul 24 04:04:40.217590 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:40.217558 2563 generic.go:356] "Generic (PLEG): container finished" podID="28eb5550-c34e-4bc6-9fbb-aea697362d74" containerID="8c93177cec06e35f8975f5f794b7a417ef97ffb4ca17747d7a7530613deef959" exitCode=0 Jul 24 04:04:40.217978 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:40.217631 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw" event={"ID":"28eb5550-c34e-4bc6-9fbb-aea697362d74","Type":"ContainerDied","Data":"8c93177cec06e35f8975f5f794b7a417ef97ffb4ca17747d7a7530613deef959"} Jul 24 04:04:41.223987 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:41.223951 2563 generic.go:356] "Generic (PLEG): container finished" podID="28eb5550-c34e-4bc6-9fbb-aea697362d74" containerID="e47b455429d051a54c2cbb94b3399e7857c327db48d61e9d8a906cfc24a2cafe" exitCode=0 Jul 24 04:04:41.224367 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:41.224020 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw" event={"ID":"28eb5550-c34e-4bc6-9fbb-aea697362d74","Type":"ContainerDied","Data":"e47b455429d051a54c2cbb94b3399e7857c327db48d61e9d8a906cfc24a2cafe"} Jul 24 04:04:42.352841 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:42.352817 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw" Jul 24 04:04:42.447398 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:42.447357 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28eb5550-c34e-4bc6-9fbb-aea697362d74-bundle\") pod \"28eb5550-c34e-4bc6-9fbb-aea697362d74\" (UID: \"28eb5550-c34e-4bc6-9fbb-aea697362d74\") " Jul 24 04:04:42.447606 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:42.447434 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28eb5550-c34e-4bc6-9fbb-aea697362d74-util\") pod \"28eb5550-c34e-4bc6-9fbb-aea697362d74\" (UID: \"28eb5550-c34e-4bc6-9fbb-aea697362d74\") " Jul 24 04:04:42.447606 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:42.447505 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nh6gg\" (UniqueName: \"kubernetes.io/projected/28eb5550-c34e-4bc6-9fbb-aea697362d74-kube-api-access-nh6gg\") pod \"28eb5550-c34e-4bc6-9fbb-aea697362d74\" (UID: \"28eb5550-c34e-4bc6-9fbb-aea697362d74\") " Jul 24 04:04:42.448202 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:42.448170 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28eb5550-c34e-4bc6-9fbb-aea697362d74-bundle" (OuterVolumeSpecName: "bundle") pod "28eb5550-c34e-4bc6-9fbb-aea697362d74" (UID: "28eb5550-c34e-4bc6-9fbb-aea697362d74"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 04:04:42.449593 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:42.449571 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/28eb5550-c34e-4bc6-9fbb-aea697362d74-kube-api-access-nh6gg" (OuterVolumeSpecName: "kube-api-access-nh6gg") pod "28eb5550-c34e-4bc6-9fbb-aea697362d74" (UID: "28eb5550-c34e-4bc6-9fbb-aea697362d74"). InnerVolumeSpecName "kube-api-access-nh6gg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:04:42.453270 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:42.453231 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/28eb5550-c34e-4bc6-9fbb-aea697362d74-util" (OuterVolumeSpecName: "util") pod "28eb5550-c34e-4bc6-9fbb-aea697362d74" (UID: "28eb5550-c34e-4bc6-9fbb-aea697362d74"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 04:04:42.548874 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:42.548795 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/28eb5550-c34e-4bc6-9fbb-aea697362d74-util\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:04:42.548874 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:42.548825 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nh6gg\" (UniqueName: \"kubernetes.io/projected/28eb5550-c34e-4bc6-9fbb-aea697362d74-kube-api-access-nh6gg\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:04:42.548874 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:42.548836 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/28eb5550-c34e-4bc6-9fbb-aea697362d74-bundle\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:04:43.234917 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:43.234828 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw" event={"ID":"28eb5550-c34e-4bc6-9fbb-aea697362d74","Type":"ContainerDied","Data":"7d5b46648f6f12078585b034ffd9d831ccfb7c479ce49c96ff36aa3a6cfd1f3e"} Jul 24 04:04:43.234917 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:43.234886 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="7d5b46648f6f12078585b034ffd9d831ccfb7c479ce49c96ff36aa3a6cfd1f3e" Jul 24 04:04:43.234917 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:43.234842 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796af99rlw" Jul 24 04:04:53.142830 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:53.142799 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:54.530184 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.530140 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:54.642081 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.642033 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:54.754433 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.754400 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx"] Jul 24 04:04:54.754826 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.754807 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28eb5550-c34e-4bc6-9fbb-aea697362d74" containerName="util" Jul 24 04:04:54.754921 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.754828 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="28eb5550-c34e-4bc6-9fbb-aea697362d74" containerName="util" Jul 24 04:04:54.754921 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.754843 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28eb5550-c34e-4bc6-9fbb-aea697362d74" containerName="extract" Jul 24 04:04:54.754921 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.754853 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="28eb5550-c34e-4bc6-9fbb-aea697362d74" containerName="extract" Jul 24 04:04:54.754921 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.754867 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="28eb5550-c34e-4bc6-9fbb-aea697362d74" containerName="pull" Jul 24 04:04:54.754921 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.754875 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="28eb5550-c34e-4bc6-9fbb-aea697362d74" containerName="pull" Jul 24 04:04:54.755163 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.754954 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="28eb5550-c34e-4bc6-9fbb-aea697362d74" containerName="extract" Jul 24 04:04:54.757855 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.757830 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" Jul 24 04:04:54.762315 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.762294 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 24 04:04:54.763874 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.763847 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 24 04:04:54.764604 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.764401 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 24 04:04:54.765428 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.765411 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-fdbz4\"" Jul 24 04:04:54.766756 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.766742 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 24 04:04:54.791445 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.791361 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx"] Jul 24 04:04:54.858208 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.858169 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b336efd-f6ea-4f51-8378-202c915201b7-tmp\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-5djmx\" (UID: \"7b336efd-f6ea-4f51-8378-202c915201b7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" Jul 24 04:04:54.858367 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.858221 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b336efd-f6ea-4f51-8378-202c915201b7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-5djmx\" (UID: \"7b336efd-f6ea-4f51-8378-202c915201b7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" Jul 24 04:04:54.858367 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.858283 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwpkr\" (UniqueName: \"kubernetes.io/projected/7b336efd-f6ea-4f51-8378-202c915201b7-kube-api-access-jwpkr\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-5djmx\" (UID: \"7b336efd-f6ea-4f51-8378-202c915201b7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" Jul 24 04:04:54.858367 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.858344 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7b336efd-f6ea-4f51-8378-202c915201b7-manifests\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-5djmx\" (UID: \"7b336efd-f6ea-4f51-8378-202c915201b7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" Jul 24 04:04:54.858544 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.858394 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7b336efd-f6ea-4f51-8378-202c915201b7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-5djmx\" (UID: \"7b336efd-f6ea-4f51-8378-202c915201b7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" Jul 24 04:04:54.959145 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.959106 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7b336efd-f6ea-4f51-8378-202c915201b7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-5djmx\" (UID: \"7b336efd-f6ea-4f51-8378-202c915201b7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" Jul 24 04:04:54.959314 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.959171 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b336efd-f6ea-4f51-8378-202c915201b7-tmp\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-5djmx\" (UID: \"7b336efd-f6ea-4f51-8378-202c915201b7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" Jul 24 04:04:54.959314 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.959214 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b336efd-f6ea-4f51-8378-202c915201b7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-5djmx\" (UID: \"7b336efd-f6ea-4f51-8378-202c915201b7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" Jul 24 04:04:54.959314 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.959242 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwpkr\" (UniqueName: \"kubernetes.io/projected/7b336efd-f6ea-4f51-8378-202c915201b7-kube-api-access-jwpkr\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-5djmx\" (UID: \"7b336efd-f6ea-4f51-8378-202c915201b7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" Jul 24 04:04:54.959314 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.959290 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7b336efd-f6ea-4f51-8378-202c915201b7-manifests\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-5djmx\" (UID: \"7b336efd-f6ea-4f51-8378-202c915201b7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" Jul 24 04:04:54.959766 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.959742 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/7b336efd-f6ea-4f51-8378-202c915201b7-manifests\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-5djmx\" (UID: \"7b336efd-f6ea-4f51-8378-202c915201b7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" Jul 24 04:04:54.961677 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.961645 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b336efd-f6ea-4f51-8378-202c915201b7-tmp\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-5djmx\" (UID: \"7b336efd-f6ea-4f51-8378-202c915201b7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" Jul 24 04:04:54.961774 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.961747 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/7b336efd-f6ea-4f51-8378-202c915201b7-webhook-cert\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-5djmx\" (UID: \"7b336efd-f6ea-4f51-8378-202c915201b7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" Jul 24 04:04:54.961885 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.961864 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/7b336efd-f6ea-4f51-8378-202c915201b7-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-5djmx\" (UID: \"7b336efd-f6ea-4f51-8378-202c915201b7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" Jul 24 04:04:54.968984 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:54.968962 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwpkr\" (UniqueName: \"kubernetes.io/projected/7b336efd-f6ea-4f51-8378-202c915201b7-kube-api-access-jwpkr\") pod \"opendatahub-operator-controller-manager-6dfdd98ccb-5djmx\" (UID: \"7b336efd-f6ea-4f51-8378-202c915201b7\") " pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" Jul 24 04:04:55.068245 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:55.068144 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" Jul 24 04:04:55.112833 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:55.112793 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:55.245040 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:55.245007 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx"] Jul 24 04:04:55.248551 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:04:55.248521 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b336efd_f6ea_4f51_8378_202c915201b7.slice/crio-827802bc35e63422d24b18c0b25fe74b205879924df0b9a785758d6bf8dac61f WatchSource:0}: Error finding container 827802bc35e63422d24b18c0b25fe74b205879924df0b9a785758d6bf8dac61f: Status 404 returned error can't find the container with id 827802bc35e63422d24b18c0b25fe74b205879924df0b9a785758d6bf8dac61f Jul 24 04:04:55.264970 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:55.264944 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:55.290729 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:55.290694 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" event={"ID":"7b336efd-f6ea-4f51-8378-202c915201b7","Type":"ContainerStarted","Data":"827802bc35e63422d24b18c0b25fe74b205879924df0b9a785758d6bf8dac61f"} Jul 24 04:04:55.383091 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:55.383009 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:55.500609 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:55.500573 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:55.604839 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:55.604805 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:55.893153 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:55.893116 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:56.015365 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:56.015322 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:56.442201 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:56.442124 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:56.551863 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:56.551802 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:04:58.307411 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:58.307375 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" event={"ID":"7b336efd-f6ea-4f51-8378-202c915201b7","Type":"ContainerStarted","Data":"1f11d4249e74860c3c00bca3359f3d75671f63f0f60b0b9e38320aedaa3bdf16"} Jul 24 04:04:59.314095 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:59.314056 2563 generic.go:356] "Generic (PLEG): container finished" podID="7b336efd-f6ea-4f51-8378-202c915201b7" containerID="1f11d4249e74860c3c00bca3359f3d75671f63f0f60b0b9e38320aedaa3bdf16" exitCode=0 Jul 24 04:04:59.314468 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:04:59.314139 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" event={"ID":"7b336efd-f6ea-4f51-8378-202c915201b7","Type":"ContainerDied","Data":"1f11d4249e74860c3c00bca3359f3d75671f63f0f60b0b9e38320aedaa3bdf16"} Jul 24 04:05:00.320605 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:00.320568 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" event={"ID":"7b336efd-f6ea-4f51-8378-202c915201b7","Type":"ContainerStarted","Data":"e396676a08230ea014677cab8aa86ea74832dabdc4cb68aff07cdb46bca7d2fc"} Jul 24 04:05:00.321103 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:00.320658 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" Jul 24 04:05:06.264343 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:06.264304 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:06.388245 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:06.388209 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:09.459711 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:09.459676 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:09.561261 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:09.561221 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:09.902598 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:09.902499 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:10.003299 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:10.003266 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:10.409003 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:10.408961 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:10.510257 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:10.510221 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:11.327270 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:11.327238 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" Jul 24 04:05:11.352257 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:11.352179 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6dfdd98ccb-5djmx" podStartSLOduration=12.913021913 podStartE2EDuration="17.352161332s" totalImagesPullingTime="3.401042919s" totalInitContainerRuntime="1.0380965s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:04:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:05:00.356686718 +0000 UTC m=+282.103060301" watchObservedRunningTime="2026-07-24 04:05:11.352161332 +0000 UTC m=+293.098534915" Jul 24 04:05:12.509127 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:12.509094 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:14.510419 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:14.510375 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:14.644266 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:14.644216 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:15.101276 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.101234 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:15.271944 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.271900 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:15.276054 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.276020 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-555685c6b7-msds4"] Jul 24 04:05:15.282653 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.282622 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-555685c6b7-msds4" Jul 24 04:05:15.288401 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.288361 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 24 04:05:15.288609 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.288494 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 24 04:05:15.289696 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.289671 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 24 04:05:15.289807 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.289788 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 24 04:05:15.289922 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.289904 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-zzsfh\"" Jul 24 04:05:15.292078 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.292051 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-555685c6b7-msds4"] Jul 24 04:05:15.328516 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.328453 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cc95h\" (UniqueName: \"kubernetes.io/projected/659b4d8e-8b94-48ed-b294-42200d52c5ab-kube-api-access-cc95h\") pod \"kube-auth-proxy-555685c6b7-msds4\" (UID: \"659b4d8e-8b94-48ed-b294-42200d52c5ab\") " pod="openshift-ingress/kube-auth-proxy-555685c6b7-msds4" Jul 24 04:05:15.328714 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.328554 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/659b4d8e-8b94-48ed-b294-42200d52c5ab-tls-certs\") pod \"kube-auth-proxy-555685c6b7-msds4\" (UID: \"659b4d8e-8b94-48ed-b294-42200d52c5ab\") " pod="openshift-ingress/kube-auth-proxy-555685c6b7-msds4" Jul 24 04:05:15.328714 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.328595 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/659b4d8e-8b94-48ed-b294-42200d52c5ab-tmp\") pod \"kube-auth-proxy-555685c6b7-msds4\" (UID: \"659b4d8e-8b94-48ed-b294-42200d52c5ab\") " pod="openshift-ingress/kube-auth-proxy-555685c6b7-msds4" Jul 24 04:05:15.420167 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.420070 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:15.429264 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.429231 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cc95h\" (UniqueName: \"kubernetes.io/projected/659b4d8e-8b94-48ed-b294-42200d52c5ab-kube-api-access-cc95h\") pod \"kube-auth-proxy-555685c6b7-msds4\" (UID: \"659b4d8e-8b94-48ed-b294-42200d52c5ab\") " pod="openshift-ingress/kube-auth-proxy-555685c6b7-msds4" Jul 24 04:05:15.429340 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.429294 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/659b4d8e-8b94-48ed-b294-42200d52c5ab-tls-certs\") pod \"kube-auth-proxy-555685c6b7-msds4\" (UID: \"659b4d8e-8b94-48ed-b294-42200d52c5ab\") " pod="openshift-ingress/kube-auth-proxy-555685c6b7-msds4" Jul 24 04:05:15.429340 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.429326 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/659b4d8e-8b94-48ed-b294-42200d52c5ab-tmp\") pod \"kube-auth-proxy-555685c6b7-msds4\" (UID: \"659b4d8e-8b94-48ed-b294-42200d52c5ab\") " pod="openshift-ingress/kube-auth-proxy-555685c6b7-msds4" Jul 24 04:05:15.431653 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.431625 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/659b4d8e-8b94-48ed-b294-42200d52c5ab-tmp\") pod \"kube-auth-proxy-555685c6b7-msds4\" (UID: \"659b4d8e-8b94-48ed-b294-42200d52c5ab\") " pod="openshift-ingress/kube-auth-proxy-555685c6b7-msds4" Jul 24 04:05:15.431974 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.431952 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/659b4d8e-8b94-48ed-b294-42200d52c5ab-tls-certs\") pod \"kube-auth-proxy-555685c6b7-msds4\" (UID: \"659b4d8e-8b94-48ed-b294-42200d52c5ab\") " pod="openshift-ingress/kube-auth-proxy-555685c6b7-msds4" Jul 24 04:05:15.444277 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.444242 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cc95h\" (UniqueName: \"kubernetes.io/projected/659b4d8e-8b94-48ed-b294-42200d52c5ab-kube-api-access-cc95h\") pod \"kube-auth-proxy-555685c6b7-msds4\" (UID: \"659b4d8e-8b94-48ed-b294-42200d52c5ab\") " pod="openshift-ingress/kube-auth-proxy-555685c6b7-msds4" Jul 24 04:05:15.527810 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.527780 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:15.594214 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.594178 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-555685c6b7-msds4" Jul 24 04:05:15.661337 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.661256 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:15.774943 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.774912 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-555685c6b7-msds4"] Jul 24 04:05:15.777585 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:05:15.777551 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod659b4d8e_8b94_48ed_b294_42200d52c5ab.slice/crio-80bf30adbc2045492b4b927fbbfa359146ecff43e02bb3aa30ce528d2de147de WatchSource:0}: Error finding container 80bf30adbc2045492b4b927fbbfa359146ecff43e02bb3aa30ce528d2de147de: Status 404 returned error can't find the container with id 80bf30adbc2045492b4b927fbbfa359146ecff43e02bb3aa30ce528d2de147de Jul 24 04:05:15.842610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:15.842574 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:16.014549 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:16.014511 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:16.398539 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:16.398424 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-555685c6b7-msds4" event={"ID":"659b4d8e-8b94-48ed-b294-42200d52c5ab","Type":"ContainerStarted","Data":"80bf30adbc2045492b4b927fbbfa359146ecff43e02bb3aa30ce528d2de147de"} Jul 24 04:05:16.886687 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:16.886651 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:16.933800 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:16.933756 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jg4jj"] Jul 24 04:05:16.937010 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:16.936972 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jg4jj" Jul 24 04:05:16.941248 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:16.941206 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhqd5\" (UniqueName: \"kubernetes.io/projected/58f0720e-e218-488e-9f6f-753cfaddd960-kube-api-access-bhqd5\") pod \"model-serving-api-54d89bd5fc-jg4jj\" (UID: \"58f0720e-e218-488e-9f6f-753cfaddd960\") " pod="opendatahub/model-serving-api-54d89bd5fc-jg4jj" Jul 24 04:05:16.941415 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:16.941314 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58f0720e-e218-488e-9f6f-753cfaddd960-tls-certs\") pod \"model-serving-api-54d89bd5fc-jg4jj\" (UID: \"58f0720e-e218-488e-9f6f-753cfaddd960\") " pod="opendatahub/model-serving-api-54d89bd5fc-jg4jj" Jul 24 04:05:16.942256 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:16.942231 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 24 04:05:16.942533 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:16.942265 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-5dbp6\"" Jul 24 04:05:16.973770 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:16.973682 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jg4jj"] Jul 24 04:05:17.042452 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.042419 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58f0720e-e218-488e-9f6f-753cfaddd960-tls-certs\") pod \"model-serving-api-54d89bd5fc-jg4jj\" (UID: \"58f0720e-e218-488e-9f6f-753cfaddd960\") " pod="opendatahub/model-serving-api-54d89bd5fc-jg4jj" Jul 24 04:05:17.042656 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.042532 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhqd5\" (UniqueName: \"kubernetes.io/projected/58f0720e-e218-488e-9f6f-753cfaddd960-kube-api-access-bhqd5\") pod \"model-serving-api-54d89bd5fc-jg4jj\" (UID: \"58f0720e-e218-488e-9f6f-753cfaddd960\") " pod="opendatahub/model-serving-api-54d89bd5fc-jg4jj" Jul 24 04:05:17.042656 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:05:17.042591 2563 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 24 04:05:17.042745 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:05:17.042703 2563 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/58f0720e-e218-488e-9f6f-753cfaddd960-tls-certs podName:58f0720e-e218-488e-9f6f-753cfaddd960 nodeName:}" failed. No retries permitted until 2026-07-24 04:05:17.542677801 +0000 UTC m=+299.289051374 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/58f0720e-e218-488e-9f6f-753cfaddd960-tls-certs") pod "model-serving-api-54d89bd5fc-jg4jj" (UID: "58f0720e-e218-488e-9f6f-753cfaddd960") : secret "model-serving-api-tls" not found Jul 24 04:05:17.067448 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.067411 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhqd5\" (UniqueName: \"kubernetes.io/projected/58f0720e-e218-488e-9f6f-753cfaddd960-kube-api-access-bhqd5\") pod \"model-serving-api-54d89bd5fc-jg4jj\" (UID: \"58f0720e-e218-488e-9f6f-753cfaddd960\") " pod="opendatahub/model-serving-api-54d89bd5fc-jg4jj" Jul 24 04:05:17.298100 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.298060 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:17.472792 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.472752 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz"] Jul 24 04:05:17.475149 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.475132 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.479552 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.479529 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 24 04:05:17.479739 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.479726 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 24 04:05:17.480030 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.480015 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 24 04:05:17.480230 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.480209 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 24 04:05:17.480284 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.480238 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-cc9r7\"" Jul 24 04:05:17.492691 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.492657 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz"] Jul 24 04:05:17.493255 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.493220 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:17.545345 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.545294 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c01973a7-c220-468c-a106-230eebbe0823-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-znmdz\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.545591 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.545387 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c01973a7-c220-468c-a106-230eebbe0823-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-znmdz\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.545591 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.545412 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c01973a7-c220-468c-a106-230eebbe0823-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-znmdz\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.545591 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.545430 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c01973a7-c220-468c-a106-230eebbe0823-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-znmdz\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.545591 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.545457 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58f0720e-e218-488e-9f6f-753cfaddd960-tls-certs\") pod \"model-serving-api-54d89bd5fc-jg4jj\" (UID: \"58f0720e-e218-488e-9f6f-753cfaddd960\") " pod="opendatahub/model-serving-api-54d89bd5fc-jg4jj" Jul 24 04:05:17.545591 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.545531 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c01973a7-c220-468c-a106-230eebbe0823-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-znmdz\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.545839 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.545631 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xf5v4\" (UniqueName: \"kubernetes.io/projected/c01973a7-c220-468c-a106-230eebbe0823-kube-api-access-xf5v4\") pod \"istiod-openshift-gateway-7b7995d5cd-znmdz\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.545839 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.545681 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c01973a7-c220-468c-a106-230eebbe0823-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-znmdz\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.548609 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.548546 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/58f0720e-e218-488e-9f6f-753cfaddd960-tls-certs\") pod \"model-serving-api-54d89bd5fc-jg4jj\" (UID: \"58f0720e-e218-488e-9f6f-753cfaddd960\") " pod="opendatahub/model-serving-api-54d89bd5fc-jg4jj" Jul 24 04:05:17.550356 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.550337 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-jg4jj" Jul 24 04:05:17.605711 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.605621 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:17.646286 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.646245 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c01973a7-c220-468c-a106-230eebbe0823-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-znmdz\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.646462 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.646358 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c01973a7-c220-468c-a106-230eebbe0823-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-znmdz\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.646462 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.646387 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c01973a7-c220-468c-a106-230eebbe0823-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-znmdz\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.646462 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.646411 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c01973a7-c220-468c-a106-230eebbe0823-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-znmdz\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.646462 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.646444 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c01973a7-c220-468c-a106-230eebbe0823-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-znmdz\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.646673 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.646497 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xf5v4\" (UniqueName: \"kubernetes.io/projected/c01973a7-c220-468c-a106-230eebbe0823-kube-api-access-xf5v4\") pod \"istiod-openshift-gateway-7b7995d5cd-znmdz\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.646673 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.646533 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c01973a7-c220-468c-a106-230eebbe0823-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-znmdz\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.647573 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.647457 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c01973a7-c220-468c-a106-230eebbe0823-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7b7995d5cd-znmdz\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.649222 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.649192 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c01973a7-c220-468c-a106-230eebbe0823-local-certs\") pod \"istiod-openshift-gateway-7b7995d5cd-znmdz\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.649334 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.649199 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c01973a7-c220-468c-a106-230eebbe0823-istio-kubeconfig\") pod \"istiod-openshift-gateway-7b7995d5cd-znmdz\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.649334 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.649319 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c01973a7-c220-468c-a106-230eebbe0823-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7b7995d5cd-znmdz\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.649452 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.649390 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c01973a7-c220-468c-a106-230eebbe0823-cacerts\") pod \"istiod-openshift-gateway-7b7995d5cd-znmdz\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.663017 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.662939 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c01973a7-c220-468c-a106-230eebbe0823-istio-token\") pod \"istiod-openshift-gateway-7b7995d5cd-znmdz\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.663989 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.663967 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xf5v4\" (UniqueName: \"kubernetes.io/projected/c01973a7-c220-468c-a106-230eebbe0823-kube-api-access-xf5v4\") pod \"istiod-openshift-gateway-7b7995d5cd-znmdz\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.713737 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.713697 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-jg4jj"] Jul 24 04:05:17.716922 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:05:17.716893 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod58f0720e_e218_488e_9f6f_753cfaddd960.slice/crio-d411d9832190cbd50ef337baf5a3fb0d94273373ca08a63b183e57471c177e6b WatchSource:0}: Error finding container d411d9832190cbd50ef337baf5a3fb0d94273373ca08a63b183e57471c177e6b: Status 404 returned error can't find the container with id d411d9832190cbd50ef337baf5a3fb0d94273373ca08a63b183e57471c177e6b Jul 24 04:05:17.785157 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.785121 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:17.989888 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:17.989854 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz"] Jul 24 04:05:17.992147 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:05:17.992109 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc01973a7_c220_468c_a106_230eebbe0823.slice/crio-8320059a8fe36e50a28bbde9e477a55ac2e4451dc8b73f33c1b52814779422da WatchSource:0}: Error finding container 8320059a8fe36e50a28bbde9e477a55ac2e4451dc8b73f33c1b52814779422da: Status 404 returned error can't find the container with id 8320059a8fe36e50a28bbde9e477a55ac2e4451dc8b73f33c1b52814779422da Jul 24 04:05:18.412862 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:18.412817 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jg4jj" event={"ID":"58f0720e-e218-488e-9f6f-753cfaddd960","Type":"ContainerStarted","Data":"d411d9832190cbd50ef337baf5a3fb0d94273373ca08a63b183e57471c177e6b"} Jul 24 04:05:18.414640 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:18.414609 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" event={"ID":"c01973a7-c220-468c-a106-230eebbe0823","Type":"ContainerStarted","Data":"8320059a8fe36e50a28bbde9e477a55ac2e4451dc8b73f33c1b52814779422da"} Jul 24 04:05:18.716303 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:18.716274 2563 kubelet.go:1648] "Image garbage collection succeeded" Jul 24 04:05:18.923744 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:18.923580 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:20.070649 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:20.070622 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 24 04:05:20.428857 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:20.428679 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-jg4jj" event={"ID":"58f0720e-e218-488e-9f6f-753cfaddd960","Type":"ContainerStarted","Data":"78336d7db192d1aa8a72b6d2e31d6fd4444ecff4e263f01f88addd500b84df10"} Jul 24 04:05:20.429028 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:20.428912 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-jg4jj" Jul 24 04:05:20.431417 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:20.430967 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-555685c6b7-msds4" event={"ID":"659b4d8e-8b94-48ed-b294-42200d52c5ab","Type":"ContainerStarted","Data":"c9fa5f2e9510446219bba9dc202b99203484180fba1599a9e72339f904b2a202"} Jul 24 04:05:20.448163 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:20.448106 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-jg4jj" podStartSLOduration=2.112978313 podStartE2EDuration="4.448084867s" totalImagesPullingTime="2.335106554s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:05:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:05:20.44621335 +0000 UTC m=+302.192586961" watchObservedRunningTime="2026-07-24 04:05:20.448084867 +0000 UTC m=+302.194458451" Jul 24 04:05:20.468885 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:20.468830 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-555685c6b7-msds4" podStartSLOduration=1.1827119449999999 podStartE2EDuration="5.468813778s" totalImagesPullingTime="4.286101833s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:05:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:05:20.466701669 +0000 UTC m=+302.213075252" watchObservedRunningTime="2026-07-24 04:05:20.468813778 +0000 UTC m=+302.215187361" Jul 24 04:05:21.448091 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:21.448053 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 04:05:21.448408 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:21.448121 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 04:05:22.396014 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:22.395972 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:22.445279 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:22.445241 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" event={"ID":"c01973a7-c220-468c-a106-230eebbe0823","Type":"ContainerStarted","Data":"e108b80a8db9dfd39eeed7fbfebb3557bda56a8a72fa3fe98d582a345252c657"} Jul 24 04:05:22.446634 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:22.446610 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:22.448323 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:22.448292 2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7b7995d5cd-znmdz container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 24 04:05:22.448771 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:22.448377 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" podUID="c01973a7-c220-468c-a106-230eebbe0823" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 04:05:22.492381 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:22.492315 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" podStartSLOduration=2.039323657 podStartE2EDuration="5.492294593s" totalImagesPullingTime="3.452970936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:05:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:05:22.489531354 +0000 UTC m=+304.235904950" watchObservedRunningTime="2026-07-24 04:05:22.492294593 +0000 UTC m=+304.238668180" Jul 24 04:05:22.513750 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:22.513702 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:23.286398 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:23.286352 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:23.430060 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:23.430024 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:23.452551 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:23.452521 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:23.657449 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:23.657352 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:26.340253 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.340212 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7"] Jul 24 04:05:26.344225 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.344197 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.359499 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.359435 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7"] Jul 24 04:05:26.420547 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.420465 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/407748c9-5392-43dc-b5d1-08a1c6e0945a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-2lbn7\" (UID: \"407748c9-5392-43dc-b5d1-08a1c6e0945a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.420739 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.420565 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/407748c9-5392-43dc-b5d1-08a1c6e0945a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-2lbn7\" (UID: \"407748c9-5392-43dc-b5d1-08a1c6e0945a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.420739 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.420602 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/407748c9-5392-43dc-b5d1-08a1c6e0945a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-2lbn7\" (UID: \"407748c9-5392-43dc-b5d1-08a1c6e0945a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.420739 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.420628 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/407748c9-5392-43dc-b5d1-08a1c6e0945a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-2lbn7\" (UID: \"407748c9-5392-43dc-b5d1-08a1c6e0945a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.420739 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.420730 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vnchq\" (UniqueName: \"kubernetes.io/projected/407748c9-5392-43dc-b5d1-08a1c6e0945a-kube-api-access-vnchq\") pod \"istiod-openshift-gateway-5677ccb49b-2lbn7\" (UID: \"407748c9-5392-43dc-b5d1-08a1c6e0945a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.420899 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.420772 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/407748c9-5392-43dc-b5d1-08a1c6e0945a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-2lbn7\" (UID: \"407748c9-5392-43dc-b5d1-08a1c6e0945a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.420899 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.420862 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/407748c9-5392-43dc-b5d1-08a1c6e0945a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-2lbn7\" (UID: \"407748c9-5392-43dc-b5d1-08a1c6e0945a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.522097 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.522058 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/407748c9-5392-43dc-b5d1-08a1c6e0945a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-2lbn7\" (UID: \"407748c9-5392-43dc-b5d1-08a1c6e0945a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.522097 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.522099 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/407748c9-5392-43dc-b5d1-08a1c6e0945a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-2lbn7\" (UID: \"407748c9-5392-43dc-b5d1-08a1c6e0945a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.522352 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.522136 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vnchq\" (UniqueName: \"kubernetes.io/projected/407748c9-5392-43dc-b5d1-08a1c6e0945a-kube-api-access-vnchq\") pod \"istiod-openshift-gateway-5677ccb49b-2lbn7\" (UID: \"407748c9-5392-43dc-b5d1-08a1c6e0945a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.522352 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.522166 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/407748c9-5392-43dc-b5d1-08a1c6e0945a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-2lbn7\" (UID: \"407748c9-5392-43dc-b5d1-08a1c6e0945a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.522352 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.522189 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/407748c9-5392-43dc-b5d1-08a1c6e0945a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-2lbn7\" (UID: \"407748c9-5392-43dc-b5d1-08a1c6e0945a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.522352 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.522214 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/407748c9-5392-43dc-b5d1-08a1c6e0945a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-2lbn7\" (UID: \"407748c9-5392-43dc-b5d1-08a1c6e0945a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.522352 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.522237 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/407748c9-5392-43dc-b5d1-08a1c6e0945a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-2lbn7\" (UID: \"407748c9-5392-43dc-b5d1-08a1c6e0945a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.523177 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.523145 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/407748c9-5392-43dc-b5d1-08a1c6e0945a-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-5677ccb49b-2lbn7\" (UID: \"407748c9-5392-43dc-b5d1-08a1c6e0945a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.524710 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.524684 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/407748c9-5392-43dc-b5d1-08a1c6e0945a-local-certs\") pod \"istiod-openshift-gateway-5677ccb49b-2lbn7\" (UID: \"407748c9-5392-43dc-b5d1-08a1c6e0945a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.524807 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.524715 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/407748c9-5392-43dc-b5d1-08a1c6e0945a-cacerts\") pod \"istiod-openshift-gateway-5677ccb49b-2lbn7\" (UID: \"407748c9-5392-43dc-b5d1-08a1c6e0945a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.524807 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.524751 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/407748c9-5392-43dc-b5d1-08a1c6e0945a-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-5677ccb49b-2lbn7\" (UID: \"407748c9-5392-43dc-b5d1-08a1c6e0945a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.524880 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.524808 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/407748c9-5392-43dc-b5d1-08a1c6e0945a-istio-kubeconfig\") pod \"istiod-openshift-gateway-5677ccb49b-2lbn7\" (UID: \"407748c9-5392-43dc-b5d1-08a1c6e0945a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.538779 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.538750 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vnchq\" (UniqueName: \"kubernetes.io/projected/407748c9-5392-43dc-b5d1-08a1c6e0945a-kube-api-access-vnchq\") pod \"istiod-openshift-gateway-5677ccb49b-2lbn7\" (UID: \"407748c9-5392-43dc-b5d1-08a1c6e0945a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.543486 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.543449 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/407748c9-5392-43dc-b5d1-08a1c6e0945a-istio-token\") pod \"istiod-openshift-gateway-5677ccb49b-2lbn7\" (UID: \"407748c9-5392-43dc-b5d1-08a1c6e0945a\") " pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.653740 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.653640 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:26.849836 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.849712 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7"] Jul 24 04:05:26.853146 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.853109 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 04:05:26.853242 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:26.853181 2563 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 24 04:05:27.473839 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:27.473806 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" event={"ID":"407748c9-5392-43dc-b5d1-08a1c6e0945a","Type":"ContainerStarted","Data":"acb869b4f3712c529e6bbe6a0c49587d235b01c850a328dcd559f67771232906"} Jul 24 04:05:27.474317 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:27.473856 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" event={"ID":"407748c9-5392-43dc-b5d1-08a1c6e0945a","Type":"ContainerStarted","Data":"74b52aa5f4b647ec7af523d6628443dbace0c8c596f291924b81f05beddf9331"} Jul 24 04:05:27.474317 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:27.474053 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:27.475781 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:27.475754 2563 patch_prober.go:28] interesting pod/istiod-openshift-gateway-5677ccb49b-2lbn7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 24 04:05:27.475902 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:27.475800 2563 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" podUID="407748c9-5392-43dc-b5d1-08a1c6e0945a" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 24 04:05:27.506793 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:27.506707 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" podStartSLOduration=1.506685821 podStartE2EDuration="1.506685821s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:05:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:05:27.504812537 +0000 UTC m=+309.251186120" watchObservedRunningTime="2026-07-24 04:05:27.506685821 +0000 UTC m=+309.253059404" Jul 24 04:05:27.704298 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:27.704257 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:27.856751 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:27.856602 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:28.054069 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:28.054036 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:28.395181 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:28.395149 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:28.479405 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:28.479377 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-5677ccb49b-2lbn7" Jul 24 04:05:28.578608 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:28.578574 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:28.619645 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:28.619608 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz"] Jul 24 04:05:28.619844 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:28.619822 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" podUID="c01973a7-c220-468c-a106-230eebbe0823" containerName="discovery" containerID="cri-o://e108b80a8db9dfd39eeed7fbfebb3557bda56a8a72fa3fe98d582a345252c657" gracePeriod=30 Jul 24 04:05:28.754411 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:28.754371 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:28.885436 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:28.885409 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:28.962964 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:28.962927 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c01973a7-c220-468c-a106-230eebbe0823-istio-kubeconfig\") pod \"c01973a7-c220-468c-a106-230eebbe0823\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " Jul 24 04:05:28.963162 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:28.962979 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c01973a7-c220-468c-a106-230eebbe0823-istio-token\") pod \"c01973a7-c220-468c-a106-230eebbe0823\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " Jul 24 04:05:28.963162 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:28.963019 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c01973a7-c220-468c-a106-230eebbe0823-istio-csr-dns-cert\") pod \"c01973a7-c220-468c-a106-230eebbe0823\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " Jul 24 04:05:28.963162 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:28.963061 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c01973a7-c220-468c-a106-230eebbe0823-local-certs\") pod \"c01973a7-c220-468c-a106-230eebbe0823\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " Jul 24 04:05:28.963162 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:28.963086 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xf5v4\" (UniqueName: \"kubernetes.io/projected/c01973a7-c220-468c-a106-230eebbe0823-kube-api-access-xf5v4\") pod \"c01973a7-c220-468c-a106-230eebbe0823\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " Jul 24 04:05:28.963162 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:28.963151 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c01973a7-c220-468c-a106-230eebbe0823-cacerts\") pod \"c01973a7-c220-468c-a106-230eebbe0823\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " Jul 24 04:05:28.963425 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:28.963184 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c01973a7-c220-468c-a106-230eebbe0823-istio-csr-ca-configmap\") pod \"c01973a7-c220-468c-a106-230eebbe0823\" (UID: \"c01973a7-c220-468c-a106-230eebbe0823\") " Jul 24 04:05:28.963748 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:28.963714 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c01973a7-c220-468c-a106-230eebbe0823-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "c01973a7-c220-468c-a106-230eebbe0823" (UID: "c01973a7-c220-468c-a106-230eebbe0823"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:05:28.965953 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:28.965916 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c01973a7-c220-468c-a106-230eebbe0823-local-certs" (OuterVolumeSpecName: "local-certs") pod "c01973a7-c220-468c-a106-230eebbe0823" (UID: "c01973a7-c220-468c-a106-230eebbe0823"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 04:05:28.967039 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:28.966148 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c01973a7-c220-468c-a106-230eebbe0823-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "c01973a7-c220-468c-a106-230eebbe0823" (UID: "c01973a7-c220-468c-a106-230eebbe0823"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:05:28.967039 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:28.966340 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c01973a7-c220-468c-a106-230eebbe0823-istio-token" (OuterVolumeSpecName: "istio-token") pod "c01973a7-c220-468c-a106-230eebbe0823" (UID: "c01973a7-c220-468c-a106-230eebbe0823"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:05:28.970517 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:28.967626 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c01973a7-c220-468c-a106-230eebbe0823-kube-api-access-xf5v4" (OuterVolumeSpecName: "kube-api-access-xf5v4") pod "c01973a7-c220-468c-a106-230eebbe0823" (UID: "c01973a7-c220-468c-a106-230eebbe0823"). InnerVolumeSpecName "kube-api-access-xf5v4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:05:28.970517 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:28.968104 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c01973a7-c220-468c-a106-230eebbe0823-cacerts" (OuterVolumeSpecName: "cacerts") pod "c01973a7-c220-468c-a106-230eebbe0823" (UID: "c01973a7-c220-468c-a106-230eebbe0823"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:05:28.973146 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:28.973117 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c01973a7-c220-468c-a106-230eebbe0823-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "c01973a7-c220-468c-a106-230eebbe0823" (UID: "c01973a7-c220-468c-a106-230eebbe0823"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:05:29.065024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:29.064977 2563 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c01973a7-c220-468c-a106-230eebbe0823-istio-token\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:05:29.065024 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:29.065019 2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c01973a7-c220-468c-a106-230eebbe0823-istio-csr-dns-cert\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:05:29.065291 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:29.065034 2563 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c01973a7-c220-468c-a106-230eebbe0823-local-certs\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:05:29.065291 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:29.065050 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xf5v4\" (UniqueName: \"kubernetes.io/projected/c01973a7-c220-468c-a106-230eebbe0823-kube-api-access-xf5v4\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:05:29.065291 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:29.065063 2563 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c01973a7-c220-468c-a106-230eebbe0823-cacerts\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:05:29.065291 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:29.065078 2563 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c01973a7-c220-468c-a106-230eebbe0823-istio-csr-ca-configmap\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:05:29.065291 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:29.065093 2563 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c01973a7-c220-468c-a106-230eebbe0823-istio-kubeconfig\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:05:29.484124 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:29.484078 2563 generic.go:356] "Generic (PLEG): container finished" podID="c01973a7-c220-468c-a106-230eebbe0823" containerID="e108b80a8db9dfd39eeed7fbfebb3557bda56a8a72fa3fe98d582a345252c657" exitCode=0 Jul 24 04:05:29.484611 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:29.484160 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" Jul 24 04:05:29.484611 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:29.484175 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" event={"ID":"c01973a7-c220-468c-a106-230eebbe0823","Type":"ContainerDied","Data":"e108b80a8db9dfd39eeed7fbfebb3557bda56a8a72fa3fe98d582a345252c657"} Jul 24 04:05:29.484611 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:29.484259 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz" event={"ID":"c01973a7-c220-468c-a106-230eebbe0823","Type":"ContainerDied","Data":"8320059a8fe36e50a28bbde9e477a55ac2e4451dc8b73f33c1b52814779422da"} Jul 24 04:05:29.484611 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:29.484282 2563 scope.go:117] "RemoveContainer" containerID="e108b80a8db9dfd39eeed7fbfebb3557bda56a8a72fa3fe98d582a345252c657" Jul 24 04:05:29.493702 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:29.493682 2563 scope.go:117] "RemoveContainer" containerID="e108b80a8db9dfd39eeed7fbfebb3557bda56a8a72fa3fe98d582a345252c657" Jul 24 04:05:29.494000 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:05:29.493978 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e108b80a8db9dfd39eeed7fbfebb3557bda56a8a72fa3fe98d582a345252c657\": container with ID starting with e108b80a8db9dfd39eeed7fbfebb3557bda56a8a72fa3fe98d582a345252c657 not found: ID does not exist" containerID="e108b80a8db9dfd39eeed7fbfebb3557bda56a8a72fa3fe98d582a345252c657" Jul 24 04:05:29.494071 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:29.494013 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e108b80a8db9dfd39eeed7fbfebb3557bda56a8a72fa3fe98d582a345252c657"} err="failed to get container status \"e108b80a8db9dfd39eeed7fbfebb3557bda56a8a72fa3fe98d582a345252c657\": rpc error: code = NotFound desc = could not find container \"e108b80a8db9dfd39eeed7fbfebb3557bda56a8a72fa3fe98d582a345252c657\": container with ID starting with e108b80a8db9dfd39eeed7fbfebb3557bda56a8a72fa3fe98d582a345252c657 not found: ID does not exist" Jul 24 04:05:29.531081 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:29.531042 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz"] Jul 24 04:05:29.536087 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:29.536054 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7b7995d5cd-znmdz"] Jul 24 04:05:30.943544 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:30.943508 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c01973a7-c220-468c-a106-230eebbe0823" path="/var/lib/kubelet/pods/c01973a7-c220-468c-a106-230eebbe0823/volumes" Jul 24 04:05:31.440986 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:31.440898 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-jg4jj" Jul 24 04:05:40.548400 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:40.548363 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:05:40.612326 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:05:40.612286 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:06:04.056283 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:04.056224 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:06:16.094882 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.094839 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:06:16.193300 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.193269 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:06:16.210917 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.210878 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sc2mq"] Jul 24 04:06:16.211250 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.211237 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c01973a7-c220-468c-a106-230eebbe0823" containerName="discovery" Jul 24 04:06:16.211293 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.211251 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c01973a7-c220-468c-a106-230eebbe0823" containerName="discovery" Jul 24 04:06:16.211345 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.211336 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c01973a7-c220-468c-a106-230eebbe0823" containerName="discovery" Jul 24 04:06:16.213268 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.213252 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sc2mq" Jul 24 04:06:16.216728 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.216698 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-n92db\"" Jul 24 04:06:16.217700 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.217677 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 24 04:06:16.217857 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.217733 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 24 04:06:16.226785 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.226758 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sc2mq"] Jul 24 04:06:16.277093 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.277061 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:06:16.283111 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.283085 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7rrn2\" (UniqueName: \"kubernetes.io/projected/70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6-kube-api-access-7rrn2\") pod \"kuadrant-operator-catalog-sc2mq\" (UID: \"70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6\") " pod="kuadrant-system/kuadrant-operator-catalog-sc2mq" Jul 24 04:06:16.383867 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.383782 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7rrn2\" (UniqueName: \"kubernetes.io/projected/70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6-kube-api-access-7rrn2\") pod \"kuadrant-operator-catalog-sc2mq\" (UID: \"70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6\") " pod="kuadrant-system/kuadrant-operator-catalog-sc2mq" Jul 24 04:06:16.392067 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.392034 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7rrn2\" (UniqueName: \"kubernetes.io/projected/70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6-kube-api-access-7rrn2\") pod \"kuadrant-operator-catalog-sc2mq\" (UID: \"70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6\") " pod="kuadrant-system/kuadrant-operator-catalog-sc2mq" Jul 24 04:06:16.526738 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.526698 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sc2mq" Jul 24 04:06:16.575443 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.575404 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sc2mq"] Jul 24 04:06:16.659891 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.659862 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sc2mq"] Jul 24 04:06:16.661995 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:06:16.661967 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70bda542_1c95_4b3e_aa9c_0c64c2cc0ad6.slice/crio-54083a07de309e4ffccc5d98cc7e47f85d186d6caf2bfef3dd5c0552e62ae893 WatchSource:0}: Error finding container 54083a07de309e4ffccc5d98cc7e47f85d186d6caf2bfef3dd5c0552e62ae893: Status 404 returned error can't find the container with id 54083a07de309e4ffccc5d98cc7e47f85d186d6caf2bfef3dd5c0552e62ae893 Jul 24 04:06:16.663242 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.663221 2563 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 24 04:06:16.716837 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.716799 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sc2mq" event={"ID":"70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6","Type":"ContainerStarted","Data":"54083a07de309e4ffccc5d98cc7e47f85d186d6caf2bfef3dd5c0552e62ae893"} Jul 24 04:06:16.781510 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.781458 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wwp78"] Jul 24 04:06:16.784244 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.784227 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wwp78" Jul 24 04:06:16.792012 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.791986 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wwp78"] Jul 24 04:06:16.888673 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.888636 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhh9h\" (UniqueName: \"kubernetes.io/projected/4acfd099-d763-4dc7-9b79-869fc47831cc-kube-api-access-bhh9h\") pod \"kuadrant-operator-catalog-wwp78\" (UID: \"4acfd099-d763-4dc7-9b79-869fc47831cc\") " pod="kuadrant-system/kuadrant-operator-catalog-wwp78" Jul 24 04:06:16.990094 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.990055 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhh9h\" (UniqueName: \"kubernetes.io/projected/4acfd099-d763-4dc7-9b79-869fc47831cc-kube-api-access-bhh9h\") pod \"kuadrant-operator-catalog-wwp78\" (UID: \"4acfd099-d763-4dc7-9b79-869fc47831cc\") " pod="kuadrant-system/kuadrant-operator-catalog-wwp78" Jul 24 04:06:16.998041 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:16.998013 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhh9h\" (UniqueName: \"kubernetes.io/projected/4acfd099-d763-4dc7-9b79-869fc47831cc-kube-api-access-bhh9h\") pod \"kuadrant-operator-catalog-wwp78\" (UID: \"4acfd099-d763-4dc7-9b79-869fc47831cc\") " pod="kuadrant-system/kuadrant-operator-catalog-wwp78" Jul 24 04:06:17.095000 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:17.094956 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-wwp78" Jul 24 04:06:17.248501 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:17.248462 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-wwp78"] Jul 24 04:06:17.250603 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:06:17.250555 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4acfd099_d763_4dc7_9b79_869fc47831cc.slice/crio-227108ee33b2b69219d73d70b99ebdebf16548061113d6c420805345c1301a19 WatchSource:0}: Error finding container 227108ee33b2b69219d73d70b99ebdebf16548061113d6c420805345c1301a19: Status 404 returned error can't find the container with id 227108ee33b2b69219d73d70b99ebdebf16548061113d6c420805345c1301a19 Jul 24 04:06:17.723642 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:17.723600 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wwp78" event={"ID":"4acfd099-d763-4dc7-9b79-869fc47831cc","Type":"ContainerStarted","Data":"227108ee33b2b69219d73d70b99ebdebf16548061113d6c420805345c1301a19"} Jul 24 04:06:19.736226 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:19.736185 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-wwp78" event={"ID":"4acfd099-d763-4dc7-9b79-869fc47831cc","Type":"ContainerStarted","Data":"03ffb5adae2cc7f4c7b5279edad3e08551232c53141ac0e5a8e8e8e3f0b0e9cf"} Jul 24 04:06:19.737808 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:19.737784 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sc2mq" event={"ID":"70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6","Type":"ContainerStarted","Data":"04a32ace83395afd0ed55d2bf7612acc231f1a682e1ca32f49dc69e2e4f4669c"} Jul 24 04:06:19.737920 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:19.737801 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-sc2mq" podUID="70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6" containerName="registry-server" containerID="cri-o://04a32ace83395afd0ed55d2bf7612acc231f1a682e1ca32f49dc69e2e4f4669c" gracePeriod=2 Jul 24 04:06:19.752439 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:19.752379 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-wwp78" podStartSLOduration=1.464745504 podStartE2EDuration="3.752361642s" totalImagesPullingTime="2.287616138s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:06:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:06:19.750020604 +0000 UTC m=+361.496394213" watchObservedRunningTime="2026-07-24 04:06:19.752361642 +0000 UTC m=+361.498735224" Jul 24 04:06:19.764949 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:19.764890 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-sc2mq" podStartSLOduration=0.884495541 podStartE2EDuration="3.764873628s" totalImagesPullingTime="2.880378087s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:06:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:06:19.764202306 +0000 UTC m=+361.510575934" watchObservedRunningTime="2026-07-24 04:06:19.764873628 +0000 UTC m=+361.511247210" Jul 24 04:06:19.982372 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:19.982343 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sc2mq" Jul 24 04:06:20.121579 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:20.121451 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7rrn2\" (UniqueName: \"kubernetes.io/projected/70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6-kube-api-access-7rrn2\") pod \"70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6\" (UID: \"70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6\") " Jul 24 04:06:20.123707 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:20.123671 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6-kube-api-access-7rrn2" (OuterVolumeSpecName: "kube-api-access-7rrn2") pod "70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6" (UID: "70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6"). InnerVolumeSpecName "kube-api-access-7rrn2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:06:20.222805 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:20.222749 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7rrn2\" (UniqueName: \"kubernetes.io/projected/70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6-kube-api-access-7rrn2\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:06:20.745362 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:20.745327 2563 generic.go:356] "Generic (PLEG): container finished" podID="70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6" containerID="04a32ace83395afd0ed55d2bf7612acc231f1a682e1ca32f49dc69e2e4f4669c" exitCode=0 Jul 24 04:06:20.745854 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:20.745379 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-sc2mq" Jul 24 04:06:20.745854 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:20.745422 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sc2mq" event={"ID":"70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6","Type":"ContainerDied","Data":"04a32ace83395afd0ed55d2bf7612acc231f1a682e1ca32f49dc69e2e4f4669c"} Jul 24 04:06:20.745854 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:20.745494 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-sc2mq" event={"ID":"70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6","Type":"ContainerDied","Data":"54083a07de309e4ffccc5d98cc7e47f85d186d6caf2bfef3dd5c0552e62ae893"} Jul 24 04:06:20.745854 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:20.745516 2563 scope.go:117] "RemoveContainer" containerID="04a32ace83395afd0ed55d2bf7612acc231f1a682e1ca32f49dc69e2e4f4669c" Jul 24 04:06:20.755406 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:20.755388 2563 scope.go:117] "RemoveContainer" containerID="04a32ace83395afd0ed55d2bf7612acc231f1a682e1ca32f49dc69e2e4f4669c" Jul 24 04:06:20.755720 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:06:20.755701 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"04a32ace83395afd0ed55d2bf7612acc231f1a682e1ca32f49dc69e2e4f4669c\": container with ID starting with 04a32ace83395afd0ed55d2bf7612acc231f1a682e1ca32f49dc69e2e4f4669c not found: ID does not exist" containerID="04a32ace83395afd0ed55d2bf7612acc231f1a682e1ca32f49dc69e2e4f4669c" Jul 24 04:06:20.755784 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:20.755730 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"04a32ace83395afd0ed55d2bf7612acc231f1a682e1ca32f49dc69e2e4f4669c"} err="failed to get container status \"04a32ace83395afd0ed55d2bf7612acc231f1a682e1ca32f49dc69e2e4f4669c\": rpc error: code = NotFound desc = could not find container \"04a32ace83395afd0ed55d2bf7612acc231f1a682e1ca32f49dc69e2e4f4669c\": container with ID starting with 04a32ace83395afd0ed55d2bf7612acc231f1a682e1ca32f49dc69e2e4f4669c not found: ID does not exist" Jul 24 04:06:20.766502 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:20.766457 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sc2mq"] Jul 24 04:06:20.769959 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:20.769923 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-sc2mq"] Jul 24 04:06:20.943160 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:20.943080 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6" path="/var/lib/kubelet/pods/70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6/volumes" Jul 24 04:06:27.095800 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:27.095764 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-wwp78" Jul 24 04:06:27.096232 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:27.095847 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-wwp78" Jul 24 04:06:27.117666 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:27.117632 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-wwp78" Jul 24 04:06:27.799222 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:27.799195 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-wwp78" Jul 24 04:06:46.848134 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:46.848098 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9"] Jul 24 04:06:46.848534 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:46.848434 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6" containerName="registry-server" Jul 24 04:06:46.848534 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:46.848445 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6" containerName="registry-server" Jul 24 04:06:46.848534 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:46.848531 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="70bda542-1c95-4b3e-aa9c-0c64c2cc0ad6" containerName="registry-server" Jul 24 04:06:46.850786 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:46.850769 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9" Jul 24 04:06:46.853272 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:46.853250 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-g5kfq\"" Jul 24 04:06:46.857125 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:46.857098 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97980117-7e05-4782-ae28-fbc864eba45f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9\" (UID: \"97980117-7e05-4782-ae28-fbc864eba45f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9" Jul 24 04:06:46.857251 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:46.857151 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97980117-7e05-4782-ae28-fbc864eba45f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9\" (UID: \"97980117-7e05-4782-ae28-fbc864eba45f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9" Jul 24 04:06:46.857313 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:46.857248 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h8z96\" (UniqueName: \"kubernetes.io/projected/97980117-7e05-4782-ae28-fbc864eba45f-kube-api-access-h8z96\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9\" (UID: \"97980117-7e05-4782-ae28-fbc864eba45f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9" Jul 24 04:06:46.859361 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:46.859335 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9"] Jul 24 04:06:46.942685 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:46.942650 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6"] Jul 24 04:06:46.945212 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:46.945195 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6" Jul 24 04:06:46.954413 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:46.954382 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6"] Jul 24 04:06:46.958624 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:46.958595 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h8z96\" (UniqueName: \"kubernetes.io/projected/97980117-7e05-4782-ae28-fbc864eba45f-kube-api-access-h8z96\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9\" (UID: \"97980117-7e05-4782-ae28-fbc864eba45f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9" Jul 24 04:06:46.958760 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:46.958658 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e936a90e-f557-4668-bd7e-6e6a9de661d3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6\" (UID: \"e936a90e-f557-4668-bd7e-6e6a9de661d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6" Jul 24 04:06:46.958760 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:46.958685 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dnk8t\" (UniqueName: \"kubernetes.io/projected/e936a90e-f557-4668-bd7e-6e6a9de661d3-kube-api-access-dnk8t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6\" (UID: \"e936a90e-f557-4668-bd7e-6e6a9de661d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6" Jul 24 04:06:46.958760 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:46.958727 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e936a90e-f557-4668-bd7e-6e6a9de661d3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6\" (UID: \"e936a90e-f557-4668-bd7e-6e6a9de661d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6" Jul 24 04:06:46.958936 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:46.958762 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97980117-7e05-4782-ae28-fbc864eba45f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9\" (UID: \"97980117-7e05-4782-ae28-fbc864eba45f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9" Jul 24 04:06:46.958936 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:46.958808 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97980117-7e05-4782-ae28-fbc864eba45f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9\" (UID: \"97980117-7e05-4782-ae28-fbc864eba45f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9" Jul 24 04:06:46.959102 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:46.959085 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97980117-7e05-4782-ae28-fbc864eba45f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9\" (UID: \"97980117-7e05-4782-ae28-fbc864eba45f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9" Jul 24 04:06:46.959196 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:46.959176 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97980117-7e05-4782-ae28-fbc864eba45f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9\" (UID: \"97980117-7e05-4782-ae28-fbc864eba45f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9" Jul 24 04:06:46.967224 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:46.967202 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h8z96\" (UniqueName: \"kubernetes.io/projected/97980117-7e05-4782-ae28-fbc864eba45f-kube-api-access-h8z96\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9\" (UID: \"97980117-7e05-4782-ae28-fbc864eba45f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9" Jul 24 04:06:47.060158 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.060121 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e936a90e-f557-4668-bd7e-6e6a9de661d3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6\" (UID: \"e936a90e-f557-4668-bd7e-6e6a9de661d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6" Jul 24 04:06:47.060451 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.060165 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dnk8t\" (UniqueName: \"kubernetes.io/projected/e936a90e-f557-4668-bd7e-6e6a9de661d3-kube-api-access-dnk8t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6\" (UID: \"e936a90e-f557-4668-bd7e-6e6a9de661d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6" Jul 24 04:06:47.060451 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.060195 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e936a90e-f557-4668-bd7e-6e6a9de661d3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6\" (UID: \"e936a90e-f557-4668-bd7e-6e6a9de661d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6" Jul 24 04:06:47.060643 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.060620 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e936a90e-f557-4668-bd7e-6e6a9de661d3-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6\" (UID: \"e936a90e-f557-4668-bd7e-6e6a9de661d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6" Jul 24 04:06:47.060731 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.060622 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e936a90e-f557-4668-bd7e-6e6a9de661d3-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6\" (UID: \"e936a90e-f557-4668-bd7e-6e6a9de661d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6" Jul 24 04:06:47.071539 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.071501 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dnk8t\" (UniqueName: \"kubernetes.io/projected/e936a90e-f557-4668-bd7e-6e6a9de661d3-kube-api-access-dnk8t\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6\" (UID: \"e936a90e-f557-4668-bd7e-6e6a9de661d3\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6" Jul 24 04:06:47.161031 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.160948 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9" Jul 24 04:06:47.238793 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.238762 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25"] Jul 24 04:06:47.242604 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.242582 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25" Jul 24 04:06:47.251119 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.251051 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25"] Jul 24 04:06:47.255162 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.254905 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6" Jul 24 04:06:47.262121 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.262091 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd97523c-af73-4919-8813-24f7c8cf4a53-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25\" (UID: \"dd97523c-af73-4919-8813-24f7c8cf4a53\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25" Jul 24 04:06:47.262325 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.262170 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r4tqt\" (UniqueName: \"kubernetes.io/projected/dd97523c-af73-4919-8813-24f7c8cf4a53-kube-api-access-r4tqt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25\" (UID: \"dd97523c-af73-4919-8813-24f7c8cf4a53\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25" Jul 24 04:06:47.262325 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.262211 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd97523c-af73-4919-8813-24f7c8cf4a53-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25\" (UID: \"dd97523c-af73-4919-8813-24f7c8cf4a53\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25" Jul 24 04:06:47.307190 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.307165 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9"] Jul 24 04:06:47.309663 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:06:47.309634 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97980117_7e05_4782_ae28_fbc864eba45f.slice/crio-4669ab45b85f5abb906f9d34d461073f1267c333b5367621c3390dd8ecd66667 WatchSource:0}: Error finding container 4669ab45b85f5abb906f9d34d461073f1267c333b5367621c3390dd8ecd66667: Status 404 returned error can't find the container with id 4669ab45b85f5abb906f9d34d461073f1267c333b5367621c3390dd8ecd66667 Jul 24 04:06:47.363127 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.363093 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r4tqt\" (UniqueName: \"kubernetes.io/projected/dd97523c-af73-4919-8813-24f7c8cf4a53-kube-api-access-r4tqt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25\" (UID: \"dd97523c-af73-4919-8813-24f7c8cf4a53\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25" Jul 24 04:06:47.363301 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.363147 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd97523c-af73-4919-8813-24f7c8cf4a53-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25\" (UID: \"dd97523c-af73-4919-8813-24f7c8cf4a53\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25" Jul 24 04:06:47.363301 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.363188 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd97523c-af73-4919-8813-24f7c8cf4a53-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25\" (UID: \"dd97523c-af73-4919-8813-24f7c8cf4a53\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25" Jul 24 04:06:47.363628 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.363607 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd97523c-af73-4919-8813-24f7c8cf4a53-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25\" (UID: \"dd97523c-af73-4919-8813-24f7c8cf4a53\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25" Jul 24 04:06:47.363628 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.363621 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd97523c-af73-4919-8813-24f7c8cf4a53-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25\" (UID: \"dd97523c-af73-4919-8813-24f7c8cf4a53\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25" Jul 24 04:06:47.371923 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.371882 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r4tqt\" (UniqueName: \"kubernetes.io/projected/dd97523c-af73-4919-8813-24f7c8cf4a53-kube-api-access-r4tqt\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25\" (UID: \"dd97523c-af73-4919-8813-24f7c8cf4a53\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25" Jul 24 04:06:47.408077 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.408048 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6"] Jul 24 04:06:47.410628 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:06:47.410594 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode936a90e_f557_4668_bd7e_6e6a9de661d3.slice/crio-bc1646cc008bfb7b4f1c581e75215d65abfa93324b91ef5da6d6884b1ae36141 WatchSource:0}: Error finding container bc1646cc008bfb7b4f1c581e75215d65abfa93324b91ef5da6d6884b1ae36141: Status 404 returned error can't find the container with id bc1646cc008bfb7b4f1c581e75215d65abfa93324b91ef5da6d6884b1ae36141 Jul 24 04:06:47.556281 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.556251 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25" Jul 24 04:06:47.640825 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.640791 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79"] Jul 24 04:06:47.647948 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.647918 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79" Jul 24 04:06:47.655447 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.655357 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79"] Jul 24 04:06:47.665856 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.665754 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e1b5fdb-7bf8-47ee-944c-e22204b086b7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79\" (UID: \"1e1b5fdb-7bf8-47ee-944c-e22204b086b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79" Jul 24 04:06:47.665856 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.665818 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e1b5fdb-7bf8-47ee-944c-e22204b086b7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79\" (UID: \"1e1b5fdb-7bf8-47ee-944c-e22204b086b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79" Jul 24 04:06:47.666077 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.665922 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j7scx\" (UniqueName: \"kubernetes.io/projected/1e1b5fdb-7bf8-47ee-944c-e22204b086b7-kube-api-access-j7scx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79\" (UID: \"1e1b5fdb-7bf8-47ee-944c-e22204b086b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79" Jul 24 04:06:47.693937 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.693911 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25"] Jul 24 04:06:47.695824 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:06:47.695801 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd97523c_af73_4919_8813_24f7c8cf4a53.slice/crio-a4937f1f31501eb891cce318b124213e795c1816bd111ab92086cd660bd06493 WatchSource:0}: Error finding container a4937f1f31501eb891cce318b124213e795c1816bd111ab92086cd660bd06493: Status 404 returned error can't find the container with id a4937f1f31501eb891cce318b124213e795c1816bd111ab92086cd660bd06493 Jul 24 04:06:47.766717 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.766681 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j7scx\" (UniqueName: \"kubernetes.io/projected/1e1b5fdb-7bf8-47ee-944c-e22204b086b7-kube-api-access-j7scx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79\" (UID: \"1e1b5fdb-7bf8-47ee-944c-e22204b086b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79" Jul 24 04:06:47.766890 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.766746 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e1b5fdb-7bf8-47ee-944c-e22204b086b7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79\" (UID: \"1e1b5fdb-7bf8-47ee-944c-e22204b086b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79" Jul 24 04:06:47.766890 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.766776 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e1b5fdb-7bf8-47ee-944c-e22204b086b7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79\" (UID: \"1e1b5fdb-7bf8-47ee-944c-e22204b086b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79" Jul 24 04:06:47.767214 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.767195 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e1b5fdb-7bf8-47ee-944c-e22204b086b7-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79\" (UID: \"1e1b5fdb-7bf8-47ee-944c-e22204b086b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79" Jul 24 04:06:47.767255 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.767231 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e1b5fdb-7bf8-47ee-944c-e22204b086b7-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79\" (UID: \"1e1b5fdb-7bf8-47ee-944c-e22204b086b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79" Jul 24 04:06:47.775494 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.775453 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j7scx\" (UniqueName: \"kubernetes.io/projected/1e1b5fdb-7bf8-47ee-944c-e22204b086b7-kube-api-access-j7scx\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79\" (UID: \"1e1b5fdb-7bf8-47ee-944c-e22204b086b7\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79" Jul 24 04:06:47.874433 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.874395 2563 generic.go:356] "Generic (PLEG): container finished" podID="dd97523c-af73-4919-8813-24f7c8cf4a53" containerID="e28c8e86f63696c078681f8f168f43820bd465add3aa52c25715350062f78c25" exitCode=0 Jul 24 04:06:47.875034 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.874507 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25" event={"ID":"dd97523c-af73-4919-8813-24f7c8cf4a53","Type":"ContainerDied","Data":"e28c8e86f63696c078681f8f168f43820bd465add3aa52c25715350062f78c25"} Jul 24 04:06:47.875034 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.874568 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25" event={"ID":"dd97523c-af73-4919-8813-24f7c8cf4a53","Type":"ContainerStarted","Data":"a4937f1f31501eb891cce318b124213e795c1816bd111ab92086cd660bd06493"} Jul 24 04:06:47.876243 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.876220 2563 generic.go:356] "Generic (PLEG): container finished" podID="e936a90e-f557-4668-bd7e-6e6a9de661d3" containerID="8c3d834b4d7d330a3fb8fd180d9b86f07b3804928ceea957edd60dbcf5bfb554" exitCode=0 Jul 24 04:06:47.876360 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.876300 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6" event={"ID":"e936a90e-f557-4668-bd7e-6e6a9de661d3","Type":"ContainerDied","Data":"8c3d834b4d7d330a3fb8fd180d9b86f07b3804928ceea957edd60dbcf5bfb554"} Jul 24 04:06:47.876360 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.876343 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6" event={"ID":"e936a90e-f557-4668-bd7e-6e6a9de661d3","Type":"ContainerStarted","Data":"bc1646cc008bfb7b4f1c581e75215d65abfa93324b91ef5da6d6884b1ae36141"} Jul 24 04:06:47.877946 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.877925 2563 generic.go:356] "Generic (PLEG): container finished" podID="97980117-7e05-4782-ae28-fbc864eba45f" containerID="f08d27817303a39074580b270f9b7811f375540f5e2f8f759ccc0a97c2d2eb87" exitCode=0 Jul 24 04:06:47.878003 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.877953 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9" event={"ID":"97980117-7e05-4782-ae28-fbc864eba45f","Type":"ContainerDied","Data":"f08d27817303a39074580b270f9b7811f375540f5e2f8f759ccc0a97c2d2eb87"} Jul 24 04:06:47.878050 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.878002 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9" event={"ID":"97980117-7e05-4782-ae28-fbc864eba45f","Type":"ContainerStarted","Data":"4669ab45b85f5abb906f9d34d461073f1267c333b5367621c3390dd8ecd66667"} Jul 24 04:06:47.920888 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.920796 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-5c4f697c77-cschj"] Jul 24 04:06:47.924307 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.924281 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:47.935914 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.935871 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c4f697c77-cschj"] Jul 24 04:06:47.959316 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.959285 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79" Jul 24 04:06:47.968527 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.968467 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/151a8fcc-0ca9-4b48-8805-ad4f5d1c923a-console-serving-cert\") pod \"console-5c4f697c77-cschj\" (UID: \"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a\") " pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:47.968668 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.968551 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/151a8fcc-0ca9-4b48-8805-ad4f5d1c923a-console-oauth-config\") pod \"console-5c4f697c77-cschj\" (UID: \"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a\") " pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:47.968668 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.968606 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/151a8fcc-0ca9-4b48-8805-ad4f5d1c923a-oauth-serving-cert\") pod \"console-5c4f697c77-cschj\" (UID: \"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a\") " pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:47.968668 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.968665 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8pxmg\" (UniqueName: \"kubernetes.io/projected/151a8fcc-0ca9-4b48-8805-ad4f5d1c923a-kube-api-access-8pxmg\") pod \"console-5c4f697c77-cschj\" (UID: \"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a\") " pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:47.968827 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.968695 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/151a8fcc-0ca9-4b48-8805-ad4f5d1c923a-trusted-ca-bundle\") pod \"console-5c4f697c77-cschj\" (UID: \"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a\") " pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:47.968827 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.968806 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/151a8fcc-0ca9-4b48-8805-ad4f5d1c923a-console-config\") pod \"console-5c4f697c77-cschj\" (UID: \"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a\") " pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:47.968921 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.968850 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/151a8fcc-0ca9-4b48-8805-ad4f5d1c923a-service-ca\") pod \"console-5c4f697c77-cschj\" (UID: \"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a\") " pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:47.984806 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:47.984771 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:06:48.069826 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.069788 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/151a8fcc-0ca9-4b48-8805-ad4f5d1c923a-service-ca\") pod \"console-5c4f697c77-cschj\" (UID: \"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a\") " pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:48.070018 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.069852 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/151a8fcc-0ca9-4b48-8805-ad4f5d1c923a-console-serving-cert\") pod \"console-5c4f697c77-cschj\" (UID: \"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a\") " pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:48.070018 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.069889 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/151a8fcc-0ca9-4b48-8805-ad4f5d1c923a-console-oauth-config\") pod \"console-5c4f697c77-cschj\" (UID: \"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a\") " pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:48.070018 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.069915 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/151a8fcc-0ca9-4b48-8805-ad4f5d1c923a-oauth-serving-cert\") pod \"console-5c4f697c77-cschj\" (UID: \"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a\") " pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:48.070018 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.069957 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8pxmg\" (UniqueName: \"kubernetes.io/projected/151a8fcc-0ca9-4b48-8805-ad4f5d1c923a-kube-api-access-8pxmg\") pod \"console-5c4f697c77-cschj\" (UID: \"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a\") " pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:48.070288 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.070056 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/151a8fcc-0ca9-4b48-8805-ad4f5d1c923a-trusted-ca-bundle\") pod \"console-5c4f697c77-cschj\" (UID: \"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a\") " pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:48.070288 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.070132 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/151a8fcc-0ca9-4b48-8805-ad4f5d1c923a-console-config\") pod \"console-5c4f697c77-cschj\" (UID: \"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a\") " pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:48.071000 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.070658 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/151a8fcc-0ca9-4b48-8805-ad4f5d1c923a-service-ca\") pod \"console-5c4f697c77-cschj\" (UID: \"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a\") " pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:48.071000 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.070957 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/151a8fcc-0ca9-4b48-8805-ad4f5d1c923a-console-config\") pod \"console-5c4f697c77-cschj\" (UID: \"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a\") " pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:48.071195 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.071061 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/151a8fcc-0ca9-4b48-8805-ad4f5d1c923a-oauth-serving-cert\") pod \"console-5c4f697c77-cschj\" (UID: \"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a\") " pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:48.071195 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.071164 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/151a8fcc-0ca9-4b48-8805-ad4f5d1c923a-trusted-ca-bundle\") pod \"console-5c4f697c77-cschj\" (UID: \"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a\") " pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:48.072729 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.072696 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/151a8fcc-0ca9-4b48-8805-ad4f5d1c923a-console-serving-cert\") pod \"console-5c4f697c77-cschj\" (UID: \"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a\") " pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:48.073045 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.073025 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/151a8fcc-0ca9-4b48-8805-ad4f5d1c923a-console-oauth-config\") pod \"console-5c4f697c77-cschj\" (UID: \"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a\") " pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:48.078277 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.078245 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8pxmg\" (UniqueName: \"kubernetes.io/projected/151a8fcc-0ca9-4b48-8805-ad4f5d1c923a-kube-api-access-8pxmg\") pod \"console-5c4f697c77-cschj\" (UID: \"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a\") " pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:48.095426 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.095394 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79"] Jul 24 04:06:48.096534 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:06:48.096509 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e1b5fdb_7bf8_47ee_944c_e22204b086b7.slice/crio-cfeaf230ea6f84ad52c207443e620c8295594fb5505cbb7daba6de3e3e605141 WatchSource:0}: Error finding container cfeaf230ea6f84ad52c207443e620c8295594fb5505cbb7daba6de3e3e605141: Status 404 returned error can't find the container with id cfeaf230ea6f84ad52c207443e620c8295594fb5505cbb7daba6de3e3e605141 Jul 24 04:06:48.119491 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.119452 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:06:48.216506 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.216454 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:06:48.234581 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.234546 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:48.368097 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.368058 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-5c4f697c77-cschj"] Jul 24 04:06:48.371130 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:06:48.371103 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod151a8fcc_0ca9_4b48_8805_ad4f5d1c923a.slice/crio-d7e9d4c54dc87d8e5697fa8c16b9d977365a9cb8461b745c78518ff69311d015 WatchSource:0}: Error finding container d7e9d4c54dc87d8e5697fa8c16b9d977365a9cb8461b745c78518ff69311d015: Status 404 returned error can't find the container with id d7e9d4c54dc87d8e5697fa8c16b9d977365a9cb8461b745c78518ff69311d015 Jul 24 04:06:48.713733 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.713709 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:06:48.885752 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.885652 2563 generic.go:356] "Generic (PLEG): container finished" podID="dd97523c-af73-4919-8813-24f7c8cf4a53" containerID="59906e22ddef22129c650ef209f2049f826f26bb086c122fa881d4a3a9a9d796" exitCode=0 Jul 24 04:06:48.885752 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.885730 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25" event={"ID":"dd97523c-af73-4919-8813-24f7c8cf4a53","Type":"ContainerDied","Data":"59906e22ddef22129c650ef209f2049f826f26bb086c122fa881d4a3a9a9d796"} Jul 24 04:06:48.887699 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.887668 2563 generic.go:356] "Generic (PLEG): container finished" podID="e936a90e-f557-4668-bd7e-6e6a9de661d3" containerID="0827be7da21f04200943100cb9552f54e740da70c4cc655b61146a7544c15742" exitCode=0 Jul 24 04:06:48.887824 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.887755 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6" event={"ID":"e936a90e-f557-4668-bd7e-6e6a9de661d3","Type":"ContainerDied","Data":"0827be7da21f04200943100cb9552f54e740da70c4cc655b61146a7544c15742"} Jul 24 04:06:48.889528 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.889502 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c4f697c77-cschj" event={"ID":"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a","Type":"ContainerStarted","Data":"28dc17146ca66ea3f2f0202095503b2ca64cf192a74433f8094f5af7f014e8c9"} Jul 24 04:06:48.889640 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.889551 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-5c4f697c77-cschj" event={"ID":"151a8fcc-0ca9-4b48-8805-ad4f5d1c923a","Type":"ContainerStarted","Data":"d7e9d4c54dc87d8e5697fa8c16b9d977365a9cb8461b745c78518ff69311d015"} Jul 24 04:06:48.891052 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.891026 2563 generic.go:356] "Generic (PLEG): container finished" podID="1e1b5fdb-7bf8-47ee-944c-e22204b086b7" containerID="2ca96c7ceea7fb908f277cb29716fc8c8b3100ed4c78e4894db69fde4636ba9c" exitCode=0 Jul 24 04:06:48.891184 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.891125 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79" event={"ID":"1e1b5fdb-7bf8-47ee-944c-e22204b086b7","Type":"ContainerDied","Data":"2ca96c7ceea7fb908f277cb29716fc8c8b3100ed4c78e4894db69fde4636ba9c"} Jul 24 04:06:48.891184 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.891159 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79" event={"ID":"1e1b5fdb-7bf8-47ee-944c-e22204b086b7","Type":"ContainerStarted","Data":"cfeaf230ea6f84ad52c207443e620c8295594fb5505cbb7daba6de3e3e605141"} Jul 24 04:06:48.952427 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:48.952371 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-5c4f697c77-cschj" podStartSLOduration=1.952349265 podStartE2EDuration="1.952349265s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:06:47 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:06:48.948029456 +0000 UTC m=+390.694403042" watchObservedRunningTime="2026-07-24 04:06:48.952349265 +0000 UTC m=+390.698722849" Jul 24 04:06:49.899154 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:49.899114 2563 generic.go:356] "Generic (PLEG): container finished" podID="dd97523c-af73-4919-8813-24f7c8cf4a53" containerID="d049698cf72d7679c2a31083a67a47a28964e25ac07b5abdc4e98d603d30ce4c" exitCode=0 Jul 24 04:06:49.899567 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:49.899189 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25" event={"ID":"dd97523c-af73-4919-8813-24f7c8cf4a53","Type":"ContainerDied","Data":"d049698cf72d7679c2a31083a67a47a28964e25ac07b5abdc4e98d603d30ce4c"} Jul 24 04:06:49.901406 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:49.901375 2563 generic.go:356] "Generic (PLEG): container finished" podID="e936a90e-f557-4668-bd7e-6e6a9de661d3" containerID="ea54ce496c70de4bd86daad21f206bfa3a5d265cb236173b97bc446bf7cdc124" exitCode=0 Jul 24 04:06:49.901556 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:49.901453 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6" event={"ID":"e936a90e-f557-4668-bd7e-6e6a9de661d3","Type":"ContainerDied","Data":"ea54ce496c70de4bd86daad21f206bfa3a5d265cb236173b97bc446bf7cdc124"} Jul 24 04:06:49.903289 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:49.903266 2563 generic.go:356] "Generic (PLEG): container finished" podID="97980117-7e05-4782-ae28-fbc864eba45f" containerID="fde1d733ec11f82ccc107064360efd3c665839b6c771e6931f018ea290b9495e" exitCode=0 Jul 24 04:06:49.903392 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:49.903334 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9" event={"ID":"97980117-7e05-4782-ae28-fbc864eba45f","Type":"ContainerDied","Data":"fde1d733ec11f82ccc107064360efd3c665839b6c771e6931f018ea290b9495e"} Jul 24 04:06:49.905177 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:49.905155 2563 generic.go:356] "Generic (PLEG): container finished" podID="1e1b5fdb-7bf8-47ee-944c-e22204b086b7" containerID="f7a931c9aaacc4ef759b295f3dd7f24e514a9a2acf28ff596bf062424057bf7a" exitCode=0 Jul 24 04:06:49.905267 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:49.905192 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79" event={"ID":"1e1b5fdb-7bf8-47ee-944c-e22204b086b7","Type":"ContainerDied","Data":"f7a931c9aaacc4ef759b295f3dd7f24e514a9a2acf28ff596bf062424057bf7a"} Jul 24 04:06:50.911902 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:50.911869 2563 generic.go:356] "Generic (PLEG): container finished" podID="97980117-7e05-4782-ae28-fbc864eba45f" containerID="79c1578f7740169313ca203c226697968dab2a0d79b110930fb81294f0fdca13" exitCode=0 Jul 24 04:06:50.912298 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:50.911955 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9" event={"ID":"97980117-7e05-4782-ae28-fbc864eba45f","Type":"ContainerDied","Data":"79c1578f7740169313ca203c226697968dab2a0d79b110930fb81294f0fdca13"} Jul 24 04:06:50.914041 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:50.914019 2563 generic.go:356] "Generic (PLEG): container finished" podID="1e1b5fdb-7bf8-47ee-944c-e22204b086b7" containerID="987de0e396b4891f3ce10e5564a886aebae569f9388084cb899bb66379b63e80" exitCode=0 Jul 24 04:06:50.914172 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:50.914100 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79" event={"ID":"1e1b5fdb-7bf8-47ee-944c-e22204b086b7","Type":"ContainerDied","Data":"987de0e396b4891f3ce10e5564a886aebae569f9388084cb899bb66379b63e80"} Jul 24 04:06:51.049271 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.049243 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6" Jul 24 04:06:51.085056 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.085018 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25" Jul 24 04:06:51.095507 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.095454 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dnk8t\" (UniqueName: \"kubernetes.io/projected/e936a90e-f557-4668-bd7e-6e6a9de661d3-kube-api-access-dnk8t\") pod \"e936a90e-f557-4668-bd7e-6e6a9de661d3\" (UID: \"e936a90e-f557-4668-bd7e-6e6a9de661d3\") " Jul 24 04:06:51.095664 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.095533 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e936a90e-f557-4668-bd7e-6e6a9de661d3-util\") pod \"e936a90e-f557-4668-bd7e-6e6a9de661d3\" (UID: \"e936a90e-f557-4668-bd7e-6e6a9de661d3\") " Jul 24 04:06:51.095664 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.095580 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e936a90e-f557-4668-bd7e-6e6a9de661d3-bundle\") pod \"e936a90e-f557-4668-bd7e-6e6a9de661d3\" (UID: \"e936a90e-f557-4668-bd7e-6e6a9de661d3\") " Jul 24 04:06:51.096106 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.096072 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e936a90e-f557-4668-bd7e-6e6a9de661d3-bundle" (OuterVolumeSpecName: "bundle") pod "e936a90e-f557-4668-bd7e-6e6a9de661d3" (UID: "e936a90e-f557-4668-bd7e-6e6a9de661d3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 04:06:51.097582 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.097559 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e936a90e-f557-4668-bd7e-6e6a9de661d3-kube-api-access-dnk8t" (OuterVolumeSpecName: "kube-api-access-dnk8t") pod "e936a90e-f557-4668-bd7e-6e6a9de661d3" (UID: "e936a90e-f557-4668-bd7e-6e6a9de661d3"). InnerVolumeSpecName "kube-api-access-dnk8t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:06:51.103714 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.103677 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e936a90e-f557-4668-bd7e-6e6a9de661d3-util" (OuterVolumeSpecName: "util") pod "e936a90e-f557-4668-bd7e-6e6a9de661d3" (UID: "e936a90e-f557-4668-bd7e-6e6a9de661d3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 04:06:51.197133 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.197098 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd97523c-af73-4919-8813-24f7c8cf4a53-bundle\") pod \"dd97523c-af73-4919-8813-24f7c8cf4a53\" (UID: \"dd97523c-af73-4919-8813-24f7c8cf4a53\") " Jul 24 04:06:51.197298 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.197144 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-r4tqt\" (UniqueName: \"kubernetes.io/projected/dd97523c-af73-4919-8813-24f7c8cf4a53-kube-api-access-r4tqt\") pod \"dd97523c-af73-4919-8813-24f7c8cf4a53\" (UID: \"dd97523c-af73-4919-8813-24f7c8cf4a53\") " Jul 24 04:06:51.197298 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.197168 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd97523c-af73-4919-8813-24f7c8cf4a53-util\") pod \"dd97523c-af73-4919-8813-24f7c8cf4a53\" (UID: \"dd97523c-af73-4919-8813-24f7c8cf4a53\") " Jul 24 04:06:51.197431 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.197356 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dnk8t\" (UniqueName: \"kubernetes.io/projected/e936a90e-f557-4668-bd7e-6e6a9de661d3-kube-api-access-dnk8t\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:06:51.197431 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.197375 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/e936a90e-f557-4668-bd7e-6e6a9de661d3-util\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:06:51.197431 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.197426 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/e936a90e-f557-4668-bd7e-6e6a9de661d3-bundle\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:06:51.197755 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.197714 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd97523c-af73-4919-8813-24f7c8cf4a53-bundle" (OuterVolumeSpecName: "bundle") pod "dd97523c-af73-4919-8813-24f7c8cf4a53" (UID: "dd97523c-af73-4919-8813-24f7c8cf4a53"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 04:06:51.199290 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.199262 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd97523c-af73-4919-8813-24f7c8cf4a53-kube-api-access-r4tqt" (OuterVolumeSpecName: "kube-api-access-r4tqt") pod "dd97523c-af73-4919-8813-24f7c8cf4a53" (UID: "dd97523c-af73-4919-8813-24f7c8cf4a53"). InnerVolumeSpecName "kube-api-access-r4tqt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:06:51.202709 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.202683 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd97523c-af73-4919-8813-24f7c8cf4a53-util" (OuterVolumeSpecName: "util") pod "dd97523c-af73-4919-8813-24f7c8cf4a53" (UID: "dd97523c-af73-4919-8813-24f7c8cf4a53"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 04:06:51.298040 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.298001 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/dd97523c-af73-4919-8813-24f7c8cf4a53-bundle\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:06:51.298040 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.298040 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-r4tqt\" (UniqueName: \"kubernetes.io/projected/dd97523c-af73-4919-8813-24f7c8cf4a53-kube-api-access-r4tqt\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:06:51.298255 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.298053 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/dd97523c-af73-4919-8813-24f7c8cf4a53-util\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:06:51.921778 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.921745 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25" Jul 24 04:06:51.922204 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.921744 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25" event={"ID":"dd97523c-af73-4919-8813-24f7c8cf4a53","Type":"ContainerDied","Data":"a4937f1f31501eb891cce318b124213e795c1816bd111ab92086cd660bd06493"} Jul 24 04:06:51.922204 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.921867 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a4937f1f31501eb891cce318b124213e795c1816bd111ab92086cd660bd06493" Jul 24 04:06:51.923744 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.923722 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6" Jul 24 04:06:51.923862 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.923746 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6" event={"ID":"e936a90e-f557-4668-bd7e-6e6a9de661d3","Type":"ContainerDied","Data":"bc1646cc008bfb7b4f1c581e75215d65abfa93324b91ef5da6d6884b1ae36141"} Jul 24 04:06:51.923862 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:51.923794 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bc1646cc008bfb7b4f1c581e75215d65abfa93324b91ef5da6d6884b1ae36141" Jul 24 04:06:52.079166 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.079145 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9" Jul 24 04:06:52.095653 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.095616 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79" Jul 24 04:06:52.104328 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.104298 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-h8z96\" (UniqueName: \"kubernetes.io/projected/97980117-7e05-4782-ae28-fbc864eba45f-kube-api-access-h8z96\") pod \"97980117-7e05-4782-ae28-fbc864eba45f\" (UID: \"97980117-7e05-4782-ae28-fbc864eba45f\") " Jul 24 04:06:52.104466 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.104342 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97980117-7e05-4782-ae28-fbc864eba45f-bundle\") pod \"97980117-7e05-4782-ae28-fbc864eba45f\" (UID: \"97980117-7e05-4782-ae28-fbc864eba45f\") " Jul 24 04:06:52.104466 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.104429 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97980117-7e05-4782-ae28-fbc864eba45f-util\") pod \"97980117-7e05-4782-ae28-fbc864eba45f\" (UID: \"97980117-7e05-4782-ae28-fbc864eba45f\") " Jul 24 04:06:52.104906 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.104873 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97980117-7e05-4782-ae28-fbc864eba45f-bundle" (OuterVolumeSpecName: "bundle") pod "97980117-7e05-4782-ae28-fbc864eba45f" (UID: "97980117-7e05-4782-ae28-fbc864eba45f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 04:06:52.106550 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.106523 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/97980117-7e05-4782-ae28-fbc864eba45f-kube-api-access-h8z96" (OuterVolumeSpecName: "kube-api-access-h8z96") pod "97980117-7e05-4782-ae28-fbc864eba45f" (UID: "97980117-7e05-4782-ae28-fbc864eba45f"). InnerVolumeSpecName "kube-api-access-h8z96". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:06:52.110443 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.110415 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/97980117-7e05-4782-ae28-fbc864eba45f-util" (OuterVolumeSpecName: "util") pod "97980117-7e05-4782-ae28-fbc864eba45f" (UID: "97980117-7e05-4782-ae28-fbc864eba45f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 04:06:52.205666 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.205634 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e1b5fdb-7bf8-47ee-944c-e22204b086b7-bundle\") pod \"1e1b5fdb-7bf8-47ee-944c-e22204b086b7\" (UID: \"1e1b5fdb-7bf8-47ee-944c-e22204b086b7\") " Jul 24 04:06:52.205824 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.205726 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e1b5fdb-7bf8-47ee-944c-e22204b086b7-util\") pod \"1e1b5fdb-7bf8-47ee-944c-e22204b086b7\" (UID: \"1e1b5fdb-7bf8-47ee-944c-e22204b086b7\") " Jul 24 04:06:52.205824 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.205762 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j7scx\" (UniqueName: \"kubernetes.io/projected/1e1b5fdb-7bf8-47ee-944c-e22204b086b7-kube-api-access-j7scx\") pod \"1e1b5fdb-7bf8-47ee-944c-e22204b086b7\" (UID: \"1e1b5fdb-7bf8-47ee-944c-e22204b086b7\") " Jul 24 04:06:52.205943 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.205927 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-h8z96\" (UniqueName: \"kubernetes.io/projected/97980117-7e05-4782-ae28-fbc864eba45f-kube-api-access-h8z96\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:06:52.205976 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.205952 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/97980117-7e05-4782-ae28-fbc864eba45f-bundle\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:06:52.205976 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.205965 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/97980117-7e05-4782-ae28-fbc864eba45f-util\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:06:52.206114 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.206089 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e1b5fdb-7bf8-47ee-944c-e22204b086b7-bundle" (OuterVolumeSpecName: "bundle") pod "1e1b5fdb-7bf8-47ee-944c-e22204b086b7" (UID: "1e1b5fdb-7bf8-47ee-944c-e22204b086b7"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 04:06:52.207860 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.207828 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e1b5fdb-7bf8-47ee-944c-e22204b086b7-kube-api-access-j7scx" (OuterVolumeSpecName: "kube-api-access-j7scx") pod "1e1b5fdb-7bf8-47ee-944c-e22204b086b7" (UID: "1e1b5fdb-7bf8-47ee-944c-e22204b086b7"). InnerVolumeSpecName "kube-api-access-j7scx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:06:52.211716 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.211686 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e1b5fdb-7bf8-47ee-944c-e22204b086b7-util" (OuterVolumeSpecName: "util") pod "1e1b5fdb-7bf8-47ee-944c-e22204b086b7" (UID: "1e1b5fdb-7bf8-47ee-944c-e22204b086b7"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 04:06:52.306446 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.306401 2563 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1e1b5fdb-7bf8-47ee-944c-e22204b086b7-bundle\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:06:52.306446 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.306438 2563 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1e1b5fdb-7bf8-47ee-944c-e22204b086b7-util\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:06:52.306446 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.306448 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j7scx\" (UniqueName: \"kubernetes.io/projected/1e1b5fdb-7bf8-47ee-944c-e22204b086b7-kube-api-access-j7scx\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:06:52.930647 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.930616 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9" Jul 24 04:06:52.931075 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.930608 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9" event={"ID":"97980117-7e05-4782-ae28-fbc864eba45f","Type":"ContainerDied","Data":"4669ab45b85f5abb906f9d34d461073f1267c333b5367621c3390dd8ecd66667"} Jul 24 04:06:52.931075 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.930750 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4669ab45b85f5abb906f9d34d461073f1267c333b5367621c3390dd8ecd66667" Jul 24 04:06:52.932630 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.932611 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79" Jul 24 04:06:52.932732 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.932637 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79" event={"ID":"1e1b5fdb-7bf8-47ee-944c-e22204b086b7","Type":"ContainerDied","Data":"cfeaf230ea6f84ad52c207443e620c8295594fb5505cbb7daba6de3e3e605141"} Jul 24 04:06:52.932732 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:52.932668 2563 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cfeaf230ea6f84ad52c207443e620c8295594fb5505cbb7daba6de3e3e605141" Jul 24 04:06:58.234979 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:58.234929 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:58.235521 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:58.235013 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:58.239685 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:58.239659 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:58.966442 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:58.966411 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-5c4f697c77-cschj" Jul 24 04:06:59.019062 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:59.019030 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69d5bf9758-vbwvp"] Jul 24 04:06:59.142497 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:59.139929 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:06:59.234906 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:59.234817 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:06:59.346144 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:59.346111 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:06:59.448387 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:06:59.448344 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:02.839763 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:02.839727 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:03.968671 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.968633 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v"] Jul 24 04:07:03.969054 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.968997 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd97523c-af73-4919-8813-24f7c8cf4a53" containerName="pull" Jul 24 04:07:03.969054 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969010 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd97523c-af73-4919-8813-24f7c8cf4a53" containerName="pull" Jul 24 04:07:03.969054 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969020 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97980117-7e05-4782-ae28-fbc864eba45f" containerName="util" Jul 24 04:07:03.969054 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969025 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="97980117-7e05-4782-ae28-fbc864eba45f" containerName="util" Jul 24 04:07:03.969054 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969036 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e936a90e-f557-4668-bd7e-6e6a9de661d3" containerName="util" Jul 24 04:07:03.969054 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969048 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e936a90e-f557-4668-bd7e-6e6a9de661d3" containerName="util" Jul 24 04:07:03.969054 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969056 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e936a90e-f557-4668-bd7e-6e6a9de661d3" containerName="extract" Jul 24 04:07:03.969324 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969062 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e936a90e-f557-4668-bd7e-6e6a9de661d3" containerName="extract" Jul 24 04:07:03.969324 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969070 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd97523c-af73-4919-8813-24f7c8cf4a53" containerName="extract" Jul 24 04:07:03.969324 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969075 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd97523c-af73-4919-8813-24f7c8cf4a53" containerName="extract" Jul 24 04:07:03.969324 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969081 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e1b5fdb-7bf8-47ee-944c-e22204b086b7" containerName="extract" Jul 24 04:07:03.969324 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969086 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e1b5fdb-7bf8-47ee-944c-e22204b086b7" containerName="extract" Jul 24 04:07:03.969324 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969095 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e936a90e-f557-4668-bd7e-6e6a9de661d3" containerName="pull" Jul 24 04:07:03.969324 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969101 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="e936a90e-f557-4668-bd7e-6e6a9de661d3" containerName="pull" Jul 24 04:07:03.969324 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969128 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97980117-7e05-4782-ae28-fbc864eba45f" containerName="pull" Jul 24 04:07:03.969324 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969136 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="97980117-7e05-4782-ae28-fbc864eba45f" containerName="pull" Jul 24 04:07:03.969324 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969149 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e1b5fdb-7bf8-47ee-944c-e22204b086b7" containerName="pull" Jul 24 04:07:03.969324 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969158 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e1b5fdb-7bf8-47ee-944c-e22204b086b7" containerName="pull" Jul 24 04:07:03.969324 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969173 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd97523c-af73-4919-8813-24f7c8cf4a53" containerName="util" Jul 24 04:07:03.969324 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969183 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd97523c-af73-4919-8813-24f7c8cf4a53" containerName="util" Jul 24 04:07:03.969324 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969191 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e1b5fdb-7bf8-47ee-944c-e22204b086b7" containerName="util" Jul 24 04:07:03.969324 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969206 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e1b5fdb-7bf8-47ee-944c-e22204b086b7" containerName="util" Jul 24 04:07:03.969324 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969217 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="97980117-7e05-4782-ae28-fbc864eba45f" containerName="extract" Jul 24 04:07:03.969324 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969225 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="97980117-7e05-4782-ae28-fbc864eba45f" containerName="extract" Jul 24 04:07:03.969324 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969308 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="e936a90e-f557-4668-bd7e-6e6a9de661d3" containerName="extract" Jul 24 04:07:03.969324 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969320 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="97980117-7e05-4782-ae28-fbc864eba45f" containerName="extract" Jul 24 04:07:03.969324 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969331 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd97523c-af73-4919-8813-24f7c8cf4a53" containerName="extract" Jul 24 04:07:03.970068 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.969342 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e1b5fdb-7bf8-47ee-944c-e22204b086b7" containerName="extract" Jul 24 04:07:03.976258 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.976237 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v" Jul 24 04:07:03.978807 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.978775 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-5s7bc\"" Jul 24 04:07:03.987404 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:03.987363 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v"] Jul 24 04:07:04.117848 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:04.117802 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzq54\" (UniqueName: \"kubernetes.io/projected/7b5d7a2e-4ee4-48ec-9175-a657204050fc-kube-api-access-nzq54\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lbs2v\" (UID: \"7b5d7a2e-4ee4-48ec-9175-a657204050fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v" Jul 24 04:07:04.118057 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:04.117879 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b5d7a2e-4ee4-48ec-9175-a657204050fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lbs2v\" (UID: \"7b5d7a2e-4ee4-48ec-9175-a657204050fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v" Jul 24 04:07:04.218638 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:04.218595 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzq54\" (UniqueName: \"kubernetes.io/projected/7b5d7a2e-4ee4-48ec-9175-a657204050fc-kube-api-access-nzq54\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lbs2v\" (UID: \"7b5d7a2e-4ee4-48ec-9175-a657204050fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v" Jul 24 04:07:04.218867 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:04.218663 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b5d7a2e-4ee4-48ec-9175-a657204050fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lbs2v\" (UID: \"7b5d7a2e-4ee4-48ec-9175-a657204050fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v" Jul 24 04:07:04.219073 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:04.219053 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b5d7a2e-4ee4-48ec-9175-a657204050fc-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lbs2v\" (UID: \"7b5d7a2e-4ee4-48ec-9175-a657204050fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v" Jul 24 04:07:04.222296 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:04.222261 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:04.227029 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:04.227001 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzq54\" (UniqueName: \"kubernetes.io/projected/7b5d7a2e-4ee4-48ec-9175-a657204050fc-kube-api-access-nzq54\") pod \"kuadrant-operator-controller-manager-8684c9ff49-lbs2v\" (UID: \"7b5d7a2e-4ee4-48ec-9175-a657204050fc\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v" Jul 24 04:07:04.288095 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:04.288056 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v" Jul 24 04:07:04.454250 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:04.454225 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v"] Jul 24 04:07:04.457149 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:07:04.457121 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b5d7a2e_4ee4_48ec_9175_a657204050fc.slice/crio-c9140238d11d7ee762545cdb10bf47f38779e729b0ce6a8d830a442165ea2abe WatchSource:0}: Error finding container c9140238d11d7ee762545cdb10bf47f38779e729b0ce6a8d830a442165ea2abe: Status 404 returned error can't find the container with id c9140238d11d7ee762545cdb10bf47f38779e729b0ce6a8d830a442165ea2abe Jul 24 04:07:04.606510 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:04.606395 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:05.002259 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:05.002216 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v" event={"ID":"7b5d7a2e-4ee4-48ec-9175-a657204050fc","Type":"ContainerStarted","Data":"c9140238d11d7ee762545cdb10bf47f38779e729b0ce6a8d830a442165ea2abe"} Jul 24 04:07:05.735410 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:05.735376 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:05.867168 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:05.867124 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:06.732134 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:06.732097 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-n9vnf"] Jul 24 04:07:06.735388 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:06.735370 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n9vnf" Jul 24 04:07:06.739686 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:06.739651 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-j9nr4\"" Jul 24 04:07:06.763360 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:06.763266 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-n9vnf"] Jul 24 04:07:06.844884 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:06.844847 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xkc4s\" (UniqueName: \"kubernetes.io/projected/cb2b9d72-793f-4f64-8cf4-db2bac4f4fcb-kube-api-access-xkc4s\") pod \"authorino-operator-75cc8d5cb7-n9vnf\" (UID: \"cb2b9d72-793f-4f64-8cf4-db2bac4f4fcb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-n9vnf" Jul 24 04:07:06.946492 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:06.946444 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xkc4s\" (UniqueName: \"kubernetes.io/projected/cb2b9d72-793f-4f64-8cf4-db2bac4f4fcb-kube-api-access-xkc4s\") pod \"authorino-operator-75cc8d5cb7-n9vnf\" (UID: \"cb2b9d72-793f-4f64-8cf4-db2bac4f4fcb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-n9vnf" Jul 24 04:07:06.959071 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:06.959035 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xkc4s\" (UniqueName: \"kubernetes.io/projected/cb2b9d72-793f-4f64-8cf4-db2bac4f4fcb-kube-api-access-xkc4s\") pod \"authorino-operator-75cc8d5cb7-n9vnf\" (UID: \"cb2b9d72-793f-4f64-8cf4-db2bac4f4fcb\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-n9vnf" Jul 24 04:07:07.045760 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:07.045661 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n9vnf" Jul 24 04:07:07.203184 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:07.203147 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-n9vnf"] Jul 24 04:07:07.205052 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:07:07.205026 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb2b9d72_793f_4f64_8cf4_db2bac4f4fcb.slice/crio-e72e5b01476ff7fb748adb5520e3905b16a74a7bbd2cf85fec3339e74f6f2e3f WatchSource:0}: Error finding container e72e5b01476ff7fb748adb5520e3905b16a74a7bbd2cf85fec3339e74f6f2e3f: Status 404 returned error can't find the container with id e72e5b01476ff7fb748adb5520e3905b16a74a7bbd2cf85fec3339e74f6f2e3f Jul 24 04:07:07.234660 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:07.234626 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:07.365598 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:07.365487 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:08.026109 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:08.026025 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n9vnf" event={"ID":"cb2b9d72-793f-4f64-8cf4-db2bac4f4fcb","Type":"ContainerStarted","Data":"e72e5b01476ff7fb748adb5520e3905b16a74a7bbd2cf85fec3339e74f6f2e3f"} Jul 24 04:07:09.418713 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:09.418645 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:11.046121 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:11.046087 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n9vnf" event={"ID":"cb2b9d72-793f-4f64-8cf4-db2bac4f4fcb","Type":"ContainerStarted","Data":"dc5c75494d1a9bd8a349969e844ac3daed20e7b1092dce7326078a99afd92f4c"} Jul 24 04:07:11.046640 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:11.046252 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n9vnf" Jul 24 04:07:11.048314 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:11.048256 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v" event={"ID":"7b5d7a2e-4ee4-48ec-9175-a657204050fc","Type":"ContainerStarted","Data":"c37ad442b863a2141203184ab55d3c6791080db1cec40529ef7d421ecc975056"} Jul 24 04:07:11.048490 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:11.048359 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v" Jul 24 04:07:11.068656 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:11.068606 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n9vnf" podStartSLOduration=1.624265597 podStartE2EDuration="5.068585317s" totalImagesPullingTime="3.44431972s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:07:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:07:11.064974378 +0000 UTC m=+412.811347962" watchObservedRunningTime="2026-07-24 04:07:11.068585317 +0000 UTC m=+412.814958900" Jul 24 04:07:11.084229 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:11.084172 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v" podStartSLOduration=1.9277627609999999 podStartE2EDuration="8.084153087s" totalImagesPullingTime="6.156390326s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:07:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:07:11.081838595 +0000 UTC m=+412.828212178" watchObservedRunningTime="2026-07-24 04:07:11.084153087 +0000 UTC m=+412.830526669" Jul 24 04:07:11.246176 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:11.246141 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:13.003689 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:13.003652 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:13.065368 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:13.065338 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:13.443360 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:13.443282 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:14.043115 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:14.043081 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:22.055404 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:22.055369 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-n9vnf" Jul 24 04:07:22.055868 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:22.055453 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v" Jul 24 04:07:22.218573 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:22.218535 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:22.318050 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:22.317963 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:23.916555 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:23.916521 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67xpq"] Jul 24 04:07:23.921804 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:23.921777 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67xpq" Jul 24 04:07:23.934196 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:23.934165 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67xpq"] Jul 24 04:07:23.953366 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:23.953332 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v"] Jul 24 04:07:23.953550 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:23.953533 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v" podUID="7b5d7a2e-4ee4-48ec-9175-a657204050fc" containerName="manager" containerID="cri-o://c37ad442b863a2141203184ab55d3c6791080db1cec40529ef7d421ecc975056" gracePeriod=2 Jul 24 04:07:23.961898 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:23.961867 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v"] Jul 24 04:07:23.984685 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:23.984658 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67xpq"] Jul 24 04:07:23.984962 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:07:23.984941 2563 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-jn8zp], unattached volumes=[], failed to process volumes=[extensions-socket-volume kube-api-access-jn8zp]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67xpq" podUID="2e1c12e9-8917-4d12-98f7-72a80163a7a1" Jul 24 04:07:23.991523 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:23.991493 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67xpq"] Jul 24 04:07:24.009376 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.009346 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4"] Jul 24 04:07:24.009749 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.009735 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="7b5d7a2e-4ee4-48ec-9175-a657204050fc" containerName="manager" Jul 24 04:07:24.009806 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.009750 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="7b5d7a2e-4ee4-48ec-9175-a657204050fc" containerName="manager" Jul 24 04:07:24.009853 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.009808 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="7b5d7a2e-4ee4-48ec-9175-a657204050fc" containerName="manager" Jul 24 04:07:24.013116 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.013094 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4" Jul 24 04:07:24.015499 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:07:24.015442 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lbs2v\" is forbidden: User \"system:node:ip-10-0-138-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-155.ec2.internal' and this object" podUID="7b5d7a2e-4ee4-48ec-9175-a657204050fc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v" Jul 24 04:07:24.040348 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.040318 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4"] Jul 24 04:07:24.048528 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.048498 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hjc7"] Jul 24 04:07:24.050084 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.050040 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-69d5bf9758-vbwvp" podUID="c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0" containerName="console" containerID="cri-o://30f39f731c3e1c9de587c3721748960eec211bd1436212ba956a2b11e5f7bee5" gracePeriod=15 Jul 24 04:07:24.052160 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.052127 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hjc7" Jul 24 04:07:24.081065 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.081034 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hjc7"] Jul 24 04:07:24.098391 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:07:24.098345 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lbs2v\" is forbidden: User \"system:node:ip-10-0-138-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-155.ec2.internal' and this object" podUID="7b5d7a2e-4ee4-48ec-9175-a657204050fc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v" Jul 24 04:07:24.108548 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.108515 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8687e3f9-1811-4c0a-a9fe-e652febe1ec6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7hjc7\" (UID: \"8687e3f9-1811-4c0a-a9fe-e652febe1ec6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hjc7" Jul 24 04:07:24.108675 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.108580 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l4rbp\" (UniqueName: \"kubernetes.io/projected/430be003-deef-4d7d-845d-3f9a282976ea-kube-api-access-l4rbp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9xsn4\" (UID: \"430be003-deef-4d7d-845d-3f9a282976ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4" Jul 24 04:07:24.108675 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.108640 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-555ct\" (UniqueName: \"kubernetes.io/projected/8687e3f9-1811-4c0a-a9fe-e652febe1ec6-kube-api-access-555ct\") pod \"kuadrant-operator-controller-manager-86878c769f-7hjc7\" (UID: \"8687e3f9-1811-4c0a-a9fe-e652febe1ec6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hjc7" Jul 24 04:07:24.108748 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.108675 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/430be003-deef-4d7d-845d-3f9a282976ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9xsn4\" (UID: \"430be003-deef-4d7d-845d-3f9a282976ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4" Jul 24 04:07:24.121236 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.121194 2563 generic.go:356] "Generic (PLEG): container finished" podID="7b5d7a2e-4ee4-48ec-9175-a657204050fc" containerID="c37ad442b863a2141203184ab55d3c6791080db1cec40529ef7d421ecc975056" exitCode=0 Jul 24 04:07:24.121413 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.121337 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67xpq" Jul 24 04:07:24.124278 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:07:24.124234 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-67xpq\" is forbidden: User \"system:node:ip-10-0-138-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-155.ec2.internal' and this object" podUID="2e1c12e9-8917-4d12-98f7-72a80163a7a1" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67xpq" Jul 24 04:07:24.126334 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:07:24.126296 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lbs2v\" is forbidden: User \"system:node:ip-10-0-138-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-155.ec2.internal' and this object" podUID="7b5d7a2e-4ee4-48ec-9175-a657204050fc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v" Jul 24 04:07:24.129397 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.129376 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67xpq" Jul 24 04:07:24.131591 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:07:24.131564 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-67xpq\" is forbidden: User \"system:node:ip-10-0-138-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-155.ec2.internal' and this object" podUID="2e1c12e9-8917-4d12-98f7-72a80163a7a1" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67xpq" Jul 24 04:07:24.133518 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:07:24.133495 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lbs2v\" is forbidden: User \"system:node:ip-10-0-138-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-155.ec2.internal' and this object" podUID="7b5d7a2e-4ee4-48ec-9175-a657204050fc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v" Jul 24 04:07:24.205020 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.204988 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v" Jul 24 04:07:24.207250 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:07:24.207211 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lbs2v\" is forbidden: User \"system:node:ip-10-0-138-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-155.ec2.internal' and this object" podUID="7b5d7a2e-4ee4-48ec-9175-a657204050fc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v" Jul 24 04:07:24.209319 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:07:24.209287 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-67xpq\" is forbidden: User \"system:node:ip-10-0-138-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-155.ec2.internal' and this object" podUID="2e1c12e9-8917-4d12-98f7-72a80163a7a1" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67xpq" Jul 24 04:07:24.209662 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.209642 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-555ct\" (UniqueName: \"kubernetes.io/projected/8687e3f9-1811-4c0a-a9fe-e652febe1ec6-kube-api-access-555ct\") pod \"kuadrant-operator-controller-manager-86878c769f-7hjc7\" (UID: \"8687e3f9-1811-4c0a-a9fe-e652febe1ec6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hjc7" Jul 24 04:07:24.209710 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.209678 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/430be003-deef-4d7d-845d-3f9a282976ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9xsn4\" (UID: \"430be003-deef-4d7d-845d-3f9a282976ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4" Jul 24 04:07:24.209757 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.209746 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8687e3f9-1811-4c0a-a9fe-e652febe1ec6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7hjc7\" (UID: \"8687e3f9-1811-4c0a-a9fe-e652febe1ec6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hjc7" Jul 24 04:07:24.209795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.209773 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l4rbp\" (UniqueName: \"kubernetes.io/projected/430be003-deef-4d7d-845d-3f9a282976ea-kube-api-access-l4rbp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9xsn4\" (UID: \"430be003-deef-4d7d-845d-3f9a282976ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4" Jul 24 04:07:24.210210 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.210191 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/8687e3f9-1811-4c0a-a9fe-e652febe1ec6-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-7hjc7\" (UID: \"8687e3f9-1811-4c0a-a9fe-e652febe1ec6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hjc7" Jul 24 04:07:24.210246 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.210192 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/430be003-deef-4d7d-845d-3f9a282976ea-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9xsn4\" (UID: \"430be003-deef-4d7d-845d-3f9a282976ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4" Jul 24 04:07:24.220628 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.220599 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-555ct\" (UniqueName: \"kubernetes.io/projected/8687e3f9-1811-4c0a-a9fe-e652febe1ec6-kube-api-access-555ct\") pod \"kuadrant-operator-controller-manager-86878c769f-7hjc7\" (UID: \"8687e3f9-1811-4c0a-a9fe-e652febe1ec6\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hjc7" Jul 24 04:07:24.220971 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.220678 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l4rbp\" (UniqueName: \"kubernetes.io/projected/430be003-deef-4d7d-845d-3f9a282976ea-kube-api-access-l4rbp\") pod \"kuadrant-operator-controller-manager-8684c9ff49-9xsn4\" (UID: \"430be003-deef-4d7d-845d-3f9a282976ea\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4" Jul 24 04:07:24.308438 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.308411 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:07:24.310143 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.310124 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-console-config\") pod \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " Jul 24 04:07:24.310217 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.310161 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-console-oauth-config\") pod \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " Jul 24 04:07:24.310217 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.310187 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b5d7a2e-4ee4-48ec-9175-a657204050fc-extensions-socket-volume\") pod \"7b5d7a2e-4ee4-48ec-9175-a657204050fc\" (UID: \"7b5d7a2e-4ee4-48ec-9175-a657204050fc\") " Jul 24 04:07:24.310217 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.310204 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-oauth-serving-cert\") pod \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " Jul 24 04:07:24.310353 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.310231 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-trusted-ca-bundle\") pod \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " Jul 24 04:07:24.310353 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.310264 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-console-serving-cert\") pod \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " Jul 24 04:07:24.310353 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.310311 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-service-ca\") pod \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " Jul 24 04:07:24.310531 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.310425 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzq54\" (UniqueName: \"kubernetes.io/projected/7b5d7a2e-4ee4-48ec-9175-a657204050fc-kube-api-access-nzq54\") pod \"7b5d7a2e-4ee4-48ec-9175-a657204050fc\" (UID: \"7b5d7a2e-4ee4-48ec-9175-a657204050fc\") " Jul 24 04:07:24.310531 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.310492 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-console-config" (OuterVolumeSpecName: "console-config") pod "c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0" (UID: "c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:07:24.310531 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.310506 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-92zg5\" (UniqueName: \"kubernetes.io/projected/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-kube-api-access-92zg5\") pod \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\" (UID: \"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0\") " Jul 24 04:07:24.310701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.310614 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/7b5d7a2e-4ee4-48ec-9175-a657204050fc-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "7b5d7a2e-4ee4-48ec-9175-a657204050fc" (UID: "7b5d7a2e-4ee4-48ec-9175-a657204050fc"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 04:07:24.310701 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.310684 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-service-ca" (OuterVolumeSpecName: "service-ca") pod "c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0" (UID: "c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:07:24.310829 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.310769 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0" (UID: "c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:07:24.310892 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.310832 2563 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-service-ca\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:07:24.310892 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.310855 2563 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-console-config\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:07:24.310892 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.310870 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/7b5d7a2e-4ee4-48ec-9175-a657204050fc-extensions-socket-volume\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:07:24.311057 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:07:24.310929 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-lbs2v\" is forbidden: User \"system:node:ip-10-0-138-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-155.ec2.internal' and this object" podUID="7b5d7a2e-4ee4-48ec-9175-a657204050fc" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v" Jul 24 04:07:24.311248 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.311224 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0" (UID: "c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:07:24.312409 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.312385 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0" (UID: "c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:07:24.312574 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.312548 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0" (UID: "c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:07:24.313044 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.313013 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/7b5d7a2e-4ee4-48ec-9175-a657204050fc-kube-api-access-nzq54" (OuterVolumeSpecName: "kube-api-access-nzq54") pod "7b5d7a2e-4ee4-48ec-9175-a657204050fc" (UID: "7b5d7a2e-4ee4-48ec-9175-a657204050fc"). InnerVolumeSpecName "kube-api-access-nzq54". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:07:24.313044 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.313030 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-kube-api-access-92zg5" (OuterVolumeSpecName: "kube-api-access-92zg5") pod "c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0" (UID: "c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0"). InnerVolumeSpecName "kube-api-access-92zg5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:07:24.313159 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:07:24.313088 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-67xpq\" is forbidden: User \"system:node:ip-10-0-138-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-155.ec2.internal' and this object" podUID="2e1c12e9-8917-4d12-98f7-72a80163a7a1" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67xpq" Jul 24 04:07:24.342453 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.342418 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4" Jul 24 04:07:24.412154 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.412126 2563 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-oauth-serving-cert\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:07:24.412154 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.412154 2563 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-trusted-ca-bundle\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:07:24.412347 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.412168 2563 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-console-serving-cert\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:07:24.412347 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.412179 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzq54\" (UniqueName: \"kubernetes.io/projected/7b5d7a2e-4ee4-48ec-9175-a657204050fc-kube-api-access-nzq54\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:07:24.412347 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.412193 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-92zg5\" (UniqueName: \"kubernetes.io/projected/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-kube-api-access-92zg5\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:07:24.412347 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.412203 2563 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0-console-oauth-config\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:07:24.419376 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.419299 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hjc7" Jul 24 04:07:24.516787 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.516573 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4"] Jul 24 04:07:24.519836 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:07:24.519803 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod430be003_deef_4d7d_845d_3f9a282976ea.slice/crio-502b3ee0eac133c2512ee2aa3781952a46711c61b6c2b2f82619e61c17e0bca4 WatchSource:0}: Error finding container 502b3ee0eac133c2512ee2aa3781952a46711c61b6c2b2f82619e61c17e0bca4: Status 404 returned error can't find the container with id 502b3ee0eac133c2512ee2aa3781952a46711c61b6c2b2f82619e61c17e0bca4 Jul 24 04:07:24.592336 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.592311 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hjc7"] Jul 24 04:07:24.593542 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:07:24.593497 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8687e3f9_1811_4c0a_a9fe_e652febe1ec6.slice/crio-2885f05ab631c9a52dc74f3d1b0ea06f484de84d6a348b318cb25ba900ce252e WatchSource:0}: Error finding container 2885f05ab631c9a52dc74f3d1b0ea06f484de84d6a348b318cb25ba900ce252e: Status 404 returned error can't find the container with id 2885f05ab631c9a52dc74f3d1b0ea06f484de84d6a348b318cb25ba900ce252e Jul 24 04:07:24.761520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.761457 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:24.852669 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.852635 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:24.943713 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.943676 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2e1c12e9-8917-4d12-98f7-72a80163a7a1" path="/var/lib/kubelet/pods/2e1c12e9-8917-4d12-98f7-72a80163a7a1/volumes" Jul 24 04:07:24.944084 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:24.943910 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="7b5d7a2e-4ee4-48ec-9175-a657204050fc" path="/var/lib/kubelet/pods/7b5d7a2e-4ee4-48ec-9175-a657204050fc/volumes" Jul 24 04:07:25.128967 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:25.128866 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4" event={"ID":"430be003-deef-4d7d-845d-3f9a282976ea","Type":"ContainerStarted","Data":"3cd5101b3f683ac273142fb7c6bd11fd02d03a963420cc1c0453aa26f86cbc70"} Jul 24 04:07:25.128967 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:25.128924 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4" event={"ID":"430be003-deef-4d7d-845d-3f9a282976ea","Type":"ContainerStarted","Data":"502b3ee0eac133c2512ee2aa3781952a46711c61b6c2b2f82619e61c17e0bca4"} Jul 24 04:07:25.129200 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:25.128972 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4" Jul 24 04:07:25.130401 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:25.130376 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-lbs2v" Jul 24 04:07:25.130566 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:25.130415 2563 scope.go:117] "RemoveContainer" containerID="c37ad442b863a2141203184ab55d3c6791080db1cec40529ef7d421ecc975056" Jul 24 04:07:25.132016 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:25.131991 2563 generic.go:356] "Generic (PLEG): container finished" podID="c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0" containerID="30f39f731c3e1c9de587c3721748960eec211bd1436212ba956a2b11e5f7bee5" exitCode=0 Jul 24 04:07:25.132122 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:25.132039 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69d5bf9758-vbwvp" Jul 24 04:07:25.132122 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:25.132078 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d5bf9758-vbwvp" event={"ID":"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0","Type":"ContainerDied","Data":"30f39f731c3e1c9de587c3721748960eec211bd1436212ba956a2b11e5f7bee5"} Jul 24 04:07:25.132250 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:25.132128 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69d5bf9758-vbwvp" event={"ID":"c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0","Type":"ContainerDied","Data":"2b80e6cd652e940a1845e3d5f7a9969716a23b23d01acfa2d0bbeea9fe3b768e"} Jul 24 04:07:25.134370 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:25.134347 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67xpq" Jul 24 04:07:25.134647 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:25.134351 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hjc7" event={"ID":"8687e3f9-1811-4c0a-a9fe-e652febe1ec6","Type":"ContainerStarted","Data":"af07258da708e7145636c07370f69f5a58653a5386bbeb77cf6ef5a61cb5e0d8"} Jul 24 04:07:25.134732 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:25.134685 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hjc7" Jul 24 04:07:25.134732 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:25.134719 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hjc7" event={"ID":"8687e3f9-1811-4c0a-a9fe-e652febe1ec6","Type":"ContainerStarted","Data":"2885f05ab631c9a52dc74f3d1b0ea06f484de84d6a348b318cb25ba900ce252e"} Jul 24 04:07:25.140966 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:25.140946 2563 scope.go:117] "RemoveContainer" containerID="30f39f731c3e1c9de587c3721748960eec211bd1436212ba956a2b11e5f7bee5" Jul 24 04:07:25.149415 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:25.149398 2563 scope.go:117] "RemoveContainer" containerID="30f39f731c3e1c9de587c3721748960eec211bd1436212ba956a2b11e5f7bee5" Jul 24 04:07:25.149735 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:07:25.149708 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"30f39f731c3e1c9de587c3721748960eec211bd1436212ba956a2b11e5f7bee5\": container with ID starting with 30f39f731c3e1c9de587c3721748960eec211bd1436212ba956a2b11e5f7bee5 not found: ID does not exist" containerID="30f39f731c3e1c9de587c3721748960eec211bd1436212ba956a2b11e5f7bee5" Jul 24 04:07:25.149854 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:25.149745 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"30f39f731c3e1c9de587c3721748960eec211bd1436212ba956a2b11e5f7bee5"} err="failed to get container status \"30f39f731c3e1c9de587c3721748960eec211bd1436212ba956a2b11e5f7bee5\": rpc error: code = NotFound desc = could not find container \"30f39f731c3e1c9de587c3721748960eec211bd1436212ba956a2b11e5f7bee5\": container with ID starting with 30f39f731c3e1c9de587c3721748960eec211bd1436212ba956a2b11e5f7bee5 not found: ID does not exist" Jul 24 04:07:25.158467 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:25.158411 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4" podStartSLOduration=2.158393345 podStartE2EDuration="2.158393345s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:07:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:07:25.156089063 +0000 UTC m=+426.902462657" watchObservedRunningTime="2026-07-24 04:07:25.158393345 +0000 UTC m=+426.904766928" Jul 24 04:07:25.178693 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:25.178658 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69d5bf9758-vbwvp"] Jul 24 04:07:25.186215 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:25.186185 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69d5bf9758-vbwvp"] Jul 24 04:07:25.206588 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:07:25.206546 2563 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-67xpq\" is forbidden: User \"system:node:ip-10-0-138-155.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-155.ec2.internal' and this object" podUID="2e1c12e9-8917-4d12-98f7-72a80163a7a1" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-67xpq" Jul 24 04:07:25.207205 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:25.207163 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hjc7" podStartSLOduration=1.207147237 podStartE2EDuration="1.207147237s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:07:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:07:25.204420474 +0000 UTC m=+426.950794083" watchObservedRunningTime="2026-07-24 04:07:25.207147237 +0000 UTC m=+426.953520820" Jul 24 04:07:26.943075 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:26.943037 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0" path="/var/lib/kubelet/pods/c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0/volumes" Jul 24 04:07:28.823197 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:28.823160 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:28.923401 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:28.923366 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:29.412679 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:29.412646 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:29.514444 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:29.514406 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:33.222606 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:33.222571 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:33.282056 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:33.282017 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:36.144171 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:36.144137 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4" Jul 24 04:07:36.144644 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:36.144213 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-7hjc7" Jul 24 04:07:36.214591 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:36.214551 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4"] Jul 24 04:07:36.214830 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:36.214790 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4" podUID="430be003-deef-4d7d-845d-3f9a282976ea" containerName="manager" containerID="cri-o://3cd5101b3f683ac273142fb7c6bd11fd02d03a963420cc1c0453aa26f86cbc70" gracePeriod=10 Jul 24 04:07:36.466952 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:36.466928 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4" Jul 24 04:07:36.520019 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:36.519983 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/430be003-deef-4d7d-845d-3f9a282976ea-extensions-socket-volume\") pod \"430be003-deef-4d7d-845d-3f9a282976ea\" (UID: \"430be003-deef-4d7d-845d-3f9a282976ea\") " Jul 24 04:07:36.520225 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:36.520045 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l4rbp\" (UniqueName: \"kubernetes.io/projected/430be003-deef-4d7d-845d-3f9a282976ea-kube-api-access-l4rbp\") pod \"430be003-deef-4d7d-845d-3f9a282976ea\" (UID: \"430be003-deef-4d7d-845d-3f9a282976ea\") " Jul 24 04:07:36.520432 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:36.520406 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/430be003-deef-4d7d-845d-3f9a282976ea-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "430be003-deef-4d7d-845d-3f9a282976ea" (UID: "430be003-deef-4d7d-845d-3f9a282976ea"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 24 04:07:36.522222 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:36.522196 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/430be003-deef-4d7d-845d-3f9a282976ea-kube-api-access-l4rbp" (OuterVolumeSpecName: "kube-api-access-l4rbp") pod "430be003-deef-4d7d-845d-3f9a282976ea" (UID: "430be003-deef-4d7d-845d-3f9a282976ea"). InnerVolumeSpecName "kube-api-access-l4rbp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:07:36.621013 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:36.620979 2563 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/430be003-deef-4d7d-845d-3f9a282976ea-extensions-socket-volume\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:07:36.621013 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:36.621006 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l4rbp\" (UniqueName: \"kubernetes.io/projected/430be003-deef-4d7d-845d-3f9a282976ea-kube-api-access-l4rbp\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:07:37.202850 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:37.202748 2563 generic.go:356] "Generic (PLEG): container finished" podID="430be003-deef-4d7d-845d-3f9a282976ea" containerID="3cd5101b3f683ac273142fb7c6bd11fd02d03a963420cc1c0453aa26f86cbc70" exitCode=0 Jul 24 04:07:37.202850 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:37.202789 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4" Jul 24 04:07:37.202850 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:37.202829 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4" event={"ID":"430be003-deef-4d7d-845d-3f9a282976ea","Type":"ContainerDied","Data":"3cd5101b3f683ac273142fb7c6bd11fd02d03a963420cc1c0453aa26f86cbc70"} Jul 24 04:07:37.203334 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:37.202881 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4" event={"ID":"430be003-deef-4d7d-845d-3f9a282976ea","Type":"ContainerDied","Data":"502b3ee0eac133c2512ee2aa3781952a46711c61b6c2b2f82619e61c17e0bca4"} Jul 24 04:07:37.203334 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:37.202905 2563 scope.go:117] "RemoveContainer" containerID="3cd5101b3f683ac273142fb7c6bd11fd02d03a963420cc1c0453aa26f86cbc70" Jul 24 04:07:37.212018 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:37.211997 2563 scope.go:117] "RemoveContainer" containerID="3cd5101b3f683ac273142fb7c6bd11fd02d03a963420cc1c0453aa26f86cbc70" Jul 24 04:07:37.212303 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:07:37.212283 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3cd5101b3f683ac273142fb7c6bd11fd02d03a963420cc1c0453aa26f86cbc70\": container with ID starting with 3cd5101b3f683ac273142fb7c6bd11fd02d03a963420cc1c0453aa26f86cbc70 not found: ID does not exist" containerID="3cd5101b3f683ac273142fb7c6bd11fd02d03a963420cc1c0453aa26f86cbc70" Jul 24 04:07:37.212368 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:37.212322 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3cd5101b3f683ac273142fb7c6bd11fd02d03a963420cc1c0453aa26f86cbc70"} err="failed to get container status \"3cd5101b3f683ac273142fb7c6bd11fd02d03a963420cc1c0453aa26f86cbc70\": rpc error: code = NotFound desc = could not find container \"3cd5101b3f683ac273142fb7c6bd11fd02d03a963420cc1c0453aa26f86cbc70\": container with ID starting with 3cd5101b3f683ac273142fb7c6bd11fd02d03a963420cc1c0453aa26f86cbc70 not found: ID does not exist" Jul 24 04:07:37.234320 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:37.234280 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4"] Jul 24 04:07:37.241231 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:37.241202 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-9xsn4"] Jul 24 04:07:38.942969 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:38.942927 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="430be003-deef-4d7d-845d-3f9a282976ea" path="/var/lib/kubelet/pods/430be003-deef-4d7d-845d-3f9a282976ea/volumes" Jul 24 04:07:41.861849 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:41.861770 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:41.961518 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:41.961452 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:44.301909 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:44.301875 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:44.402946 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:44.402912 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:49.058655 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:49.058593 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:49.157359 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:49.157329 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:52.580987 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:52.580945 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:53.029918 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:53.029882 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:53.113995 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:53.113955 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:54.716196 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:54.716161 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:54.720335 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:54.720305 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9mckw"] Jul 24 04:07:54.720850 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:54.720824 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0" containerName="console" Jul 24 04:07:54.720850 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:54.720844 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0" containerName="console" Jul 24 04:07:54.720850 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:54.720855 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="430be003-deef-4d7d-845d-3f9a282976ea" containerName="manager" Jul 24 04:07:54.721043 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:54.720891 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="430be003-deef-4d7d-845d-3f9a282976ea" containerName="manager" Jul 24 04:07:54.721043 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:54.720995 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="430be003-deef-4d7d-845d-3f9a282976ea" containerName="manager" Jul 24 04:07:54.721043 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:54.721008 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="c8b749ef-f3c8-4d9b-ae2e-02df9fe20ed0" containerName="console" Jul 24 04:07:54.723144 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:54.723126 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9mckw" Jul 24 04:07:54.725697 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:54.725673 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 24 04:07:54.725824 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:54.725705 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-g5kfq\"" Jul 24 04:07:54.732382 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:54.732351 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9mckw"] Jul 24 04:07:54.787265 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:54.787230 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:54.815602 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:54.815559 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9mckw"] Jul 24 04:07:54.850850 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:54.850805 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:54.884204 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:54.884157 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whbpm\" (UniqueName: \"kubernetes.io/projected/b19ee6da-a99d-4d10-b924-2ec2c229d835-kube-api-access-whbpm\") pod \"limitador-limitador-64c94fd64f-9mckw\" (UID: \"b19ee6da-a99d-4d10-b924-2ec2c229d835\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9mckw" Jul 24 04:07:54.884398 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:54.884274 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b19ee6da-a99d-4d10-b924-2ec2c229d835-config-file\") pod \"limitador-limitador-64c94fd64f-9mckw\" (UID: \"b19ee6da-a99d-4d10-b924-2ec2c229d835\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9mckw" Jul 24 04:07:54.985748 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:54.985651 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whbpm\" (UniqueName: \"kubernetes.io/projected/b19ee6da-a99d-4d10-b924-2ec2c229d835-kube-api-access-whbpm\") pod \"limitador-limitador-64c94fd64f-9mckw\" (UID: \"b19ee6da-a99d-4d10-b924-2ec2c229d835\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9mckw" Jul 24 04:07:54.985748 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:54.985694 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b19ee6da-a99d-4d10-b924-2ec2c229d835-config-file\") pod \"limitador-limitador-64c94fd64f-9mckw\" (UID: \"b19ee6da-a99d-4d10-b924-2ec2c229d835\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9mckw" Jul 24 04:07:54.986267 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:54.986247 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b19ee6da-a99d-4d10-b924-2ec2c229d835-config-file\") pod \"limitador-limitador-64c94fd64f-9mckw\" (UID: \"b19ee6da-a99d-4d10-b924-2ec2c229d835\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9mckw" Jul 24 04:07:54.996518 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:54.996466 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-whbpm\" (UniqueName: \"kubernetes.io/projected/b19ee6da-a99d-4d10-b924-2ec2c229d835-kube-api-access-whbpm\") pod \"limitador-limitador-64c94fd64f-9mckw\" (UID: \"b19ee6da-a99d-4d10-b924-2ec2c229d835\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-9mckw" Jul 24 04:07:55.035215 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:55.035179 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9mckw" Jul 24 04:07:55.171982 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:55.171957 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9mckw"] Jul 24 04:07:55.175075 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:07:55.175048 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb19ee6da_a99d_4d10_b924_2ec2c229d835.slice/crio-c89b50b5e9ac1650472538e17c26dc9bda5bb6298d30e4951755375175abb610 WatchSource:0}: Error finding container c89b50b5e9ac1650472538e17c26dc9bda5bb6298d30e4951755375175abb610: Status 404 returned error can't find the container with id c89b50b5e9ac1650472538e17c26dc9bda5bb6298d30e4951755375175abb610 Jul 24 04:07:55.305598 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:55.305512 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9mckw" event={"ID":"b19ee6da-a99d-4d10-b924-2ec2c229d835","Type":"ContainerStarted","Data":"c89b50b5e9ac1650472538e17c26dc9bda5bb6298d30e4951755375175abb610"} Jul 24 04:07:55.468993 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:55.468962 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-r84bz"] Jul 24 04:07:55.472247 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:55.472225 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r84bz" Jul 24 04:07:55.474648 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:55.474624 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-gqhbd\"" Jul 24 04:07:55.480420 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:55.480389 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-r84bz"] Jul 24 04:07:55.495921 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:55.495888 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:55.550719 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:55.550684 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:07:55.592041 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:55.591941 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fxk5r\" (UniqueName: \"kubernetes.io/projected/15bf2e3b-a7eb-46c4-af3e-f46b82337461-kube-api-access-fxk5r\") pod \"authorino-58cd955675-r84bz\" (UID: \"15bf2e3b-a7eb-46c4-af3e-f46b82337461\") " pod="kuadrant-system/authorino-58cd955675-r84bz" Jul 24 04:07:55.693436 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:55.693392 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fxk5r\" (UniqueName: \"kubernetes.io/projected/15bf2e3b-a7eb-46c4-af3e-f46b82337461-kube-api-access-fxk5r\") pod \"authorino-58cd955675-r84bz\" (UID: \"15bf2e3b-a7eb-46c4-af3e-f46b82337461\") " pod="kuadrant-system/authorino-58cd955675-r84bz" Jul 24 04:07:55.709774 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:55.709746 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fxk5r\" (UniqueName: \"kubernetes.io/projected/15bf2e3b-a7eb-46c4-af3e-f46b82337461-kube-api-access-fxk5r\") pod \"authorino-58cd955675-r84bz\" (UID: \"15bf2e3b-a7eb-46c4-af3e-f46b82337461\") " pod="kuadrant-system/authorino-58cd955675-r84bz" Jul 24 04:07:55.783882 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:55.783848 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r84bz" Jul 24 04:07:55.952380 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:55.952319 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-r84bz"] Jul 24 04:07:55.955136 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:07:55.954981 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod15bf2e3b_a7eb_46c4_af3e_f46b82337461.slice/crio-593bcb4121fa5256ff09458066033b7d838bc775271ad1ca60c3aa05ba94ddf7 WatchSource:0}: Error finding container 593bcb4121fa5256ff09458066033b7d838bc775271ad1ca60c3aa05ba94ddf7: Status 404 returned error can't find the container with id 593bcb4121fa5256ff09458066033b7d838bc775271ad1ca60c3aa05ba94ddf7 Jul 24 04:07:56.312883 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:56.312847 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r84bz" event={"ID":"15bf2e3b-a7eb-46c4-af3e-f46b82337461","Type":"ContainerStarted","Data":"593bcb4121fa5256ff09458066033b7d838bc775271ad1ca60c3aa05ba94ddf7"} Jul 24 04:07:58.329982 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:58.329865 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9mckw" event={"ID":"b19ee6da-a99d-4d10-b924-2ec2c229d835","Type":"ContainerStarted","Data":"718a07c793b3cfb8fdfa9709f71140793075f46e83c46aa29202d0376714c185"} Jul 24 04:07:58.330431 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:58.330001 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-9mckw" Jul 24 04:07:58.349098 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:58.349032 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-9mckw" podStartSLOduration=1.536185285 podStartE2EDuration="4.349008492s" totalImagesPullingTime="2.812823207s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:07:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:07:58.346129747 +0000 UTC m=+460.092503331" watchObservedRunningTime="2026-07-24 04:07:58.349008492 +0000 UTC m=+460.095382077" Jul 24 04:07:59.661219 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:07:59.661175 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-r84bz"] Jul 24 04:08:00.343659 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:00.343618 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r84bz" event={"ID":"15bf2e3b-a7eb-46c4-af3e-f46b82337461","Type":"ContainerStarted","Data":"9d72cd4dbcf88752d3f1004099bd4bfa93a7b32b7fe28df79519486d93124473"} Jul 24 04:08:00.343808 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:00.343702 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-r84bz" podUID="15bf2e3b-a7eb-46c4-af3e-f46b82337461" containerName="authorino" containerID="cri-o://9d72cd4dbcf88752d3f1004099bd4bfa93a7b32b7fe28df79519486d93124473" gracePeriod=30 Jul 24 04:08:00.359299 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:00.359249 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-r84bz" podStartSLOduration=1.198742632 podStartE2EDuration="5.359231316s" totalImagesPullingTime="4.160488684s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:07:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:08:00.35698304 +0000 UTC m=+462.103356618" watchObservedRunningTime="2026-07-24 04:08:00.359231316 +0000 UTC m=+462.105604917" Jul 24 04:08:00.587903 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:00.587875 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r84bz" Jul 24 04:08:00.741268 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:00.741169 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fxk5r\" (UniqueName: \"kubernetes.io/projected/15bf2e3b-a7eb-46c4-af3e-f46b82337461-kube-api-access-fxk5r\") pod \"15bf2e3b-a7eb-46c4-af3e-f46b82337461\" (UID: \"15bf2e3b-a7eb-46c4-af3e-f46b82337461\") " Jul 24 04:08:00.743404 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:00.743380 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/15bf2e3b-a7eb-46c4-af3e-f46b82337461-kube-api-access-fxk5r" (OuterVolumeSpecName: "kube-api-access-fxk5r") pod "15bf2e3b-a7eb-46c4-af3e-f46b82337461" (UID: "15bf2e3b-a7eb-46c4-af3e-f46b82337461"). InnerVolumeSpecName "kube-api-access-fxk5r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:08:00.842573 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:00.842538 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fxk5r\" (UniqueName: \"kubernetes.io/projected/15bf2e3b-a7eb-46c4-af3e-f46b82337461-kube-api-access-fxk5r\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:08:01.350293 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:01.350261 2563 generic.go:356] "Generic (PLEG): container finished" podID="15bf2e3b-a7eb-46c4-af3e-f46b82337461" containerID="9d72cd4dbcf88752d3f1004099bd4bfa93a7b32b7fe28df79519486d93124473" exitCode=0 Jul 24 04:08:01.350529 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:01.350319 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r84bz" Jul 24 04:08:01.350529 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:01.350349 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r84bz" event={"ID":"15bf2e3b-a7eb-46c4-af3e-f46b82337461","Type":"ContainerDied","Data":"9d72cd4dbcf88752d3f1004099bd4bfa93a7b32b7fe28df79519486d93124473"} Jul 24 04:08:01.350529 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:01.350401 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r84bz" event={"ID":"15bf2e3b-a7eb-46c4-af3e-f46b82337461","Type":"ContainerDied","Data":"593bcb4121fa5256ff09458066033b7d838bc775271ad1ca60c3aa05ba94ddf7"} Jul 24 04:08:01.350529 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:01.350425 2563 scope.go:117] "RemoveContainer" containerID="9d72cd4dbcf88752d3f1004099bd4bfa93a7b32b7fe28df79519486d93124473" Jul 24 04:08:01.359463 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:01.359412 2563 scope.go:117] "RemoveContainer" containerID="9d72cd4dbcf88752d3f1004099bd4bfa93a7b32b7fe28df79519486d93124473" Jul 24 04:08:01.359754 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:08:01.359734 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"9d72cd4dbcf88752d3f1004099bd4bfa93a7b32b7fe28df79519486d93124473\": container with ID starting with 9d72cd4dbcf88752d3f1004099bd4bfa93a7b32b7fe28df79519486d93124473 not found: ID does not exist" containerID="9d72cd4dbcf88752d3f1004099bd4bfa93a7b32b7fe28df79519486d93124473" Jul 24 04:08:01.359805 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:01.359767 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"9d72cd4dbcf88752d3f1004099bd4bfa93a7b32b7fe28df79519486d93124473"} err="failed to get container status \"9d72cd4dbcf88752d3f1004099bd4bfa93a7b32b7fe28df79519486d93124473\": rpc error: code = NotFound desc = could not find container \"9d72cd4dbcf88752d3f1004099bd4bfa93a7b32b7fe28df79519486d93124473\": container with ID starting with 9d72cd4dbcf88752d3f1004099bd4bfa93a7b32b7fe28df79519486d93124473 not found: ID does not exist" Jul 24 04:08:01.368153 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:01.368115 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-r84bz"] Jul 24 04:08:01.374059 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:01.374028 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-r84bz"] Jul 24 04:08:02.943262 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:02.943218 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="15bf2e3b-a7eb-46c4-af3e-f46b82337461" path="/var/lib/kubelet/pods/15bf2e3b-a7eb-46c4-af3e-f46b82337461/volumes" Jul 24 04:08:03.278276 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:03.278244 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:08:03.378368 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:03.378329 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:08:03.657982 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:03.657876 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:08:03.712307 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:03.712278 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:08:04.931408 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:04.931375 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:08:04.983243 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:04.983211 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:08:06.075194 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:06.075154 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:08:06.148581 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:06.148545 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:08:09.337569 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:09.337538 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-9mckw" Jul 24 04:08:09.739830 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:09.739792 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9mckw"] Jul 24 04:08:09.740065 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:09.740035 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-9mckw" podUID="b19ee6da-a99d-4d10-b924-2ec2c229d835" containerName="limitador" containerID="cri-o://718a07c793b3cfb8fdfa9709f71140793075f46e83c46aa29202d0376714c185" gracePeriod=30 Jul 24 04:08:10.063219 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:10.063186 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:08:10.163977 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:10.163946 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:08:10.305324 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:10.305251 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9mckw" Jul 24 04:08:10.323849 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:10.323822 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b19ee6da-a99d-4d10-b924-2ec2c229d835-config-file\") pod \"b19ee6da-a99d-4d10-b924-2ec2c229d835\" (UID: \"b19ee6da-a99d-4d10-b924-2ec2c229d835\") " Jul 24 04:08:10.324045 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:10.323978 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-whbpm\" (UniqueName: \"kubernetes.io/projected/b19ee6da-a99d-4d10-b924-2ec2c229d835-kube-api-access-whbpm\") pod \"b19ee6da-a99d-4d10-b924-2ec2c229d835\" (UID: \"b19ee6da-a99d-4d10-b924-2ec2c229d835\") " Jul 24 04:08:10.324239 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:10.324211 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b19ee6da-a99d-4d10-b924-2ec2c229d835-config-file" (OuterVolumeSpecName: "config-file") pod "b19ee6da-a99d-4d10-b924-2ec2c229d835" (UID: "b19ee6da-a99d-4d10-b924-2ec2c229d835"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 24 04:08:10.326181 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:10.326143 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b19ee6da-a99d-4d10-b924-2ec2c229d835-kube-api-access-whbpm" (OuterVolumeSpecName: "kube-api-access-whbpm") pod "b19ee6da-a99d-4d10-b924-2ec2c229d835" (UID: "b19ee6da-a99d-4d10-b924-2ec2c229d835"). InnerVolumeSpecName "kube-api-access-whbpm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:08:10.406797 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:10.406766 2563 generic.go:356] "Generic (PLEG): container finished" podID="b19ee6da-a99d-4d10-b924-2ec2c229d835" containerID="718a07c793b3cfb8fdfa9709f71140793075f46e83c46aa29202d0376714c185" exitCode=0 Jul 24 04:08:10.407174 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:10.406825 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-9mckw" Jul 24 04:08:10.407174 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:10.406861 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9mckw" event={"ID":"b19ee6da-a99d-4d10-b924-2ec2c229d835","Type":"ContainerDied","Data":"718a07c793b3cfb8fdfa9709f71140793075f46e83c46aa29202d0376714c185"} Jul 24 04:08:10.407174 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:10.406944 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-9mckw" event={"ID":"b19ee6da-a99d-4d10-b924-2ec2c229d835","Type":"ContainerDied","Data":"c89b50b5e9ac1650472538e17c26dc9bda5bb6298d30e4951755375175abb610"} Jul 24 04:08:10.407174 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:10.406973 2563 scope.go:117] "RemoveContainer" containerID="718a07c793b3cfb8fdfa9709f71140793075f46e83c46aa29202d0376714c185" Jul 24 04:08:10.416390 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:10.416368 2563 scope.go:117] "RemoveContainer" containerID="718a07c793b3cfb8fdfa9709f71140793075f46e83c46aa29202d0376714c185" Jul 24 04:08:10.416782 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:08:10.416759 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"718a07c793b3cfb8fdfa9709f71140793075f46e83c46aa29202d0376714c185\": container with ID starting with 718a07c793b3cfb8fdfa9709f71140793075f46e83c46aa29202d0376714c185 not found: ID does not exist" containerID="718a07c793b3cfb8fdfa9709f71140793075f46e83c46aa29202d0376714c185" Jul 24 04:08:10.416876 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:10.416792 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"718a07c793b3cfb8fdfa9709f71140793075f46e83c46aa29202d0376714c185"} err="failed to get container status \"718a07c793b3cfb8fdfa9709f71140793075f46e83c46aa29202d0376714c185\": rpc error: code = NotFound desc = could not find container \"718a07c793b3cfb8fdfa9709f71140793075f46e83c46aa29202d0376714c185\": container with ID starting with 718a07c793b3cfb8fdfa9709f71140793075f46e83c46aa29202d0376714c185 not found: ID does not exist" Jul 24 04:08:10.424922 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:10.424893 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-whbpm\" (UniqueName: \"kubernetes.io/projected/b19ee6da-a99d-4d10-b924-2ec2c229d835-kube-api-access-whbpm\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:08:10.424922 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:10.424919 2563 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b19ee6da-a99d-4d10-b924-2ec2c229d835-config-file\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:08:10.427088 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:10.427051 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9mckw"] Jul 24 04:08:10.430583 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:10.430559 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-9mckw"] Jul 24 04:08:10.875061 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:10.875030 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:08:10.944581 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:10.944547 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b19ee6da-a99d-4d10-b924-2ec2c229d835" path="/var/lib/kubelet/pods/b19ee6da-a99d-4d10-b924-2ec2c229d835/volumes" Jul 24 04:08:10.994690 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:10.994658 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:08:11.302628 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:11.302592 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4chlm"] Jul 24 04:08:11.302969 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:11.302954 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b19ee6da-a99d-4d10-b924-2ec2c229d835" containerName="limitador" Jul 24 04:08:11.302969 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:11.302970 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="b19ee6da-a99d-4d10-b924-2ec2c229d835" containerName="limitador" Jul 24 04:08:11.303063 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:11.302987 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="15bf2e3b-a7eb-46c4-af3e-f46b82337461" containerName="authorino" Jul 24 04:08:11.303063 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:11.302993 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="15bf2e3b-a7eb-46c4-af3e-f46b82337461" containerName="authorino" Jul 24 04:08:11.303063 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:11.303051 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="b19ee6da-a99d-4d10-b924-2ec2c229d835" containerName="limitador" Jul 24 04:08:11.303063 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:11.303058 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="15bf2e3b-a7eb-46c4-af3e-f46b82337461" containerName="authorino" Jul 24 04:08:11.307599 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:11.307573 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4chlm" Jul 24 04:08:11.311176 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:11.311153 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 24 04:08:11.312384 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:11.312352 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 24 04:08:11.312559 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:11.312360 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 24 04:08:11.312559 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:11.312484 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-tp8tx\"" Jul 24 04:08:11.318555 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:11.318528 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4chlm"] Jul 24 04:08:11.333175 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:11.332996 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mlkcf\" (UniqueName: \"kubernetes.io/projected/8207985c-a322-4c85-a6ec-f81e839e3134-kube-api-access-mlkcf\") pod \"postgres-69fb4594cf-4chlm\" (UID: \"8207985c-a322-4c85-a6ec-f81e839e3134\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4chlm" Jul 24 04:08:11.333175 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:11.333063 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8207985c-a322-4c85-a6ec-f81e839e3134-data\") pod \"postgres-69fb4594cf-4chlm\" (UID: \"8207985c-a322-4c85-a6ec-f81e839e3134\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4chlm" Jul 24 04:08:11.339281 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:11.339233 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:08:11.434459 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:11.434426 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mlkcf\" (UniqueName: \"kubernetes.io/projected/8207985c-a322-4c85-a6ec-f81e839e3134-kube-api-access-mlkcf\") pod \"postgres-69fb4594cf-4chlm\" (UID: \"8207985c-a322-4c85-a6ec-f81e839e3134\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4chlm" Jul 24 04:08:11.434866 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:11.434468 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8207985c-a322-4c85-a6ec-f81e839e3134-data\") pod \"postgres-69fb4594cf-4chlm\" (UID: \"8207985c-a322-4c85-a6ec-f81e839e3134\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4chlm" Jul 24 04:08:11.434907 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:11.434863 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/8207985c-a322-4c85-a6ec-f81e839e3134-data\") pod \"postgres-69fb4594cf-4chlm\" (UID: \"8207985c-a322-4c85-a6ec-f81e839e3134\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4chlm" Jul 24 04:08:11.442753 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:11.442726 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mlkcf\" (UniqueName: \"kubernetes.io/projected/8207985c-a322-4c85-a6ec-f81e839e3134-kube-api-access-mlkcf\") pod \"postgres-69fb4594cf-4chlm\" (UID: \"8207985c-a322-4c85-a6ec-f81e839e3134\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-4chlm" Jul 24 04:08:11.618700 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:11.618595 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4chlm" Jul 24 04:08:11.799495 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:11.799453 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-4chlm"] Jul 24 04:08:11.801710 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:08:11.801682 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8207985c_a322_4c85_a6ec_f81e839e3134.slice/crio-b073d3d7489682cf7a9f2ebce9c94c81899bf35bdb51f90f7eb1118c3313b6c1 WatchSource:0}: Error finding container b073d3d7489682cf7a9f2ebce9c94c81899bf35bdb51f90f7eb1118c3313b6c1: Status 404 returned error can't find the container with id b073d3d7489682cf7a9f2ebce9c94c81899bf35bdb51f90f7eb1118c3313b6c1 Jul 24 04:08:12.423042 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:12.423007 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4chlm" event={"ID":"8207985c-a322-4c85-a6ec-f81e839e3134","Type":"ContainerStarted","Data":"b073d3d7489682cf7a9f2ebce9c94c81899bf35bdb51f90f7eb1118c3313b6c1"} Jul 24 04:08:17.467284 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:17.467243 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4chlm" event={"ID":"8207985c-a322-4c85-a6ec-f81e839e3134","Type":"ContainerStarted","Data":"610c579e28f3d3a36f7e875e3cc93ddd4adb92bab8aa849b163c84321e4b6bf2"} Jul 24 04:08:17.467782 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:17.467434 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4chlm" Jul 24 04:08:17.484129 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:17.484082 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4chlm" podStartSLOduration=1.684742857 podStartE2EDuration="6.484066701s" totalImagesPullingTime="4.799323844s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:08:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:08:17.481596674 +0000 UTC m=+479.227970258" watchObservedRunningTime="2026-07-24 04:08:17.484066701 +0000 UTC m=+479.230440284" Jul 24 04:08:23.502117 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:23.502067 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-4chlm" Jul 24 04:08:23.830419 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:23.830304 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:08:23.942190 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:23.942156 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:08:30.681885 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:30.681844 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-77c7db588d-9nktc"] Jul 24 04:08:30.724429 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:30.724372 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:08:30.782796 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:30.782754 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77c7db588d-9nktc"] Jul 24 04:08:30.782963 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:30.782878 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77c7db588d-9nktc" Jul 24 04:08:30.785984 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:30.785955 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:08:30.786523 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:30.786503 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 24 04:08:30.786651 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:30.786633 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-gfr2d\"" Jul 24 04:08:30.786700 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:30.786634 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 24 04:08:30.869994 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:30.869958 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-6877c4dbdc-lv599"] Jul 24 04:08:30.914628 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:30.914596 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6264ff75-d54b-4fac-bcc9-ec1dcdea398c-webhook-cert\") pod \"maas-controller-77c7db588d-9nktc\" (UID: \"6264ff75-d54b-4fac-bcc9-ec1dcdea398c\") " pod="opendatahub/maas-controller-77c7db588d-9nktc" Jul 24 04:08:30.914628 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:30.914633 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vm2kd\" (UniqueName: \"kubernetes.io/projected/6264ff75-d54b-4fac-bcc9-ec1dcdea398c-kube-api-access-vm2kd\") pod \"maas-controller-77c7db588d-9nktc\" (UID: \"6264ff75-d54b-4fac-bcc9-ec1dcdea398c\") " pod="opendatahub/maas-controller-77c7db588d-9nktc" Jul 24 04:08:30.925998 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:30.925958 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6877c4dbdc-lv599"] Jul 24 04:08:30.926148 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:30.926089 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6877c4dbdc-lv599" Jul 24 04:08:31.015243 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:31.015202 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09b67885-72a9-421e-9c3b-4524e4c68e75-webhook-cert\") pod \"maas-controller-6877c4dbdc-lv599\" (UID: \"09b67885-72a9-421e-9c3b-4524e4c68e75\") " pod="opendatahub/maas-controller-6877c4dbdc-lv599" Jul 24 04:08:31.015427 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:31.015380 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6264ff75-d54b-4fac-bcc9-ec1dcdea398c-webhook-cert\") pod \"maas-controller-77c7db588d-9nktc\" (UID: \"6264ff75-d54b-4fac-bcc9-ec1dcdea398c\") " pod="opendatahub/maas-controller-77c7db588d-9nktc" Jul 24 04:08:31.015524 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:31.015422 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vm2kd\" (UniqueName: \"kubernetes.io/projected/6264ff75-d54b-4fac-bcc9-ec1dcdea398c-kube-api-access-vm2kd\") pod \"maas-controller-77c7db588d-9nktc\" (UID: \"6264ff75-d54b-4fac-bcc9-ec1dcdea398c\") " pod="opendatahub/maas-controller-77c7db588d-9nktc" Jul 24 04:08:31.015587 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:31.015532 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4hnb\" (UniqueName: \"kubernetes.io/projected/09b67885-72a9-421e-9c3b-4524e4c68e75-kube-api-access-c4hnb\") pod \"maas-controller-6877c4dbdc-lv599\" (UID: \"09b67885-72a9-421e-9c3b-4524e4c68e75\") " pod="opendatahub/maas-controller-6877c4dbdc-lv599" Jul 24 04:08:31.017822 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:31.017800 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6264ff75-d54b-4fac-bcc9-ec1dcdea398c-webhook-cert\") pod \"maas-controller-77c7db588d-9nktc\" (UID: \"6264ff75-d54b-4fac-bcc9-ec1dcdea398c\") " pod="opendatahub/maas-controller-77c7db588d-9nktc" Jul 24 04:08:31.024419 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:31.024398 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vm2kd\" (UniqueName: \"kubernetes.io/projected/6264ff75-d54b-4fac-bcc9-ec1dcdea398c-kube-api-access-vm2kd\") pod \"maas-controller-77c7db588d-9nktc\" (UID: \"6264ff75-d54b-4fac-bcc9-ec1dcdea398c\") " pod="opendatahub/maas-controller-77c7db588d-9nktc" Jul 24 04:08:31.093567 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:31.093527 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77c7db588d-9nktc" Jul 24 04:08:31.116076 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:31.116040 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09b67885-72a9-421e-9c3b-4524e4c68e75-webhook-cert\") pod \"maas-controller-6877c4dbdc-lv599\" (UID: \"09b67885-72a9-421e-9c3b-4524e4c68e75\") " pod="opendatahub/maas-controller-6877c4dbdc-lv599" Jul 24 04:08:31.116241 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:31.116107 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4hnb\" (UniqueName: \"kubernetes.io/projected/09b67885-72a9-421e-9c3b-4524e4c68e75-kube-api-access-c4hnb\") pod \"maas-controller-6877c4dbdc-lv599\" (UID: \"09b67885-72a9-421e-9c3b-4524e4c68e75\") " pod="opendatahub/maas-controller-6877c4dbdc-lv599" Jul 24 04:08:31.120286 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:31.120252 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/09b67885-72a9-421e-9c3b-4524e4c68e75-webhook-cert\") pod \"maas-controller-6877c4dbdc-lv599\" (UID: \"09b67885-72a9-421e-9c3b-4524e4c68e75\") " pod="opendatahub/maas-controller-6877c4dbdc-lv599" Jul 24 04:08:31.124425 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:31.124401 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4hnb\" (UniqueName: \"kubernetes.io/projected/09b67885-72a9-421e-9c3b-4524e4c68e75-kube-api-access-c4hnb\") pod \"maas-controller-6877c4dbdc-lv599\" (UID: \"09b67885-72a9-421e-9c3b-4524e4c68e75\") " pod="opendatahub/maas-controller-6877c4dbdc-lv599" Jul 24 04:08:31.236426 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:31.236345 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-6877c4dbdc-lv599" Jul 24 04:08:31.276742 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:31.276713 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-77c7db588d-9nktc"] Jul 24 04:08:31.277784 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:08:31.277745 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6264ff75_d54b_4fac_bcc9_ec1dcdea398c.slice/crio-d131b6703900646d817fa1dcbc739c9091b46047845606bbb4f9bd52ef6a6334 WatchSource:0}: Error finding container d131b6703900646d817fa1dcbc739c9091b46047845606bbb4f9bd52ef6a6334: Status 404 returned error can't find the container with id d131b6703900646d817fa1dcbc739c9091b46047845606bbb4f9bd52ef6a6334 Jul 24 04:08:31.408834 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:31.408804 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-6877c4dbdc-lv599"] Jul 24 04:08:31.410287 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:08:31.410254 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09b67885_72a9_421e_9c3b_4524e4c68e75.slice/crio-6eff282662efec2a67d8abf1cffb171d81de2054ef903ed3ef766bd8e95f6a1c WatchSource:0}: Error finding container 6eff282662efec2a67d8abf1cffb171d81de2054ef903ed3ef766bd8e95f6a1c: Status 404 returned error can't find the container with id 6eff282662efec2a67d8abf1cffb171d81de2054ef903ed3ef766bd8e95f6a1c Jul 24 04:08:31.544923 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:31.544833 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6877c4dbdc-lv599" event={"ID":"09b67885-72a9-421e-9c3b-4524e4c68e75","Type":"ContainerStarted","Data":"6eff282662efec2a67d8abf1cffb171d81de2054ef903ed3ef766bd8e95f6a1c"} Jul 24 04:08:31.546028 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:31.546000 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77c7db588d-9nktc" event={"ID":"6264ff75-d54b-4fac-bcc9-ec1dcdea398c","Type":"ContainerStarted","Data":"d131b6703900646d817fa1dcbc739c9091b46047845606bbb4f9bd52ef6a6334"} Jul 24 04:08:34.131774 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:34.131730 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:08:34.226007 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:34.225912 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:08:34.567498 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:34.567394 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-6877c4dbdc-lv599" event={"ID":"09b67885-72a9-421e-9c3b-4524e4c68e75","Type":"ContainerStarted","Data":"f8abd410a2cc0595d8f87352667a181b287917cdd151164eb377c22fd04bc060"} Jul 24 04:08:34.567694 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:34.567542 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-6877c4dbdc-lv599" Jul 24 04:08:34.569108 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:34.569076 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77c7db588d-9nktc" event={"ID":"6264ff75-d54b-4fac-bcc9-ec1dcdea398c","Type":"ContainerStarted","Data":"2356ac8468dc918e394fa8abb47308fd9f013aec9d7206ae0d77af1c8bff0b82"} Jul 24 04:08:34.569235 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:34.569129 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-77c7db588d-9nktc" Jul 24 04:08:34.587610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:34.587557 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-6877c4dbdc-lv599" podStartSLOduration=2.048464586 podStartE2EDuration="4.587541557s" totalImagesPullingTime="2.539076971s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:08:34.585333236 +0000 UTC m=+496.331706824" watchObservedRunningTime="2026-07-24 04:08:34.587541557 +0000 UTC m=+496.333915139" Jul 24 04:08:34.602461 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:34.602405 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-77c7db588d-9nktc" podStartSLOduration=1.921172576 podStartE2EDuration="4.602384639s" totalImagesPullingTime="2.681212063s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:08:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:08:34.60081625 +0000 UTC m=+496.347189835" watchObservedRunningTime="2026-07-24 04:08:34.602384639 +0000 UTC m=+496.348758222" Jul 24 04:08:45.578252 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:45.578216 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-77c7db588d-9nktc" Jul 24 04:08:45.578751 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:45.578299 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-6877c4dbdc-lv599" Jul 24 04:08:45.643728 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:45.643687 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77c7db588d-9nktc"] Jul 24 04:08:45.643980 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:45.643946 2563 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-77c7db588d-9nktc" podUID="6264ff75-d54b-4fac-bcc9-ec1dcdea398c" containerName="manager" containerID="cri-o://2356ac8468dc918e394fa8abb47308fd9f013aec9d7206ae0d77af1c8bff0b82" gracePeriod=30 Jul 24 04:08:45.889025 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:45.888994 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77c7db588d-9nktc" Jul 24 04:08:46.057802 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:46.057752 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6264ff75-d54b-4fac-bcc9-ec1dcdea398c-webhook-cert\") pod \"6264ff75-d54b-4fac-bcc9-ec1dcdea398c\" (UID: \"6264ff75-d54b-4fac-bcc9-ec1dcdea398c\") " Jul 24 04:08:46.057802 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:46.057807 2563 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vm2kd\" (UniqueName: \"kubernetes.io/projected/6264ff75-d54b-4fac-bcc9-ec1dcdea398c-kube-api-access-vm2kd\") pod \"6264ff75-d54b-4fac-bcc9-ec1dcdea398c\" (UID: \"6264ff75-d54b-4fac-bcc9-ec1dcdea398c\") " Jul 24 04:08:46.060099 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:46.060070 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6264ff75-d54b-4fac-bcc9-ec1dcdea398c-kube-api-access-vm2kd" (OuterVolumeSpecName: "kube-api-access-vm2kd") pod "6264ff75-d54b-4fac-bcc9-ec1dcdea398c" (UID: "6264ff75-d54b-4fac-bcc9-ec1dcdea398c"). InnerVolumeSpecName "kube-api-access-vm2kd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 24 04:08:46.060099 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:46.060092 2563 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6264ff75-d54b-4fac-bcc9-ec1dcdea398c-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "6264ff75-d54b-4fac-bcc9-ec1dcdea398c" (UID: "6264ff75-d54b-4fac-bcc9-ec1dcdea398c"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 24 04:08:46.158552 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:46.158456 2563 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6264ff75-d54b-4fac-bcc9-ec1dcdea398c-webhook-cert\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:08:46.158552 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:46.158502 2563 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vm2kd\" (UniqueName: \"kubernetes.io/projected/6264ff75-d54b-4fac-bcc9-ec1dcdea398c-kube-api-access-vm2kd\") on node \"ip-10-0-138-155.ec2.internal\" DevicePath \"\"" Jul 24 04:08:46.635424 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:46.635385 2563 generic.go:356] "Generic (PLEG): container finished" podID="6264ff75-d54b-4fac-bcc9-ec1dcdea398c" containerID="2356ac8468dc918e394fa8abb47308fd9f013aec9d7206ae0d77af1c8bff0b82" exitCode=0 Jul 24 04:08:46.635424 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:46.635428 2563 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-77c7db588d-9nktc" Jul 24 04:08:46.635945 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:46.635487 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77c7db588d-9nktc" event={"ID":"6264ff75-d54b-4fac-bcc9-ec1dcdea398c","Type":"ContainerDied","Data":"2356ac8468dc918e394fa8abb47308fd9f013aec9d7206ae0d77af1c8bff0b82"} Jul 24 04:08:46.635945 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:46.635536 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-77c7db588d-9nktc" event={"ID":"6264ff75-d54b-4fac-bcc9-ec1dcdea398c","Type":"ContainerDied","Data":"d131b6703900646d817fa1dcbc739c9091b46047845606bbb4f9bd52ef6a6334"} Jul 24 04:08:46.635945 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:46.635559 2563 scope.go:117] "RemoveContainer" containerID="2356ac8468dc918e394fa8abb47308fd9f013aec9d7206ae0d77af1c8bff0b82" Jul 24 04:08:46.644996 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:46.644881 2563 scope.go:117] "RemoveContainer" containerID="2356ac8468dc918e394fa8abb47308fd9f013aec9d7206ae0d77af1c8bff0b82" Jul 24 04:08:46.645188 ip-10-0-138-155 kubenswrapper[2563]: E0724 04:08:46.645168 2563 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2356ac8468dc918e394fa8abb47308fd9f013aec9d7206ae0d77af1c8bff0b82\": container with ID starting with 2356ac8468dc918e394fa8abb47308fd9f013aec9d7206ae0d77af1c8bff0b82 not found: ID does not exist" containerID="2356ac8468dc918e394fa8abb47308fd9f013aec9d7206ae0d77af1c8bff0b82" Jul 24 04:08:46.645231 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:46.645196 2563 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2356ac8468dc918e394fa8abb47308fd9f013aec9d7206ae0d77af1c8bff0b82"} err="failed to get container status \"2356ac8468dc918e394fa8abb47308fd9f013aec9d7206ae0d77af1c8bff0b82\": rpc error: code = NotFound desc = could not find container \"2356ac8468dc918e394fa8abb47308fd9f013aec9d7206ae0d77af1c8bff0b82\": container with ID starting with 2356ac8468dc918e394fa8abb47308fd9f013aec9d7206ae0d77af1c8bff0b82 not found: ID does not exist" Jul 24 04:08:46.656441 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:46.656410 2563 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-77c7db588d-9nktc"] Jul 24 04:08:46.665342 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:46.662012 2563 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-77c7db588d-9nktc"] Jul 24 04:08:46.943577 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:46.943552 2563 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6264ff75-d54b-4fac-bcc9-ec1dcdea398c" path="/var/lib/kubelet/pods/6264ff75-d54b-4fac-bcc9-ec1dcdea398c/volumes" Jul 24 04:08:59.057524 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:59.057490 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:08:59.158789 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:08:59.158756 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:09:06.484020 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:06.483979 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:09:06.574364 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:06.574324 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:09:07.224930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.224890 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:09:07.317209 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.317170 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-5fddb77949-pmmbs"] Jul 24 04:09:07.317601 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.317585 2563 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6264ff75-d54b-4fac-bcc9-ec1dcdea398c" containerName="manager" Jul 24 04:09:07.317659 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.317602 2563 state_mem.go:107] "Deleted CPUSet assignment" podUID="6264ff75-d54b-4fac-bcc9-ec1dcdea398c" containerName="manager" Jul 24 04:09:07.317719 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.317709 2563 memory_manager.go:368] "RemoveStaleState removing state" podUID="6264ff75-d54b-4fac-bcc9-ec1dcdea398c" containerName="manager" Jul 24 04:09:07.323995 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.323970 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5fddb77949-pmmbs" Jul 24 04:09:07.339705 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.339682 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 24 04:09:07.343539 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.343508 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-l6jtw\"" Jul 24 04:09:07.345889 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.345863 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5fddb77949-pmmbs"] Jul 24 04:09:07.446999 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.446961 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/249b2a73-7c13-43dc-8219-278dd0dad413-openshift-service-ca\") pod \"maas-api-5fddb77949-pmmbs\" (UID: \"249b2a73-7c13-43dc-8219-278dd0dad413\") " pod="odh-ai-gateway-infra/maas-api-5fddb77949-pmmbs" Jul 24 04:09:07.446999 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.447001 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzlft\" (UniqueName: \"kubernetes.io/projected/249b2a73-7c13-43dc-8219-278dd0dad413-kube-api-access-pzlft\") pod \"maas-api-5fddb77949-pmmbs\" (UID: \"249b2a73-7c13-43dc-8219-278dd0dad413\") " pod="odh-ai-gateway-infra/maas-api-5fddb77949-pmmbs" Jul 24 04:09:07.447238 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.447099 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/249b2a73-7c13-43dc-8219-278dd0dad413-maas-api-tls\") pod \"maas-api-5fddb77949-pmmbs\" (UID: \"249b2a73-7c13-43dc-8219-278dd0dad413\") " pod="odh-ai-gateway-infra/maas-api-5fddb77949-pmmbs" Jul 24 04:09:07.454459 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.454432 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:09:07.548285 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.548187 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/249b2a73-7c13-43dc-8219-278dd0dad413-openshift-service-ca\") pod \"maas-api-5fddb77949-pmmbs\" (UID: \"249b2a73-7c13-43dc-8219-278dd0dad413\") " pod="odh-ai-gateway-infra/maas-api-5fddb77949-pmmbs" Jul 24 04:09:07.548892 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.548861 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzlft\" (UniqueName: \"kubernetes.io/projected/249b2a73-7c13-43dc-8219-278dd0dad413-kube-api-access-pzlft\") pod \"maas-api-5fddb77949-pmmbs\" (UID: \"249b2a73-7c13-43dc-8219-278dd0dad413\") " pod="odh-ai-gateway-infra/maas-api-5fddb77949-pmmbs" Jul 24 04:09:07.549021 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.548993 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/249b2a73-7c13-43dc-8219-278dd0dad413-maas-api-tls\") pod \"maas-api-5fddb77949-pmmbs\" (UID: \"249b2a73-7c13-43dc-8219-278dd0dad413\") " pod="odh-ai-gateway-infra/maas-api-5fddb77949-pmmbs" Jul 24 04:09:07.549129 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.549095 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/249b2a73-7c13-43dc-8219-278dd0dad413-openshift-service-ca\") pod \"maas-api-5fddb77949-pmmbs\" (UID: \"249b2a73-7c13-43dc-8219-278dd0dad413\") " pod="odh-ai-gateway-infra/maas-api-5fddb77949-pmmbs" Jul 24 04:09:07.551900 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.551875 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/249b2a73-7c13-43dc-8219-278dd0dad413-maas-api-tls\") pod \"maas-api-5fddb77949-pmmbs\" (UID: \"249b2a73-7c13-43dc-8219-278dd0dad413\") " pod="odh-ai-gateway-infra/maas-api-5fddb77949-pmmbs" Jul 24 04:09:07.559980 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.559952 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzlft\" (UniqueName: \"kubernetes.io/projected/249b2a73-7c13-43dc-8219-278dd0dad413-kube-api-access-pzlft\") pod \"maas-api-5fddb77949-pmmbs\" (UID: \"249b2a73-7c13-43dc-8219-278dd0dad413\") " pod="odh-ai-gateway-infra/maas-api-5fddb77949-pmmbs" Jul 24 04:09:07.634085 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.634047 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-5fddb77949-pmmbs" Jul 24 04:09:07.746491 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.746446 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:09:07.786253 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.786215 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-5fddb77949-pmmbs"] Jul 24 04:09:07.788286 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:09:07.788247 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod249b2a73_7c13_43dc_8219_278dd0dad413.slice/crio-a4417275fbc7d6904b5261a3ff0f07f2b520b2f03eb2701bf397ec1b5be44f92 WatchSource:0}: Error finding container a4417275fbc7d6904b5261a3ff0f07f2b520b2f03eb2701bf397ec1b5be44f92: Status 404 returned error can't find the container with id a4417275fbc7d6904b5261a3ff0f07f2b520b2f03eb2701bf397ec1b5be44f92 Jul 24 04:09:07.841237 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.841148 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:09:07.852820 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.852792 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-zpjjc"] Jul 24 04:09:07.857830 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.857810 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zpjjc" Jul 24 04:09:07.860615 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.860593 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 24 04:09:07.860747 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.860666 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-sx6zz\"" Jul 24 04:09:07.867399 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.866917 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-zpjjc"] Jul 24 04:09:07.870732 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.870709 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-8jmsh"] Jul 24 04:09:07.874012 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.873995 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-8jmsh" Jul 24 04:09:07.889201 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.889173 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-8jmsh"] Jul 24 04:09:07.953167 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.953133 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wx4vn\" (UniqueName: \"kubernetes.io/projected/a9f53f86-6df2-4b9a-a6c2-1fc37fff930d-kube-api-access-wx4vn\") pod \"payload-processing-5cc6cd444b-8jmsh\" (UID: \"a9f53f86-6df2-4b9a-a6c2-1fc37fff930d\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8jmsh" Jul 24 04:09:07.953358 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.953182 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm58d\" (UniqueName: \"kubernetes.io/projected/1597a2b7-a29b-4f58-8750-2bb8e0667cb4-kube-api-access-dm58d\") pod \"payload-pre-processing-687dbb6cf6-zpjjc\" (UID: \"1597a2b7-a29b-4f58-8750-2bb8e0667cb4\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zpjjc" Jul 24 04:09:07.953358 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.953220 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1597a2b7-a29b-4f58-8750-2bb8e0667cb4-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-zpjjc\" (UID: \"1597a2b7-a29b-4f58-8750-2bb8e0667cb4\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zpjjc" Jul 24 04:09:07.953358 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:07.953252 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9f53f86-6df2-4b9a-a6c2-1fc37fff930d-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-8jmsh\" (UID: \"a9f53f86-6df2-4b9a-a6c2-1fc37fff930d\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8jmsh" Jul 24 04:09:08.054465 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:08.054423 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm58d\" (UniqueName: \"kubernetes.io/projected/1597a2b7-a29b-4f58-8750-2bb8e0667cb4-kube-api-access-dm58d\") pod \"payload-pre-processing-687dbb6cf6-zpjjc\" (UID: \"1597a2b7-a29b-4f58-8750-2bb8e0667cb4\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zpjjc" Jul 24 04:09:08.054465 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:08.054468 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1597a2b7-a29b-4f58-8750-2bb8e0667cb4-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-zpjjc\" (UID: \"1597a2b7-a29b-4f58-8750-2bb8e0667cb4\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zpjjc" Jul 24 04:09:08.054751 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:08.054524 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9f53f86-6df2-4b9a-a6c2-1fc37fff930d-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-8jmsh\" (UID: \"a9f53f86-6df2-4b9a-a6c2-1fc37fff930d\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8jmsh" Jul 24 04:09:08.054751 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:08.054585 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wx4vn\" (UniqueName: \"kubernetes.io/projected/a9f53f86-6df2-4b9a-a6c2-1fc37fff930d-kube-api-access-wx4vn\") pod \"payload-processing-5cc6cd444b-8jmsh\" (UID: \"a9f53f86-6df2-4b9a-a6c2-1fc37fff930d\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8jmsh" Jul 24 04:09:08.055299 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:08.055273 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/a9f53f86-6df2-4b9a-a6c2-1fc37fff930d-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-8jmsh\" (UID: \"a9f53f86-6df2-4b9a-a6c2-1fc37fff930d\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8jmsh" Jul 24 04:09:08.055299 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:08.055283 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1597a2b7-a29b-4f58-8750-2bb8e0667cb4-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-zpjjc\" (UID: \"1597a2b7-a29b-4f58-8750-2bb8e0667cb4\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zpjjc" Jul 24 04:09:08.062870 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:08.062836 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm58d\" (UniqueName: \"kubernetes.io/projected/1597a2b7-a29b-4f58-8750-2bb8e0667cb4-kube-api-access-dm58d\") pod \"payload-pre-processing-687dbb6cf6-zpjjc\" (UID: \"1597a2b7-a29b-4f58-8750-2bb8e0667cb4\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zpjjc" Jul 24 04:09:08.062997 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:08.062870 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wx4vn\" (UniqueName: \"kubernetes.io/projected/a9f53f86-6df2-4b9a-a6c2-1fc37fff930d-kube-api-access-wx4vn\") pod \"payload-processing-5cc6cd444b-8jmsh\" (UID: \"a9f53f86-6df2-4b9a-a6c2-1fc37fff930d\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8jmsh" Jul 24 04:09:08.171392 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:08.171291 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zpjjc" Jul 24 04:09:08.187155 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:08.187123 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-8jmsh" Jul 24 04:09:08.327894 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:08.327815 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-zpjjc"] Jul 24 04:09:08.330955 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:09:08.330921 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1597a2b7_a29b_4f58_8750_2bb8e0667cb4.slice/crio-716953c5e7e16b24779d6aa8d8dbbef7c0ab22dc03bf5e0b09f16e9f34c75fc9 WatchSource:0}: Error finding container 716953c5e7e16b24779d6aa8d8dbbef7c0ab22dc03bf5e0b09f16e9f34c75fc9: Status 404 returned error can't find the container with id 716953c5e7e16b24779d6aa8d8dbbef7c0ab22dc03bf5e0b09f16e9f34c75fc9 Jul 24 04:09:08.357646 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:08.357616 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-8jmsh"] Jul 24 04:09:08.358816 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:09:08.358780 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9f53f86_6df2_4b9a_a6c2_1fc37fff930d.slice/crio-312eeee15b1195bc0b5c52a685036dda0ca2e8877136384205625ecc3011071b WatchSource:0}: Error finding container 312eeee15b1195bc0b5c52a685036dda0ca2e8877136384205625ecc3011071b: Status 404 returned error can't find the container with id 312eeee15b1195bc0b5c52a685036dda0ca2e8877136384205625ecc3011071b Jul 24 04:09:08.768725 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:08.768676 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zpjjc" event={"ID":"1597a2b7-a29b-4f58-8750-2bb8e0667cb4","Type":"ContainerStarted","Data":"716953c5e7e16b24779d6aa8d8dbbef7c0ab22dc03bf5e0b09f16e9f34c75fc9"} Jul 24 04:09:08.770063 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:08.770030 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5fddb77949-pmmbs" event={"ID":"249b2a73-7c13-43dc-8219-278dd0dad413","Type":"ContainerStarted","Data":"a4417275fbc7d6904b5261a3ff0f07f2b520b2f03eb2701bf397ec1b5be44f92"} Jul 24 04:09:08.771347 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:08.771326 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-8jmsh" event={"ID":"a9f53f86-6df2-4b9a-a6c2-1fc37fff930d","Type":"ContainerStarted","Data":"312eeee15b1195bc0b5c52a685036dda0ca2e8877136384205625ecc3011071b"} Jul 24 04:09:09.785465 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:09.785423 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-5fddb77949-pmmbs" event={"ID":"249b2a73-7c13-43dc-8219-278dd0dad413","Type":"ContainerStarted","Data":"c78c683cc93ff00b540007857f5355f9f0f00f6f5e19b8e2147efc24f4e5532f"} Jul 24 04:09:09.785931 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:09.785648 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-5fddb77949-pmmbs" Jul 24 04:09:09.807164 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:09.807082 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-5fddb77949-pmmbs" podStartSLOduration=0.91736594 podStartE2EDuration="2.807059763s" totalImagesPullingTime="1.889693823s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:09:09.805572687 +0000 UTC m=+531.551946271" watchObservedRunningTime="2026-07-24 04:09:09.807059763 +0000 UTC m=+531.553433347" Jul 24 04:09:10.793142 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:10.793089 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-8jmsh" event={"ID":"a9f53f86-6df2-4b9a-a6c2-1fc37fff930d","Type":"ContainerStarted","Data":"4f5adc1aa17b008176813e357b7119bc16153ac54b2d0ce8c2a1b026b7678921"} Jul 24 04:09:10.793646 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:10.793312 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-8jmsh" Jul 24 04:09:10.794949 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:10.794918 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zpjjc" event={"ID":"1597a2b7-a29b-4f58-8750-2bb8e0667cb4","Type":"ContainerStarted","Data":"90b75b85b6d8f00f5a57a481fde0c2241cddc523ba4e8c380804044000e8edc9"} Jul 24 04:09:10.795159 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:10.795143 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zpjjc" Jul 24 04:09:10.809068 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:10.809011 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-8jmsh" podStartSLOduration=1.882221742 podStartE2EDuration="3.80899458s" totalImagesPullingTime="1.926772838s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:09:10.808076623 +0000 UTC m=+532.554450206" watchObservedRunningTime="2026-07-24 04:09:10.80899458 +0000 UTC m=+532.555368164" Jul 24 04:09:10.823757 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:10.823697 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zpjjc" podStartSLOduration=1.862116748 podStartE2EDuration="3.823677207s" totalImagesPullingTime="1.961560459s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:09:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:09:10.82221616 +0000 UTC m=+532.568589747" watchObservedRunningTime="2026-07-24 04:09:10.823677207 +0000 UTC m=+532.570050790" Jul 24 04:09:15.800909 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:15.800878 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-5fddb77949-pmmbs" Jul 24 04:09:17.485658 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:17.485599 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:09:17.585625 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:17.585596 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:09:21.803676 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:21.803641 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-zpjjc" Jul 24 04:09:21.804096 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:21.803711 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-8jmsh" Jul 24 04:09:30.622404 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:30.622361 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:09:44.627623 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:44.627585 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:09:44.679429 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:44.679395 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:09:45.085622 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.085580 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk"] Jul 24 04:09:45.094025 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.093995 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:45.097674 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.097651 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 24 04:09:45.097825 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.097651 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 24 04:09:45.097825 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.097651 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-wfpq8\"" Jul 24 04:09:45.097825 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.097651 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 24 04:09:45.098038 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.098019 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk"] Jul 24 04:09:45.107667 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.107638 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:09:45.205595 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.205556 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db2eef1b-7729-4d81-b97c-d67054f5f093-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9mbsk\" (UID: \"db2eef1b-7729-4d81-b97c-d67054f5f093\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:45.205800 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.205610 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db2eef1b-7729-4d81-b97c-d67054f5f093-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9mbsk\" (UID: \"db2eef1b-7729-4d81-b97c-d67054f5f093\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:45.205800 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.205643 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db2eef1b-7729-4d81-b97c-d67054f5f093-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9mbsk\" (UID: \"db2eef1b-7729-4d81-b97c-d67054f5f093\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:45.205800 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.205666 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db2eef1b-7729-4d81-b97c-d67054f5f093-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9mbsk\" (UID: \"db2eef1b-7729-4d81-b97c-d67054f5f093\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:45.205800 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.205689 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db2eef1b-7729-4d81-b97c-d67054f5f093-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9mbsk\" (UID: \"db2eef1b-7729-4d81-b97c-d67054f5f093\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:45.205800 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.205718 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7948g\" (UniqueName: \"kubernetes.io/projected/db2eef1b-7729-4d81-b97c-d67054f5f093-kube-api-access-7948g\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9mbsk\" (UID: \"db2eef1b-7729-4d81-b97c-d67054f5f093\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:45.306746 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.306706 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db2eef1b-7729-4d81-b97c-d67054f5f093-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9mbsk\" (UID: \"db2eef1b-7729-4d81-b97c-d67054f5f093\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:45.306922 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.306789 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db2eef1b-7729-4d81-b97c-d67054f5f093-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9mbsk\" (UID: \"db2eef1b-7729-4d81-b97c-d67054f5f093\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:45.306922 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.306835 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db2eef1b-7729-4d81-b97c-d67054f5f093-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9mbsk\" (UID: \"db2eef1b-7729-4d81-b97c-d67054f5f093\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:45.307008 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.306965 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db2eef1b-7729-4d81-b97c-d67054f5f093-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9mbsk\" (UID: \"db2eef1b-7729-4d81-b97c-d67054f5f093\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:45.307060 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.307030 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7948g\" (UniqueName: \"kubernetes.io/projected/db2eef1b-7729-4d81-b97c-d67054f5f093-kube-api-access-7948g\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9mbsk\" (UID: \"db2eef1b-7729-4d81-b97c-d67054f5f093\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:45.307178 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.307158 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db2eef1b-7729-4d81-b97c-d67054f5f093-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9mbsk\" (UID: \"db2eef1b-7729-4d81-b97c-d67054f5f093\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:45.307261 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.307212 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/db2eef1b-7729-4d81-b97c-d67054f5f093-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9mbsk\" (UID: \"db2eef1b-7729-4d81-b97c-d67054f5f093\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:45.307318 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.307286 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/db2eef1b-7729-4d81-b97c-d67054f5f093-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9mbsk\" (UID: \"db2eef1b-7729-4d81-b97c-d67054f5f093\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:45.307432 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.307411 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/db2eef1b-7729-4d81-b97c-d67054f5f093-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9mbsk\" (UID: \"db2eef1b-7729-4d81-b97c-d67054f5f093\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:45.309134 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.309113 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/db2eef1b-7729-4d81-b97c-d67054f5f093-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9mbsk\" (UID: \"db2eef1b-7729-4d81-b97c-d67054f5f093\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:45.309341 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.309323 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/db2eef1b-7729-4d81-b97c-d67054f5f093-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9mbsk\" (UID: \"db2eef1b-7729-4d81-b97c-d67054f5f093\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:45.315562 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.315541 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7948g\" (UniqueName: \"kubernetes.io/projected/db2eef1b-7729-4d81-b97c-d67054f5f093-kube-api-access-7948g\") pod \"e2e-distinct-simulated-kserve-59975d69f9-9mbsk\" (UID: \"db2eef1b-7729-4d81-b97c-d67054f5f093\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:45.406160 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.406076 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:45.547558 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.547531 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk"] Jul 24 04:09:45.549253 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:09:45.549223 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb2eef1b_7729_4d81_b97c_d67054f5f093.slice/crio-3d192354c0d04ff2ecbf3204087bbeea593225b5a071d3a6ecdbf506fc2fc991 WatchSource:0}: Error finding container 3d192354c0d04ff2ecbf3204087bbeea593225b5a071d3a6ecdbf506fc2fc991: Status 404 returned error can't find the container with id 3d192354c0d04ff2ecbf3204087bbeea593225b5a071d3a6ecdbf506fc2fc991 Jul 24 04:09:45.985849 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:45.985801 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" event={"ID":"db2eef1b-7729-4d81-b97c-d67054f5f093","Type":"ContainerStarted","Data":"3d192354c0d04ff2ecbf3204087bbeea593225b5a071d3a6ecdbf506fc2fc991"} Jul 24 04:09:46.992832 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:46.992792 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" event={"ID":"db2eef1b-7729-4d81-b97c-d67054f5f093","Type":"ContainerStarted","Data":"91e6c4a7f7292c64117343f6f6e7ef3b7265306b702282e197ffcd9acb65cd0c"} Jul 24 04:09:47.014632 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:47.014578 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" podStartSLOduration=1.006588152 podStartE2EDuration="2.014558859s" totalImagesPullingTime="1.007970707s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:09:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:09:47.013808957 +0000 UTC m=+568.760182542" watchObservedRunningTime="2026-07-24 04:09:47.014558859 +0000 UTC m=+568.760932441" Jul 24 04:09:55.406896 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:55.406855 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:55.407305 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:55.406916 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:55.419188 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:55.419163 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:09:56.051776 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:09:56.051747 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-9mbsk" Jul 24 04:10:09.706986 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:09.706944 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:10:12.053900 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.053857 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q"] Jul 24 04:10:12.057892 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.057871 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:12.060281 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.060259 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 24 04:10:12.067212 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.067186 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q"] Jul 24 04:10:12.147329 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.147294 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28z4t\" (UniqueName: \"kubernetes.io/projected/338a602c-fff2-4b20-9772-40d962e3d593-kube-api-access-28z4t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q\" (UID: \"338a602c-fff2-4b20-9772-40d962e3d593\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:12.147554 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.147335 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/338a602c-fff2-4b20-9772-40d962e3d593-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q\" (UID: \"338a602c-fff2-4b20-9772-40d962e3d593\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:12.147554 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.147363 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/338a602c-fff2-4b20-9772-40d962e3d593-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q\" (UID: \"338a602c-fff2-4b20-9772-40d962e3d593\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:12.147554 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.147515 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338a602c-fff2-4b20-9772-40d962e3d593-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q\" (UID: \"338a602c-fff2-4b20-9772-40d962e3d593\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:12.147725 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.147570 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/338a602c-fff2-4b20-9772-40d962e3d593-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q\" (UID: \"338a602c-fff2-4b20-9772-40d962e3d593\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:12.147725 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.147619 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/338a602c-fff2-4b20-9772-40d962e3d593-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q\" (UID: \"338a602c-fff2-4b20-9772-40d962e3d593\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:12.177693 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.177654 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:10:12.248737 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.248698 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/338a602c-fff2-4b20-9772-40d962e3d593-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q\" (UID: \"338a602c-fff2-4b20-9772-40d962e3d593\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:12.248930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.248749 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/338a602c-fff2-4b20-9772-40d962e3d593-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q\" (UID: \"338a602c-fff2-4b20-9772-40d962e3d593\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:12.248930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.248796 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28z4t\" (UniqueName: \"kubernetes.io/projected/338a602c-fff2-4b20-9772-40d962e3d593-kube-api-access-28z4t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q\" (UID: \"338a602c-fff2-4b20-9772-40d962e3d593\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:12.248930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.248819 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/338a602c-fff2-4b20-9772-40d962e3d593-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q\" (UID: \"338a602c-fff2-4b20-9772-40d962e3d593\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:12.249099 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.248961 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/338a602c-fff2-4b20-9772-40d962e3d593-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q\" (UID: \"338a602c-fff2-4b20-9772-40d962e3d593\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:12.249099 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.249076 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338a602c-fff2-4b20-9772-40d962e3d593-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q\" (UID: \"338a602c-fff2-4b20-9772-40d962e3d593\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:12.249377 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.249355 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/338a602c-fff2-4b20-9772-40d962e3d593-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q\" (UID: \"338a602c-fff2-4b20-9772-40d962e3d593\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:12.249448 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.249412 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/338a602c-fff2-4b20-9772-40d962e3d593-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q\" (UID: \"338a602c-fff2-4b20-9772-40d962e3d593\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:12.249522 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.249492 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/338a602c-fff2-4b20-9772-40d962e3d593-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q\" (UID: \"338a602c-fff2-4b20-9772-40d962e3d593\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:12.251125 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.251107 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/338a602c-fff2-4b20-9772-40d962e3d593-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q\" (UID: \"338a602c-fff2-4b20-9772-40d962e3d593\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:12.251440 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.251421 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/338a602c-fff2-4b20-9772-40d962e3d593-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q\" (UID: \"338a602c-fff2-4b20-9772-40d962e3d593\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:12.256690 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.256671 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28z4t\" (UniqueName: \"kubernetes.io/projected/338a602c-fff2-4b20-9772-40d962e3d593-kube-api-access-28z4t\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q\" (UID: \"338a602c-fff2-4b20-9772-40d962e3d593\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:12.369439 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.369335 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:12.513390 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:12.513360 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q"] Jul 24 04:10:12.514917 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:10:12.514882 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod338a602c_fff2_4b20_9772_40d962e3d593.slice/crio-5fbdaea808de32b0f5bf2adee40f4c172671341941769daa0c5d516dce6d6b29 WatchSource:0}: Error finding container 5fbdaea808de32b0f5bf2adee40f4c172671341941769daa0c5d516dce6d6b29: Status 404 returned error can't find the container with id 5fbdaea808de32b0f5bf2adee40f4c172671341941769daa0c5d516dce6d6b29 Jul 24 04:10:13.136930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:13.136835 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" event={"ID":"338a602c-fff2-4b20-9772-40d962e3d593","Type":"ContainerStarted","Data":"59ac8f748afd1a6199c40271b1b3c4cf0ab97eb3cc606906b23c222fc33dd661"} Jul 24 04:10:13.136930 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:13.136919 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" event={"ID":"338a602c-fff2-4b20-9772-40d962e3d593","Type":"ContainerStarted","Data":"5fbdaea808de32b0f5bf2adee40f4c172671341941769daa0c5d516dce6d6b29"} Jul 24 04:10:13.152512 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:13.152449 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" podStartSLOduration=0.934591884 podStartE2EDuration="1.152430765s" totalImagesPullingTime="217.838881ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:10:12 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:10:13.151507319 +0000 UTC m=+594.897880898" watchObservedRunningTime="2026-07-24 04:10:13.152430765 +0000 UTC m=+594.898804347" Jul 24 04:10:22.370189 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:22.370132 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:22.370189 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:22.370213 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:22.382867 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:22.382839 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:23.203810 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:23.203782 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q" Jul 24 04:10:36.174801 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.174507 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr"] Jul 24 04:10:36.179066 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.179032 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:36.181561 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.181534 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 24 04:10:36.190581 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.190555 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr"] Jul 24 04:10:36.215739 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.215700 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:10:36.278365 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.278318 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f76e876c-4520-460c-a0fe-620818738916-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rzvcr\" (UID: \"f76e876c-4520-460c-a0fe-620818738916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:36.278612 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.278390 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74mwn\" (UniqueName: \"kubernetes.io/projected/f76e876c-4520-460c-a0fe-620818738916-kube-api-access-74mwn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rzvcr\" (UID: \"f76e876c-4520-460c-a0fe-620818738916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:36.278612 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.278424 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f76e876c-4520-460c-a0fe-620818738916-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rzvcr\" (UID: \"f76e876c-4520-460c-a0fe-620818738916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:36.278612 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.278505 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f76e876c-4520-460c-a0fe-620818738916-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rzvcr\" (UID: \"f76e876c-4520-460c-a0fe-620818738916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:36.278612 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.278527 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f76e876c-4520-460c-a0fe-620818738916-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rzvcr\" (UID: \"f76e876c-4520-460c-a0fe-620818738916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:36.278612 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.278563 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f76e876c-4520-460c-a0fe-620818738916-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rzvcr\" (UID: \"f76e876c-4520-460c-a0fe-620818738916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:36.379624 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.379588 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f76e876c-4520-460c-a0fe-620818738916-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rzvcr\" (UID: \"f76e876c-4520-460c-a0fe-620818738916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:36.379813 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.379641 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74mwn\" (UniqueName: \"kubernetes.io/projected/f76e876c-4520-460c-a0fe-620818738916-kube-api-access-74mwn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rzvcr\" (UID: \"f76e876c-4520-460c-a0fe-620818738916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:36.379813 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.379660 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f76e876c-4520-460c-a0fe-620818738916-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rzvcr\" (UID: \"f76e876c-4520-460c-a0fe-620818738916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:36.379813 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.379689 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f76e876c-4520-460c-a0fe-620818738916-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rzvcr\" (UID: \"f76e876c-4520-460c-a0fe-620818738916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:36.379813 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.379706 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f76e876c-4520-460c-a0fe-620818738916-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rzvcr\" (UID: \"f76e876c-4520-460c-a0fe-620818738916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:36.379813 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.379743 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f76e876c-4520-460c-a0fe-620818738916-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rzvcr\" (UID: \"f76e876c-4520-460c-a0fe-620818738916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:36.380070 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.380052 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/f76e876c-4520-460c-a0fe-620818738916-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rzvcr\" (UID: \"f76e876c-4520-460c-a0fe-620818738916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:36.380128 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.380069 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/f76e876c-4520-460c-a0fe-620818738916-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rzvcr\" (UID: \"f76e876c-4520-460c-a0fe-620818738916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:36.380171 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.380140 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/f76e876c-4520-460c-a0fe-620818738916-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rzvcr\" (UID: \"f76e876c-4520-460c-a0fe-620818738916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:36.382050 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.382025 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/f76e876c-4520-460c-a0fe-620818738916-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rzvcr\" (UID: \"f76e876c-4520-460c-a0fe-620818738916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:36.382330 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.382309 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/f76e876c-4520-460c-a0fe-620818738916-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rzvcr\" (UID: \"f76e876c-4520-460c-a0fe-620818738916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:36.389559 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.389536 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74mwn\" (UniqueName: \"kubernetes.io/projected/f76e876c-4520-460c-a0fe-620818738916-kube-api-access-74mwn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-rzvcr\" (UID: \"f76e876c-4520-460c-a0fe-620818738916\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:36.490400 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.490363 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:36.637035 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:36.637001 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr"] Jul 24 04:10:36.638931 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:10:36.638893 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf76e876c_4520_460c_a0fe_620818738916.slice/crio-df29dbda50110a6c01518f44357ab81b9a6fa5eae3d45752635310a8ccf5f981 WatchSource:0}: Error finding container df29dbda50110a6c01518f44357ab81b9a6fa5eae3d45752635310a8ccf5f981: Status 404 returned error can't find the container with id df29dbda50110a6c01518f44357ab81b9a6fa5eae3d45752635310a8ccf5f981 Jul 24 04:10:37.279632 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:37.279591 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" event={"ID":"f76e876c-4520-460c-a0fe-620818738916","Type":"ContainerStarted","Data":"d5e0de1abaa7319580bbc91d0d268bf4dc9b3aead32e900430fa7d3c87ddf1b3"} Jul 24 04:10:37.280034 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:37.279646 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" event={"ID":"f76e876c-4520-460c-a0fe-620818738916","Type":"ContainerStarted","Data":"df29dbda50110a6c01518f44357ab81b9a6fa5eae3d45752635310a8ccf5f981"} Jul 24 04:10:37.297725 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:37.297670 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" podStartSLOduration=1.13063607 podStartE2EDuration="1.297651766s" totalImagesPullingTime="167.015696ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-24 04:10:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:10:37.296145847 +0000 UTC m=+619.042519424" watchObservedRunningTime="2026-07-24 04:10:37.297651766 +0000 UTC m=+619.044025348" Jul 24 04:10:39.081012 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:39.080970 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:10:46.490861 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:46.490761 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:46.490861 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:46.490841 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:46.503385 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:46.503358 2563 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:47.346621 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:47.346591 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-rzvcr" Jul 24 04:10:57.821822 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:57.821784 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:10:57.922795 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:10:57.922758 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:12:05.814900 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:05.814862 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:12:05.911950 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:05.911910 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:12:07.048517 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:07.048430 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:12:07.151670 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:07.151634 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:12:12.877694 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:12.877648 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:12:35.067906 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:35.067866 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:12:50.831597 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:50.831561 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6877c4dbdc-lv599_09b67885-72a9-421e-9c3b-4524e4c68e75/manager/0.log" Jul 24 04:12:50.945694 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:50.945664 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jg4jj_58f0720e-e218-488e-9f6f-753cfaddd960/server/0.log" Jul 24 04:12:51.196119 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:51.196093 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dfdd98ccb-5djmx_7b336efd-f6ea-4f51-8378-202c915201b7/copy-manifests/0.log" Jul 24 04:12:51.208610 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:51.208579 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dfdd98ccb-5djmx_7b336efd-f6ea-4f51-8378-202c915201b7/manager/0.log" Jul 24 04:12:51.814286 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:51.814255 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-5fddb77949-pmmbs_249b2a73-7c13-43dc-8219-278dd0dad413/maas-api/0.log" Jul 24 04:12:51.921666 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:51.921639 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-4chlm_8207985c-a322-4c85-a6ec-f81e839e3134/postgres/0.log" Jul 24 04:12:52.704389 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:52.704362 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79_1e1b5fdb-7bf8-47ee-944c-e22204b086b7/pull/0.log" Jul 24 04:12:52.709987 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:52.709963 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79_1e1b5fdb-7bf8-47ee-944c-e22204b086b7/extract/0.log" Jul 24 04:12:52.716038 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:52.716017 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79_1e1b5fdb-7bf8-47ee-944c-e22204b086b7/util/0.log" Jul 24 04:12:52.835776 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:52.835748 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6_e936a90e-f557-4668-bd7e-6e6a9de661d3/util/0.log" Jul 24 04:12:52.841268 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:52.841242 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6_e936a90e-f557-4668-bd7e-6e6a9de661d3/pull/0.log" Jul 24 04:12:52.846897 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:52.846877 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6_e936a90e-f557-4668-bd7e-6e6a9de661d3/extract/0.log" Jul 24 04:12:52.966765 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:52.966658 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25_dd97523c-af73-4919-8813-24f7c8cf4a53/pull/0.log" Jul 24 04:12:52.972741 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:52.972715 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25_dd97523c-af73-4919-8813-24f7c8cf4a53/extract/0.log" Jul 24 04:12:52.978288 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:52.978269 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25_dd97523c-af73-4919-8813-24f7c8cf4a53/util/0.log" Jul 24 04:12:53.098059 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:53.098031 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9_97980117-7e05-4782-ae28-fbc864eba45f/util/0.log" Jul 24 04:12:53.103912 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:53.103893 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9_97980117-7e05-4782-ae28-fbc864eba45f/pull/0.log" Jul 24 04:12:53.109087 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:53.109066 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9_97980117-7e05-4782-ae28-fbc864eba45f/extract/0.log" Jul 24 04:12:53.348849 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:53.348770 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-n9vnf_cb2b9d72-793f-4f64-8cf4-db2bac4f4fcb/manager/0.log" Jul 24 04:12:53.704413 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:53.704384 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wwp78_4acfd099-d763-4dc7-9b79-869fc47831cc/registry-server/0.log" Jul 24 04:12:53.824873 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:53.824839 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7hjc7_8687e3f9-1811-4c0a-a9fe-e652febe1ec6/manager/0.log" Jul 24 04:12:54.571554 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:54.571522 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2lbn7_407748c9-5392-43dc-b5d1-08a1c6e0945a/discovery/0.log" Jul 24 04:12:54.804527 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:54.804493 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-555685c6b7-msds4_659b4d8e-8b94-48ed-b294-42200d52c5ab/kube-auth-proxy/0.log" Jul 24 04:12:55.034240 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:55.034212 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zpjjc_1597a2b7-a29b-4f58-8750-2bb8e0667cb4/payload-pre-processing/0.log" Jul 24 04:12:55.150462 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:55.150434 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8jmsh_a9f53f86-6df2-4b9a-a6c2-1fc37fff930d/payload-processing/0.log" Jul 24 04:12:55.743425 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:55.743395 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-9mbsk_db2eef1b-7729-4d81-b97c-d67054f5f093/main/0.log" Jul 24 04:12:55.982739 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:55.982700 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68f8q57q_338a602c-fff2-4b20-9772-40d962e3d593/main/0.log" Jul 24 04:12:56.096014 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:12:56.095940 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-rzvcr_f76e876c-4520-460c-a0fe-620818738916/main/0.log" Jul 24 04:13:01.955708 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:01.955676 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:13:02.028831 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:02.028793 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:13:04.571106 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:04.571071 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-7v47c_e98f98aa-332c-44a4-912f-985762f6a84f/global-pull-secret-syncer/0.log" Jul 24 04:13:04.699151 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:04.699126 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" Jul 24 04:13:04.818520 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:04.818467 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-155.ec2.internal_68b5c35a661317b944b4a5969fbb303c/haproxy/0.log" Jul 24 04:13:07.511014 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:07.510976 2563 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-8d6fk_38538035-14dc-4f67-9a68-3b265171eedb/konnectivity-agent/0.log" limit=1024 Jul 24 04:13:08.920537 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:08.920503 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79_1e1b5fdb-7bf8-47ee-944c-e22204b086b7/extract/0.log" Jul 24 04:13:08.946837 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:08.946812 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79_1e1b5fdb-7bf8-47ee-944c-e22204b086b7/util/0.log" Jul 24 04:13:08.971855 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:08.971826 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759g8f79_1e1b5fdb-7bf8-47ee-944c-e22204b086b7/pull/0.log" Jul 24 04:13:09.007166 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:09.007135 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6_e936a90e-f557-4668-bd7e-6e6a9de661d3/extract/0.log" Jul 24 04:13:09.037058 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:09.037030 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6_e936a90e-f557-4668-bd7e-6e6a9de661d3/util/0.log" Jul 24 04:13:09.067415 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:09.067385 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0v46w6_e936a90e-f557-4668-bd7e-6e6a9de661d3/pull/0.log" Jul 24 04:13:09.102197 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:09.102165 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25_dd97523c-af73-4919-8813-24f7c8cf4a53/extract/0.log" Jul 24 04:13:09.129529 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:09.129501 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25_dd97523c-af73-4919-8813-24f7c8cf4a53/util/0.log" Jul 24 04:13:09.161607 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:09.161577 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qsn25_dd97523c-af73-4919-8813-24f7c8cf4a53/pull/0.log" Jul 24 04:13:09.189779 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:09.189706 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9_97980117-7e05-4782-ae28-fbc864eba45f/extract/0.log" Jul 24 04:13:09.216154 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:09.216125 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9_97980117-7e05-4782-ae28-fbc864eba45f/util/0.log" Jul 24 04:13:09.240096 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:09.240073 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1n49w9_97980117-7e05-4782-ae28-fbc864eba45f/pull/0.log" Jul 24 04:13:09.304868 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:09.304833 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-n9vnf_cb2b9d72-793f-4f64-8cf4-db2bac4f4fcb/manager/0.log" Jul 24 04:13:09.406179 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:09.406147 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-wwp78_4acfd099-d763-4dc7-9b79-869fc47831cc/registry-server/0.log" Jul 24 04:13:09.453399 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:09.453365 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-7hjc7_8687e3f9-1811-4c0a-a9fe-e652febe1ec6/manager/0.log" Jul 24 04:13:11.230061 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:11.230029 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_41c44cd8-7a6c-4333-902f-0f97d0446a22/alertmanager/0.log" Jul 24 04:13:11.257892 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:11.257864 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_41c44cd8-7a6c-4333-902f-0f97d0446a22/config-reloader/0.log" Jul 24 04:13:11.281155 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:11.281128 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_41c44cd8-7a6c-4333-902f-0f97d0446a22/kube-rbac-proxy-web/0.log" Jul 24 04:13:11.303433 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:11.303409 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_41c44cd8-7a6c-4333-902f-0f97d0446a22/kube-rbac-proxy/0.log" Jul 24 04:13:11.331742 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:11.331717 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_41c44cd8-7a6c-4333-902f-0f97d0446a22/kube-rbac-proxy-metric/0.log" Jul 24 04:13:11.358347 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:11.358321 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_41c44cd8-7a6c-4333-902f-0f97d0446a22/prom-label-proxy/0.log" Jul 24 04:13:11.383581 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:11.383554 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_41c44cd8-7a6c-4333-902f-0f97d0446a22/init-config-reloader/0.log" Jul 24 04:13:11.448858 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:11.448803 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-8wp2g_b21856df-0512-432d-8d47-c80f296da089/kube-state-metrics/0.log" Jul 24 04:13:11.483231 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:11.483119 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-8wp2g_b21856df-0512-432d-8d47-c80f296da089/kube-rbac-proxy-main/0.log" Jul 24 04:13:11.508094 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:11.508051 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-56d9f944b4-8wp2g_b21856df-0512-432d-8d47-c80f296da089/kube-rbac-proxy-self/0.log" Jul 24 04:13:11.561593 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:11.561567 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_metrics-server-6898dd96d7-67dkq_38a52b98-f0ba-4581-bff2-de37f4c61924/metrics-server/0.log" Jul 24 04:13:11.583619 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:11.583592 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-68b7fc9574-m6mb5_4375272d-87fe-4632-8ad8-4641ef1a7779/monitoring-plugin/0.log" Jul 24 04:13:11.623569 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:11.623544 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7cbxn_7d08624c-3e69-41df-90cb-13713c13ed7c/node-exporter/0.log" Jul 24 04:13:11.655387 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:11.655355 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7cbxn_7d08624c-3e69-41df-90cb-13713c13ed7c/kube-rbac-proxy/0.log" Jul 24 04:13:11.686339 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:11.686313 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-7cbxn_7d08624c-3e69-41df-90cb-13713c13ed7c/init-textfile/0.log" Jul 24 04:13:12.356519 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:12.356492 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-xknpk_b5603c6a-3a7a-4dd4-aa89-fd405d7757e8/prometheus-operator/0.log" Jul 24 04:13:12.382957 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:12.382918 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-84d69f794d-xknpk_b5603c6a-3a7a-4dd4-aa89-fd405d7757e8/kube-rbac-proxy/0.log" Jul 24 04:13:12.441030 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:12.440996 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-677c9d765b-8k949_10d40af9-154e-42d7-9b2b-0829f13bdbfb/telemeter-client/0.log" Jul 24 04:13:12.462794 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:12.462766 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-677c9d765b-8k949_10d40af9-154e-42d7-9b2b-0829f13bdbfb/reload/0.log" Jul 24 04:13:12.485212 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:12.485178 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-677c9d765b-8k949_10d40af9-154e-42d7-9b2b-0829f13bdbfb/kube-rbac-proxy/0.log" Jul 24 04:13:14.677832 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.677795 2563 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc"] Jul 24 04:13:14.681311 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.681291 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc" Jul 24 04:13:14.684148 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.684122 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-plmrp\"/\"kube-root-ca.crt\"" Jul 24 04:13:14.684148 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.684144 2563 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-plmrp\"/\"openshift-service-ca.crt\"" Jul 24 04:13:14.685393 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.685370 2563 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-plmrp\"/\"default-dockercfg-qlnt6\"" Jul 24 04:13:14.688579 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.688548 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc"] Jul 24 04:13:14.877987 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.877944 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5714c1c7-da66-4ab4-a3e3-faead710a9d5-podres\") pod \"perf-node-gather-daemonset-7pgkc\" (UID: \"5714c1c7-da66-4ab4-a3e3-faead710a9d5\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc" Jul 24 04:13:14.878165 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.878010 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5714c1c7-da66-4ab4-a3e3-faead710a9d5-sys\") pod \"perf-node-gather-daemonset-7pgkc\" (UID: \"5714c1c7-da66-4ab4-a3e3-faead710a9d5\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc" Jul 24 04:13:14.878165 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.878044 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5714c1c7-da66-4ab4-a3e3-faead710a9d5-lib-modules\") pod \"perf-node-gather-daemonset-7pgkc\" (UID: \"5714c1c7-da66-4ab4-a3e3-faead710a9d5\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc" Jul 24 04:13:14.878165 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.878085 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5714c1c7-da66-4ab4-a3e3-faead710a9d5-proc\") pod \"perf-node-gather-daemonset-7pgkc\" (UID: \"5714c1c7-da66-4ab4-a3e3-faead710a9d5\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc" Jul 24 04:13:14.878165 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.878138 2563 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-89zql\" (UniqueName: \"kubernetes.io/projected/5714c1c7-da66-4ab4-a3e3-faead710a9d5-kube-api-access-89zql\") pod \"perf-node-gather-daemonset-7pgkc\" (UID: \"5714c1c7-da66-4ab4-a3e3-faead710a9d5\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc" Jul 24 04:13:14.972591 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.972555 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-5c4f697c77-cschj_151a8fcc-0ca9-4b48-8805-ad4f5d1c923a/console/0.log" Jul 24 04:13:14.979410 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.979371 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5714c1c7-da66-4ab4-a3e3-faead710a9d5-proc\") pod \"perf-node-gather-daemonset-7pgkc\" (UID: \"5714c1c7-da66-4ab4-a3e3-faead710a9d5\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc" Jul 24 04:13:14.979620 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.979415 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-89zql\" (UniqueName: \"kubernetes.io/projected/5714c1c7-da66-4ab4-a3e3-faead710a9d5-kube-api-access-89zql\") pod \"perf-node-gather-daemonset-7pgkc\" (UID: \"5714c1c7-da66-4ab4-a3e3-faead710a9d5\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc" Jul 24 04:13:14.979620 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.979508 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/5714c1c7-da66-4ab4-a3e3-faead710a9d5-proc\") pod \"perf-node-gather-daemonset-7pgkc\" (UID: \"5714c1c7-da66-4ab4-a3e3-faead710a9d5\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc" Jul 24 04:13:14.979620 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.979551 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5714c1c7-da66-4ab4-a3e3-faead710a9d5-podres\") pod \"perf-node-gather-daemonset-7pgkc\" (UID: \"5714c1c7-da66-4ab4-a3e3-faead710a9d5\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc" Jul 24 04:13:14.979620 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.979601 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5714c1c7-da66-4ab4-a3e3-faead710a9d5-sys\") pod \"perf-node-gather-daemonset-7pgkc\" (UID: \"5714c1c7-da66-4ab4-a3e3-faead710a9d5\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc" Jul 24 04:13:14.979810 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.979640 2563 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5714c1c7-da66-4ab4-a3e3-faead710a9d5-lib-modules\") pod \"perf-node-gather-daemonset-7pgkc\" (UID: \"5714c1c7-da66-4ab4-a3e3-faead710a9d5\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc" Jul 24 04:13:14.979810 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.979656 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/5714c1c7-da66-4ab4-a3e3-faead710a9d5-sys\") pod \"perf-node-gather-daemonset-7pgkc\" (UID: \"5714c1c7-da66-4ab4-a3e3-faead710a9d5\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc" Jul 24 04:13:14.979810 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.979664 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/5714c1c7-da66-4ab4-a3e3-faead710a9d5-podres\") pod \"perf-node-gather-daemonset-7pgkc\" (UID: \"5714c1c7-da66-4ab4-a3e3-faead710a9d5\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc" Jul 24 04:13:14.979810 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.979790 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/5714c1c7-da66-4ab4-a3e3-faead710a9d5-lib-modules\") pod \"perf-node-gather-daemonset-7pgkc\" (UID: \"5714c1c7-da66-4ab4-a3e3-faead710a9d5\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc" Jul 24 04:13:14.986794 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.986758 2563 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-89zql\" (UniqueName: \"kubernetes.io/projected/5714c1c7-da66-4ab4-a3e3-faead710a9d5-kube-api-access-89zql\") pod \"perf-node-gather-daemonset-7pgkc\" (UID: \"5714c1c7-da66-4ab4-a3e3-faead710a9d5\") " pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc" Jul 24 04:13:14.992959 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:14.992933 2563 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc" Jul 24 04:13:15.000571 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:15.000545 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-7c97dc4555-4dnhg_6bf01f68-a821-4198-b02c-099d27d3669a/download-server/0.log" Jul 24 04:13:15.134907 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:15.134880 2563 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc"] Jul 24 04:13:15.136027 ip-10-0-138-155 kubenswrapper[2563]: W0724 04:13:15.136002 2563 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod5714c1c7_da66_4ab4_a3e3_faead710a9d5.slice/crio-2354afc1e0d01bcf8c711481ca369fb2f95b6f454fe754ec506719640284f6fa WatchSource:0}: Error finding container 2354afc1e0d01bcf8c711481ca369fb2f95b6f454fe754ec506719640284f6fa: Status 404 returned error can't find the container with id 2354afc1e0d01bcf8c711481ca369fb2f95b6f454fe754ec506719640284f6fa Jul 24 04:13:15.161300 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:15.161269 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc" event={"ID":"5714c1c7-da66-4ab4-a3e3-faead710a9d5","Type":"ContainerStarted","Data":"2354afc1e0d01bcf8c711481ca369fb2f95b6f454fe754ec506719640284f6fa"} Jul 24 04:13:16.169208 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:16.169174 2563 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc" event={"ID":"5714c1c7-da66-4ab4-a3e3-faead710a9d5","Type":"ContainerStarted","Data":"390d373c1f99684365ff31c24decb7c19982f099d3e20f660c3174de2f55d4d3"} Jul 24 04:13:16.169744 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:16.169240 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc" Jul 24 04:13:16.183253 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:16.183197 2563 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc" podStartSLOduration=2.183179641 podStartE2EDuration="2.183179641s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-24 04:13:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-24 04:13:16.182116774 +0000 UTC m=+777.928490359" watchObservedRunningTime="2026-07-24 04:13:16.183179641 +0000 UTC m=+777.929553224" Jul 24 04:13:16.725862 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:16.725830 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wq5n4_646ab979-b371-4653-9751-5f26ec108eca/dns/0.log" Jul 24 04:13:16.749306 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:16.749258 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-wq5n4_646ab979-b371-4653-9751-5f26ec108eca/kube-rbac-proxy/0.log" Jul 24 04:13:16.797991 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:16.797956 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-lbhzg_97f262a1-d4fd-4990-9e85-86dd2530dbb3/dns-node-resolver/0.log" Jul 24 04:13:17.488254 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:17.488227 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xh2m8_5696a323-4908-4da2-9496-8112032a1012/node-ca/0.log" Jul 24 04:13:18.594918 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:18.594885 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2lbn7_407748c9-5392-43dc-b5d1-08a1c6e0945a/discovery/0.log" Jul 24 04:13:18.647797 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:18.647770 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-555685c6b7-msds4_659b4d8e-8b94-48ed-b294-42200d52c5ab/kube-auth-proxy/0.log" Jul 24 04:13:18.701213 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:18.701187 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zpjjc_1597a2b7-a29b-4f58-8750-2bb8e0667cb4/payload-pre-processing/0.log" Jul 24 04:13:18.727183 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:18.727153 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8jmsh_a9f53f86-6df2-4b9a-a6c2-1fc37fff930d/payload-processing/0.log" Jul 24 04:13:19.428301 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:19.428270 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-lq554_1caca312-bb28-46db-ba00-89002a4d2f7f/serve-healthcheck-canary/0.log" Jul 24 04:13:20.002432 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:20.002404 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pkk9l_a3828b21-ec96-4f8d-b932-b4f06ced7add/kube-rbac-proxy/0.log" Jul 24 04:13:20.022787 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:20.022760 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pkk9l_a3828b21-ec96-4f8d-b932-b4f06ced7add/exporter/0.log" Jul 24 04:13:20.054410 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:20.054374 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-pkk9l_a3828b21-ec96-4f8d-b932-b4f06ced7add/extractor/0.log" Jul 24 04:13:22.184793 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:22.184764 2563 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-plmrp/perf-node-gather-daemonset-7pgkc" Jul 24 04:13:22.300068 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:22.300030 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-6877c4dbdc-lv599_09b67885-72a9-421e-9c3b-4524e4c68e75/manager/0.log" Jul 24 04:13:22.319315 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:22.319288 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-jg4jj_58f0720e-e218-488e-9f6f-753cfaddd960/server/0.log" Jul 24 04:13:22.407484 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:22.407437 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dfdd98ccb-5djmx_7b336efd-f6ea-4f51-8378-202c915201b7/manager/0.log" Jul 24 04:13:22.424909 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:22.424879 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6dfdd98ccb-5djmx_7b336efd-f6ea-4f51-8378-202c915201b7/copy-manifests/0.log" Jul 24 04:13:24.431103 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:24.431068 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2lbn7_407748c9-5392-43dc-b5d1-08a1c6e0945a/discovery/0.log" Jul 24 04:13:24.455694 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:24.455667 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-555685c6b7-msds4_659b4d8e-8b94-48ed-b294-42200d52c5ab/kube-auth-proxy/0.log" Jul 24 04:13:24.490838 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:24.490786 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zpjjc_1597a2b7-a29b-4f58-8750-2bb8e0667cb4/payload-pre-processing/0.log" Jul 24 04:13:24.504567 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:24.504517 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8jmsh_a9f53f86-6df2-4b9a-a6c2-1fc37fff930d/payload-processing/0.log" Jul 24 04:13:25.805752 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:25.805720 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-5677ccb49b-2lbn7_407748c9-5392-43dc-b5d1-08a1c6e0945a/discovery/0.log" Jul 24 04:13:25.834375 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:25.834324 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-555685c6b7-msds4_659b4d8e-8b94-48ed-b294-42200d52c5ab/kube-auth-proxy/0.log" Jul 24 04:13:25.869655 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:25.869619 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-zpjjc_1597a2b7-a29b-4f58-8750-2bb8e0667cb4/payload-pre-processing/0.log" Jul 24 04:13:25.886113 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:25.886088 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8jmsh_a9f53f86-6df2-4b9a-a6c2-1fc37fff930d/payload-processing/0.log" Jul 24 04:13:30.611338 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:30.611303 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ccdmw_5880389d-2038-4693-b674-5f81ec273823/kube-multus-additional-cni-plugins/0.log" Jul 24 04:13:30.633162 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:30.633136 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ccdmw_5880389d-2038-4693-b674-5f81ec273823/egress-router-binary-copy/0.log" Jul 24 04:13:30.654180 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:30.654153 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ccdmw_5880389d-2038-4693-b674-5f81ec273823/cni-plugins/0.log" Jul 24 04:13:30.676906 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:30.676878 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ccdmw_5880389d-2038-4693-b674-5f81ec273823/bond-cni-plugin/0.log" Jul 24 04:13:30.697583 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:30.697552 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ccdmw_5880389d-2038-4693-b674-5f81ec273823/routeoverride-cni/0.log" Jul 24 04:13:30.719174 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:30.719144 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ccdmw_5880389d-2038-4693-b674-5f81ec273823/whereabouts-cni-bincopy/0.log" Jul 24 04:13:30.744744 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:30.744710 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-ccdmw_5880389d-2038-4693-b674-5f81ec273823/whereabouts-cni/0.log" Jul 24 04:13:30.779567 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:30.779442 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-bxt4g_22f4cfa7-8834-4275-8d7f-a979f6912d7c/kube-multus/0.log" Jul 24 04:13:30.960079 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:30.960052 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l9w8m_c7fb9480-376d-487f-bfdf-386603ce759c/network-metrics-daemon/0.log" Jul 24 04:13:30.979560 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:30.979526 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-l9w8m_c7fb9480-376d-487f-bfdf-386603ce759c/kube-rbac-proxy/0.log" Jul 24 04:13:31.793058 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:31.793029 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gl4b9_cf4b914a-d9a8-4d59-a86a-1912f05699e3/ovn-controller/0.log" Jul 24 04:13:31.813799 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:31.813774 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gl4b9_cf4b914a-d9a8-4d59-a86a-1912f05699e3/ovn-acl-logging/0.log" Jul 24 04:13:31.846192 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:31.846155 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gl4b9_cf4b914a-d9a8-4d59-a86a-1912f05699e3/kube-rbac-proxy-node/0.log" Jul 24 04:13:31.880717 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:31.880686 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gl4b9_cf4b914a-d9a8-4d59-a86a-1912f05699e3/kube-rbac-proxy-ovn-metrics/0.log" Jul 24 04:13:31.907624 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:31.907595 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gl4b9_cf4b914a-d9a8-4d59-a86a-1912f05699e3/northd/0.log" Jul 24 04:13:31.933606 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:31.933573 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gl4b9_cf4b914a-d9a8-4d59-a86a-1912f05699e3/nbdb/0.log" Jul 24 04:13:31.958183 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:31.958154 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gl4b9_cf4b914a-d9a8-4d59-a86a-1912f05699e3/sbdb/0.log" Jul 24 04:13:32.007197 ip-10-0-138-155 kubenswrapper[2563]: I0724 04:13:32.007160 2563 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-gl4b9_cf4b914a-d9a8-4d59-a86a-1912f05699e3/ovnkube-controller/0.log"