Jul 15 17:53:12.930552 ip-10-0-128-25 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 15 17:53:12.930564 ip-10-0-128-25 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 15 17:53:12.930571 ip-10-0-128-25 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 15 17:53:12.930816 ip-10-0-128-25 systemd[1]: Failed to start Kubernetes Kubelet. Jul 15 17:53:22.987222 ip-10-0-128-25 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 15 17:53:22.987239 ip-10-0-128-25 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 1d95fa249b7944b49be43095268565f9 -- Jul 15 17:55:01.537946 ip-10-0-128-25 systemd[1]: Starting Kubernetes Kubelet... Jul 15 17:55:01.983360 ip-10-0-128-25 kubenswrapper[2551]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 17:55:01.983360 ip-10-0-128-25 kubenswrapper[2551]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 17:55:01.983360 ip-10-0-128-25 kubenswrapper[2551]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 17:55:01.983360 ip-10-0-128-25 kubenswrapper[2551]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 17:55:01.983360 ip-10-0-128-25 kubenswrapper[2551]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 17:55:01.984101 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.983415 2551 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 17:55:01.987187 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987172 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 17:55:01.987187 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987186 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 17:55:01.987247 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987191 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 17:55:01.987247 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987194 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 17:55:01.987247 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987197 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 17:55:01.987247 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987200 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 17:55:01.987247 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987203 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 17:55:01.987247 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987205 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 17:55:01.987247 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987208 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 17:55:01.987247 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987210 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 17:55:01.987247 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987214 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 17:55:01.987247 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987218 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 17:55:01.987247 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987221 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 17:55:01.987247 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987223 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 17:55:01.987247 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987226 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 17:55:01.987247 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987228 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 17:55:01.987247 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987231 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 17:55:01.987247 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987233 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 17:55:01.987247 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987236 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 17:55:01.987247 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987239 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 17:55:01.987247 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987241 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 17:55:01.987696 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987244 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 17:55:01.987696 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987246 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 17:55:01.987696 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987249 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 17:55:01.987696 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987251 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 17:55:01.987696 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987254 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 17:55:01.987696 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987257 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 17:55:01.987696 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987260 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 17:55:01.987696 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987262 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 17:55:01.987696 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987265 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 17:55:01.987696 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987267 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 17:55:01.987696 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987270 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 17:55:01.987696 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987272 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 17:55:01.987696 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987275 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 17:55:01.987696 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987277 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 17:55:01.987696 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987281 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 17:55:01.987696 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987284 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 17:55:01.987696 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987287 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 17:55:01.987696 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987289 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 17:55:01.987696 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987292 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 17:55:01.987696 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987295 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 17:55:01.988183 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987297 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 17:55:01.988183 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987300 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 17:55:01.988183 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987303 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 17:55:01.988183 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987306 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 17:55:01.988183 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987308 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 17:55:01.988183 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987311 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 17:55:01.988183 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987313 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 17:55:01.988183 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987316 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 17:55:01.988183 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987318 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 17:55:01.988183 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987320 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 17:55:01.988183 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987323 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 17:55:01.988183 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987325 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 17:55:01.988183 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987327 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 17:55:01.988183 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987330 2551 feature_gate.go:328] unrecognized feature gate: Example Jul 15 17:55:01.988183 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987333 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 17:55:01.988183 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987335 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 17:55:01.988183 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987338 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 17:55:01.988183 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987340 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 17:55:01.988183 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987342 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 17:55:01.988183 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987345 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 17:55:01.988680 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987347 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 17:55:01.988680 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987350 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 17:55:01.988680 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987352 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 17:55:01.988680 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987354 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 17:55:01.988680 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987357 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 17:55:01.988680 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987359 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 17:55:01.988680 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987361 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 17:55:01.988680 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987363 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 17:55:01.988680 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987366 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 17:55:01.988680 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987368 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 17:55:01.988680 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987371 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 17:55:01.988680 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987374 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 17:55:01.988680 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987377 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 17:55:01.988680 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987380 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 17:55:01.988680 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987383 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 17:55:01.988680 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987386 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 17:55:01.988680 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987389 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 17:55:01.988680 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987391 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 17:55:01.988680 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987394 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 17:55:01.989138 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987396 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 17:55:01.989138 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987399 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 17:55:01.989138 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987401 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 17:55:01.989138 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987403 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 17:55:01.989138 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987406 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 17:55:01.989138 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987408 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 17:55:01.989138 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987413 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 17:55:01.989138 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987416 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 17:55:01.989138 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987418 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 17:55:01.989138 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987420 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 17:55:01.989138 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987423 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 17:55:01.989138 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987425 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 17:55:01.989138 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987428 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 17:55:01.989138 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987430 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 17:55:01.989138 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987432 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 17:55:01.989138 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987435 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 17:55:01.989138 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987437 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 17:55:01.989138 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987439 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 17:55:01.989138 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.987441 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 17:55:01.989138 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988160 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 17:55:01.989616 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988167 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 17:55:01.989616 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988170 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 17:55:01.989616 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988172 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 17:55:01.989616 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988175 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 17:55:01.989616 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988178 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 17:55:01.989616 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988181 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 17:55:01.989616 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988185 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 17:55:01.989616 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988189 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 17:55:01.989616 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988192 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 17:55:01.989616 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988195 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 17:55:01.989616 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988198 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 17:55:01.989616 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988201 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 17:55:01.989616 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988203 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 17:55:01.989616 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988206 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 17:55:01.989616 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988208 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 17:55:01.989616 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988211 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 17:55:01.989616 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988214 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 17:55:01.989616 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988216 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 17:55:01.989616 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988220 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 17:55:01.990120 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988224 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 17:55:01.990120 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988228 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 17:55:01.990120 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988231 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 17:55:01.990120 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988234 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 17:55:01.990120 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988237 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 17:55:01.990120 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988240 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 17:55:01.990120 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988243 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 17:55:01.990120 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988245 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 17:55:01.990120 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988248 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 17:55:01.990120 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988250 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 17:55:01.990120 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988253 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 17:55:01.990120 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988255 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 17:55:01.990120 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988257 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 17:55:01.990120 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988260 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 17:55:01.990120 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988263 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 17:55:01.990120 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988265 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 17:55:01.990120 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988267 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 17:55:01.990120 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988270 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 17:55:01.990120 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988273 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 17:55:01.990120 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988275 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 17:55:01.990580 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988277 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 17:55:01.990580 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988280 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 17:55:01.990580 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988282 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 17:55:01.990580 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988285 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 17:55:01.990580 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988288 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 17:55:01.990580 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988290 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 17:55:01.990580 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988292 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 17:55:01.990580 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988295 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 17:55:01.990580 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988298 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 17:55:01.990580 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988301 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 17:55:01.990580 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988303 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 17:55:01.990580 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988306 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 17:55:01.990580 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988309 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 17:55:01.990580 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988311 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 17:55:01.990580 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988314 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 17:55:01.990580 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988316 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 17:55:01.990580 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988318 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 17:55:01.990580 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988321 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 17:55:01.990580 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988323 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 17:55:01.990580 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988326 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 17:55:01.991053 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988328 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 17:55:01.991053 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988331 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 17:55:01.991053 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988333 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 17:55:01.991053 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988335 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 17:55:01.991053 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988338 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 17:55:01.991053 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988340 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 17:55:01.991053 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988342 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 17:55:01.991053 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988345 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 17:55:01.991053 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988347 2551 feature_gate.go:328] unrecognized feature gate: Example Jul 15 17:55:01.991053 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988350 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 17:55:01.991053 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988353 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 17:55:01.991053 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988355 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 17:55:01.991053 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988358 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 17:55:01.991053 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988360 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 17:55:01.991053 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988364 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 17:55:01.991053 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988367 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 17:55:01.991053 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988369 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 17:55:01.991053 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988372 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 17:55:01.991053 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988374 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 17:55:01.991053 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988376 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 17:55:01.991521 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988379 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 17:55:01.991521 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988381 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 17:55:01.991521 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988383 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 17:55:01.991521 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988386 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 17:55:01.991521 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988389 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 17:55:01.991521 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988393 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 17:55:01.991521 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988396 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 17:55:01.991521 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988399 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 17:55:01.991521 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988402 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 17:55:01.991521 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988405 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 17:55:01.991521 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988407 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 17:55:01.991521 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988410 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 17:55:01.991521 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988412 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 17:55:01.991521 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988415 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 17:55:01.991521 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988418 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 17:55:01.991521 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988420 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 17:55:01.991521 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988423 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 17:55:01.991521 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988426 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 17:55:01.991521 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988428 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 17:55:01.991984 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988845 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 17:55:01.991984 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988851 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 17:55:01.991984 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988854 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 17:55:01.991984 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988857 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 17:55:01.991984 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988861 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 17:55:01.991984 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988864 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 17:55:01.991984 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988866 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 17:55:01.991984 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988869 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 17:55:01.991984 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988872 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 17:55:01.991984 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988874 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 17:55:01.991984 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988877 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 17:55:01.991984 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988879 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 17:55:01.991984 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988882 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 17:55:01.991984 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988884 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 17:55:01.991984 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988887 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 17:55:01.991984 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988889 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 17:55:01.991984 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988892 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 17:55:01.991984 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988895 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 17:55:01.991984 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988897 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 17:55:01.991984 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988900 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 17:55:01.992497 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988902 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 17:55:01.992497 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988905 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 17:55:01.992497 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988908 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 17:55:01.992497 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988910 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 17:55:01.992497 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988912 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 17:55:01.992497 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988915 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 17:55:01.992497 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988917 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 17:55:01.992497 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988920 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 17:55:01.992497 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988923 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 17:55:01.992497 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988927 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 17:55:01.992497 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988929 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 17:55:01.992497 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988932 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 17:55:01.992497 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988936 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 17:55:01.992497 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988939 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 17:55:01.992497 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988942 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 17:55:01.992497 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988945 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 17:55:01.992497 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988947 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 17:55:01.992497 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988950 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 17:55:01.992497 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988953 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 17:55:01.992963 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988956 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 17:55:01.992963 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988958 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 17:55:01.992963 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988961 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 17:55:01.992963 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988963 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 17:55:01.992963 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988965 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 17:55:01.992963 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988968 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 17:55:01.992963 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988970 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 17:55:01.992963 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988972 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 17:55:01.992963 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988975 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 17:55:01.992963 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988982 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 17:55:01.992963 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988984 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 17:55:01.992963 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988987 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 17:55:01.992963 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988989 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 17:55:01.992963 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988992 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 17:55:01.992963 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988995 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 17:55:01.992963 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.988997 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 17:55:01.992963 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989000 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 17:55:01.992963 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989002 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 17:55:01.992963 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989005 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 17:55:01.992963 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989007 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 17:55:01.993445 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989009 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 17:55:01.993445 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989013 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 17:55:01.993445 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989016 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 17:55:01.993445 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989020 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 17:55:01.993445 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989023 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 17:55:01.993445 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989026 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 17:55:01.993445 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989029 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 17:55:01.993445 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989032 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 17:55:01.993445 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989035 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 17:55:01.993445 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989037 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 17:55:01.993445 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989040 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 17:55:01.993445 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989043 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 17:55:01.993445 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989046 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 17:55:01.993445 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989048 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 17:55:01.993445 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989051 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 17:55:01.993445 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989053 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 17:55:01.993445 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989056 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 17:55:01.993445 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989058 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 17:55:01.993445 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989061 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 17:55:01.993445 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989063 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 17:55:01.993918 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989066 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 17:55:01.993918 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989069 2551 feature_gate.go:328] unrecognized feature gate: Example Jul 15 17:55:01.993918 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989072 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 17:55:01.993918 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989074 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 17:55:01.993918 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989076 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 17:55:01.993918 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989079 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 17:55:01.993918 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989081 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 17:55:01.993918 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989084 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 17:55:01.993918 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989086 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 17:55:01.993918 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989089 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 17:55:01.993918 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989091 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 17:55:01.993918 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989094 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 17:55:01.993918 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989096 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 17:55:01.993918 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989099 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 17:55:01.993918 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989101 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 17:55:01.993918 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989103 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 17:55:01.993918 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989106 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 17:55:01.993918 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989108 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 17:55:01.993918 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989111 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 17:55:01.993918 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989113 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 17:55:01.993918 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989176 2551 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989183 2551 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989189 2551 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989193 2551 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989198 2551 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989202 2551 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989206 2551 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989209 2551 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989212 2551 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989215 2551 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989219 2551 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989222 2551 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989238 2551 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989242 2551 flags.go:64] FLAG: --cgroup-root="" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989245 2551 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989248 2551 flags.go:64] FLAG: --client-ca-file="" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989251 2551 flags.go:64] FLAG: --cloud-provider="external" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989253 2551 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989258 2551 flags.go:64] FLAG: --cluster-domain="" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989260 2551 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989263 2551 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989266 2551 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989269 2551 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989273 2551 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 17:55:01.994396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989275 2551 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989278 2551 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989281 2551 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989283 2551 flags.go:64] FLAG: --contention-profiling="false" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989286 2551 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989289 2551 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989292 2551 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989294 2551 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989298 2551 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989300 2551 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989303 2551 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989306 2551 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989309 2551 flags.go:64] FLAG: --enable-server="true" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989312 2551 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989316 2551 flags.go:64] FLAG: --event-burst="100" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989319 2551 flags.go:64] FLAG: --event-qps="50" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989322 2551 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989324 2551 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989327 2551 flags.go:64] FLAG: --eviction-hard="" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989330 2551 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989333 2551 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989337 2551 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989340 2551 flags.go:64] FLAG: --eviction-soft="" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989343 2551 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989346 2551 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 17:55:01.995000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989348 2551 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989351 2551 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989353 2551 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989356 2551 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989359 2551 flags.go:64] FLAG: --feature-gates="" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989362 2551 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989365 2551 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989367 2551 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989370 2551 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989373 2551 flags.go:64] FLAG: --healthz-port="10248" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989376 2551 flags.go:64] FLAG: --help="false" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989379 2551 flags.go:64] FLAG: --hostname-override="ip-10-0-128-25.ec2.internal" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989381 2551 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989384 2551 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989387 2551 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989390 2551 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989393 2551 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989395 2551 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989398 2551 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989401 2551 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989404 2551 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989407 2551 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989410 2551 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989413 2551 flags.go:64] FLAG: --kube-reserved="" Jul 15 17:55:01.995576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989416 2551 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989418 2551 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989421 2551 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989423 2551 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989427 2551 flags.go:64] FLAG: --lock-file="" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989430 2551 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989433 2551 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989435 2551 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989441 2551 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989443 2551 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989446 2551 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989448 2551 flags.go:64] FLAG: --logging-format="text" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989451 2551 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989454 2551 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989456 2551 flags.go:64] FLAG: --manifest-url="" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989459 2551 flags.go:64] FLAG: --manifest-url-header="" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989463 2551 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989466 2551 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989469 2551 flags.go:64] FLAG: --max-pods="110" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989472 2551 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989474 2551 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989477 2551 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989480 2551 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989482 2551 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989485 2551 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 17:55:01.996223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989488 2551 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989494 2551 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989497 2551 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989500 2551 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989503 2551 flags.go:64] FLAG: --pod-cidr="" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989506 2551 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989511 2551 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989514 2551 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989517 2551 flags.go:64] FLAG: --pods-per-core="0" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989519 2551 flags.go:64] FLAG: --port="10250" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989522 2551 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989524 2551 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-0c063d6bfa881fd0c" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989529 2551 flags.go:64] FLAG: --qos-reserved="" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989532 2551 flags.go:64] FLAG: --read-only-port="10255" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989535 2551 flags.go:64] FLAG: --register-node="true" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989537 2551 flags.go:64] FLAG: --register-with-taints="" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989540 2551 flags.go:64] FLAG: --registry-burst="10" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989543 2551 flags.go:64] FLAG: --registry-qps="5" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989546 2551 flags.go:64] FLAG: --reserved-cpus="" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989548 2551 flags.go:64] FLAG: --reserved-memory="" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989551 2551 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989554 2551 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989558 2551 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989563 2551 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989567 2551 flags.go:64] FLAG: --runonce="false" Jul 15 17:55:01.996839 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989571 2551 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989575 2551 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989578 2551 flags.go:64] FLAG: --seccomp-default="false" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989581 2551 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989583 2551 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989586 2551 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989589 2551 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989592 2551 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989594 2551 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989597 2551 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989600 2551 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989602 2551 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989605 2551 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989609 2551 flags.go:64] FLAG: --system-cgroups="" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989611 2551 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989616 2551 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989619 2551 flags.go:64] FLAG: --tls-cert-file="" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989622 2551 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989626 2551 flags.go:64] FLAG: --tls-min-version="" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989630 2551 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989633 2551 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989635 2551 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989638 2551 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989641 2551 flags.go:64] FLAG: --v="2" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989645 2551 flags.go:64] FLAG: --version="false" Jul 15 17:55:01.997440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989648 2551 flags.go:64] FLAG: --vmodule="" Jul 15 17:55:01.998028 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989651 2551 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 17:55:01.998028 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.989654 2551 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 17:55:01.998028 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989775 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 17:55:01.998028 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989779 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 17:55:01.998028 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989782 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 17:55:01.998028 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989785 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 17:55:01.998028 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989788 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 17:55:01.998028 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989792 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 17:55:01.998028 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989795 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 17:55:01.998028 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989797 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 17:55:01.998028 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989800 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 17:55:01.998028 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989802 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 17:55:01.998028 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989804 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 17:55:01.998028 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989807 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 17:55:01.998028 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989810 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 17:55:01.998028 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989812 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 17:55:01.998028 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989814 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 17:55:01.998028 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989817 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 17:55:01.998028 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989819 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 17:55:01.998028 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989822 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 17:55:01.998525 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989825 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 17:55:01.998525 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989827 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 17:55:01.998525 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989830 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 17:55:01.998525 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989832 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 17:55:01.998525 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989834 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 17:55:01.998525 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989838 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 17:55:01.998525 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989841 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 17:55:01.998525 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989843 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 17:55:01.998525 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989845 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 17:55:01.998525 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989848 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 17:55:01.998525 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989851 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 17:55:01.998525 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989853 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 17:55:01.998525 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989856 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 17:55:01.998525 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989858 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 17:55:01.998525 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989860 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 17:55:01.998525 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989863 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 17:55:01.998525 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989865 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 17:55:01.998525 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989867 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 17:55:01.998525 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989870 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 17:55:01.998525 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989873 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 17:55:01.999017 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989876 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 17:55:01.999017 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989878 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 17:55:01.999017 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989880 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 17:55:01.999017 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989882 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 17:55:01.999017 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989885 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 17:55:01.999017 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989887 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 17:55:01.999017 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989890 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 17:55:01.999017 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989893 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 17:55:01.999017 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989897 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 17:55:01.999017 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989900 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 17:55:01.999017 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989902 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 17:55:01.999017 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989905 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 17:55:01.999017 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989908 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 17:55:01.999017 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989911 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 17:55:01.999017 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989913 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 17:55:01.999017 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989916 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 17:55:01.999017 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989920 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 17:55:01.999017 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989924 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 17:55:01.999017 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989926 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 17:55:01.999470 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989929 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 17:55:01.999470 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989932 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 17:55:01.999470 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989934 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 17:55:01.999470 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989936 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 17:55:01.999470 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989939 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 17:55:01.999470 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989941 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 17:55:01.999470 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989944 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 17:55:01.999470 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989946 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 17:55:01.999470 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989949 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 17:55:01.999470 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989951 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 17:55:01.999470 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989953 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 17:55:01.999470 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989956 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 17:55:01.999470 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989963 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 17:55:01.999470 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989965 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 17:55:01.999470 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989968 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 17:55:01.999470 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989970 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 17:55:01.999470 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989973 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 17:55:01.999470 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989977 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 17:55:01.999470 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989979 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 17:55:01.999939 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989982 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 17:55:01.999939 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989984 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 17:55:01.999939 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989986 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 17:55:01.999939 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989989 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 17:55:01.999939 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989991 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 17:55:01.999939 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989993 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 17:55:01.999939 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989996 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 17:55:01.999939 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.989998 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 17:55:01.999939 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.990001 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 17:55:01.999939 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.990003 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 17:55:01.999939 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.990006 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 17:55:01.999939 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.990009 2551 feature_gate.go:328] unrecognized feature gate: Example Jul 15 17:55:01.999939 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.990012 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 17:55:01.999939 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.990014 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 17:55:01.999939 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.990017 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 17:55:01.999939 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.990019 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 17:55:01.999939 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.990021 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 17:55:01.999939 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.990024 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 17:55:01.999939 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.990026 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 17:55:01.999939 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.990028 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 17:55:02.000439 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.990031 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 17:55:02.000439 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.990033 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 17:55:02.000439 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.990036 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 17:55:02.000439 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.990041 2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 17:55:02.000439 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.997161 2551 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 17:55:02.000439 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.997175 2551 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 17:55:02.000439 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.997193 2551 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 17:55:02.000439 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.997203 2551 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 17:55:02.000439 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997276 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 17:55:02.000439 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997282 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 17:55:02.000439 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997286 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 17:55:02.000439 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997290 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 17:55:02.000439 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997293 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 17:55:02.000439 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997296 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 17:55:02.000817 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997299 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 17:55:02.000817 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997301 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 17:55:02.000817 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997304 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 17:55:02.000817 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997306 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 17:55:02.000817 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997309 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 17:55:02.000817 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997311 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 17:55:02.000817 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997314 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 17:55:02.000817 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997316 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 17:55:02.000817 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997318 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 17:55:02.000817 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997321 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 17:55:02.000817 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997323 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 17:55:02.000817 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997326 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 17:55:02.000817 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997329 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 17:55:02.000817 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997334 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 17:55:02.000817 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997338 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 17:55:02.000817 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997342 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 17:55:02.000817 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997347 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 17:55:02.000817 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997351 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 17:55:02.000817 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997354 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 17:55:02.000817 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997356 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 17:55:02.001293 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997359 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 17:55:02.001293 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997361 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 17:55:02.001293 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997363 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 17:55:02.001293 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997367 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 17:55:02.001293 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997371 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 17:55:02.001293 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997373 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 17:55:02.001293 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997376 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 17:55:02.001293 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997378 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 17:55:02.001293 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997381 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 17:55:02.001293 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997383 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 17:55:02.001293 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997386 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 17:55:02.001293 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997389 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 17:55:02.001293 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997391 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 17:55:02.001293 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997393 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 17:55:02.001293 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997396 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 17:55:02.001293 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997398 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 17:55:02.001293 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997400 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 17:55:02.001293 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997403 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 17:55:02.001293 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997406 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 17:55:02.001293 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997408 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 17:55:02.001821 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997410 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 17:55:02.001821 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997413 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 17:55:02.001821 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997418 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 17:55:02.001821 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997422 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 17:55:02.001821 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997426 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 17:55:02.001821 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997431 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 17:55:02.001821 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997433 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 17:55:02.001821 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997435 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 17:55:02.001821 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997437 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 17:55:02.001821 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997440 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 17:55:02.001821 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997442 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 17:55:02.001821 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997445 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 17:55:02.001821 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997447 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 17:55:02.001821 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997450 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 17:55:02.001821 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997452 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 17:55:02.001821 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997456 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 17:55:02.001821 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997459 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 17:55:02.001821 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997462 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 17:55:02.001821 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997464 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 17:55:02.002281 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997466 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 17:55:02.002281 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997469 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 17:55:02.002281 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997471 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 17:55:02.002281 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997473 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 17:55:02.002281 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997476 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 17:55:02.002281 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997478 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 17:55:02.002281 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997480 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 17:55:02.002281 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997483 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 17:55:02.002281 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997485 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 17:55:02.002281 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997487 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 17:55:02.002281 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997490 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 17:55:02.002281 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997492 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 17:55:02.002281 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997496 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 17:55:02.002281 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997500 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 17:55:02.002281 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997504 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 17:55:02.002281 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997508 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 17:55:02.002281 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997511 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 17:55:02.002281 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997513 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 17:55:02.002281 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997516 2551 feature_gate.go:328] unrecognized feature gate: Example Jul 15 17:55:02.002281 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997518 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 17:55:02.002831 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997521 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 17:55:02.002831 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997523 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 17:55:02.002831 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997525 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 17:55:02.002831 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997528 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 17:55:02.002831 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997530 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 17:55:02.002831 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997532 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 17:55:02.002831 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997535 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 17:55:02.002831 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997537 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 17:55:02.002831 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997540 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 17:55:02.002831 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997543 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 17:55:02.002831 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997546 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 17:55:02.002831 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997548 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 17:55:02.002831 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997552 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 17:55:02.002831 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997555 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 17:55:02.003194 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.997561 2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 17:55:02.003194 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997694 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 17:55:02.003194 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997701 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 17:55:02.003194 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997704 2551 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 17:55:02.003194 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997707 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 17:55:02.003194 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997709 2551 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 17:55:02.003194 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997712 2551 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 17:55:02.003194 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997715 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 17:55:02.003194 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997718 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 17:55:02.003194 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997720 2551 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 17:55:02.003194 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997723 2551 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 17:55:02.003194 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997726 2551 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 17:55:02.003194 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997729 2551 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 17:55:02.003194 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997733 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 17:55:02.003194 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997739 2551 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 17:55:02.003548 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997745 2551 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 17:55:02.003548 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997749 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 17:55:02.003548 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997751 2551 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 17:55:02.003548 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997754 2551 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 17:55:02.003548 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997756 2551 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 17:55:02.003548 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997759 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 17:55:02.003548 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997761 2551 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 17:55:02.003548 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997764 2551 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 17:55:02.003548 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997766 2551 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 17:55:02.003548 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997768 2551 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 17:55:02.003548 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997771 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 17:55:02.003548 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997773 2551 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 17:55:02.003548 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997776 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 17:55:02.003548 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997779 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 17:55:02.003548 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997782 2551 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 17:55:02.003548 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997784 2551 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 17:55:02.003548 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997786 2551 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 17:55:02.003548 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997790 2551 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 17:55:02.003548 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997792 2551 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 17:55:02.004049 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997795 2551 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 17:55:02.004049 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997797 2551 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 17:55:02.004049 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997800 2551 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 17:55:02.004049 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997803 2551 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 17:55:02.004049 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997806 2551 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 17:55:02.004049 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997809 2551 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 17:55:02.004049 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997813 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 17:55:02.004049 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997817 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 17:55:02.004049 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997821 2551 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 17:55:02.004049 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997825 2551 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 17:55:02.004049 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997829 2551 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 17:55:02.004049 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997831 2551 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 17:55:02.004049 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997834 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 17:55:02.004049 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997836 2551 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 17:55:02.004049 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997839 2551 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 17:55:02.004049 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997841 2551 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 17:55:02.004049 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997843 2551 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 17:55:02.004049 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997846 2551 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 17:55:02.004049 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997848 2551 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 17:55:02.004049 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997850 2551 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 17:55:02.004554 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997853 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 17:55:02.004554 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997855 2551 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 17:55:02.004554 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997857 2551 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 17:55:02.004554 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997860 2551 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 17:55:02.004554 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997862 2551 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 17:55:02.004554 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997865 2551 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 17:55:02.004554 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997868 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 17:55:02.004554 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997870 2551 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 17:55:02.004554 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997873 2551 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 17:55:02.004554 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997876 2551 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 17:55:02.004554 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997878 2551 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 17:55:02.004554 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997880 2551 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 17:55:02.004554 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997883 2551 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 17:55:02.004554 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997885 2551 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 17:55:02.004554 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997888 2551 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 17:55:02.004554 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997891 2551 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 17:55:02.004554 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997895 2551 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 17:55:02.004554 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997899 2551 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 17:55:02.004554 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997903 2551 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 17:55:02.004554 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997907 2551 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 17:55:02.005151 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997909 2551 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 17:55:02.005151 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997911 2551 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 17:55:02.005151 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997914 2551 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 17:55:02.005151 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997916 2551 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 17:55:02.005151 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997918 2551 feature_gate.go:328] unrecognized feature gate: Example Jul 15 17:55:02.005151 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997920 2551 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 17:55:02.005151 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997923 2551 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 17:55:02.005151 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997925 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 17:55:02.005151 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997927 2551 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 17:55:02.005151 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997929 2551 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 17:55:02.005151 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997932 2551 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 17:55:02.005151 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997934 2551 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 17:55:02.005151 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997936 2551 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 17:55:02.005151 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997939 2551 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 17:55:02.005151 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997941 2551 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 17:55:02.005151 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997943 2551 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 17:55:02.005151 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997946 2551 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 17:55:02.005151 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997948 2551 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 17:55:02.005151 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997950 2551 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 17:55:02.005151 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997953 2551 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 17:55:02.005618 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997955 2551 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 17:55:02.005618 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997958 2551 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 17:55:02.005618 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997960 2551 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 17:55:02.005618 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997962 2551 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 17:55:02.005618 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997965 2551 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 17:55:02.005618 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:01.997967 2551 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 17:55:02.005618 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.997973 2551 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 17:55:02.005618 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:01.998080 2551 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 17:55:02.005618 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.001402 2551 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 17:55:02.005618 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.002942 2551 server.go:1019] "Starting client certificate rotation" Jul 15 17:55:02.005618 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.003041 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 17:55:02.005618 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.003071 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 17:55:02.006917 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.006902 2551 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 17:55:02.012291 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.012269 2551 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 17:55:02.017678 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.017646 2551 log.go:25] "Validated CRI v1 runtime API" Jul 15 17:55:02.020577 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.020561 2551 log.go:25] "Validated CRI v1 image API" Jul 15 17:55:02.021392 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.021377 2551 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 17:55:02.025408 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.025386 2551 fs.go:135] Filesystem UUIDs: map[79bac942-023b-4a71-877e-605694b5b9a3:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 c8ee72a2-3310-4bbb-9349-0fd6cd98e689:/dev/nvme0n1p4] Jul 15 17:55:02.025481 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.025406 2551 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 17:55:02.030560 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.030451 2551 manager.go:216] Machine: {Timestamp:2026-07-15 17:55:02.02908223 +0000 UTC m=+0.364390522 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3189880 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec250d21e0351357238b0c0ac012cdd2 SystemUUID:ec250d21-e035-1357-238b-0c0ac012cdd2 BootID:1d95fa24-9b79-44b4-9be4-3095268565f9 Filesystems:[{Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:4b:8e:be:13:b7 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:4b:8e:be:13:b7 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:9e:7c:4c:12:fe:08 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 17:55:02.030560 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.030552 2551 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 17:55:02.030744 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.030712 2551 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 17:55:02.034003 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.033974 2551 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 17:55:02.034137 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.034006 2551 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-128-25.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 17:55:02.035026 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.035013 2551 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 17:55:02.035026 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.035027 2551 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 17:55:02.035110 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.035035 2551 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 17:55:02.035883 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.035873 2551 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 17:55:02.036981 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.036971 2551 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 17:55:02.037777 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.037762 2551 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 17:55:02.041238 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.041213 2551 state_mem.go:36] "Initialized new in-memory state store" Jul 15 17:55:02.041336 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.041327 2551 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 17:55:02.041372 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.041355 2551 kubelet.go:486] "Attempting to sync node with API server" Jul 15 17:55:02.041372 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.041366 2551 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 17:55:02.041432 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.041380 2551 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 17:55:02.041432 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.041391 2551 kubelet.go:398] "Adding apiserver pod source" Jul 15 17:55:02.041432 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.041398 2551 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 17:55:02.041726 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.041715 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 17:55:02.041771 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.041732 2551 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 17:55:02.044173 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.044157 2551 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 17:55:02.045751 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.045733 2551 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 17:55:02.045793 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.045769 2551 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 17:55:02.046615 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.046605 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 17:55:02.046650 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.046620 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 17:55:02.046650 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.046626 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 17:55:02.046650 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.046632 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 17:55:02.046732 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.046651 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 17:55:02.046732 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.046661 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 17:55:02.046732 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.046681 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 17:55:02.046732 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.046686 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 17:55:02.046732 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.046693 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 17:55:02.046732 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.046698 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 17:55:02.046732 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.046710 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 17:55:02.046732 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.046716 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 17:55:02.047690 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.047658 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 17:55:02.047690 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.047688 2551 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 17:55:02.053643 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.053627 2551 server.go:1268] "Started kubelet" Jul 15 17:55:02.053761 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.053727 2551 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 17:55:02.053761 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.053722 2551 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 17:55:02.054216 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.054179 2551 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-128-25.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 17:55:02.054216 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.054196 2551 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 17:55:02.054497 ip-10-0-128-25 systemd[1]: Started Kubernetes Kubelet. Jul 15 17:55:02.054993 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.054960 2551 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 17:55:02.055083 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.055016 2551 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-128-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 17:55:02.055785 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.055769 2551 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 17:55:02.055880 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.055867 2551 server.go:310] "Adding debug handlers to kubelet server" Jul 15 17:55:02.060179 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.060153 2551 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 17:55:02.061329 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.060275 2551 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-25.ec2.internal.18c28826ab250248 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-25.ec2.internal,UID:ip-10-0-128-25.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-128-25.ec2.internal,},FirstTimestamp:2026-07-15 17:55:02.053601864 +0000 UTC m=+0.388910156,LastTimestamp:2026-07-15 17:55:02.053601864 +0000 UTC m=+0.388910156,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-25.ec2.internal,}" Jul 15 17:55:02.061555 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.061541 2551 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 17:55:02.061607 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.061561 2551 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 17:55:02.061654 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.061611 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-25.ec2.internal\" not found" Jul 15 17:55:02.062386 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.062363 2551 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 17:55:02.062386 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.062370 2551 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 17:55:02.062386 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.062388 2551 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 17:55:02.062515 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.062463 2551 reconstruct.go:97] "Volume reconstruction finished" Jul 15 17:55:02.062515 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.062470 2551 reconciler.go:29] "Reconciler: start to sync state" Jul 15 17:55:02.063293 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.063274 2551 factory.go:55] Registering systemd factory Jul 15 17:55:02.063354 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.063295 2551 factory.go:223] Registration of the systemd container factory successfully Jul 15 17:55:02.063524 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.063509 2551 factory.go:153] Registering CRI-O factory Jul 15 17:55:02.063524 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.063524 2551 factory.go:223] Registration of the crio container factory successfully Jul 15 17:55:02.063647 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.063571 2551 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 17:55:02.063647 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.063589 2551 factory.go:103] Registering Raw factory Jul 15 17:55:02.063647 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.063599 2551 manager.go:1196] Started watching for new ooms in manager Jul 15 17:55:02.064005 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.063992 2551 manager.go:349] Starting recovery of all containers Jul 15 17:55:02.066046 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.066012 2551 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 17:55:02.066046 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.066023 2551 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-128-25.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 17:55:02.073863 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.073850 2551 manager.go:354] Recovery completed Jul 15 17:55:02.079068 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.079056 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 17:55:02.080659 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.080634 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasSufficientMemory" Jul 15 17:55:02.080732 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.080687 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 17:55:02.080732 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.080698 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasSufficientPID" Jul 15 17:55:02.081170 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.081149 2551 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 17:55:02.081170 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.081162 2551 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 17:55:02.081267 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.081176 2551 state_mem.go:36] "Initialized new in-memory state store" Jul 15 17:55:02.081267 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.081213 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 17:55:02.081946 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.081931 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasSufficientMemory" Jul 15 17:55:02.082018 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.081957 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 17:55:02.082018 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.081973 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasSufficientPID" Jul 15 17:55:02.083194 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.083125 2551 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-25.ec2.internal.18c28826acc222c3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-25.ec2.internal,UID:ip-10-0-128-25.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-25.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-25.ec2.internal,},FirstTimestamp:2026-07-15 17:55:02.080676547 +0000 UTC m=+0.415984841,LastTimestamp:2026-07-15 17:55:02.080676547 +0000 UTC m=+0.415984841,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-25.ec2.internal,}" Jul 15 17:55:02.083318 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.083304 2551 policy_none.go:49] "None policy: Start" Jul 15 17:55:02.083381 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.083324 2551 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 17:55:02.083381 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.083338 2551 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 17:55:02.085351 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.085338 2551 policy_none.go:47] "Start" Jul 15 17:55:02.091496 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.091440 2551 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-25.ec2.internal.18c28826acc264f8 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-25.ec2.internal,UID:ip-10-0-128-25.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-128-25.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-128-25.ec2.internal,},FirstTimestamp:2026-07-15 17:55:02.080693496 +0000 UTC m=+0.416001789,LastTimestamp:2026-07-15 17:55:02.080693496 +0000 UTC m=+0.416001789,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-25.ec2.internal,}" Jul 15 17:55:02.100653 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.100577 2551 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-25.ec2.internal.18c28826acc28735 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-25.ec2.internal,UID:ip-10-0-128-25.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-128-25.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-128-25.ec2.internal,},FirstTimestamp:2026-07-15 17:55:02.080702261 +0000 UTC m=+0.416010553,LastTimestamp:2026-07-15 17:55:02.080702261 +0000 UTC m=+0.416010553,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-25.ec2.internal,}" Jul 15 17:55:02.103086 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.102980 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jcj4g" Jul 15 17:55:02.108736 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.108720 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-jcj4g" Jul 15 17:55:02.113079 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.113019 2551 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-128-25.ec2.internal.18c28826acc222c3\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-128-25.ec2.internal.18c28826acc222c3 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-128-25.ec2.internal,UID:ip-10-0-128-25.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-128-25.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-128-25.ec2.internal,},FirstTimestamp:2026-07-15 17:55:02.080676547 +0000 UTC m=+0.415984841,LastTimestamp:2026-07-15 17:55:02.081943155 +0000 UTC m=+0.417251449,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-128-25.ec2.internal,}" Jul 15 17:55:02.141523 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.120263 2551 manager.go:337] "Starting Device Plugin manager" Jul 15 17:55:02.141523 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.120295 2551 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 17:55:02.141523 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.120304 2551 server.go:87] "Starting device plugin registration server" Jul 15 17:55:02.141523 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.120526 2551 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 17:55:02.141523 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.120538 2551 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 17:55:02.141523 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.120639 2551 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 17:55:02.141523 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.120736 2551 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 17:55:02.141523 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.120744 2551 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 17:55:02.141523 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.121163 2551 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 17:55:02.141523 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.121200 2551 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-128-25.ec2.internal\" not found" Jul 15 17:55:02.203537 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.203505 2551 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 17:55:02.204802 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.204786 2551 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 17:55:02.204885 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.204821 2551 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 17:55:02.204885 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.204837 2551 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 17:55:02.204885 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.204866 2551 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 17:55:02.207595 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.207580 2551 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 17:55:02.221068 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.221049 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 17:55:02.221762 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.221743 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasSufficientMemory" Jul 15 17:55:02.221832 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.221767 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 17:55:02.221832 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.221777 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasSufficientPID" Jul 15 17:55:02.221832 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.221797 2551 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-128-25.ec2.internal" Jul 15 17:55:02.234027 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.233984 2551 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-128-25.ec2.internal" Jul 15 17:55:02.234027 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.234004 2551 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-128-25.ec2.internal\": node \"ip-10-0-128-25.ec2.internal\" not found" Jul 15 17:55:02.280308 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.280293 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-25.ec2.internal\" not found" Jul 15 17:55:02.305048 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.305027 2551 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-25.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-128-25.ec2.internal"] Jul 15 17:55:02.305122 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.305104 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 17:55:02.306964 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.306939 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasSufficientMemory" Jul 15 17:55:02.307049 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.306979 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 17:55:02.307049 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.306989 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasSufficientPID" Jul 15 17:55:02.309197 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.309185 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 17:55:02.309333 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.309312 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-25.ec2.internal" Jul 15 17:55:02.309384 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.309340 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 17:55:02.309819 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.309806 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasSufficientMemory" Jul 15 17:55:02.309889 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.309831 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 17:55:02.309889 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.309841 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasSufficientPID" Jul 15 17:55:02.309889 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.309862 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasSufficientMemory" Jul 15 17:55:02.309889 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.309879 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 17:55:02.309889 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.309889 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasSufficientPID" Jul 15 17:55:02.311909 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.311894 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-25.ec2.internal" Jul 15 17:55:02.311968 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.311926 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 17:55:02.312558 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.312536 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasSufficientMemory" Jul 15 17:55:02.312604 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.312562 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 17:55:02.312604 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.312577 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasSufficientPID" Jul 15 17:55:02.338219 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.338202 2551 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-25.ec2.internal\" not found" node="ip-10-0-128-25.ec2.internal" Jul 15 17:55:02.341356 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.341340 2551 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-128-25.ec2.internal\" not found" node="ip-10-0-128-25.ec2.internal" Jul 15 17:55:02.365048 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.365029 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9eaccd26994c83fcdad8d06f7f02281b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-25.ec2.internal\" (UID: \"9eaccd26994c83fcdad8d06f7f02281b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-25.ec2.internal" Jul 15 17:55:02.365166 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.365050 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9eaccd26994c83fcdad8d06f7f02281b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-25.ec2.internal\" (UID: \"9eaccd26994c83fcdad8d06f7f02281b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-25.ec2.internal" Jul 15 17:55:02.365166 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.365066 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/713382c42dd951a131036f50252694db-config\") pod \"kube-apiserver-proxy-ip-10-0-128-25.ec2.internal\" (UID: \"713382c42dd951a131036f50252694db\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-25.ec2.internal" Jul 15 17:55:02.380897 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.380876 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-25.ec2.internal\" not found" Jul 15 17:55:02.465781 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.465747 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9eaccd26994c83fcdad8d06f7f02281b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-25.ec2.internal\" (UID: \"9eaccd26994c83fcdad8d06f7f02281b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-25.ec2.internal" Jul 15 17:55:02.465883 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.465790 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9eaccd26994c83fcdad8d06f7f02281b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-25.ec2.internal\" (UID: \"9eaccd26994c83fcdad8d06f7f02281b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-25.ec2.internal" Jul 15 17:55:02.465883 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.465813 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/713382c42dd951a131036f50252694db-config\") pod \"kube-apiserver-proxy-ip-10-0-128-25.ec2.internal\" (UID: \"713382c42dd951a131036f50252694db\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-25.ec2.internal" Jul 15 17:55:02.465883 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.465861 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/713382c42dd951a131036f50252694db-config\") pod \"kube-apiserver-proxy-ip-10-0-128-25.ec2.internal\" (UID: \"713382c42dd951a131036f50252694db\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-128-25.ec2.internal" Jul 15 17:55:02.465989 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.465860 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/9eaccd26994c83fcdad8d06f7f02281b-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-128-25.ec2.internal\" (UID: \"9eaccd26994c83fcdad8d06f7f02281b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-25.ec2.internal" Jul 15 17:55:02.465989 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.465860 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/9eaccd26994c83fcdad8d06f7f02281b-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-128-25.ec2.internal\" (UID: \"9eaccd26994c83fcdad8d06f7f02281b\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-25.ec2.internal" Jul 15 17:55:02.481881 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.481860 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-25.ec2.internal\" not found" Jul 15 17:55:02.582660 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.582606 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-25.ec2.internal\" not found" Jul 15 17:55:02.640798 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.640780 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-25.ec2.internal" Jul 15 17:55:02.643898 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.643885 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-25.ec2.internal" Jul 15 17:55:02.682830 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.682806 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-25.ec2.internal\" not found" Jul 15 17:55:02.783380 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.783343 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-25.ec2.internal\" not found" Jul 15 17:55:02.883919 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.883845 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-25.ec2.internal\" not found" Jul 15 17:55:02.930889 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.930872 2551 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 17:55:02.978941 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:02.978920 2551 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 17:55:02.984580 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:02.984543 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-25.ec2.internal\" not found" Jul 15 17:55:03.002735 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:03.002715 2551 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 17:55:03.002835 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:03.002818 2551 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 17:55:03.002889 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:03.002866 2551 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 17:55:03.002932 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:03.002866 2551 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 17:55:03.084799 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:03.084772 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-25.ec2.internal\" not found" Jul 15 17:55:03.117458 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:03.117425 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 17:50:02 +0000 UTC" deadline="2028-04-09 01:30:41.678742764 +0000 UTC" Jul 15 17:55:03.117458 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:03.117456 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15199h35m38.561290525s" Jul 15 17:55:03.185067 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:03.185018 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-25.ec2.internal\" not found" Jul 15 17:55:03.214318 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:03.214288 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod713382c42dd951a131036f50252694db.slice/crio-e2b3e206079840719a8f48b3e670585b3488f3bce3915b995cc93d6909431e19 WatchSource:0}: Error finding container e2b3e206079840719a8f48b3e670585b3488f3bce3915b995cc93d6909431e19: Status 404 returned error can't find the container with id e2b3e206079840719a8f48b3e670585b3488f3bce3915b995cc93d6909431e19 Jul 15 17:55:03.215249 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:03.215228 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eaccd26994c83fcdad8d06f7f02281b.slice/crio-6d5d9dc5027ec8d6b5c5f875e1f1a070d4eb956dc2737a5fe768677bb3d7f97d WatchSource:0}: Error finding container 6d5d9dc5027ec8d6b5c5f875e1f1a070d4eb956dc2737a5fe768677bb3d7f97d: Status 404 returned error can't find the container with id 6d5d9dc5027ec8d6b5c5f875e1f1a070d4eb956dc2737a5fe768677bb3d7f97d Jul 15 17:55:03.219832 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:03.219814 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 17:55:03.285717 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:03.285676 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-25.ec2.internal\" not found" Jul 15 17:55:03.290830 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:03.290817 2551 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 17:55:03.291786 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:03.291769 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasSufficientMemory" Jul 15 17:55:03.291854 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:03.291800 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 17:55:03.291854 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:03.291820 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeHasSufficientPID" Jul 15 17:55:03.386397 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:03.386367 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-25.ec2.internal\" not found" Jul 15 17:55:03.486871 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:03.486815 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-25.ec2.internal\" not found" Jul 15 17:55:03.587619 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:03.587574 2551 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-128-25.ec2.internal\" not found" Jul 15 17:55:03.635187 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:03.635163 2551 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 17:55:03.662697 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:03.662677 2551 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-25.ec2.internal" Jul 15 17:55:03.676089 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:03.676067 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 17:55:03.677267 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:03.677255 2551 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-25.ec2.internal" Jul 15 17:55:03.686127 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:03.686111 2551 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 17:55:04.042699 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.042653 2551 apiserver.go:52] "Watching apiserver" Jul 15 17:55:04.051580 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.051549 2551 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 17:55:04.052764 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.052736 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/multus-vnm66","openshift-network-operator/iptables-alerter-lvsxh","openshift-ovn-kubernetes/ovnkube-node-pwzkz","kube-system/kube-apiserver-proxy-ip-10-0-128-25.ec2.internal","openshift-cluster-node-tuning-operator/tuned-pfj4m","openshift-dns/node-resolver-zskmc","openshift-image-registry/node-ca-xhh8c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-25.ec2.internal","openshift-multus/network-metrics-daemon-fvtvh","openshift-network-diagnostics/network-check-target-rd5vp","kube-system/global-pull-secret-syncer-6jz77","kube-system/konnectivity-agent-h74qh","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962","openshift-multus/multus-additional-cni-plugins-7z26z"] Jul 15 17:55:04.055175 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.055157 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:04.055285 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:04.055262 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rd5vp" podUID="cd44a874-643c-4efc-b8b4-b92449f574e5" Jul 15 17:55:04.057499 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.057466 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.059005 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.058987 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 17:55:04.059292 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.059268 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 17:55:04.059408 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.059390 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-lb6kd\"" Jul 15 17:55:04.059467 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.059444 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 17:55:04.059796 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.059777 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.061740 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.061722 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 17:55:04.062186 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.061830 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 17:55:04.062186 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.062035 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-lkxv6\"" Jul 15 17:55:04.062186 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.062066 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.062186 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.062167 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 17:55:04.062358 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.062251 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 17:55:04.062358 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.062295 2551 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 17:55:04.062421 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.062367 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 17:55:04.062472 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.062452 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 17:55:04.063618 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.063600 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 17:55:04.063847 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.063833 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 17:55:04.063990 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.063974 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 17:55:04.064074 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.064018 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bhd5q\"" Jul 15 17:55:04.064265 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.064245 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.064349 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.064335 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 17:55:04.064413 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.064338 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 17:55:04.066235 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.066217 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 17:55:04.066451 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.066436 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-j528k\"" Jul 15 17:55:04.066576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.066555 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 17:55:04.066698 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.066685 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zskmc" Jul 15 17:55:04.068478 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.068307 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 17:55:04.068478 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.068364 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-ptc2w\"" Jul 15 17:55:04.068478 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.068451 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 17:55:04.069149 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.069123 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:04.069248 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:04.069208 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvtvh" podUID="002a3085-9fdc-414b-bbf4-4be0580cf88f" Jul 15 17:55:04.071185 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.071166 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xhh8c" Jul 15 17:55:04.072995 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.072980 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 17:55:04.073087 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.072998 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 17:55:04.073087 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.073020 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-4nrvg\"" Jul 15 17:55:04.073565 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.073308 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 17:55:04.073565 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.073334 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lvsxh" Jul 15 17:55:04.073565 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.073334 2551 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 17:55:04.075396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.075336 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 17:55:04.076062 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.075592 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/24b3fd3f-7151-4359-9635-9837155eabff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rb962\" (UID: \"24b3fd3f-7151-4359-9635-9837155eabff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.076062 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.075625 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/24b3fd3f-7151-4359-9635-9837155eabff-registration-dir\") pod \"aws-ebs-csi-driver-node-rb962\" (UID: \"24b3fd3f-7151-4359-9635-9837155eabff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.076062 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.075658 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-host-slash\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.076062 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.075687 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-22npv\"" Jul 15 17:55:04.076062 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.075702 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-log-socket\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.076062 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.075726 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 17:55:04.076062 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.075735 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 17:55:04.076062 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.075728 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-host-run-ovn-kubernetes\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.076062 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.075796 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-ovnkube-config\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.076062 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.075832 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a40a06d0-9182-44da-8229-fec808a929a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.076062 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.075847 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7b54p\" (UniqueName: \"kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p\") pod \"network-check-target-rd5vp\" (UID: \"cd44a874-643c-4efc-b8b4-b92449f574e5\") " pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:04.076062 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.075862 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-var-lib-openvswitch\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.076062 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.075881 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-ovnkube-script-lib\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.076062 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.075896 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hkxrt\" (UniqueName: \"kubernetes.io/projected/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-kube-api-access-hkxrt\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.076062 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.075923 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a40a06d0-9182-44da-8229-fec808a929a1-system-cni-dir\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.076062 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.075961 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a40a06d0-9182-44da-8229-fec808a929a1-cnibin\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.076062 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.075980 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gv7tj\" (UniqueName: \"kubernetes.io/projected/a40a06d0-9182-44da-8229-fec808a929a1-kube-api-access-gv7tj\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.076777 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.075995 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-etc-modprobe-d\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.076777 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076008 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-systemd-units\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.076777 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076027 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-host-run-netns\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.076777 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076039 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-env-overrides\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.076777 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076051 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-etc-sysconfig\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.076777 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076073 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-etc-kubernetes\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.076777 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076147 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-etc-systemd\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.076777 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076191 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-lib-modules\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.076777 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076229 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-host\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.076777 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076243 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/24b3fd3f-7151-4359-9635-9837155eabff-etc-selinux\") pod \"aws-ebs-csi-driver-node-rb962\" (UID: \"24b3fd3f-7151-4359-9635-9837155eabff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.076777 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076258 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-run-ovn\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.076777 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076286 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.076777 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076308 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a40a06d0-9182-44da-8229-fec808a929a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.076777 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076322 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a40a06d0-9182-44da-8229-fec808a929a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.076777 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076335 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-etc-sysctl-d\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.076777 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076348 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-sys\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.077503 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076372 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4bb74316-2275-47ed-bd0b-6a64d3777082-etc-tuned\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.077503 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076397 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-var-lib-kubelet\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.077503 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076425 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/24b3fd3f-7151-4359-9635-9837155eabff-sys-fs\") pod \"aws-ebs-csi-driver-node-rb962\" (UID: \"24b3fd3f-7151-4359-9635-9837155eabff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.077503 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076443 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.077503 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076455 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-etc-openvswitch\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.077503 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076480 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-node-log\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.077503 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076530 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-host-cni-bin\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.077503 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076556 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a40a06d0-9182-44da-8229-fec808a929a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.077503 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076585 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bb74316-2275-47ed-bd0b-6a64d3777082-tmp\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.077503 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076617 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/24b3fd3f-7151-4359-9635-9837155eabff-socket-dir\") pod \"aws-ebs-csi-driver-node-rb962\" (UID: \"24b3fd3f-7151-4359-9635-9837155eabff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.077503 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076642 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-run-systemd\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.077503 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076697 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-run-openvswitch\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.077503 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076726 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-host-cni-netd\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.077503 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076753 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-ovn-node-metrics-cert\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.077503 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076778 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a40a06d0-9182-44da-8229-fec808a929a1-os-release\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.077503 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076808 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-etc-sysctl-conf\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.077503 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076830 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9tc4h\" (UniqueName: \"kubernetes.io/projected/4bb74316-2275-47ed-bd0b-6a64d3777082-kube-api-access-9tc4h\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.078194 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076857 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/24b3fd3f-7151-4359-9635-9837155eabff-device-dir\") pod \"aws-ebs-csi-driver-node-rb962\" (UID: \"24b3fd3f-7151-4359-9635-9837155eabff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.078194 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076886 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mtvqw\" (UniqueName: \"kubernetes.io/projected/24b3fd3f-7151-4359-9635-9837155eabff-kube-api-access-mtvqw\") pod \"aws-ebs-csi-driver-node-rb962\" (UID: \"24b3fd3f-7151-4359-9635-9837155eabff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.078194 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076909 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-host-kubelet\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.078194 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.076986 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-run\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.078194 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.077724 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 17:55:04.078194 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.078194 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:04.078408 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.078237 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-gxc2q\"" Jul 15 17:55:04.081534 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:04.078758 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6jz77" podUID="12a379a8-7075-4528-a2c5-9d2750f9e71c" Jul 15 17:55:04.082299 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.082260 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h74qh" Jul 15 17:55:04.085029 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.084387 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-sgthf\"" Jul 15 17:55:04.085029 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.084533 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 17:55:04.085029 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.084691 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 17:55:04.098746 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.098726 2551 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-7s26c" Jul 15 17:55:04.106439 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.106402 2551 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-7s26c" Jul 15 17:55:04.163866 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.163840 2551 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 17:55:04.178012 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.177984 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-etc-kubernetes\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.178128 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178029 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da-agent-certs\") pod \"konnectivity-agent-h74qh\" (UID: \"3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da\") " pod="kube-system/konnectivity-agent-h74qh" Jul 15 17:55:04.178128 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178059 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-run-ovn\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.178128 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178087 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a40a06d0-9182-44da-8229-fec808a929a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.178128 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178117 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-run-ovn\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.178279 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178116 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-host-var-lib-cni-multus\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.178279 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178116 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-etc-kubernetes\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.178279 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178239 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/24b3fd3f-7151-4359-9635-9837155eabff-sys-fs\") pod \"aws-ebs-csi-driver-node-rb962\" (UID: \"24b3fd3f-7151-4359-9635-9837155eabff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.178279 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178260 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-node-log\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.178279 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178276 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bb74316-2275-47ed-bd0b-6a64d3777082-tmp\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.178279 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178277 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/24b3fd3f-7151-4359-9635-9837155eabff-sys-fs\") pod \"aws-ebs-csi-driver-node-rb962\" (UID: \"24b3fd3f-7151-4359-9635-9837155eabff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.178523 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178239 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/a40a06d0-9182-44da-8229-fec808a929a1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.178523 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178310 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-node-log\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.178523 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178303 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs\") pod \"network-metrics-daemon-fvtvh\" (UID: \"002a3085-9fdc-414b-bbf4-4be0580cf88f\") " pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:04.178523 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178347 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1ec3250-3d3a-4901-a5e1-8bb3d3e6a0ae-host\") pod \"node-ca-xhh8c\" (UID: \"d1ec3250-3d3a-4901-a5e1-8bb3d3e6a0ae\") " pod="openshift-image-registry/node-ca-xhh8c" Jul 15 17:55:04.178523 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178373 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da-konnectivity-ca\") pod \"konnectivity-agent-h74qh\" (UID: \"3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da\") " pod="kube-system/konnectivity-agent-h74qh" Jul 15 17:55:04.178523 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178405 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-host-var-lib-kubelet\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.178523 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178428 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-run-openvswitch\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.178523 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178445 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-ovn-node-metrics-cert\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.178523 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178460 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-multus-socket-dir-parent\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.178523 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178488 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-run-openvswitch\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.178523 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178508 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-multus-conf-dir\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.178523 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178529 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44z9z\" (UniqueName: \"kubernetes.io/projected/3bd1d559-f9db-4a45-916c-bb693f1a3c52-kube-api-access-44z9z\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.179121 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178552 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mtvqw\" (UniqueName: \"kubernetes.io/projected/24b3fd3f-7151-4359-9635-9837155eabff-kube-api-access-mtvqw\") pod \"aws-ebs-csi-driver-node-rb962\" (UID: \"24b3fd3f-7151-4359-9635-9837155eabff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.179121 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178576 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12a379a8-7075-4528-a2c5-9d2750f9e71c-kubelet-config\") pod \"global-pull-secret-syncer-6jz77\" (UID: \"12a379a8-7075-4528-a2c5-9d2750f9e71c\") " pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:04.179121 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178599 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-etc-sysctl-d\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.179121 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178626 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/24b3fd3f-7151-4359-9635-9837155eabff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rb962\" (UID: \"24b3fd3f-7151-4359-9635-9837155eabff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.179121 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178650 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/24b3fd3f-7151-4359-9635-9837155eabff-registration-dir\") pod \"aws-ebs-csi-driver-node-rb962\" (UID: \"24b3fd3f-7151-4359-9635-9837155eabff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.179121 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178650 2551 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 17:55:04.179121 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178672 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-host-slash\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.179121 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178699 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-host-run-ovn-kubernetes\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.179121 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178740 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a40a06d0-9182-44da-8229-fec808a929a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.179121 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178731 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/24b3fd3f-7151-4359-9635-9837155eabff-kubelet-dir\") pod \"aws-ebs-csi-driver-node-rb962\" (UID: \"24b3fd3f-7151-4359-9635-9837155eabff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.179121 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178769 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-etc-modprobe-d\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.179121 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178793 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-var-lib-openvswitch\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.179121 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178802 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-etc-sysctl-d\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.179121 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178814 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-host-slash\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.179121 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178826 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-ovnkube-script-lib\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.179121 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178858 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/24b3fd3f-7151-4359-9635-9837155eabff-registration-dir\") pod \"aws-ebs-csi-driver-node-rb962\" (UID: \"24b3fd3f-7151-4359-9635-9837155eabff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.179121 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178866 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-host-run-ovn-kubernetes\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.179830 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178857 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hkxrt\" (UniqueName: \"kubernetes.io/projected/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-kube-api-access-hkxrt\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.179830 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178897 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-etc-modprobe-d\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.179830 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178916 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a40a06d0-9182-44da-8229-fec808a929a1-cnibin\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.179830 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178931 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-var-lib-openvswitch\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.179830 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178942 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gv7tj\" (UniqueName: \"kubernetes.io/projected/a40a06d0-9182-44da-8229-fec808a929a1-kube-api-access-gv7tj\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.179830 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178969 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-etc-systemd\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.179830 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.178992 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-host\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.179830 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179015 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqgtx\" (UniqueName: \"kubernetes.io/projected/d1ec3250-3d3a-4901-a5e1-8bb3d3e6a0ae-kube-api-access-qqgtx\") pod \"node-ca-xhh8c\" (UID: \"d1ec3250-3d3a-4901-a5e1-8bb3d3e6a0ae\") " pod="openshift-image-registry/node-ca-xhh8c" Jul 15 17:55:04.179830 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179038 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-host-run-netns\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.179830 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179039 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/a40a06d0-9182-44da-8229-fec808a929a1-cnibin\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.179830 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179061 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-env-overrides\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.179830 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179095 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-lib-modules\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.179830 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179131 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-host\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.179830 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179143 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1ec3250-3d3a-4901-a5e1-8bb3d3e6a0ae-serviceca\") pod \"node-ca-xhh8c\" (UID: \"d1ec3250-3d3a-4901-a5e1-8bb3d3e6a0ae\") " pod="openshift-image-registry/node-ca-xhh8c" Jul 15 17:55:04.179830 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179169 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-46qt8\" (UniqueName: \"kubernetes.io/projected/1c3d0c9d-5638-4fb5-86f7-dd8fa6f6cb37-kube-api-access-46qt8\") pod \"iptables-alerter-lvsxh\" (UID: \"1c3d0c9d-5638-4fb5-86f7-dd8fa6f6cb37\") " pod="openshift-network-operator/iptables-alerter-lvsxh" Jul 15 17:55:04.179830 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179209 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-system-cni-dir\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.179830 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179232 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-multus-cni-dir\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.180769 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179252 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-lib-modules\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.180769 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179293 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-host-run-netns\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.180769 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179379 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-etc-systemd\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.180769 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179256 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-host-run-netns\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.180769 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179446 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/24b3fd3f-7151-4359-9635-9837155eabff-etc-selinux\") pod \"aws-ebs-csi-driver-node-rb962\" (UID: \"24b3fd3f-7151-4359-9635-9837155eabff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.180769 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179478 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.180769 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179484 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/a40a06d0-9182-44da-8229-fec808a929a1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.180769 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179506 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a40a06d0-9182-44da-8229-fec808a929a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.180769 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179516 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-ovnkube-script-lib\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.180769 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179530 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-sys\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.180769 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179565 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.180769 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179557 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1c3d0c9d-5638-4fb5-86f7-dd8fa6f6cb37-iptables-alerter-script\") pod \"iptables-alerter-lvsxh\" (UID: \"1c3d0c9d-5638-4fb5-86f7-dd8fa6f6cb37\") " pod="openshift-network-operator/iptables-alerter-lvsxh" Jul 15 17:55:04.180769 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179603 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3bd1d559-f9db-4a45-916c-bb693f1a3c52-cni-binary-copy\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.180769 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179617 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-sys\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.180769 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179624 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/24b3fd3f-7151-4359-9635-9837155eabff-etc-selinux\") pod \"aws-ebs-csi-driver-node-rb962\" (UID: \"24b3fd3f-7151-4359-9635-9837155eabff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.180769 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179628 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-host-var-lib-cni-bin\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.180769 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179669 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-env-overrides\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.181564 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179669 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret\") pod \"global-pull-secret-syncer-6jz77\" (UID: \"12a379a8-7075-4528-a2c5-9d2750f9e71c\") " pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:04.181564 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179718 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-var-lib-kubelet\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.181564 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179766 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lf2cf\" (UniqueName: \"kubernetes.io/projected/002a3085-9fdc-414b-bbf4-4be0580cf88f-kube-api-access-lf2cf\") pod \"network-metrics-daemon-fvtvh\" (UID: \"002a3085-9fdc-414b-bbf4-4be0580cf88f\") " pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:04.181564 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179802 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-os-release\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.181564 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179825 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-hostroot\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.181564 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179827 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-var-lib-kubelet\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.181564 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179848 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-host-run-multus-certs\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.181564 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179887 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-etc-openvswitch\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.181564 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179930 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-host-cni-bin\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.181564 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179957 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/a40a06d0-9182-44da-8229-fec808a929a1-cni-binary-copy\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.181564 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.179959 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a40a06d0-9182-44da-8229-fec808a929a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.181564 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180010 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-host-cni-bin\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.181564 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180044 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-etc-openvswitch\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.181564 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180083 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c3d0c9d-5638-4fb5-86f7-dd8fa6f6cb37-host-slash\") pod \"iptables-alerter-lvsxh\" (UID: \"1c3d0c9d-5638-4fb5-86f7-dd8fa6f6cb37\") " pod="openshift-network-operator/iptables-alerter-lvsxh" Jul 15 17:55:04.181564 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180114 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-etc-kubernetes\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.181564 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180140 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/24b3fd3f-7151-4359-9635-9837155eabff-socket-dir\") pod \"aws-ebs-csi-driver-node-rb962\" (UID: \"24b3fd3f-7151-4359-9635-9837155eabff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.181564 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180175 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-run-systemd\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.182418 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180199 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-host-cni-netd\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.182418 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180222 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a40a06d0-9182-44da-8229-fec808a929a1-os-release\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.182418 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180280 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/a40a06d0-9182-44da-8229-fec808a929a1-os-release\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.182418 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180315 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/24b3fd3f-7151-4359-9635-9837155eabff-socket-dir\") pod \"aws-ebs-csi-driver-node-rb962\" (UID: \"24b3fd3f-7151-4359-9635-9837155eabff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.182418 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180317 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-run-systemd\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.182418 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180348 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-host-cni-netd\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.182418 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180376 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-etc-sysctl-conf\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.182418 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180407 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-host-run-k8s-cni-cncf-io\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.182418 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180435 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6285ed2-035b-45f1-9ca7-52023153a5e9-tmp-dir\") pod \"node-resolver-zskmc\" (UID: \"b6285ed2-035b-45f1-9ca7-52023153a5e9\") " pod="openshift-dns/node-resolver-zskmc" Jul 15 17:55:04.182418 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180453 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbfvc\" (UniqueName: \"kubernetes.io/projected/b6285ed2-035b-45f1-9ca7-52023153a5e9-kube-api-access-bbfvc\") pod \"node-resolver-zskmc\" (UID: \"b6285ed2-035b-45f1-9ca7-52023153a5e9\") " pod="openshift-dns/node-resolver-zskmc" Jul 15 17:55:04.182418 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180505 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-etc-sysctl-conf\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.182418 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180518 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/24b3fd3f-7151-4359-9635-9837155eabff-device-dir\") pod \"aws-ebs-csi-driver-node-rb962\" (UID: \"24b3fd3f-7151-4359-9635-9837155eabff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.182418 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180548 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-host-kubelet\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.182418 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180563 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/24b3fd3f-7151-4359-9635-9837155eabff-device-dir\") pod \"aws-ebs-csi-driver-node-rb962\" (UID: \"24b3fd3f-7151-4359-9635-9837155eabff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.182418 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180581 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-run\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.182418 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180623 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-cnibin\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.182418 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180582 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-host-kubelet\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.183155 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180648 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12a379a8-7075-4528-a2c5-9d2750f9e71c-dbus\") pod \"global-pull-secret-syncer-6jz77\" (UID: \"12a379a8-7075-4528-a2c5-9d2750f9e71c\") " pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:04.183155 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180665 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-run\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.183155 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180712 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4bb74316-2275-47ed-bd0b-6a64d3777082-etc-tuned\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.183155 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180740 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9tc4h\" (UniqueName: \"kubernetes.io/projected/4bb74316-2275-47ed-bd0b-6a64d3777082-kube-api-access-9tc4h\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.183155 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180760 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-log-socket\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.183155 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180775 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-ovnkube-config\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.183155 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180831 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-log-socket\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.183155 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180942 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/a40a06d0-9182-44da-8229-fec808a929a1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.183155 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.180983 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b54p\" (UniqueName: \"kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p\") pod \"network-check-target-rd5vp\" (UID: \"cd44a874-643c-4efc-b8b4-b92449f574e5\") " pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:04.183155 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.181004 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a40a06d0-9182-44da-8229-fec808a929a1-system-cni-dir\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.183155 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.181045 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3bd1d559-f9db-4a45-916c-bb693f1a3c52-multus-daemon-config\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.183155 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.181059 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/a40a06d0-9182-44da-8229-fec808a929a1-system-cni-dir\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.183155 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.181071 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b6285ed2-035b-45f1-9ca7-52023153a5e9-hosts-file\") pod \"node-resolver-zskmc\" (UID: \"b6285ed2-035b-45f1-9ca7-52023153a5e9\") " pod="openshift-dns/node-resolver-zskmc" Jul 15 17:55:04.183155 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.181121 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-systemd-units\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.183155 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.181137 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-etc-sysconfig\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.183155 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.181188 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-systemd-units\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.183155 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.181261 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/4bb74316-2275-47ed-bd0b-6a64d3777082-etc-sysconfig\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.183713 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.181845 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-ovnkube-config\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.183713 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.183085 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/4bb74316-2275-47ed-bd0b-6a64d3777082-etc-tuned\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.183713 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.183151 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/4bb74316-2275-47ed-bd0b-6a64d3777082-tmp\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.183713 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.183161 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-ovn-node-metrics-cert\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.189815 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:04.189781 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 17:55:04.189815 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:04.189810 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 17:55:04.190077 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:04.189825 2551 projected.go:196] Error preparing data for projected volume kube-api-access-7b54p for pod openshift-network-diagnostics/network-check-target-rd5vp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 17:55:04.190077 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:04.189897 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p podName:cd44a874-643c-4efc-b8b4-b92449f574e5 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:04.689875497 +0000 UTC m=+3.025183805 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-7b54p" (UniqueName: "kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p") pod "network-check-target-rd5vp" (UID: "cd44a874-643c-4efc-b8b4-b92449f574e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 17:55:04.191196 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.191172 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hkxrt\" (UniqueName: \"kubernetes.io/projected/ff5857c7-97d1-467d-8b6f-8691f7e0d6dc-kube-api-access-hkxrt\") pod \"ovnkube-node-pwzkz\" (UID: \"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc\") " pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.191618 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.191590 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mtvqw\" (UniqueName: \"kubernetes.io/projected/24b3fd3f-7151-4359-9635-9837155eabff-kube-api-access-mtvqw\") pod \"aws-ebs-csi-driver-node-rb962\" (UID: \"24b3fd3f-7151-4359-9635-9837155eabff\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.191845 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.191827 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gv7tj\" (UniqueName: \"kubernetes.io/projected/a40a06d0-9182-44da-8229-fec808a929a1-kube-api-access-gv7tj\") pod \"multus-additional-cni-plugins-7z26z\" (UID: \"a40a06d0-9182-44da-8229-fec808a929a1\") " pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.192250 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.192233 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9tc4h\" (UniqueName: \"kubernetes.io/projected/4bb74316-2275-47ed-bd0b-6a64d3777082-kube-api-access-9tc4h\") pod \"tuned-pfj4m\" (UID: \"4bb74316-2275-47ed-bd0b-6a64d3777082\") " pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.211907 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.211853 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-25.ec2.internal" event={"ID":"9eaccd26994c83fcdad8d06f7f02281b","Type":"ContainerStarted","Data":"6d5d9dc5027ec8d6b5c5f875e1f1a070d4eb956dc2737a5fe768677bb3d7f97d"} Jul 15 17:55:04.213048 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.213025 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-25.ec2.internal" event={"ID":"713382c42dd951a131036f50252694db","Type":"ContainerStarted","Data":"e2b3e206079840719a8f48b3e670585b3488f3bce3915b995cc93d6909431e19"} Jul 15 17:55:04.252747 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.252720 2551 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 17:55:04.281450 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281421 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lf2cf\" (UniqueName: \"kubernetes.io/projected/002a3085-9fdc-414b-bbf4-4be0580cf88f-kube-api-access-lf2cf\") pod \"network-metrics-daemon-fvtvh\" (UID: \"002a3085-9fdc-414b-bbf4-4be0580cf88f\") " pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:04.281576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281459 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-os-release\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.281576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281476 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-hostroot\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.281576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281491 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-host-run-multus-certs\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.281576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281509 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c3d0c9d-5638-4fb5-86f7-dd8fa6f6cb37-host-slash\") pod \"iptables-alerter-lvsxh\" (UID: \"1c3d0c9d-5638-4fb5-86f7-dd8fa6f6cb37\") " pod="openshift-network-operator/iptables-alerter-lvsxh" Jul 15 17:55:04.281576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281553 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-etc-kubernetes\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.281902 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281593 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-os-release\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.281902 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281610 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-host-run-k8s-cni-cncf-io\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.281902 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281643 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-etc-kubernetes\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.281902 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281641 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6285ed2-035b-45f1-9ca7-52023153a5e9-tmp-dir\") pod \"node-resolver-zskmc\" (UID: \"b6285ed2-035b-45f1-9ca7-52023153a5e9\") " pod="openshift-dns/node-resolver-zskmc" Jul 15 17:55:04.281902 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281737 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbfvc\" (UniqueName: \"kubernetes.io/projected/b6285ed2-035b-45f1-9ca7-52023153a5e9-kube-api-access-bbfvc\") pod \"node-resolver-zskmc\" (UID: \"b6285ed2-035b-45f1-9ca7-52023153a5e9\") " pod="openshift-dns/node-resolver-zskmc" Jul 15 17:55:04.281902 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281753 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-hostroot\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.281902 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281768 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-cnibin\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.281902 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281796 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12a379a8-7075-4528-a2c5-9d2750f9e71c-dbus\") pod \"global-pull-secret-syncer-6jz77\" (UID: \"12a379a8-7075-4528-a2c5-9d2750f9e71c\") " pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:04.281902 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281824 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-cnibin\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.281902 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281736 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-host-run-k8s-cni-cncf-io\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.281902 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281841 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3bd1d559-f9db-4a45-916c-bb693f1a3c52-multus-daemon-config\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.281902 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281867 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b6285ed2-035b-45f1-9ca7-52023153a5e9-hosts-file\") pod \"node-resolver-zskmc\" (UID: \"b6285ed2-035b-45f1-9ca7-52023153a5e9\") " pod="openshift-dns/node-resolver-zskmc" Jul 15 17:55:04.281902 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281898 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da-agent-certs\") pod \"konnectivity-agent-h74qh\" (UID: \"3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da\") " pod="kube-system/konnectivity-agent-h74qh" Jul 15 17:55:04.282518 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281924 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-host-var-lib-cni-multus\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.282518 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281955 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs\") pod \"network-metrics-daemon-fvtvh\" (UID: \"002a3085-9fdc-414b-bbf4-4be0580cf88f\") " pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:04.282518 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281978 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/12a379a8-7075-4528-a2c5-9d2750f9e71c-dbus\") pod \"global-pull-secret-syncer-6jz77\" (UID: \"12a379a8-7075-4528-a2c5-9d2750f9e71c\") " pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:04.282518 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281979 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1ec3250-3d3a-4901-a5e1-8bb3d3e6a0ae-host\") pod \"node-ca-xhh8c\" (UID: \"d1ec3250-3d3a-4901-a5e1-8bb3d3e6a0ae\") " pod="openshift-image-registry/node-ca-xhh8c" Jul 15 17:55:04.282518 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281997 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/b6285ed2-035b-45f1-9ca7-52023153a5e9-hosts-file\") pod \"node-resolver-zskmc\" (UID: \"b6285ed2-035b-45f1-9ca7-52023153a5e9\") " pod="openshift-dns/node-resolver-zskmc" Jul 15 17:55:04.282518 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282026 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/d1ec3250-3d3a-4901-a5e1-8bb3d3e6a0ae-host\") pod \"node-ca-xhh8c\" (UID: \"d1ec3250-3d3a-4901-a5e1-8bb3d3e6a0ae\") " pod="openshift-image-registry/node-ca-xhh8c" Jul 15 17:55:04.282518 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282032 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da-konnectivity-ca\") pod \"konnectivity-agent-h74qh\" (UID: \"3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da\") " pod="kube-system/konnectivity-agent-h74qh" Jul 15 17:55:04.282518 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282054 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/1c3d0c9d-5638-4fb5-86f7-dd8fa6f6cb37-host-slash\") pod \"iptables-alerter-lvsxh\" (UID: \"1c3d0c9d-5638-4fb5-86f7-dd8fa6f6cb37\") " pod="openshift-network-operator/iptables-alerter-lvsxh" Jul 15 17:55:04.282518 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282056 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b6285ed2-035b-45f1-9ca7-52023153a5e9-tmp-dir\") pod \"node-resolver-zskmc\" (UID: \"b6285ed2-035b-45f1-9ca7-52023153a5e9\") " pod="openshift-dns/node-resolver-zskmc" Jul 15 17:55:04.282518 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.281978 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-host-run-multus-certs\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.282518 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282063 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-host-var-lib-kubelet\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.282518 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282097 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-host-var-lib-kubelet\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.282518 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282110 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-host-var-lib-cni-multus\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.282518 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:04.282121 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 17:55:04.282518 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282156 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-multus-socket-dir-parent\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.282518 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:04.282202 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs podName:002a3085-9fdc-414b-bbf4-4be0580cf88f nodeName:}" failed. No retries permitted until 2026-07-15 17:55:04.782179708 +0000 UTC m=+3.117487991 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs") pod "network-metrics-daemon-fvtvh" (UID: "002a3085-9fdc-414b-bbf4-4be0580cf88f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 17:55:04.282518 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282219 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-multus-conf-dir\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.282518 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282244 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44z9z\" (UniqueName: \"kubernetes.io/projected/3bd1d559-f9db-4a45-916c-bb693f1a3c52-kube-api-access-44z9z\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.283412 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282274 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12a379a8-7075-4528-a2c5-9d2750f9e71c-kubelet-config\") pod \"global-pull-secret-syncer-6jz77\" (UID: \"12a379a8-7075-4528-a2c5-9d2750f9e71c\") " pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:04.283412 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282315 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqgtx\" (UniqueName: \"kubernetes.io/projected/d1ec3250-3d3a-4901-a5e1-8bb3d3e6a0ae-kube-api-access-qqgtx\") pod \"node-ca-xhh8c\" (UID: \"d1ec3250-3d3a-4901-a5e1-8bb3d3e6a0ae\") " pod="openshift-image-registry/node-ca-xhh8c" Jul 15 17:55:04.283412 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282344 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1ec3250-3d3a-4901-a5e1-8bb3d3e6a0ae-serviceca\") pod \"node-ca-xhh8c\" (UID: \"d1ec3250-3d3a-4901-a5e1-8bb3d3e6a0ae\") " pod="openshift-image-registry/node-ca-xhh8c" Jul 15 17:55:04.283412 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282369 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-46qt8\" (UniqueName: \"kubernetes.io/projected/1c3d0c9d-5638-4fb5-86f7-dd8fa6f6cb37-kube-api-access-46qt8\") pod \"iptables-alerter-lvsxh\" (UID: \"1c3d0c9d-5638-4fb5-86f7-dd8fa6f6cb37\") " pod="openshift-network-operator/iptables-alerter-lvsxh" Jul 15 17:55:04.283412 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282383 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-multus-socket-dir-parent\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.283412 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282394 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-system-cni-dir\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.283412 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282421 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-multus-cni-dir\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.283412 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282421 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/3bd1d559-f9db-4a45-916c-bb693f1a3c52-multus-daemon-config\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.283412 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282501 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-multus-cni-dir\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.283412 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282548 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/12a379a8-7075-4528-a2c5-9d2750f9e71c-kubelet-config\") pod \"global-pull-secret-syncer-6jz77\" (UID: \"12a379a8-7075-4528-a2c5-9d2750f9e71c\") " pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:04.283412 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282577 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-host-run-netns\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.283412 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282608 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1c3d0c9d-5638-4fb5-86f7-dd8fa6f6cb37-iptables-alerter-script\") pod \"iptables-alerter-lvsxh\" (UID: \"1c3d0c9d-5638-4fb5-86f7-dd8fa6f6cb37\") " pod="openshift-network-operator/iptables-alerter-lvsxh" Jul 15 17:55:04.283412 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282609 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da-konnectivity-ca\") pod \"konnectivity-agent-h74qh\" (UID: \"3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da\") " pod="kube-system/konnectivity-agent-h74qh" Jul 15 17:55:04.283412 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282634 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3bd1d559-f9db-4a45-916c-bb693f1a3c52-cni-binary-copy\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.283412 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282666 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-host-var-lib-cni-bin\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.283412 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282670 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-system-cni-dir\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.283412 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282668 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-host-run-netns\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.283412 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282757 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-host-var-lib-cni-bin\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.284075 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282857 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/d1ec3250-3d3a-4901-a5e1-8bb3d3e6a0ae-serviceca\") pod \"node-ca-xhh8c\" (UID: \"d1ec3250-3d3a-4901-a5e1-8bb3d3e6a0ae\") " pod="openshift-image-registry/node-ca-xhh8c" Jul 15 17:55:04.284075 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.282979 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret\") pod \"global-pull-secret-syncer-6jz77\" (UID: \"12a379a8-7075-4528-a2c5-9d2750f9e71c\") " pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:04.284075 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.283045 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3bd1d559-f9db-4a45-916c-bb693f1a3c52-multus-conf-dir\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.284075 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:04.283098 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 17:55:04.284075 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:04.283173 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret podName:12a379a8-7075-4528-a2c5-9d2750f9e71c nodeName:}" failed. No retries permitted until 2026-07-15 17:55:04.78315566 +0000 UTC m=+3.118463943 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret") pod "global-pull-secret-syncer-6jz77" (UID: "12a379a8-7075-4528-a2c5-9d2750f9e71c") : object "kube-system"/"original-pull-secret" not registered Jul 15 17:55:04.284075 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.283176 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3bd1d559-f9db-4a45-916c-bb693f1a3c52-cni-binary-copy\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.284075 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.283293 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/1c3d0c9d-5638-4fb5-86f7-dd8fa6f6cb37-iptables-alerter-script\") pod \"iptables-alerter-lvsxh\" (UID: \"1c3d0c9d-5638-4fb5-86f7-dd8fa6f6cb37\") " pod="openshift-network-operator/iptables-alerter-lvsxh" Jul 15 17:55:04.285004 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.284985 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da-agent-certs\") pod \"konnectivity-agent-h74qh\" (UID: \"3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da\") " pod="kube-system/konnectivity-agent-h74qh" Jul 15 17:55:04.296373 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.296296 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lf2cf\" (UniqueName: \"kubernetes.io/projected/002a3085-9fdc-414b-bbf4-4be0580cf88f-kube-api-access-lf2cf\") pod \"network-metrics-daemon-fvtvh\" (UID: \"002a3085-9fdc-414b-bbf4-4be0580cf88f\") " pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:04.296916 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.296894 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-46qt8\" (UniqueName: \"kubernetes.io/projected/1c3d0c9d-5638-4fb5-86f7-dd8fa6f6cb37-kube-api-access-46qt8\") pod \"iptables-alerter-lvsxh\" (UID: \"1c3d0c9d-5638-4fb5-86f7-dd8fa6f6cb37\") " pod="openshift-network-operator/iptables-alerter-lvsxh" Jul 15 17:55:04.298131 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.297888 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbfvc\" (UniqueName: \"kubernetes.io/projected/b6285ed2-035b-45f1-9ca7-52023153a5e9-kube-api-access-bbfvc\") pod \"node-resolver-zskmc\" (UID: \"b6285ed2-035b-45f1-9ca7-52023153a5e9\") " pod="openshift-dns/node-resolver-zskmc" Jul 15 17:55:04.298664 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.298447 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44z9z\" (UniqueName: \"kubernetes.io/projected/3bd1d559-f9db-4a45-916c-bb693f1a3c52-kube-api-access-44z9z\") pod \"multus-vnm66\" (UID: \"3bd1d559-f9db-4a45-916c-bb693f1a3c52\") " pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.298664 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.298623 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqgtx\" (UniqueName: \"kubernetes.io/projected/d1ec3250-3d3a-4901-a5e1-8bb3d3e6a0ae-kube-api-access-qqgtx\") pod \"node-ca-xhh8c\" (UID: \"d1ec3250-3d3a-4901-a5e1-8bb3d3e6a0ae\") " pod="openshift-image-registry/node-ca-xhh8c" Jul 15 17:55:04.369147 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.369119 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" Jul 15 17:55:04.375913 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.375894 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:04.389060 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.389042 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-7z26z" Jul 15 17:55:04.395884 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.395862 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" Jul 15 17:55:04.401533 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.401516 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-zskmc" Jul 15 17:55:04.412189 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.412173 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-xhh8c" Jul 15 17:55:04.423880 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.423859 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-lvsxh" Jul 15 17:55:04.430862 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.430845 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-vnm66" Jul 15 17:55:04.436737 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.436717 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-h74qh" Jul 15 17:55:04.533383 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:04.533353 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff5857c7_97d1_467d_8b6f_8691f7e0d6dc.slice/crio-b9fbbe654d84f39efad9f728f4edd2b3d30fd08e96cd6cdfd47ad90ec9c9db6e WatchSource:0}: Error finding container b9fbbe654d84f39efad9f728f4edd2b3d30fd08e96cd6cdfd47ad90ec9c9db6e: Status 404 returned error can't find the container with id b9fbbe654d84f39efad9f728f4edd2b3d30fd08e96cd6cdfd47ad90ec9c9db6e Jul 15 17:55:04.534487 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:04.534460 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bb74316_2275_47ed_bd0b_6a64d3777082.slice/crio-2e589a8acba09f2492ec9410b88c59afc40aab1f5518035e650c89ddf1383890 WatchSource:0}: Error finding container 2e589a8acba09f2492ec9410b88c59afc40aab1f5518035e650c89ddf1383890: Status 404 returned error can't find the container with id 2e589a8acba09f2492ec9410b88c59afc40aab1f5518035e650c89ddf1383890 Jul 15 17:55:04.539825 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:04.539802 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3bd1d559_f9db_4a45_916c_bb693f1a3c52.slice/crio-46c352c5955a1b8a872dac2d0c3128393292c63714f7d90cca834f38c0998dd3 WatchSource:0}: Error finding container 46c352c5955a1b8a872dac2d0c3128393292c63714f7d90cca834f38c0998dd3: Status 404 returned error can't find the container with id 46c352c5955a1b8a872dac2d0c3128393292c63714f7d90cca834f38c0998dd3 Jul 15 17:55:04.560255 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:04.560217 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c4f7d00_4a62_47f2_89d4_bc4f7d1c94da.slice/crio-3f3f79822fc28ebfb0471a696dc68a9399e518b3ac3cbd4122fe79bef0522123 WatchSource:0}: Error finding container 3f3f79822fc28ebfb0471a696dc68a9399e518b3ac3cbd4122fe79bef0522123: Status 404 returned error can't find the container with id 3f3f79822fc28ebfb0471a696dc68a9399e518b3ac3cbd4122fe79bef0522123 Jul 15 17:55:04.560924 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:04.560821 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda40a06d0_9182_44da_8229_fec808a929a1.slice/crio-54e27a6be33919c3a037418bbf9569aeca350555bfe3761f633533ff9d68d7fd WatchSource:0}: Error finding container 54e27a6be33919c3a037418bbf9569aeca350555bfe3761f633533ff9d68d7fd: Status 404 returned error can't find the container with id 54e27a6be33919c3a037418bbf9569aeca350555bfe3761f633533ff9d68d7fd Jul 15 17:55:04.561790 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:04.561763 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod24b3fd3f_7151_4359_9635_9837155eabff.slice/crio-8ea66b74db6a53fb950182def9c2cdbe5681042bf268da15ad5018a4285e4f8d WatchSource:0}: Error finding container 8ea66b74db6a53fb950182def9c2cdbe5681042bf268da15ad5018a4285e4f8d: Status 404 returned error can't find the container with id 8ea66b74db6a53fb950182def9c2cdbe5681042bf268da15ad5018a4285e4f8d Jul 15 17:55:04.563701 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:04.563268 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd1ec3250_3d3a_4901_a5e1_8bb3d3e6a0ae.slice/crio-2d107c66065dfb9157a8d210f6d63aba6c2f66f0b1261df61b8048471de17b59 WatchSource:0}: Error finding container 2d107c66065dfb9157a8d210f6d63aba6c2f66f0b1261df61b8048471de17b59: Status 404 returned error can't find the container with id 2d107c66065dfb9157a8d210f6d63aba6c2f66f0b1261df61b8048471de17b59 Jul 15 17:55:04.563701 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:04.563526 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1c3d0c9d_5638_4fb5_86f7_dd8fa6f6cb37.slice/crio-cbe72beefd802316ad7c2520931355fa7bb539b1e1064d61c055f8fc1c289109 WatchSource:0}: Error finding container cbe72beefd802316ad7c2520931355fa7bb539b1e1064d61c055f8fc1c289109: Status 404 returned error can't find the container with id cbe72beefd802316ad7c2520931355fa7bb539b1e1064d61c055f8fc1c289109 Jul 15 17:55:04.786639 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.786027 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret\") pod \"global-pull-secret-syncer-6jz77\" (UID: \"12a379a8-7075-4528-a2c5-9d2750f9e71c\") " pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:04.786639 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.786065 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b54p\" (UniqueName: \"kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p\") pod \"network-check-target-rd5vp\" (UID: \"cd44a874-643c-4efc-b8b4-b92449f574e5\") " pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:04.786639 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:04.786085 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs\") pod \"network-metrics-daemon-fvtvh\" (UID: \"002a3085-9fdc-414b-bbf4-4be0580cf88f\") " pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:04.786639 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:04.786175 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 17:55:04.786639 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:04.786217 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs podName:002a3085-9fdc-414b-bbf4-4be0580cf88f nodeName:}" failed. No retries permitted until 2026-07-15 17:55:05.786204532 +0000 UTC m=+4.121512814 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs") pod "network-metrics-daemon-fvtvh" (UID: "002a3085-9fdc-414b-bbf4-4be0580cf88f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 17:55:04.786639 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:04.786498 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 17:55:04.786639 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:04.786528 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret podName:12a379a8-7075-4528-a2c5-9d2750f9e71c nodeName:}" failed. No retries permitted until 2026-07-15 17:55:05.786519011 +0000 UTC m=+4.121827292 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret") pod "global-pull-secret-syncer-6jz77" (UID: "12a379a8-7075-4528-a2c5-9d2750f9e71c") : object "kube-system"/"original-pull-secret" not registered Jul 15 17:55:04.786639 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:04.786579 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 17:55:04.786639 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:04.786588 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 17:55:04.786639 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:04.786596 2551 projected.go:196] Error preparing data for projected volume kube-api-access-7b54p for pod openshift-network-diagnostics/network-check-target-rd5vp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 17:55:04.786639 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:04.786619 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p podName:cd44a874-643c-4efc-b8b4-b92449f574e5 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:05.786611343 +0000 UTC m=+4.121919624 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-7b54p" (UniqueName: "kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p") pod "network-check-target-rd5vp" (UID: "cd44a874-643c-4efc-b8b4-b92449f574e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 17:55:05.110445 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:05.110098 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 17:50:04 +0000 UTC" deadline="2028-03-11 19:31:57.676478962 +0000 UTC" Jul 15 17:55:05.110445 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:05.110393 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14521h36m52.566092167s" Jul 15 17:55:05.220965 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:05.220792 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" event={"ID":"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc","Type":"ContainerStarted","Data":"b9fbbe654d84f39efad9f728f4edd2b3d30fd08e96cd6cdfd47ad90ec9c9db6e"} Jul 15 17:55:05.226290 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:05.226257 2551 generic.go:356] "Generic (PLEG): container finished" podID="9eaccd26994c83fcdad8d06f7f02281b" containerID="10026d60a03b4653b68c96e9a623ec53056108e6042861528cc07215e48cb8a5" exitCode=0 Jul 15 17:55:05.226566 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:05.226496 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-25.ec2.internal" event={"ID":"9eaccd26994c83fcdad8d06f7f02281b","Type":"ContainerDied","Data":"10026d60a03b4653b68c96e9a623ec53056108e6042861528cc07215e48cb8a5"} Jul 15 17:55:05.240022 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:05.239923 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lvsxh" event={"ID":"1c3d0c9d-5638-4fb5-86f7-dd8fa6f6cb37","Type":"ContainerStarted","Data":"cbe72beefd802316ad7c2520931355fa7bb539b1e1064d61c055f8fc1c289109"} Jul 15 17:55:05.242380 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:05.242281 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h74qh" event={"ID":"3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da","Type":"ContainerStarted","Data":"3f3f79822fc28ebfb0471a696dc68a9399e518b3ac3cbd4122fe79bef0522123"} Jul 15 17:55:05.246011 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:05.245984 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zskmc" event={"ID":"b6285ed2-035b-45f1-9ca7-52023153a5e9","Type":"ContainerStarted","Data":"b371724384c782fee14e33fa346aeee91d3a6106737786200066e1dd26baf4a6"} Jul 15 17:55:05.249131 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:05.249103 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vnm66" event={"ID":"3bd1d559-f9db-4a45-916c-bb693f1a3c52","Type":"ContainerStarted","Data":"46c352c5955a1b8a872dac2d0c3128393292c63714f7d90cca834f38c0998dd3"} Jul 15 17:55:05.252180 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:05.252155 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" event={"ID":"4bb74316-2275-47ed-bd0b-6a64d3777082","Type":"ContainerStarted","Data":"2e589a8acba09f2492ec9410b88c59afc40aab1f5518035e650c89ddf1383890"} Jul 15 17:55:05.257574 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:05.257531 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xhh8c" event={"ID":"d1ec3250-3d3a-4901-a5e1-8bb3d3e6a0ae","Type":"ContainerStarted","Data":"2d107c66065dfb9157a8d210f6d63aba6c2f66f0b1261df61b8048471de17b59"} Jul 15 17:55:05.279987 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:05.279954 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" event={"ID":"24b3fd3f-7151-4359-9635-9837155eabff","Type":"ContainerStarted","Data":"8ea66b74db6a53fb950182def9c2cdbe5681042bf268da15ad5018a4285e4f8d"} Jul 15 17:55:05.289148 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:05.289055 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7z26z" event={"ID":"a40a06d0-9182-44da-8229-fec808a929a1","Type":"ContainerStarted","Data":"54e27a6be33919c3a037418bbf9569aeca350555bfe3761f633533ff9d68d7fd"} Jul 15 17:55:05.799779 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:05.799641 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b54p\" (UniqueName: \"kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p\") pod \"network-check-target-rd5vp\" (UID: \"cd44a874-643c-4efc-b8b4-b92449f574e5\") " pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:05.799779 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:05.799716 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs\") pod \"network-metrics-daemon-fvtvh\" (UID: \"002a3085-9fdc-414b-bbf4-4be0580cf88f\") " pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:05.799779 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:05.799757 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret\") pod \"global-pull-secret-syncer-6jz77\" (UID: \"12a379a8-7075-4528-a2c5-9d2750f9e71c\") " pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:05.800063 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:05.799855 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 17:55:05.800063 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:05.799913 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret podName:12a379a8-7075-4528-a2c5-9d2750f9e71c nodeName:}" failed. No retries permitted until 2026-07-15 17:55:07.799900065 +0000 UTC m=+6.135208345 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret") pod "global-pull-secret-syncer-6jz77" (UID: "12a379a8-7075-4528-a2c5-9d2750f9e71c") : object "kube-system"/"original-pull-secret" not registered Jul 15 17:55:05.800250 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:05.800231 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 17:55:05.800314 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:05.800260 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 17:55:05.800314 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:05.800271 2551 projected.go:196] Error preparing data for projected volume kube-api-access-7b54p for pod openshift-network-diagnostics/network-check-target-rd5vp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 17:55:05.800314 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:05.800304 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p podName:cd44a874-643c-4efc-b8b4-b92449f574e5 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:07.800293966 +0000 UTC m=+6.135602247 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-7b54p" (UniqueName: "kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p") pod "network-check-target-rd5vp" (UID: "cd44a874-643c-4efc-b8b4-b92449f574e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 17:55:05.800472 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:05.800350 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 17:55:05.800472 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:05.800373 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs podName:002a3085-9fdc-414b-bbf4-4be0580cf88f nodeName:}" failed. No retries permitted until 2026-07-15 17:55:07.800364857 +0000 UTC m=+6.135673138 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs") pod "network-metrics-daemon-fvtvh" (UID: "002a3085-9fdc-414b-bbf4-4be0580cf88f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 17:55:05.871113 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:05.871081 2551 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 17:55:05.999106 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:05.999077 2551 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 17:55:06.111375 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:06.111260 2551 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 17:50:04 +0000 UTC" deadline="2027-12-09 20:12:51.542954226 +0000 UTC" Jul 15 17:55:06.111375 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:06.111321 2551 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12290h17m45.431637235s" Jul 15 17:55:06.205979 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:06.205401 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:06.205979 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:06.205455 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:06.205979 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:06.205463 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:06.205979 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:06.205580 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvtvh" podUID="002a3085-9fdc-414b-bbf4-4be0580cf88f" Jul 15 17:55:06.205979 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:06.205758 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rd5vp" podUID="cd44a874-643c-4efc-b8b4-b92449f574e5" Jul 15 17:55:06.205979 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:06.205851 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6jz77" podUID="12a379a8-7075-4528-a2c5-9d2750f9e71c" Jul 15 17:55:06.311998 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:06.311960 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-25.ec2.internal" event={"ID":"9eaccd26994c83fcdad8d06f7f02281b","Type":"ContainerStarted","Data":"1ddfb14c64e3198fa075735cd4ccb8ca4ba177a7321ab4017d6f0afa7d34f589"} Jul 15 17:55:07.820329 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:07.820292 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b54p\" (UniqueName: \"kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p\") pod \"network-check-target-rd5vp\" (UID: \"cd44a874-643c-4efc-b8b4-b92449f574e5\") " pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:07.820850 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:07.820352 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs\") pod \"network-metrics-daemon-fvtvh\" (UID: \"002a3085-9fdc-414b-bbf4-4be0580cf88f\") " pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:07.820850 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:07.820406 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret\") pod \"global-pull-secret-syncer-6jz77\" (UID: \"12a379a8-7075-4528-a2c5-9d2750f9e71c\") " pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:07.820850 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:07.820559 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 17:55:07.820850 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:07.820628 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret podName:12a379a8-7075-4528-a2c5-9d2750f9e71c nodeName:}" failed. No retries permitted until 2026-07-15 17:55:11.820607092 +0000 UTC m=+10.155915396 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret") pod "global-pull-secret-syncer-6jz77" (UID: "12a379a8-7075-4528-a2c5-9d2750f9e71c") : object "kube-system"/"original-pull-secret" not registered Jul 15 17:55:07.821118 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:07.821096 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 17:55:07.821201 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:07.821126 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 17:55:07.821201 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:07.821141 2551 projected.go:196] Error preparing data for projected volume kube-api-access-7b54p for pod openshift-network-diagnostics/network-check-target-rd5vp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 17:55:07.821317 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:07.821203 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p podName:cd44a874-643c-4efc-b8b4-b92449f574e5 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:11.821187113 +0000 UTC m=+10.156495410 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-7b54p" (UniqueName: "kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p") pod "network-check-target-rd5vp" (UID: "cd44a874-643c-4efc-b8b4-b92449f574e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 17:55:07.821317 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:07.821300 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 17:55:07.821424 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:07.821337 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs podName:002a3085-9fdc-414b-bbf4-4be0580cf88f nodeName:}" failed. No retries permitted until 2026-07-15 17:55:11.821325113 +0000 UTC m=+10.156633397 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs") pod "network-metrics-daemon-fvtvh" (UID: "002a3085-9fdc-414b-bbf4-4be0580cf88f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 17:55:08.207228 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:08.207141 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:08.207389 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:08.207264 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6jz77" podUID="12a379a8-7075-4528-a2c5-9d2750f9e71c" Jul 15 17:55:08.207611 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:08.207583 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:08.207776 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:08.207693 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rd5vp" podUID="cd44a874-643c-4efc-b8b4-b92449f574e5" Jul 15 17:55:08.207838 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:08.207790 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:08.207920 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:08.207900 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvtvh" podUID="002a3085-9fdc-414b-bbf4-4be0580cf88f" Jul 15 17:55:10.206897 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:10.206864 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:10.207420 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:10.207006 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rd5vp" podUID="cd44a874-643c-4efc-b8b4-b92449f574e5" Jul 15 17:55:10.207501 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:10.207441 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:10.207873 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:10.207561 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvtvh" podUID="002a3085-9fdc-414b-bbf4-4be0580cf88f" Jul 15 17:55:10.207873 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:10.207715 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:10.207873 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:10.207825 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6jz77" podUID="12a379a8-7075-4528-a2c5-9d2750f9e71c" Jul 15 17:55:11.858097 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:11.858053 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret\") pod \"global-pull-secret-syncer-6jz77\" (UID: \"12a379a8-7075-4528-a2c5-9d2750f9e71c\") " pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:11.858535 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:11.858130 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b54p\" (UniqueName: \"kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p\") pod \"network-check-target-rd5vp\" (UID: \"cd44a874-643c-4efc-b8b4-b92449f574e5\") " pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:11.858535 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:11.858167 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs\") pod \"network-metrics-daemon-fvtvh\" (UID: \"002a3085-9fdc-414b-bbf4-4be0580cf88f\") " pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:11.858535 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:11.858242 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 17:55:11.858535 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:11.858292 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 17:55:11.858535 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:11.858328 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret podName:12a379a8-7075-4528-a2c5-9d2750f9e71c nodeName:}" failed. No retries permitted until 2026-07-15 17:55:19.858306412 +0000 UTC m=+18.193614714 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret") pod "global-pull-secret-syncer-6jz77" (UID: "12a379a8-7075-4528-a2c5-9d2750f9e71c") : object "kube-system"/"original-pull-secret" not registered Jul 15 17:55:11.858535 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:11.858346 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 17:55:11.858535 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:11.858354 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs podName:002a3085-9fdc-414b-bbf4-4be0580cf88f nodeName:}" failed. No retries permitted until 2026-07-15 17:55:19.858343049 +0000 UTC m=+18.193651333 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs") pod "network-metrics-daemon-fvtvh" (UID: "002a3085-9fdc-414b-bbf4-4be0580cf88f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 17:55:11.858535 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:11.858364 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 17:55:11.858535 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:11.858375 2551 projected.go:196] Error preparing data for projected volume kube-api-access-7b54p for pod openshift-network-diagnostics/network-check-target-rd5vp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 17:55:11.858535 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:11.858424 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p podName:cd44a874-643c-4efc-b8b4-b92449f574e5 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:19.858407301 +0000 UTC m=+18.193715604 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-7b54p" (UniqueName: "kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p") pod "network-check-target-rd5vp" (UID: "cd44a874-643c-4efc-b8b4-b92449f574e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 17:55:12.207526 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:12.206880 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:12.207526 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:12.206989 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rd5vp" podUID="cd44a874-643c-4efc-b8b4-b92449f574e5" Jul 15 17:55:12.207526 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:12.207309 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:12.207526 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:12.207436 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvtvh" podUID="002a3085-9fdc-414b-bbf4-4be0580cf88f" Jul 15 17:55:12.207818 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:12.207569 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:12.207818 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:12.207701 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6jz77" podUID="12a379a8-7075-4528-a2c5-9d2750f9e71c" Jul 15 17:55:14.206949 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:14.206858 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:14.207364 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:14.206999 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rd5vp" podUID="cd44a874-643c-4efc-b8b4-b92449f574e5" Jul 15 17:55:14.207803 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:14.207463 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:14.207803 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:14.207584 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvtvh" podUID="002a3085-9fdc-414b-bbf4-4be0580cf88f" Jul 15 17:55:14.207803 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:14.207661 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:14.207803 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:14.207734 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6jz77" podUID="12a379a8-7075-4528-a2c5-9d2750f9e71c" Jul 15 17:55:16.208186 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:16.208157 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:16.208622 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:16.208206 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:16.208622 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:16.208274 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:16.208622 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:16.208311 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvtvh" podUID="002a3085-9fdc-414b-bbf4-4be0580cf88f" Jul 15 17:55:16.208622 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:16.208398 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rd5vp" podUID="cd44a874-643c-4efc-b8b4-b92449f574e5" Jul 15 17:55:16.208622 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:16.208488 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6jz77" podUID="12a379a8-7075-4528-a2c5-9d2750f9e71c" Jul 15 17:55:18.206093 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:18.205385 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:18.206093 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:18.205445 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:18.206093 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:18.205530 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6jz77" podUID="12a379a8-7075-4528-a2c5-9d2750f9e71c" Jul 15 17:55:18.206093 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:18.205900 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:18.206093 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:18.205967 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rd5vp" podUID="cd44a874-643c-4efc-b8b4-b92449f574e5" Jul 15 17:55:18.206700 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:18.206444 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvtvh" podUID="002a3085-9fdc-414b-bbf4-4be0580cf88f" Jul 15 17:55:19.924396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:19.924354 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b54p\" (UniqueName: \"kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p\") pod \"network-check-target-rd5vp\" (UID: \"cd44a874-643c-4efc-b8b4-b92449f574e5\") " pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:19.924396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:19.924397 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs\") pod \"network-metrics-daemon-fvtvh\" (UID: \"002a3085-9fdc-414b-bbf4-4be0580cf88f\") " pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:19.924915 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:19.924436 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret\") pod \"global-pull-secret-syncer-6jz77\" (UID: \"12a379a8-7075-4528-a2c5-9d2750f9e71c\") " pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:19.924915 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:19.924509 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 17:55:19.924915 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:19.924532 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 17:55:19.924915 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:19.924534 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 17:55:19.924915 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:19.924539 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 17:55:19.924915 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:19.924554 2551 projected.go:196] Error preparing data for projected volume kube-api-access-7b54p for pod openshift-network-diagnostics/network-check-target-rd5vp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 17:55:19.924915 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:19.924591 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret podName:12a379a8-7075-4528-a2c5-9d2750f9e71c nodeName:}" failed. No retries permitted until 2026-07-15 17:55:35.924571687 +0000 UTC m=+34.259879987 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret") pod "global-pull-secret-syncer-6jz77" (UID: "12a379a8-7075-4528-a2c5-9d2750f9e71c") : object "kube-system"/"original-pull-secret" not registered Jul 15 17:55:19.924915 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:19.924610 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs podName:002a3085-9fdc-414b-bbf4-4be0580cf88f nodeName:}" failed. No retries permitted until 2026-07-15 17:55:35.924601197 +0000 UTC m=+34.259909478 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs") pod "network-metrics-daemon-fvtvh" (UID: "002a3085-9fdc-414b-bbf4-4be0580cf88f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 17:55:19.924915 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:19.924622 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p podName:cd44a874-643c-4efc-b8b4-b92449f574e5 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:35.924615917 +0000 UTC m=+34.259924197 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-7b54p" (UniqueName: "kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p") pod "network-check-target-rd5vp" (UID: "cd44a874-643c-4efc-b8b4-b92449f574e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 17:55:20.205628 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:20.205546 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:20.205787 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:20.205546 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:20.205787 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:20.205546 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:20.205787 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:20.205762 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6jz77" podUID="12a379a8-7075-4528-a2c5-9d2750f9e71c" Jul 15 17:55:20.205942 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:20.205798 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rd5vp" podUID="cd44a874-643c-4efc-b8b4-b92449f574e5" Jul 15 17:55:20.205942 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:20.205717 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvtvh" podUID="002a3085-9fdc-414b-bbf4-4be0580cf88f" Jul 15 17:55:22.206380 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:22.206346 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:22.206774 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:22.206448 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rd5vp" podUID="cd44a874-643c-4efc-b8b4-b92449f574e5" Jul 15 17:55:22.206774 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:22.206465 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:22.206774 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:22.206614 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvtvh" podUID="002a3085-9fdc-414b-bbf4-4be0580cf88f" Jul 15 17:55:22.206774 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:22.206679 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:22.206774 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:22.206739 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6jz77" podUID="12a379a8-7075-4528-a2c5-9d2750f9e71c" Jul 15 17:55:24.205930 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:24.205895 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:24.205930 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:24.205935 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:24.206365 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:24.205892 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:24.206365 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:24.206024 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rd5vp" podUID="cd44a874-643c-4efc-b8b4-b92449f574e5" Jul 15 17:55:24.206365 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:24.206129 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvtvh" podUID="002a3085-9fdc-414b-bbf4-4be0580cf88f" Jul 15 17:55:24.206365 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:24.206222 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6jz77" podUID="12a379a8-7075-4528-a2c5-9d2750f9e71c" Jul 15 17:55:25.352810 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.352306 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-h74qh" event={"ID":"3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da","Type":"ContainerStarted","Data":"cd773b31e31f98c6b57308c4b60908011c52914fa0bbd90d1175212e67ad27b5"} Jul 15 17:55:25.354863 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.354831 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-zskmc" event={"ID":"b6285ed2-035b-45f1-9ca7-52023153a5e9","Type":"ContainerStarted","Data":"c7f3bbbf217338f73cbafd832255de27032556bd17372bc3d318ba694958b6ff"} Jul 15 17:55:25.357027 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.357001 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-vnm66" event={"ID":"3bd1d559-f9db-4a45-916c-bb693f1a3c52","Type":"ContainerStarted","Data":"b1d7e71a39667682d53aeb6519abaf56b728f23a99d67a6d3b83ccdd757d76e3"} Jul 15 17:55:25.358743 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.358719 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" event={"ID":"4bb74316-2275-47ed-bd0b-6a64d3777082","Type":"ContainerStarted","Data":"41ddd53b77f574e2c925aa2de2c2d864f91a7e6dcca4aede6c4cad875163dc0d"} Jul 15 17:55:25.361579 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.361543 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-25.ec2.internal" event={"ID":"713382c42dd951a131036f50252694db","Type":"ContainerStarted","Data":"ed7d54b952e1cc63a923ae827661d9daa44f12eb1a2fcad10f89ce9141b33882"} Jul 15 17:55:25.363461 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.363403 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-xhh8c" event={"ID":"d1ec3250-3d3a-4901-a5e1-8bb3d3e6a0ae","Type":"ContainerStarted","Data":"94b01f9140606872d541248c71788c9663202b68ab64a2ec9de153d061be3399"} Jul 15 17:55:25.365065 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.365045 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" event={"ID":"24b3fd3f-7151-4359-9635-9837155eabff","Type":"ContainerStarted","Data":"0374c592537de79070a1f8195d8a071ac81c161633e4275fdf0d0e75eff140c8"} Jul 15 17:55:25.366487 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.366463 2551 generic.go:356] "Generic (PLEG): container finished" podID="a40a06d0-9182-44da-8229-fec808a929a1" containerID="ed7102419eed1b5f37c23f7bcd4bcfa4eb7f839d87c251239f0b59095248cdc4" exitCode=0 Jul 15 17:55:25.366583 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.366540 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7z26z" event={"ID":"a40a06d0-9182-44da-8229-fec808a929a1","Type":"ContainerDied","Data":"ed7102419eed1b5f37c23f7bcd4bcfa4eb7f839d87c251239f0b59095248cdc4"} Jul 15 17:55:25.367219 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.367114 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-128-25.ec2.internal" podStartSLOduration=21.367097214 podStartE2EDuration="21.367097214s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 17:55:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:55:06.333152733 +0000 UTC m=+4.668461043" watchObservedRunningTime="2026-07-15 17:55:25.367097214 +0000 UTC m=+23.702405518" Jul 15 17:55:25.367369 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.367327 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-h74qh" podStartSLOduration=2.334236067 podStartE2EDuration="22.367321544s" totalImagesPullingTime="20.033085477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:55:25.366464972 +0000 UTC m=+23.701773275" watchObservedRunningTime="2026-07-15 17:55:25.367321544 +0000 UTC m=+23.702629845" Jul 15 17:55:25.369631 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.369611 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwzkz_ff5857c7-97d1-467d-8b6f-8691f7e0d6dc/ovn-acl-logging/0.log" Jul 15 17:55:25.369999 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.369982 2551 generic.go:356] "Generic (PLEG): container finished" podID="ff5857c7-97d1-467d-8b6f-8691f7e0d6dc" containerID="81f0c1623e73f8a80fdf24dde7b974a712c9781a2037b88e385d5f0a94535ed1" exitCode=1 Jul 15 17:55:25.370074 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.370009 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" event={"ID":"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc","Type":"ContainerStarted","Data":"7a967701b3ca2a43084c063a5dbe9c5c19f6368bfa99a0faaa750d1f97e70439"} Jul 15 17:55:25.370074 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.370066 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" event={"ID":"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc","Type":"ContainerStarted","Data":"f8fadfac31b65e16289299912f8d0213279a3f7ddcb25363d8e5547b1ae4583a"} Jul 15 17:55:25.370166 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.370098 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" event={"ID":"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc","Type":"ContainerStarted","Data":"4521c30c54191fff164a087eee406d23896f04789c0ee132c14623648b1b23dc"} Jul 15 17:55:25.370166 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.370138 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" event={"ID":"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc","Type":"ContainerDied","Data":"81f0c1623e73f8a80fdf24dde7b974a712c9781a2037b88e385d5f0a94535ed1"} Jul 15 17:55:25.370231 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.370168 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" event={"ID":"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc","Type":"ContainerStarted","Data":"e22bbf85049310812e10b56f05cab5d5084a5078117e2b215b8b1d72fc60818f"} Jul 15 17:55:25.379401 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.379362 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-128-25.ec2.internal" podStartSLOduration=21.379350016 podStartE2EDuration="21.379350016s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 17:55:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:55:25.378757153 +0000 UTC m=+23.714065454" watchObservedRunningTime="2026-07-15 17:55:25.379350016 +0000 UTC m=+23.714658317" Jul 15 17:55:25.386063 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.386043 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-h74qh" Jul 15 17:55:25.386594 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.386580 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-h74qh" Jul 15 17:55:25.396042 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.396009 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-zskmc" podStartSLOduration=2.361046421 podStartE2EDuration="22.395997968s" totalImagesPullingTime="20.034951547s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 17:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:55:25.395859935 +0000 UTC m=+23.731168236" watchObservedRunningTime="2026-07-15 17:55:25.395997968 +0000 UTC m=+23.731306268" Jul 15 17:55:25.414190 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.414157 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-vnm66" podStartSLOduration=2.324072823 podStartE2EDuration="22.4141462s" totalImagesPullingTime="20.090073377s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 17:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:55:25.413904986 +0000 UTC m=+23.749213286" watchObservedRunningTime="2026-07-15 17:55:25.4141462 +0000 UTC m=+23.749454500" Jul 15 17:55:25.432459 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.432400 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-pfj4m" podStartSLOduration=2.370855266 podStartE2EDuration="22.432379918s" totalImagesPullingTime="20.061524652s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 17:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:55:25.431817058 +0000 UTC m=+23.767125359" watchObservedRunningTime="2026-07-15 17:55:25.432379918 +0000 UTC m=+23.767688221" Jul 15 17:55:25.448614 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:25.448558 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-xhh8c" podStartSLOduration=6.247290257 podStartE2EDuration="22.448538753s" totalImagesPullingTime="16.201248496s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 17:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:55:25.447788248 +0000 UTC m=+23.783096550" watchObservedRunningTime="2026-07-15 17:55:25.448538753 +0000 UTC m=+23.783847058" Jul 15 17:55:26.057268 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:26.057216 2551 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 17:55:26.135699 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:26.135574 2551 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T17:55:26.057241291Z","UUID":"de55d2ec-8c16-4e0f-8d3f-5a69a8623d8b","Handler":null,"Name":"","Endpoint":""} Jul 15 17:55:26.139283 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:26.139261 2551 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 17:55:26.139397 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:26.139303 2551 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 17:55:26.205731 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:26.205643 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:26.205880 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:26.205643 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:26.205880 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:26.205792 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvtvh" podUID="002a3085-9fdc-414b-bbf4-4be0580cf88f" Jul 15 17:55:26.205880 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:26.205828 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:26.206029 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:26.205901 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rd5vp" podUID="cd44a874-643c-4efc-b8b4-b92449f574e5" Jul 15 17:55:26.206029 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:26.205985 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6jz77" podUID="12a379a8-7075-4528-a2c5-9d2750f9e71c" Jul 15 17:55:26.375396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:26.375369 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwzkz_ff5857c7-97d1-467d-8b6f-8691f7e0d6dc/ovn-acl-logging/0.log" Jul 15 17:55:26.375895 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:26.375708 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" event={"ID":"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc","Type":"ContainerStarted","Data":"e46c25c8d0c898e8d2fbd0e76929e988814d0bec2b12c55e14579982c487fdee"} Jul 15 17:55:26.377049 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:26.377024 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-lvsxh" event={"ID":"1c3d0c9d-5638-4fb5-86f7-dd8fa6f6cb37","Type":"ContainerStarted","Data":"cd241a24aeef2ee4d843fa8df9a5936f59b613cbaa9756d8e6652c18b63c88de"} Jul 15 17:55:26.378553 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:26.378534 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" event={"ID":"24b3fd3f-7151-4359-9635-9837155eabff","Type":"ContainerStarted","Data":"45a16805e1521031cb97ac5ac579b9335ff280711dc8f79f9dabe77d37eee473"} Jul 15 17:55:26.378920 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:26.378906 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-h74qh" Jul 15 17:55:26.379422 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:26.379407 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-h74qh" Jul 15 17:55:26.390834 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:26.390785 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-lvsxh" podStartSLOduration=3.350881024 podStartE2EDuration="23.390769846s" totalImagesPullingTime="20.039888822s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 17:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:55:26.390344601 +0000 UTC m=+24.725652900" watchObservedRunningTime="2026-07-15 17:55:26.390769846 +0000 UTC m=+24.726078150" Jul 15 17:55:27.383407 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:27.383139 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" event={"ID":"24b3fd3f-7151-4359-9635-9837155eabff","Type":"ContainerStarted","Data":"221a109ce05fabd06f7f499b269e8adb3462c28a9a21c6f2f8cb70407d68ef4e"} Jul 15 17:55:27.407599 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:27.407550 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-rb962" podStartSLOduration=2.19359969 podStartE2EDuration="24.407534605s" totalImagesPullingTime="22.213934915s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 17:55:03 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:55:27.407291432 +0000 UTC m=+25.742599734" watchObservedRunningTime="2026-07-15 17:55:27.407534605 +0000 UTC m=+25.742842905" Jul 15 17:55:28.205127 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:28.205089 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:28.205347 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:28.205101 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:28.205347 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:28.205230 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:28.205347 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:28.205230 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvtvh" podUID="002a3085-9fdc-414b-bbf4-4be0580cf88f" Jul 15 17:55:28.205347 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:28.205314 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6jz77" podUID="12a379a8-7075-4528-a2c5-9d2750f9e71c" Jul 15 17:55:28.205549 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:28.205394 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rd5vp" podUID="cd44a874-643c-4efc-b8b4-b92449f574e5" Jul 15 17:55:28.388843 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:28.388817 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwzkz_ff5857c7-97d1-467d-8b6f-8691f7e0d6dc/ovn-acl-logging/0.log" Jul 15 17:55:28.389382 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:28.389275 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" event={"ID":"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc","Type":"ContainerStarted","Data":"54392155ccc02639541fdbe427e3bf25ab19ddf2f389eaa4d37da8469ecfc786"} Jul 15 17:55:30.205725 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:30.205630 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:30.205725 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:30.205650 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:30.206378 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:30.205767 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6jz77" podUID="12a379a8-7075-4528-a2c5-9d2750f9e71c" Jul 15 17:55:30.206378 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:30.205807 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rd5vp" podUID="cd44a874-643c-4efc-b8b4-b92449f574e5" Jul 15 17:55:30.206378 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:30.205838 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:30.206378 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:30.205933 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvtvh" podUID="002a3085-9fdc-414b-bbf4-4be0580cf88f" Jul 15 17:55:30.395524 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:30.395496 2551 generic.go:356] "Generic (PLEG): container finished" podID="a40a06d0-9182-44da-8229-fec808a929a1" containerID="f213942699f6f8d27dd64aeb784d30418e7f3ede153f8abaefe33fde314a89be" exitCode=0 Jul 15 17:55:30.395688 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:30.395574 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7z26z" event={"ID":"a40a06d0-9182-44da-8229-fec808a929a1","Type":"ContainerDied","Data":"f213942699f6f8d27dd64aeb784d30418e7f3ede153f8abaefe33fde314a89be"} Jul 15 17:55:30.399109 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:30.399091 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwzkz_ff5857c7-97d1-467d-8b6f-8691f7e0d6dc/ovn-acl-logging/0.log" Jul 15 17:55:30.399435 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:30.399415 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" event={"ID":"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc","Type":"ContainerStarted","Data":"f5941206b2f7eaad296658464a2b3c632dbe5d4df7c8f20e4842a834a41fbeef"} Jul 15 17:55:30.399650 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:30.399632 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:30.399750 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:30.399731 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:30.399796 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:30.399779 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:30.399842 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:30.399790 2551 scope.go:117] "RemoveContainer" containerID="81f0c1623e73f8a80fdf24dde7b974a712c9781a2037b88e385d5f0a94535ed1" Jul 15 17:55:30.415782 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:30.415764 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:30.416140 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:30.416125 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:55:31.405578 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:31.405552 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwzkz_ff5857c7-97d1-467d-8b6f-8691f7e0d6dc/ovn-acl-logging/0.log" Jul 15 17:55:31.406123 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:31.405987 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" event={"ID":"ff5857c7-97d1-467d-8b6f-8691f7e0d6dc","Type":"ContainerStarted","Data":"1e1544f4d79fec05762adc886fff83c9c09bab35acbee56f9ff55b9a0bd6e260"} Jul 15 17:55:31.436100 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:31.436055 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" podStartSLOduration=8.306226515 podStartE2EDuration="28.436036876s" totalImagesPullingTime="20.129810361s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 17:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:55:31.432306808 +0000 UTC m=+29.767615109" watchObservedRunningTime="2026-07-15 17:55:31.436036876 +0000 UTC m=+29.771345194" Jul 15 17:55:31.718407 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:31.718379 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6jz77"] Jul 15 17:55:31.718543 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:31.718481 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:31.718589 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:31.718558 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6jz77" podUID="12a379a8-7075-4528-a2c5-9d2750f9e71c" Jul 15 17:55:31.721802 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:31.721764 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fvtvh"] Jul 15 17:55:31.721936 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:31.721881 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:31.722027 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:31.721986 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvtvh" podUID="002a3085-9fdc-414b-bbf4-4be0580cf88f" Jul 15 17:55:31.722392 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:31.722364 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rd5vp"] Jul 15 17:55:31.722498 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:31.722452 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:31.722561 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:31.722538 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rd5vp" podUID="cd44a874-643c-4efc-b8b4-b92449f574e5" Jul 15 17:55:32.410795 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:32.410552 2551 generic.go:356] "Generic (PLEG): container finished" podID="a40a06d0-9182-44da-8229-fec808a929a1" containerID="7325ecc4a513e6ae7fbc1aa033e98c451e9c006b9a9163b55fb72160dd01e747" exitCode=0 Jul 15 17:55:32.411250 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:32.410632 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7z26z" event={"ID":"a40a06d0-9182-44da-8229-fec808a929a1","Type":"ContainerDied","Data":"7325ecc4a513e6ae7fbc1aa033e98c451e9c006b9a9163b55fb72160dd01e747"} Jul 15 17:55:33.205213 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:33.205173 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:33.205213 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:33.205213 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:33.205447 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:33.205213 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:33.205447 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:33.205306 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvtvh" podUID="002a3085-9fdc-414b-bbf4-4be0580cf88f" Jul 15 17:55:33.205447 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:33.205400 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rd5vp" podUID="cd44a874-643c-4efc-b8b4-b92449f574e5" Jul 15 17:55:33.205573 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:33.205486 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6jz77" podUID="12a379a8-7075-4528-a2c5-9d2750f9e71c" Jul 15 17:55:34.418018 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:34.417990 2551 generic.go:356] "Generic (PLEG): container finished" podID="a40a06d0-9182-44da-8229-fec808a929a1" containerID="c8d071a7d6a3697f0086bd3d94b9eefedd436c0b11afa4bc6b8c3cd7be57dbb3" exitCode=0 Jul 15 17:55:34.418599 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:34.418046 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7z26z" event={"ID":"a40a06d0-9182-44da-8229-fec808a929a1","Type":"ContainerDied","Data":"c8d071a7d6a3697f0086bd3d94b9eefedd436c0b11afa4bc6b8c3cd7be57dbb3"} Jul 15 17:55:35.205660 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:35.205628 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:35.205660 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:35.205660 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:35.205909 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:35.205660 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:35.205909 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:35.205769 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvtvh" podUID="002a3085-9fdc-414b-bbf4-4be0580cf88f" Jul 15 17:55:35.205909 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:35.205853 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rd5vp" podUID="cd44a874-643c-4efc-b8b4-b92449f574e5" Jul 15 17:55:35.205909 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:35.205902 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6jz77" podUID="12a379a8-7075-4528-a2c5-9d2750f9e71c" Jul 15 17:55:35.940210 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:35.940167 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret\") pod \"global-pull-secret-syncer-6jz77\" (UID: \"12a379a8-7075-4528-a2c5-9d2750f9e71c\") " pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:35.940854 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:35.940254 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b54p\" (UniqueName: \"kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p\") pod \"network-check-target-rd5vp\" (UID: \"cd44a874-643c-4efc-b8b4-b92449f574e5\") " pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:35.940854 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:35.940285 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs\") pod \"network-metrics-daemon-fvtvh\" (UID: \"002a3085-9fdc-414b-bbf4-4be0580cf88f\") " pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:35.940854 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:35.940362 2551 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 17:55:35.940854 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:35.940404 2551 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 17:55:35.940854 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:35.940422 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 17:55:35.940854 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:35.940439 2551 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 17:55:35.940854 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:35.940442 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret podName:12a379a8-7075-4528-a2c5-9d2750f9e71c nodeName:}" failed. No retries permitted until 2026-07-15 17:56:07.940423288 +0000 UTC m=+66.275731582 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret") pod "global-pull-secret-syncer-6jz77" (UID: "12a379a8-7075-4528-a2c5-9d2750f9e71c") : object "kube-system"/"original-pull-secret" not registered Jul 15 17:55:35.940854 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:35.940453 2551 projected.go:196] Error preparing data for projected volume kube-api-access-7b54p for pod openshift-network-diagnostics/network-check-target-rd5vp: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 17:55:35.940854 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:35.940462 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs podName:002a3085-9fdc-414b-bbf4-4be0580cf88f nodeName:}" failed. No retries permitted until 2026-07-15 17:56:07.940452156 +0000 UTC m=+66.275760444 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs") pod "network-metrics-daemon-fvtvh" (UID: "002a3085-9fdc-414b-bbf4-4be0580cf88f") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 17:55:35.940854 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:35.940494 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p podName:cd44a874-643c-4efc-b8b4-b92449f574e5 nodeName:}" failed. No retries permitted until 2026-07-15 17:56:07.940485292 +0000 UTC m=+66.275793588 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-7b54p" (UniqueName: "kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p") pod "network-check-target-rd5vp" (UID: "cd44a874-643c-4efc-b8b4-b92449f574e5") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 17:55:37.205478 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:37.205451 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:37.205478 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:37.205475 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:37.206068 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:37.205481 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:37.206068 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:37.205569 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-6jz77" podUID="12a379a8-7075-4528-a2c5-9d2750f9e71c" Jul 15 17:55:37.206068 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:37.205649 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-rd5vp" podUID="cd44a874-643c-4efc-b8b4-b92449f574e5" Jul 15 17:55:37.206068 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:37.205750 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-fvtvh" podUID="002a3085-9fdc-414b-bbf4-4be0580cf88f" Jul 15 17:55:38.511793 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.511764 2551 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-128-25.ec2.internal" event="NodeReady" Jul 15 17:55:38.512154 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.511882 2551 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 17:55:38.545555 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.545524 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9"] Jul 15 17:55:38.562408 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.562386 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-jrxtm"] Jul 15 17:55:38.562527 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.562512 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9" Jul 15 17:55:38.564806 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.564779 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-g2fx7\"" Jul 15 17:55:38.564946 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.564849 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 17:55:38.565605 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.565584 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 15 17:55:38.565742 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.565632 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 17:55:38.565742 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.565636 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 15 17:55:38.577092 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.577068 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-59dcc44f8-b45fj"] Jul 15 17:55:38.577184 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.577168 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" Jul 15 17:55:38.581309 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.581288 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 17:55:38.581464 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.581288 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 15 17:55:38.581788 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.581758 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-7zsxr\"" Jul 15 17:55:38.582848 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.582832 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 15 17:55:38.585777 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.585757 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 17:55:38.596947 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.596923 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-7d45cd845c-n5nn5"] Jul 15 17:55:38.597556 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.597532 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:38.600997 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.600980 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 15 17:55:38.601294 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.601275 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 15 17:55:38.601398 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.601038 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 17:55:38.601496 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.601105 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 15 17:55:38.601722 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.601705 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-njx54\"" Jul 15 17:55:38.601822 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.601755 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 17:55:38.601920 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.601905 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 15 17:55:38.603327 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.603295 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 15 17:55:38.611211 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.611185 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9"] Jul 15 17:55:38.611304 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.611222 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-jrxtm"] Jul 15 17:55:38.611304 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.611243 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59dcc44f8-b45fj"] Jul 15 17:55:38.611304 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.611259 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9pdlp"] Jul 15 17:55:38.611304 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.611300 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.613241 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.613216 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 17:55:38.613381 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.613247 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 17:55:38.613381 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.613276 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 17:55:38.613538 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.613522 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7b5g7\"" Jul 15 17:55:38.618371 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.618349 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 17:55:38.627463 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.627447 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9pdlp" Jul 15 17:55:38.627528 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.627460 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-sk64p"] Jul 15 17:55:38.629614 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.629595 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 15 17:55:38.629614 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.629614 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 15 17:55:38.629892 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.629875 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 15 17:55:38.629966 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.629879 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-ln7kf\"" Jul 15 17:55:38.630180 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.630164 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 15 17:55:38.639871 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.639854 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cbzbw"] Jul 15 17:55:38.639969 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.639955 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sk64p" Jul 15 17:55:38.641897 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.641872 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 17:55:38.641897 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.641882 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 17:55:38.642042 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.641960 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5g88f\"" Jul 15 17:55:38.651930 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.651911 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bv8hk"] Jul 15 17:55:38.652051 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.652026 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cbzbw" Jul 15 17:55:38.653981 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.653961 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 15 17:55:38.654069 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.654016 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 15 17:55:38.654069 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.654023 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-45zpz\"" Jul 15 17:55:38.660154 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.660135 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4knf9\" (UID: \"0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9" Jul 15 17:55:38.660265 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.660188 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2xddg\" (UniqueName: \"kubernetes.io/projected/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-kube-api-access-2xddg\") pod \"cluster-monitoring-operator-5f7f494dd4-4knf9\" (UID: \"0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9" Jul 15 17:55:38.660265 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.660237 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-jrxtm\" (UID: \"d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4\") " pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" Jul 15 17:55:38.660265 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.660258 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4-serving-cert\") pod \"insights-operator-68d9dd94cf-jrxtm\" (UID: \"d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4\") " pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" Jul 15 17:55:38.660402 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.660279 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4-tmp\") pod \"insights-operator-68d9dd94cf-jrxtm\" (UID: \"d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4\") " pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" Jul 15 17:55:38.660402 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.660314 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4-snapshots\") pod \"insights-operator-68d9dd94cf-jrxtm\" (UID: \"d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4\") " pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" Jul 15 17:55:38.660495 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.660404 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-4knf9\" (UID: \"0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9" Jul 15 17:55:38.660495 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.660438 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rq47k\" (UniqueName: \"kubernetes.io/projected/d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4-kube-api-access-rq47k\") pod \"insights-operator-68d9dd94cf-jrxtm\" (UID: \"d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4\") " pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" Jul 15 17:55:38.660582 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.660504 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-jrxtm\" (UID: \"d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4\") " pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" Jul 15 17:55:38.664495 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.664475 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-r97xm"] Jul 15 17:55:38.664593 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.664577 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bv8hk" Jul 15 17:55:38.666284 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.666264 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 15 17:55:38.666358 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.666268 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-tgxzj\"" Jul 15 17:55:38.666358 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.666272 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 15 17:55:38.666593 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.666578 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 15 17:55:38.676714 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.676697 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m9qlq"] Jul 15 17:55:38.676776 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.676736 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r97xm" Jul 15 17:55:38.678516 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.678500 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 17:55:38.678516 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.678515 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 17:55:38.678693 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.678528 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-8jgv5\"" Jul 15 17:55:38.678693 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.678532 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 17:55:38.683272 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.683255 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-7866497494-b89jb"] Jul 15 17:55:38.683409 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.683396 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m9qlq" Jul 15 17:55:38.685115 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.685093 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 15 17:55:38.685488 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.685469 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-tplk9\"" Jul 15 17:55:38.685565 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.685520 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 15 17:55:38.685678 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.685634 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 15 17:55:38.687692 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.685811 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 15 17:55:38.695753 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.695733 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-6cxp6"] Jul 15 17:55:38.695896 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.695882 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-b89jb" Jul 15 17:55:38.697571 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.697548 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 15 17:55:38.697920 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.697903 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 15 17:55:38.697920 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.697915 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 15 17:55:38.698099 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.697916 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 15 17:55:38.698099 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.698021 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-sfflv\"" Jul 15 17:55:38.703468 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.703449 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 15 17:55:38.709872 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.709854 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d45cd845c-n5nn5"] Jul 15 17:55:38.709964 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.709880 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cbzbw"] Jul 15 17:55:38.709964 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.709894 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9pdlp"] Jul 15 17:55:38.709964 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.709911 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bv8hk"] Jul 15 17:55:38.709964 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.709927 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r97xm"] Jul 15 17:55:38.709964 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.709938 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sk64p"] Jul 15 17:55:38.709964 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.709952 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-6cxp6"] Jul 15 17:55:38.709964 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.709963 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-b89jb"] Jul 15 17:55:38.710272 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.709974 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m9qlq"] Jul 15 17:55:38.710272 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.709973 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6cxp6" Jul 15 17:55:38.711823 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.711808 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 17:55:38.711994 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.711976 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 17:55:38.712052 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.711981 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-sfqkf\"" Jul 15 17:55:38.758634 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.758611 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:38.761880 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.761756 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2688c99-ce3c-4720-8c2c-11043d337b49-ca-trust-extracted\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.761880 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.761805 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-default-certificate\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:38.761880 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.761840 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-js2j6\" (UniqueName: \"kubernetes.io/projected/65bf8fa0-4655-4e61-8b0e-def41e359744-kube-api-access-js2j6\") pod \"cluster-samples-operator-65db858894-bv8hk\" (UID: \"65bf8fa0-4655-4e61-8b0e-def41e359744\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bv8hk" Jul 15 17:55:38.762081 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.761881 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-config-volume\") pod \"dns-default-sk64p\" (UID: \"64a2bcb4-7c5f-4859-9a19-3de5ec1af440\") " pod="openshift-dns/dns-default-sk64p" Jul 15 17:55:38.762081 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.761908 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-metrics-certs\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:38.762081 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.761939 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-jrxtm\" (UID: \"d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4\") " pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" Jul 15 17:55:38.762081 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.761965 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65bf8fa0-4655-4e61-8b0e-def41e359744-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bv8hk\" (UID: \"65bf8fa0-4655-4e61-8b0e-def41e359744\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bv8hk" Jul 15 17:55:38.762081 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.761993 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2kz8g\" (UniqueName: \"kubernetes.io/projected/bd7b71a8-c2dc-4c96-998c-2e4f1924c746-kube-api-access-2kz8g\") pod \"kube-storage-version-migrator-operator-799cb7f958-9pdlp\" (UID: \"bd7b71a8-c2dc-4c96-998c-2e4f1924c746\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9pdlp" Jul 15 17:55:38.762081 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.762018 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4-tmp\") pod \"insights-operator-68d9dd94cf-jrxtm\" (UID: \"d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4\") " pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" Jul 15 17:55:38.762081 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.762058 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9lgc\" (UniqueName: \"kubernetes.io/projected/fb5910a7-337b-4b1a-bba2-8ca95b40911e-kube-api-access-g9lgc\") pod \"ingress-canary-r97xm\" (UID: \"fb5910a7-337b-4b1a-bba2-8ca95b40911e\") " pod="openshift-ingress-canary/ingress-canary-r97xm" Jul 15 17:55:38.762421 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.762119 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-stats-auth\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:38.762421 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.762150 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4-snapshots\") pod \"insights-operator-68d9dd94cf-jrxtm\" (UID: \"d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4\") " pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" Jul 15 17:55:38.762421 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.762173 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-tmp-dir\") pod \"dns-default-sk64p\" (UID: \"64a2bcb4-7c5f-4859-9a19-3de5ec1af440\") " pod="openshift-dns/dns-default-sk64p" Jul 15 17:55:38.762759 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.762740 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4-snapshots\") pod \"insights-operator-68d9dd94cf-jrxtm\" (UID: \"d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4\") " pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" Jul 15 17:55:38.762759 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.762744 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4-tmp\") pod \"insights-operator-68d9dd94cf-jrxtm\" (UID: \"d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4\") " pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" Jul 15 17:55:38.762877 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.762208 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-certificates\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.762877 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.762807 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-jrxtm\" (UID: \"d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4\") " pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" Jul 15 17:55:38.762877 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.762823 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2688c99-ce3c-4720-8c2c-11043d337b49-trusted-ca\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.762877 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.762841 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2xddg\" (UniqueName: \"kubernetes.io/projected/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-kube-api-access-2xddg\") pod \"cluster-monitoring-operator-5f7f494dd4-4knf9\" (UID: \"0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9" Jul 15 17:55:38.762877 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.762860 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-btq8q\" (UniqueName: \"kubernetes.io/projected/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-kube-api-access-btq8q\") pod \"dns-default-sk64p\" (UID: \"64a2bcb4-7c5f-4859-9a19-3de5ec1af440\") " pod="openshift-dns/dns-default-sk64p" Jul 15 17:55:38.763093 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.762881 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4knf9\" (UID: \"0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9" Jul 15 17:55:38.763093 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.762897 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pfmln\" (UniqueName: \"kubernetes.io/projected/d7bface4-5e90-4274-806e-b1b8fea7e0e3-kube-api-access-pfmln\") pod \"volume-data-source-validator-78495597f6-cbzbw\" (UID: \"d7bface4-5e90-4274-806e-b1b8fea7e0e3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cbzbw" Jul 15 17:55:38.763093 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.762914 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2688c99-ce3c-4720-8c2c-11043d337b49-image-registry-private-configuration\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.763093 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.762939 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bd7b71a8-c2dc-4c96-998c-2e4f1924c746-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-9pdlp\" (UID: \"bd7b71a8-c2dc-4c96-998c-2e4f1924c746\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9pdlp" Jul 15 17:55:38.763093 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.762954 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4-serving-cert\") pod \"insights-operator-68d9dd94cf-jrxtm\" (UID: \"d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4\") " pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" Jul 15 17:55:38.763093 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.762968 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bd7b71a8-c2dc-4c96-998c-2e4f1924c746-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-9pdlp\" (UID: \"bd7b71a8-c2dc-4c96-998c-2e4f1924c746\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9pdlp" Jul 15 17:55:38.763093 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.762984 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-metrics-tls\") pod \"dns-default-sk64p\" (UID: \"64a2bcb4-7c5f-4859-9a19-3de5ec1af440\") " pod="openshift-dns/dns-default-sk64p" Jul 15 17:55:38.763093 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.762981 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4-trusted-ca-bundle\") pod \"insights-operator-68d9dd94cf-jrxtm\" (UID: \"d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4\") " pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" Jul 15 17:55:38.763093 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.762997 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb5910a7-337b-4b1a-bba2-8ca95b40911e-cert\") pod \"ingress-canary-r97xm\" (UID: \"fb5910a7-337b-4b1a-bba2-8ca95b40911e\") " pod="openshift-ingress-canary/ingress-canary-r97xm" Jul 15 17:55:38.763093 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.763012 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.763547 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.763163 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4-service-ca-bundle\") pod \"insights-operator-68d9dd94cf-jrxtm\" (UID: \"d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4\") " pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" Jul 15 17:55:38.763547 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.763250 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2688c99-ce3c-4720-8c2c-11043d337b49-installation-pull-secrets\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.763547 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:38.763276 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 17:55:38.763547 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.763292 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95759e5c-f715-4172-a6d2-28c19c18c556-service-ca-bundle\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:38.763547 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:38.763355 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-cluster-monitoring-operator-tls podName:0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b nodeName:}" failed. No retries permitted until 2026-07-15 17:55:39.263338433 +0000 UTC m=+37.598646720 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4knf9" (UID: "0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b") : secret "cluster-monitoring-operator-tls" not found Jul 15 17:55:38.763547 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.763407 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-4knf9\" (UID: \"0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9" Jul 15 17:55:38.763547 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.763430 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rq47k\" (UniqueName: \"kubernetes.io/projected/d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4-kube-api-access-rq47k\") pod \"insights-operator-68d9dd94cf-jrxtm\" (UID: \"d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4\") " pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" Jul 15 17:55:38.763897 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.763750 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8p95j\" (UniqueName: \"kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-kube-api-access-8p95j\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.763897 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.763800 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxr27\" (UniqueName: \"kubernetes.io/projected/95759e5c-f715-4172-a6d2-28c19c18c556-kube-api-access-kxr27\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:38.763897 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.763828 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-bound-sa-token\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.764308 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.764088 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-telemetry-config\") pod \"cluster-monitoring-operator-5f7f494dd4-4knf9\" (UID: \"0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9" Jul 15 17:55:38.767340 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.767316 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4-serving-cert\") pod \"insights-operator-68d9dd94cf-jrxtm\" (UID: \"d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4\") " pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" Jul 15 17:55:38.772341 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.771569 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rq47k\" (UniqueName: \"kubernetes.io/projected/d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4-kube-api-access-rq47k\") pod \"insights-operator-68d9dd94cf-jrxtm\" (UID: \"d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4\") " pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" Jul 15 17:55:38.773025 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.773000 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2xddg\" (UniqueName: \"kubernetes.io/projected/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-kube-api-access-2xddg\") pod \"cluster-monitoring-operator-5f7f494dd4-4knf9\" (UID: \"0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9" Jul 15 17:55:38.864808 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.864783 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bd7b71a8-c2dc-4c96-998c-2e4f1924c746-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-9pdlp\" (UID: \"bd7b71a8-c2dc-4c96-998c-2e4f1924c746\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9pdlp" Jul 15 17:55:38.864930 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.864815 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bd7b71a8-c2dc-4c96-998c-2e4f1924c746-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-9pdlp\" (UID: \"bd7b71a8-c2dc-4c96-998c-2e4f1924c746\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9pdlp" Jul 15 17:55:38.864930 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.864841 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f00291c5-c987-4f12-a396-29617c98c495-serving-cert\") pod \"service-ca-operator-7695fc6c8c-m9qlq\" (UID: \"f00291c5-c987-4f12-a396-29617c98c495\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m9qlq" Jul 15 17:55:38.864930 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.864865 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f5wfl\" (UniqueName: \"kubernetes.io/projected/67315a2e-51bd-4280-9821-5a6fd7b06df7-kube-api-access-f5wfl\") pod \"console-operator-7866497494-b89jb\" (UID: \"67315a2e-51bd-4280-9821-5a6fd7b06df7\") " pod="openshift-console-operator/console-operator-7866497494-b89jb" Jul 15 17:55:38.865082 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.864964 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-metrics-tls\") pod \"dns-default-sk64p\" (UID: \"64a2bcb4-7c5f-4859-9a19-3de5ec1af440\") " pod="openshift-dns/dns-default-sk64p" Jul 15 17:55:38.865082 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865000 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb5910a7-337b-4b1a-bba2-8ca95b40911e-cert\") pod \"ingress-canary-r97xm\" (UID: \"fb5910a7-337b-4b1a-bba2-8ca95b40911e\") " pod="openshift-ingress-canary/ingress-canary-r97xm" Jul 15 17:55:38.865082 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865023 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.865082 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:38.865050 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 17:55:38.865082 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865058 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2688c99-ce3c-4720-8c2c-11043d337b49-installation-pull-secrets\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.865309 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865094 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95759e5c-f715-4172-a6d2-28c19c18c556-service-ca-bundle\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:38.865309 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:38.865108 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-metrics-tls podName:64a2bcb4-7c5f-4859-9a19-3de5ec1af440 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:39.365088595 +0000 UTC m=+37.700396904 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-metrics-tls") pod "dns-default-sk64p" (UID: "64a2bcb4-7c5f-4859-9a19-3de5ec1af440") : secret "dns-default-metrics-tls" not found Jul 15 17:55:38.865309 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865150 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8p95j\" (UniqueName: \"kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-kube-api-access-8p95j\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.865309 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:38.865160 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 17:55:38.865309 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:38.865176 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d45cd845c-n5nn5: secret "image-registry-tls" not found Jul 15 17:55:38.865309 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865178 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxr27\" (UniqueName: \"kubernetes.io/projected/95759e5c-f715-4172-a6d2-28c19c18c556-kube-api-access-kxr27\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:38.865309 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:38.865197 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/95759e5c-f715-4172-a6d2-28c19c18c556-service-ca-bundle podName:95759e5c-f715-4172-a6d2-28c19c18c556 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:39.365181665 +0000 UTC m=+37.700489965 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/95759e5c-f715-4172-a6d2-28c19c18c556-service-ca-bundle") pod "router-default-59dcc44f8-b45fj" (UID: "95759e5c-f715-4172-a6d2-28c19c18c556") : configmap references non-existent config key: service-ca.crt Jul 15 17:55:38.865309 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:38.865218 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls podName:b2688c99-ce3c-4720-8c2c-11043d337b49 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:39.365209284 +0000 UTC m=+37.700517566 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls") pod "image-registry-7d45cd845c-n5nn5" (UID: "b2688c99-ce3c-4720-8c2c-11043d337b49") : secret "image-registry-tls" not found Jul 15 17:55:38.865309 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865246 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-bound-sa-token\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.865309 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865271 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2688c99-ce3c-4720-8c2c-11043d337b49-ca-trust-extracted\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.865309 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865299 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-default-certificate\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:38.865846 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865338 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67315a2e-51bd-4280-9821-5a6fd7b06df7-trusted-ca\") pod \"console-operator-7866497494-b89jb\" (UID: \"67315a2e-51bd-4280-9821-5a6fd7b06df7\") " pod="openshift-console-operator/console-operator-7866497494-b89jb" Jul 15 17:55:38.865846 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865370 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-js2j6\" (UniqueName: \"kubernetes.io/projected/65bf8fa0-4655-4e61-8b0e-def41e359744-kube-api-access-js2j6\") pod \"cluster-samples-operator-65db858894-bv8hk\" (UID: \"65bf8fa0-4655-4e61-8b0e-def41e359744\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bv8hk" Jul 15 17:55:38.865846 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865397 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nvph7\" (UniqueName: \"kubernetes.io/projected/f00291c5-c987-4f12-a396-29617c98c495-kube-api-access-nvph7\") pod \"service-ca-operator-7695fc6c8c-m9qlq\" (UID: \"f00291c5-c987-4f12-a396-29617c98c495\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m9qlq" Jul 15 17:55:38.865846 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865421 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67315a2e-51bd-4280-9821-5a6fd7b06df7-serving-cert\") pod \"console-operator-7866497494-b89jb\" (UID: \"67315a2e-51bd-4280-9821-5a6fd7b06df7\") " pod="openshift-console-operator/console-operator-7866497494-b89jb" Jul 15 17:55:38.865846 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865448 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-config-volume\") pod \"dns-default-sk64p\" (UID: \"64a2bcb4-7c5f-4859-9a19-3de5ec1af440\") " pod="openshift-dns/dns-default-sk64p" Jul 15 17:55:38.865846 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865471 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-metrics-certs\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:38.865846 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865480 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/bd7b71a8-c2dc-4c96-998c-2e4f1924c746-config\") pod \"kube-storage-version-migrator-operator-799cb7f958-9pdlp\" (UID: \"bd7b71a8-c2dc-4c96-998c-2e4f1924c746\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9pdlp" Jul 15 17:55:38.865846 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865498 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65bf8fa0-4655-4e61-8b0e-def41e359744-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bv8hk\" (UID: \"65bf8fa0-4655-4e61-8b0e-def41e359744\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bv8hk" Jul 15 17:55:38.865846 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865519 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f00291c5-c987-4f12-a396-29617c98c495-config\") pod \"service-ca-operator-7695fc6c8c-m9qlq\" (UID: \"f00291c5-c987-4f12-a396-29617c98c495\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m9qlq" Jul 15 17:55:38.865846 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865547 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2kz8g\" (UniqueName: \"kubernetes.io/projected/bd7b71a8-c2dc-4c96-998c-2e4f1924c746-kube-api-access-2kz8g\") pod \"kube-storage-version-migrator-operator-799cb7f958-9pdlp\" (UID: \"bd7b71a8-c2dc-4c96-998c-2e4f1924c746\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9pdlp" Jul 15 17:55:38.865846 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865576 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9lgc\" (UniqueName: \"kubernetes.io/projected/fb5910a7-337b-4b1a-bba2-8ca95b40911e-kube-api-access-g9lgc\") pod \"ingress-canary-r97xm\" (UID: \"fb5910a7-337b-4b1a-bba2-8ca95b40911e\") " pod="openshift-ingress-canary/ingress-canary-r97xm" Jul 15 17:55:38.865846 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865610 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-stats-auth\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:38.865846 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865656 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-tmp-dir\") pod \"dns-default-sk64p\" (UID: \"64a2bcb4-7c5f-4859-9a19-3de5ec1af440\") " pod="openshift-dns/dns-default-sk64p" Jul 15 17:55:38.865846 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865699 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-certificates\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.865846 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865728 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jtxmt\" (UniqueName: \"kubernetes.io/projected/840276ac-ed7f-4c65-ba1c-eea89bd79e4e-kube-api-access-jtxmt\") pod \"network-check-source-869dcfcdcd-6cxp6\" (UID: \"840276ac-ed7f-4c65-ba1c-eea89bd79e4e\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6cxp6" Jul 15 17:55:38.866539 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865780 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2688c99-ce3c-4720-8c2c-11043d337b49-trusted-ca\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.866539 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865833 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-btq8q\" (UniqueName: \"kubernetes.io/projected/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-kube-api-access-btq8q\") pod \"dns-default-sk64p\" (UID: \"64a2bcb4-7c5f-4859-9a19-3de5ec1af440\") " pod="openshift-dns/dns-default-sk64p" Jul 15 17:55:38.866539 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865890 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pfmln\" (UniqueName: \"kubernetes.io/projected/d7bface4-5e90-4274-806e-b1b8fea7e0e3-kube-api-access-pfmln\") pod \"volume-data-source-validator-78495597f6-cbzbw\" (UID: \"d7bface4-5e90-4274-806e-b1b8fea7e0e3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cbzbw" Jul 15 17:55:38.866539 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865924 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67315a2e-51bd-4280-9821-5a6fd7b06df7-config\") pod \"console-operator-7866497494-b89jb\" (UID: \"67315a2e-51bd-4280-9821-5a6fd7b06df7\") " pod="openshift-console-operator/console-operator-7866497494-b89jb" Jul 15 17:55:38.866539 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.865964 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2688c99-ce3c-4720-8c2c-11043d337b49-image-registry-private-configuration\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.866539 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:38.865996 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 17:55:38.866539 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:38.866039 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bf8fa0-4655-4e61-8b0e-def41e359744-samples-operator-tls podName:65bf8fa0-4655-4e61-8b0e-def41e359744 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:39.36602545 +0000 UTC m=+37.701333752 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/65bf8fa0-4655-4e61-8b0e-def41e359744-samples-operator-tls") pod "cluster-samples-operator-65db858894-bv8hk" (UID: "65bf8fa0-4655-4e61-8b0e-def41e359744") : secret "samples-operator-tls" not found Jul 15 17:55:38.866539 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.866319 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-config-volume\") pod \"dns-default-sk64p\" (UID: \"64a2bcb4-7c5f-4859-9a19-3de5ec1af440\") " pod="openshift-dns/dns-default-sk64p" Jul 15 17:55:38.866539 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:38.866413 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 17:55:38.866539 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:38.866456 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-metrics-certs podName:95759e5c-f715-4172-a6d2-28c19c18c556 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:39.366442835 +0000 UTC m=+37.701751128 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-metrics-certs") pod "router-default-59dcc44f8-b45fj" (UID: "95759e5c-f715-4172-a6d2-28c19c18c556") : secret "router-metrics-certs-default" not found Jul 15 17:55:38.867187 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.867008 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2688c99-ce3c-4720-8c2c-11043d337b49-trusted-ca\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.867432 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.867399 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2688c99-ce3c-4720-8c2c-11043d337b49-ca-trust-extracted\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.867982 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.867958 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-certificates\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.868101 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.867966 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:38.868325 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.868303 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-tmp-dir\") pod \"dns-default-sk64p\" (UID: \"64a2bcb4-7c5f-4859-9a19-3de5ec1af440\") " pod="openshift-dns/dns-default-sk64p" Jul 15 17:55:38.869179 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.869155 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/bd7b71a8-c2dc-4c96-998c-2e4f1924c746-serving-cert\") pod \"kube-storage-version-migrator-operator-799cb7f958-9pdlp\" (UID: \"bd7b71a8-c2dc-4c96-998c-2e4f1924c746\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9pdlp" Jul 15 17:55:38.869728 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.869707 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2688c99-ce3c-4720-8c2c-11043d337b49-installation-pull-secrets\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.869950 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.869928 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2688c99-ce3c-4720-8c2c-11043d337b49-image-registry-private-configuration\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.870834 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.870812 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/fb5910a7-337b-4b1a-bba2-8ca95b40911e-cert\") pod \"ingress-canary-r97xm\" (UID: \"fb5910a7-337b-4b1a-bba2-8ca95b40911e\") " pod="openshift-ingress-canary/ingress-canary-r97xm" Jul 15 17:55:38.876013 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.875990 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxr27\" (UniqueName: \"kubernetes.io/projected/95759e5c-f715-4172-a6d2-28c19c18c556-kube-api-access-kxr27\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:38.876013 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.876005 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-default-certificate\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:38.876143 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.876114 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-stats-auth\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:38.879445 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.879423 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-btq8q\" (UniqueName: \"kubernetes.io/projected/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-kube-api-access-btq8q\") pod \"dns-default-sk64p\" (UID: \"64a2bcb4-7c5f-4859-9a19-3de5ec1af440\") " pod="openshift-dns/dns-default-sk64p" Jul 15 17:55:38.880066 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.879975 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-bound-sa-token\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.880461 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.880439 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8p95j\" (UniqueName: \"kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-kube-api-access-8p95j\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:38.880846 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.880820 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pfmln\" (UniqueName: \"kubernetes.io/projected/d7bface4-5e90-4274-806e-b1b8fea7e0e3-kube-api-access-pfmln\") pod \"volume-data-source-validator-78495597f6-cbzbw\" (UID: \"d7bface4-5e90-4274-806e-b1b8fea7e0e3\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cbzbw" Jul 15 17:55:38.881040 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.881014 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-js2j6\" (UniqueName: \"kubernetes.io/projected/65bf8fa0-4655-4e61-8b0e-def41e359744-kube-api-access-js2j6\") pod \"cluster-samples-operator-65db858894-bv8hk\" (UID: \"65bf8fa0-4655-4e61-8b0e-def41e359744\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bv8hk" Jul 15 17:55:38.882087 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.882061 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2kz8g\" (UniqueName: \"kubernetes.io/projected/bd7b71a8-c2dc-4c96-998c-2e4f1924c746-kube-api-access-2kz8g\") pod \"kube-storage-version-migrator-operator-799cb7f958-9pdlp\" (UID: \"bd7b71a8-c2dc-4c96-998c-2e4f1924c746\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9pdlp" Jul 15 17:55:38.882286 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.882268 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9lgc\" (UniqueName: \"kubernetes.io/projected/fb5910a7-337b-4b1a-bba2-8ca95b40911e-kube-api-access-g9lgc\") pod \"ingress-canary-r97xm\" (UID: \"fb5910a7-337b-4b1a-bba2-8ca95b40911e\") " pod="openshift-ingress-canary/ingress-canary-r97xm" Jul 15 17:55:38.886817 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.886793 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" Jul 15 17:55:38.935920 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.935897 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9pdlp" Jul 15 17:55:38.959826 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.959786 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cbzbw" Jul 15 17:55:38.969768 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.967795 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jtxmt\" (UniqueName: \"kubernetes.io/projected/840276ac-ed7f-4c65-ba1c-eea89bd79e4e-kube-api-access-jtxmt\") pod \"network-check-source-869dcfcdcd-6cxp6\" (UID: \"840276ac-ed7f-4c65-ba1c-eea89bd79e4e\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6cxp6" Jul 15 17:55:38.969768 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.967903 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67315a2e-51bd-4280-9821-5a6fd7b06df7-config\") pod \"console-operator-7866497494-b89jb\" (UID: \"67315a2e-51bd-4280-9821-5a6fd7b06df7\") " pod="openshift-console-operator/console-operator-7866497494-b89jb" Jul 15 17:55:38.969768 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.967959 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f00291c5-c987-4f12-a396-29617c98c495-serving-cert\") pod \"service-ca-operator-7695fc6c8c-m9qlq\" (UID: \"f00291c5-c987-4f12-a396-29617c98c495\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m9qlq" Jul 15 17:55:38.969768 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.967992 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f5wfl\" (UniqueName: \"kubernetes.io/projected/67315a2e-51bd-4280-9821-5a6fd7b06df7-kube-api-access-f5wfl\") pod \"console-operator-7866497494-b89jb\" (UID: \"67315a2e-51bd-4280-9821-5a6fd7b06df7\") " pod="openshift-console-operator/console-operator-7866497494-b89jb" Jul 15 17:55:38.969768 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.968106 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67315a2e-51bd-4280-9821-5a6fd7b06df7-trusted-ca\") pod \"console-operator-7866497494-b89jb\" (UID: \"67315a2e-51bd-4280-9821-5a6fd7b06df7\") " pod="openshift-console-operator/console-operator-7866497494-b89jb" Jul 15 17:55:38.969768 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.968141 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nvph7\" (UniqueName: \"kubernetes.io/projected/f00291c5-c987-4f12-a396-29617c98c495-kube-api-access-nvph7\") pod \"service-ca-operator-7695fc6c8c-m9qlq\" (UID: \"f00291c5-c987-4f12-a396-29617c98c495\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m9qlq" Jul 15 17:55:38.969768 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.968169 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67315a2e-51bd-4280-9821-5a6fd7b06df7-serving-cert\") pod \"console-operator-7866497494-b89jb\" (UID: \"67315a2e-51bd-4280-9821-5a6fd7b06df7\") " pod="openshift-console-operator/console-operator-7866497494-b89jb" Jul 15 17:55:38.969768 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.968260 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f00291c5-c987-4f12-a396-29617c98c495-config\") pod \"service-ca-operator-7695fc6c8c-m9qlq\" (UID: \"f00291c5-c987-4f12-a396-29617c98c495\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m9qlq" Jul 15 17:55:38.969768 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.968924 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/f00291c5-c987-4f12-a396-29617c98c495-config\") pod \"service-ca-operator-7695fc6c8c-m9qlq\" (UID: \"f00291c5-c987-4f12-a396-29617c98c495\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m9qlq" Jul 15 17:55:38.970222 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.970017 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/67315a2e-51bd-4280-9821-5a6fd7b06df7-config\") pod \"console-operator-7866497494-b89jb\" (UID: \"67315a2e-51bd-4280-9821-5a6fd7b06df7\") " pod="openshift-console-operator/console-operator-7866497494-b89jb" Jul 15 17:55:38.972329 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.972159 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/67315a2e-51bd-4280-9821-5a6fd7b06df7-trusted-ca\") pod \"console-operator-7866497494-b89jb\" (UID: \"67315a2e-51bd-4280-9821-5a6fd7b06df7\") " pod="openshift-console-operator/console-operator-7866497494-b89jb" Jul 15 17:55:38.974316 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.974261 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/f00291c5-c987-4f12-a396-29617c98c495-serving-cert\") pod \"service-ca-operator-7695fc6c8c-m9qlq\" (UID: \"f00291c5-c987-4f12-a396-29617c98c495\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m9qlq" Jul 15 17:55:38.975397 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.975376 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/67315a2e-51bd-4280-9821-5a6fd7b06df7-serving-cert\") pod \"console-operator-7866497494-b89jb\" (UID: \"67315a2e-51bd-4280-9821-5a6fd7b06df7\") " pod="openshift-console-operator/console-operator-7866497494-b89jb" Jul 15 17:55:38.977568 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.977538 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jtxmt\" (UniqueName: \"kubernetes.io/projected/840276ac-ed7f-4c65-ba1c-eea89bd79e4e-kube-api-access-jtxmt\") pod \"network-check-source-869dcfcdcd-6cxp6\" (UID: \"840276ac-ed7f-4c65-ba1c-eea89bd79e4e\") " pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6cxp6" Jul 15 17:55:38.980603 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.980560 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-f5wfl\" (UniqueName: \"kubernetes.io/projected/67315a2e-51bd-4280-9821-5a6fd7b06df7-kube-api-access-f5wfl\") pod \"console-operator-7866497494-b89jb\" (UID: \"67315a2e-51bd-4280-9821-5a6fd7b06df7\") " pod="openshift-console-operator/console-operator-7866497494-b89jb" Jul 15 17:55:38.982382 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.982342 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nvph7\" (UniqueName: \"kubernetes.io/projected/f00291c5-c987-4f12-a396-29617c98c495-kube-api-access-nvph7\") pod \"service-ca-operator-7695fc6c8c-m9qlq\" (UID: \"f00291c5-c987-4f12-a396-29617c98c495\") " pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m9qlq" Jul 15 17:55:38.985331 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.985165 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-r97xm" Jul 15 17:55:38.994843 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:38.994678 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m9qlq" Jul 15 17:55:39.003999 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.003977 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-7866497494-b89jb" Jul 15 17:55:39.018975 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.018913 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6cxp6" Jul 15 17:55:39.045020 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.044989 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-68d9dd94cf-jrxtm"] Jul 15 17:55:39.051035 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:39.050987 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd92bdd5d_2ff9_4525_9d19_9b4b2e2c82f4.slice/crio-134df654bb419fa23ba721d2568b443b54920845a55741f7bc8dfac87e4eac5a WatchSource:0}: Error finding container 134df654bb419fa23ba721d2568b443b54920845a55741f7bc8dfac87e4eac5a: Status 404 returned error can't find the container with id 134df654bb419fa23ba721d2568b443b54920845a55741f7bc8dfac87e4eac5a Jul 15 17:55:39.207447 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.205605 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:55:39.207447 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.205629 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:55:39.207447 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.206397 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:55:39.208377 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.208359 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z65tj\"" Jul 15 17:55:39.208575 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.208558 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 17:55:39.208811 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.208785 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8g8sx\"" Jul 15 17:55:39.209180 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.209163 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 17:55:39.250188 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.250102 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cbzbw"] Jul 15 17:55:39.263578 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.263424 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9pdlp"] Jul 15 17:55:39.266006 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.265979 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-r97xm"] Jul 15 17:55:39.271615 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.271557 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4knf9\" (UID: \"0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9" Jul 15 17:55:39.271759 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:39.271741 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 17:55:39.271822 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:39.271810 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-cluster-monitoring-operator-tls podName:0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b nodeName:}" failed. No retries permitted until 2026-07-15 17:55:40.271792547 +0000 UTC m=+38.607100826 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4knf9" (UID: "0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b") : secret "cluster-monitoring-operator-tls" not found Jul 15 17:55:39.278542 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.278516 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-869dcfcdcd-6cxp6"] Jul 15 17:55:39.279637 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.279615 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-7866497494-b89jb"] Jul 15 17:55:39.293113 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.293092 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m9qlq"] Jul 15 17:55:39.296433 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:39.296406 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf00291c5_c987_4f12_a396_29617c98c495.slice/crio-86e406d5f653b010a0516890993e5c14078c408bd321155fe366f0e6d65ba4ff WatchSource:0}: Error finding container 86e406d5f653b010a0516890993e5c14078c408bd321155fe366f0e6d65ba4ff: Status 404 returned error can't find the container with id 86e406d5f653b010a0516890993e5c14078c408bd321155fe366f0e6d65ba4ff Jul 15 17:55:39.297434 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:39.297406 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb5910a7_337b_4b1a_bba2_8ca95b40911e.slice/crio-2025af8f463080281f60f0ab6d84347649bd435c53ce595066d01263cdf6285f WatchSource:0}: Error finding container 2025af8f463080281f60f0ab6d84347649bd435c53ce595066d01263cdf6285f: Status 404 returned error can't find the container with id 2025af8f463080281f60f0ab6d84347649bd435c53ce595066d01263cdf6285f Jul 15 17:55:39.298339 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:55:39.297998 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7bface4_5e90_4274_806e_b1b8fea7e0e3.slice/crio-961c27b0402c2c5138b520ff004018cf1c8b4eb406547c6777d3e476f0b17a82 WatchSource:0}: Error finding container 961c27b0402c2c5138b520ff004018cf1c8b4eb406547c6777d3e476f0b17a82: Status 404 returned error can't find the container with id 961c27b0402c2c5138b520ff004018cf1c8b4eb406547c6777d3e476f0b17a82 Jul 15 17:55:39.327848 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.327649 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:39.372777 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.372740 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-metrics-certs\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:39.372777 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.372780 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65bf8fa0-4655-4e61-8b0e-def41e359744-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bv8hk\" (UID: \"65bf8fa0-4655-4e61-8b0e-def41e359744\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bv8hk" Jul 15 17:55:39.372956 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:39.372875 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 17:55:39.372956 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:39.372881 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 17:55:39.372956 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:39.372928 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bf8fa0-4655-4e61-8b0e-def41e359744-samples-operator-tls podName:65bf8fa0-4655-4e61-8b0e-def41e359744 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:40.37291533 +0000 UTC m=+38.708223611 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/65bf8fa0-4655-4e61-8b0e-def41e359744-samples-operator-tls") pod "cluster-samples-operator-65db858894-bv8hk" (UID: "65bf8fa0-4655-4e61-8b0e-def41e359744") : secret "samples-operator-tls" not found Jul 15 17:55:39.373101 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:39.373015 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-metrics-certs podName:95759e5c-f715-4172-a6d2-28c19c18c556 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:40.372989158 +0000 UTC m=+38.708297453 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-metrics-certs") pod "router-default-59dcc44f8-b45fj" (UID: "95759e5c-f715-4172-a6d2-28c19c18c556") : secret "router-metrics-certs-default" not found Jul 15 17:55:39.373155 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.373111 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-metrics-tls\") pod \"dns-default-sk64p\" (UID: \"64a2bcb4-7c5f-4859-9a19-3de5ec1af440\") " pod="openshift-dns/dns-default-sk64p" Jul 15 17:55:39.373155 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.373144 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:39.373239 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.373181 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95759e5c-f715-4172-a6d2-28c19c18c556-service-ca-bundle\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:39.373239 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:39.373236 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 17:55:39.373313 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:39.373236 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 17:55:39.373313 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:39.373245 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d45cd845c-n5nn5: secret "image-registry-tls" not found Jul 15 17:55:39.373313 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:39.373268 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/95759e5c-f715-4172-a6d2-28c19c18c556-service-ca-bundle podName:95759e5c-f715-4172-a6d2-28c19c18c556 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:40.373258303 +0000 UTC m=+38.708566584 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/95759e5c-f715-4172-a6d2-28c19c18c556-service-ca-bundle") pod "router-default-59dcc44f8-b45fj" (UID: "95759e5c-f715-4172-a6d2-28c19c18c556") : configmap references non-existent config key: service-ca.crt Jul 15 17:55:39.373313 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:39.373292 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-metrics-tls podName:64a2bcb4-7c5f-4859-9a19-3de5ec1af440 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:40.373275062 +0000 UTC m=+38.708583342 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-metrics-tls") pod "dns-default-sk64p" (UID: "64a2bcb4-7c5f-4859-9a19-3de5ec1af440") : secret "dns-default-metrics-tls" not found Jul 15 17:55:39.373313 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:39.373313 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls podName:b2688c99-ce3c-4720-8c2c-11043d337b49 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:40.373302239 +0000 UTC m=+38.708610522 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls") pod "image-registry-7d45cd845c-n5nn5" (UID: "b2688c99-ce3c-4720-8c2c-11043d337b49") : secret "image-registry-tls" not found Jul 15 17:55:39.433614 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.433578 2551 generic.go:356] "Generic (PLEG): container finished" podID="a40a06d0-9182-44da-8229-fec808a929a1" containerID="028bf7c459835604bc34cf5d02f3edff15d492d73ee14635564306904de78349" exitCode=0 Jul 15 17:55:39.433811 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.433691 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7z26z" event={"ID":"a40a06d0-9182-44da-8229-fec808a929a1","Type":"ContainerDied","Data":"028bf7c459835604bc34cf5d02f3edff15d492d73ee14635564306904de78349"} Jul 15 17:55:39.434889 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.434865 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6cxp6" event={"ID":"840276ac-ed7f-4c65-ba1c-eea89bd79e4e","Type":"ContainerStarted","Data":"9457e45ae140a7829d3507a0b17f2a66d490a6e98010f66bc0df8ab4c7c728f0"} Jul 15 17:55:39.435994 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.435969 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-b89jb" event={"ID":"67315a2e-51bd-4280-9821-5a6fd7b06df7","Type":"ContainerStarted","Data":"83069ed582c6eb8608f9a3eabd669e0b4ad8e6c30c6aeb41409423e2e56c7291"} Jul 15 17:55:39.437141 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.437120 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m9qlq" event={"ID":"f00291c5-c987-4f12-a396-29617c98c495","Type":"ContainerStarted","Data":"86e406d5f653b010a0516890993e5c14078c408bd321155fe366f0e6d65ba4ff"} Jul 15 17:55:39.438200 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.438170 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r97xm" event={"ID":"fb5910a7-337b-4b1a-bba2-8ca95b40911e","Type":"ContainerStarted","Data":"2025af8f463080281f60f0ab6d84347649bd435c53ce595066d01263cdf6285f"} Jul 15 17:55:39.439145 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.439124 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9pdlp" event={"ID":"bd7b71a8-c2dc-4c96-998c-2e4f1924c746","Type":"ContainerStarted","Data":"fdd27bc4b41f6653152b1bf40f510045009f4221ad8b647e2c20e6c04c3a6505"} Jul 15 17:55:39.440203 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.440181 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" event={"ID":"d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4","Type":"ContainerStarted","Data":"134df654bb419fa23ba721d2568b443b54920845a55741f7bc8dfac87e4eac5a"} Jul 15 17:55:39.441269 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:39.441250 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cbzbw" event={"ID":"d7bface4-5e90-4274-806e-b1b8fea7e0e3","Type":"ContainerStarted","Data":"961c27b0402c2c5138b520ff004018cf1c8b4eb406547c6777d3e476f0b17a82"} Jul 15 17:55:40.283645 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:40.282970 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4knf9\" (UID: \"0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9" Jul 15 17:55:40.283645 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:40.283224 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 17:55:40.283645 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:40.283298 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-cluster-monitoring-operator-tls podName:0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b nodeName:}" failed. No retries permitted until 2026-07-15 17:55:42.283275599 +0000 UTC m=+40.618583892 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4knf9" (UID: "0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b") : secret "cluster-monitoring-operator-tls" not found Jul 15 17:55:40.384884 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:40.384602 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-metrics-tls\") pod \"dns-default-sk64p\" (UID: \"64a2bcb4-7c5f-4859-9a19-3de5ec1af440\") " pod="openshift-dns/dns-default-sk64p" Jul 15 17:55:40.386272 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:40.384652 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:40.386272 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:40.385277 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95759e5c-f715-4172-a6d2-28c19c18c556-service-ca-bundle\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:40.386272 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:40.385355 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-metrics-certs\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:40.386272 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:40.385412 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65bf8fa0-4655-4e61-8b0e-def41e359744-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bv8hk\" (UID: \"65bf8fa0-4655-4e61-8b0e-def41e359744\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bv8hk" Jul 15 17:55:40.386272 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:40.384794 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 17:55:40.386272 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:40.385611 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-metrics-tls podName:64a2bcb4-7c5f-4859-9a19-3de5ec1af440 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:42.385593388 +0000 UTC m=+40.720901672 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-metrics-tls") pod "dns-default-sk64p" (UID: "64a2bcb4-7c5f-4859-9a19-3de5ec1af440") : secret "dns-default-metrics-tls" not found Jul 15 17:55:40.386272 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:40.386049 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/95759e5c-f715-4172-a6d2-28c19c18c556-service-ca-bundle podName:95759e5c-f715-4172-a6d2-28c19c18c556 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:42.386034818 +0000 UTC m=+40.721343112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/95759e5c-f715-4172-a6d2-28c19c18c556-service-ca-bundle") pod "router-default-59dcc44f8-b45fj" (UID: "95759e5c-f715-4172-a6d2-28c19c18c556") : configmap references non-existent config key: service-ca.crt Jul 15 17:55:40.386272 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:40.386112 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 17:55:40.386272 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:40.386142 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-metrics-certs podName:95759e5c-f715-4172-a6d2-28c19c18c556 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:42.386131374 +0000 UTC m=+40.721439659 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-metrics-certs") pod "router-default-59dcc44f8-b45fj" (UID: "95759e5c-f715-4172-a6d2-28c19c18c556") : secret "router-metrics-certs-default" not found Jul 15 17:55:40.386272 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:40.384860 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 17:55:40.386272 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:40.386163 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d45cd845c-n5nn5: secret "image-registry-tls" not found Jul 15 17:55:40.386272 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:40.386190 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls podName:b2688c99-ce3c-4720-8c2c-11043d337b49 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:42.386181732 +0000 UTC m=+40.721490027 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls") pod "image-registry-7d45cd845c-n5nn5" (UID: "b2688c99-ce3c-4720-8c2c-11043d337b49") : secret "image-registry-tls" not found Jul 15 17:55:40.386272 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:40.385542 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 17:55:40.386272 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:40.386225 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bf8fa0-4655-4e61-8b0e-def41e359744-samples-operator-tls podName:65bf8fa0-4655-4e61-8b0e-def41e359744 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:42.386217698 +0000 UTC m=+40.721525982 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/65bf8fa0-4655-4e61-8b0e-def41e359744-samples-operator-tls") pod "cluster-samples-operator-65db858894-bv8hk" (UID: "65bf8fa0-4655-4e61-8b0e-def41e359744") : secret "samples-operator-tls" not found Jul 15 17:55:40.459223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:40.458272 2551 generic.go:356] "Generic (PLEG): container finished" podID="a40a06d0-9182-44da-8229-fec808a929a1" containerID="003d925e62ff15ae466fd3460c5f51f122cee67840a053dba94ba25836d76929" exitCode=0 Jul 15 17:55:40.459223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:40.458326 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7z26z" event={"ID":"a40a06d0-9182-44da-8229-fec808a929a1","Type":"ContainerDied","Data":"003d925e62ff15ae466fd3460c5f51f122cee67840a053dba94ba25836d76929"} Jul 15 17:55:41.471295 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:41.471036 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cbzbw" event={"ID":"d7bface4-5e90-4274-806e-b1b8fea7e0e3","Type":"ContainerStarted","Data":"93e0c70478b804f75c4a3317bcf6986297becee8f23e510fb6309a2cf4906253"} Jul 15 17:55:41.479505 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:41.479464 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-7z26z" event={"ID":"a40a06d0-9182-44da-8229-fec808a929a1","Type":"ContainerStarted","Data":"a0c4289e2313fd0a3ae38a03013202a6b3144d6274dc50afc82670c1c885ae56"} Jul 15 17:55:41.489320 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:41.489255 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-78495597f6-cbzbw" podStartSLOduration=22.751498121 podStartE2EDuration="24.489232973s" totalImagesPullingTime="1.737734852s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:55:41.488014788 +0000 UTC m=+39.823323112" watchObservedRunningTime="2026-07-15 17:55:41.489232973 +0000 UTC m=+39.824541276" Jul 15 17:55:41.511409 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:41.511350 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-7z26z" podStartSLOduration=7.731425715 podStartE2EDuration="38.511328853s" totalImagesPullingTime="30.779903138s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 17:55:03 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:55:41.511000167 +0000 UTC m=+39.846308520" watchObservedRunningTime="2026-07-15 17:55:41.511328853 +0000 UTC m=+39.846637154" Jul 15 17:55:41.637616 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:41.637525 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:41.711212 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:41.711180 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:41.733675 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:41.733628 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-xj5wd"] Jul 15 17:55:41.736371 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:41.735999 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-xj5wd" Jul 15 17:55:41.739683 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:41.739650 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mskg5\"" Jul 15 17:55:41.739927 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:41.739908 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 15 17:55:41.740201 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:41.740156 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 15 17:55:41.744627 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:41.744604 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-xj5wd"] Jul 15 17:55:41.803152 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:41.803112 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xj5wd\" (UID: \"513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xj5wd" Jul 15 17:55:41.803328 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:41.803179 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-nginx-conf\") pod \"networking-console-plugin-6cf856758c-xj5wd\" (UID: \"513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xj5wd" Jul 15 17:55:41.862592 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:41.862491 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:41.905564 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:41.904681 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xj5wd\" (UID: \"513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xj5wd" Jul 15 17:55:41.905564 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:41.904738 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-nginx-conf\") pod \"networking-console-plugin-6cf856758c-xj5wd\" (UID: \"513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xj5wd" Jul 15 17:55:41.905564 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:41.904786 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 17:55:41.905564 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:41.904849 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-networking-console-plugin-cert podName:513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa nodeName:}" failed. No retries permitted until 2026-07-15 17:55:42.404830874 +0000 UTC m=+40.740139169 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-xj5wd" (UID: "513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa") : secret "networking-console-plugin-cert" not found Jul 15 17:55:41.905564 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:41.905470 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-nginx-conf\") pod \"networking-console-plugin-6cf856758c-xj5wd\" (UID: \"513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xj5wd" Jul 15 17:55:41.962555 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:41.962520 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:42.062448 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:42.062391 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:42.309384 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:42.309288 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4knf9\" (UID: \"0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9" Jul 15 17:55:42.309534 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:42.309467 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 17:55:42.309593 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:42.309545 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-cluster-monitoring-operator-tls podName:0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b nodeName:}" failed. No retries permitted until 2026-07-15 17:55:46.309522938 +0000 UTC m=+44.644831227 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4knf9" (UID: "0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b") : secret "cluster-monitoring-operator-tls" not found Jul 15 17:55:42.410368 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:42.410326 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xj5wd\" (UID: \"513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xj5wd" Jul 15 17:55:42.410528 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:42.410401 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-metrics-tls\") pod \"dns-default-sk64p\" (UID: \"64a2bcb4-7c5f-4859-9a19-3de5ec1af440\") " pod="openshift-dns/dns-default-sk64p" Jul 15 17:55:42.410528 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:42.410433 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:42.410528 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:42.410465 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95759e5c-f715-4172-a6d2-28c19c18c556-service-ca-bundle\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:42.410528 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:42.410487 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 17:55:42.410528 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:42.410524 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 17:55:42.410779 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:42.410523 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-metrics-certs\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:42.410779 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:42.410565 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-networking-console-plugin-cert podName:513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa nodeName:}" failed. No retries permitted until 2026-07-15 17:55:43.410543178 +0000 UTC m=+41.745851459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-xj5wd" (UID: "513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa") : secret "networking-console-plugin-cert" not found Jul 15 17:55:42.410779 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:42.410611 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 17:55:42.410779 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:42.410640 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d45cd845c-n5nn5: secret "image-registry-tls" not found Jul 15 17:55:42.410779 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:42.410616 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-metrics-tls podName:64a2bcb4-7c5f-4859-9a19-3de5ec1af440 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:46.410604359 +0000 UTC m=+44.745912640 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-metrics-tls") pod "dns-default-sk64p" (UID: "64a2bcb4-7c5f-4859-9a19-3de5ec1af440") : secret "dns-default-metrics-tls" not found Jul 15 17:55:42.410779 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:42.410727 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 17:55:42.410779 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:42.410752 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/95759e5c-f715-4172-a6d2-28c19c18c556-service-ca-bundle podName:95759e5c-f715-4172-a6d2-28c19c18c556 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:46.410725508 +0000 UTC m=+44.746033799 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/95759e5c-f715-4172-a6d2-28c19c18c556-service-ca-bundle") pod "router-default-59dcc44f8-b45fj" (UID: "95759e5c-f715-4172-a6d2-28c19c18c556") : configmap references non-existent config key: service-ca.crt Jul 15 17:55:42.410779 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:42.410773 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls podName:b2688c99-ce3c-4720-8c2c-11043d337b49 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:46.410762422 +0000 UTC m=+44.746070709 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls") pod "image-registry-7d45cd845c-n5nn5" (UID: "b2688c99-ce3c-4720-8c2c-11043d337b49") : secret "image-registry-tls" not found Jul 15 17:55:42.411207 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:42.410794 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65bf8fa0-4655-4e61-8b0e-def41e359744-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bv8hk\" (UID: \"65bf8fa0-4655-4e61-8b0e-def41e359744\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bv8hk" Jul 15 17:55:42.411207 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:42.410848 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-metrics-certs podName:95759e5c-f715-4172-a6d2-28c19c18c556 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:46.410838535 +0000 UTC m=+44.746146821 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-metrics-certs") pod "router-default-59dcc44f8-b45fj" (UID: "95759e5c-f715-4172-a6d2-28c19c18c556") : secret "router-metrics-certs-default" not found Jul 15 17:55:42.411207 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:42.410897 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 17:55:42.411207 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:42.410943 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bf8fa0-4655-4e61-8b0e-def41e359744-samples-operator-tls podName:65bf8fa0-4655-4e61-8b0e-def41e359744 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:46.41092896 +0000 UTC m=+44.746237256 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/65bf8fa0-4655-4e61-8b0e-def41e359744-samples-operator-tls") pod "cluster-samples-operator-65db858894-bv8hk" (UID: "65bf8fa0-4655-4e61-8b0e-def41e359744") : secret "samples-operator-tls" not found Jul 15 17:55:43.420393 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:43.420351 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xj5wd\" (UID: \"513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xj5wd" Jul 15 17:55:43.420888 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:43.420495 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 17:55:43.420888 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:43.420557 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-networking-console-plugin-cert podName:513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa nodeName:}" failed. No retries permitted until 2026-07-15 17:55:45.420541426 +0000 UTC m=+43.755849705 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-xj5wd" (UID: "513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa") : secret "networking-console-plugin-cert" not found Jul 15 17:55:45.437431 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:45.437388 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xj5wd\" (UID: \"513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xj5wd" Jul 15 17:55:45.437858 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:45.437553 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 17:55:45.437858 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:45.437632 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-networking-console-plugin-cert podName:513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa nodeName:}" failed. No retries permitted until 2026-07-15 17:55:49.437610154 +0000 UTC m=+47.772918435 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-xj5wd" (UID: "513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa") : secret "networking-console-plugin-cert" not found Jul 15 17:55:45.968476 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:45.968378 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:46.069022 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:46.068984 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:46.347004 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:46.346940 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4knf9\" (UID: \"0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9" Jul 15 17:55:46.349630 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:46.347652 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 17:55:46.349630 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:46.347766 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-cluster-monitoring-operator-tls podName:0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b nodeName:}" failed. No retries permitted until 2026-07-15 17:55:54.347731124 +0000 UTC m=+52.683039426 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4knf9" (UID: "0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b") : secret "cluster-monitoring-operator-tls" not found Jul 15 17:55:46.448630 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:46.448599 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-metrics-tls\") pod \"dns-default-sk64p\" (UID: \"64a2bcb4-7c5f-4859-9a19-3de5ec1af440\") " pod="openshift-dns/dns-default-sk64p" Jul 15 17:55:46.448630 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:46.448634 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:46.449113 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:46.448656 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95759e5c-f715-4172-a6d2-28c19c18c556-service-ca-bundle\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:46.449113 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:46.448718 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-metrics-certs\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:46.449113 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:46.448743 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65bf8fa0-4655-4e61-8b0e-def41e359744-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bv8hk\" (UID: \"65bf8fa0-4655-4e61-8b0e-def41e359744\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bv8hk" Jul 15 17:55:46.449113 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:46.448796 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 17:55:46.449113 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:46.448798 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 17:55:46.449113 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:46.448835 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/95759e5c-f715-4172-a6d2-28c19c18c556-service-ca-bundle podName:95759e5c-f715-4172-a6d2-28c19c18c556 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:54.448814936 +0000 UTC m=+52.784123234 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/95759e5c-f715-4172-a6d2-28c19c18c556-service-ca-bundle") pod "router-default-59dcc44f8-b45fj" (UID: "95759e5c-f715-4172-a6d2-28c19c18c556") : configmap references non-existent config key: service-ca.crt Jul 15 17:55:46.449113 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:46.448842 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d45cd845c-n5nn5: secret "image-registry-tls" not found Jul 15 17:55:46.449113 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:46.448858 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-metrics-tls podName:64a2bcb4-7c5f-4859-9a19-3de5ec1af440 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:54.448847324 +0000 UTC m=+52.784155611 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-metrics-tls") pod "dns-default-sk64p" (UID: "64a2bcb4-7c5f-4859-9a19-3de5ec1af440") : secret "dns-default-metrics-tls" not found Jul 15 17:55:46.449113 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:46.448877 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls podName:b2688c99-ce3c-4720-8c2c-11043d337b49 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:54.448865416 +0000 UTC m=+52.784173730 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls") pod "image-registry-7d45cd845c-n5nn5" (UID: "b2688c99-ce3c-4720-8c2c-11043d337b49") : secret "image-registry-tls" not found Jul 15 17:55:46.449113 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:46.448880 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 17:55:46.449113 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:46.448922 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 17:55:46.449113 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:46.448930 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bf8fa0-4655-4e61-8b0e-def41e359744-samples-operator-tls podName:65bf8fa0-4655-4e61-8b0e-def41e359744 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:54.448915179 +0000 UTC m=+52.784223472 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/65bf8fa0-4655-4e61-8b0e-def41e359744-samples-operator-tls") pod "cluster-samples-operator-65db858894-bv8hk" (UID: "65bf8fa0-4655-4e61-8b0e-def41e359744") : secret "samples-operator-tls" not found Jul 15 17:55:46.449113 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:46.449011 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-metrics-certs podName:95759e5c-f715-4172-a6d2-28c19c18c556 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:54.448994318 +0000 UTC m=+52.784302598 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-metrics-certs") pod "router-default-59dcc44f8-b45fj" (UID: "95759e5c-f715-4172-a6d2-28c19c18c556") : secret "router-metrics-certs-default" not found Jul 15 17:55:46.546006 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:46.545980 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:46.657196 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:46.657171 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:46.744298 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:46.744097 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:46.843882 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:46.843852 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:47.498395 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:47.498355 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6cxp6" event={"ID":"840276ac-ed7f-4c65-ba1c-eea89bd79e4e","Type":"ContainerStarted","Data":"509f34610c116a0697ce8d076f0a1c24d3390ea8c015e381f4ab14b0e677ec1a"} Jul 15 17:55:47.500348 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:47.500328 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b89jb_67315a2e-51bd-4280-9821-5a6fd7b06df7/console-operator/0.log" Jul 15 17:55:47.500488 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:47.500365 2551 generic.go:356] "Generic (PLEG): container finished" podID="67315a2e-51bd-4280-9821-5a6fd7b06df7" containerID="f54942b021513537478d7e3238ba3e37bd335d64a5fc16cbb2163bd220b59181" exitCode=255 Jul 15 17:55:47.500488 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:47.500437 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-b89jb" event={"ID":"67315a2e-51bd-4280-9821-5a6fd7b06df7","Type":"ContainerDied","Data":"f54942b021513537478d7e3238ba3e37bd335d64a5fc16cbb2163bd220b59181"} Jul 15 17:55:47.500613 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:47.500595 2551 scope.go:117] "RemoveContainer" containerID="f54942b021513537478d7e3238ba3e37bd335d64a5fc16cbb2163bd220b59181" Jul 15 17:55:47.503135 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:47.502231 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m9qlq" event={"ID":"f00291c5-c987-4f12-a396-29617c98c495","Type":"ContainerStarted","Data":"845b35d8e3d7aae490aaf858fdd977bf28ad713a96d0d47687baffcea435a3e7"} Jul 15 17:55:47.504316 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:47.504081 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-r97xm" event={"ID":"fb5910a7-337b-4b1a-bba2-8ca95b40911e","Type":"ContainerStarted","Data":"ba2636896d045d1159c177ee52743d3ca9c94c2c8f785e5e847bdc108074eb1b"} Jul 15 17:55:47.505652 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:47.505632 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9pdlp" event={"ID":"bd7b71a8-c2dc-4c96-998c-2e4f1924c746","Type":"ContainerStarted","Data":"0d905d6e10ba4fea8538b3efdf207557835d086f0ba8f0f51405893a04bfd344"} Jul 15 17:55:47.507158 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:47.507136 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" event={"ID":"d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4","Type":"ContainerStarted","Data":"8432b64d8f6c5124f1cc0390c78415e91ef7c2047dab4ff126c477072a3cb999"} Jul 15 17:55:47.513345 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:47.513262 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-869dcfcdcd-6cxp6" podStartSLOduration=22.988346958 podStartE2EDuration="30.513245341s" totalImagesPullingTime="7.524898383s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:55:47.513019705 +0000 UTC m=+45.848328007" watchObservedRunningTime="2026-07-15 17:55:47.513245341 +0000 UTC m=+45.848553706" Jul 15 17:55:47.547686 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:47.546757 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-r97xm" podStartSLOduration=2.030343821 podStartE2EDuration="9.546739264s" totalImagesPullingTime="7.516395443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:55:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:55:47.546343537 +0000 UTC m=+45.881651840" watchObservedRunningTime="2026-07-15 17:55:47.546739264 +0000 UTC m=+45.882047568" Jul 15 17:55:47.564409 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:47.564358 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" podStartSLOduration=23.804051494 podStartE2EDuration="31.564342228s" totalImagesPullingTime="7.760290734s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:55:47.562640663 +0000 UTC m=+45.897948961" watchObservedRunningTime="2026-07-15 17:55:47.564342228 +0000 UTC m=+45.899650531" Jul 15 17:55:47.579562 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:47.579516 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m9qlq" podStartSLOduration=23.059153915 podStartE2EDuration="30.579496891s" totalImagesPullingTime="7.520342976s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:55:47.578216323 +0000 UTC m=+45.913524624" watchObservedRunningTime="2026-07-15 17:55:47.579496891 +0000 UTC m=+45.914805173" Jul 15 17:55:47.583974 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:47.583086 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:47.597061 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:47.597011 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9pdlp" podStartSLOduration=23.080017731 podStartE2EDuration="30.596989909s" totalImagesPullingTime="7.516972178s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:55:47.59365987 +0000 UTC m=+45.928968174" watchObservedRunningTime="2026-07-15 17:55:47.596989909 +0000 UTC m=+45.932298212" Jul 15 17:55:47.644396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:47.644341 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:48.512375 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.512342 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b89jb_67315a2e-51bd-4280-9821-5a6fd7b06df7/console-operator/1.log" Jul 15 17:55:48.512835 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.512776 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b89jb_67315a2e-51bd-4280-9821-5a6fd7b06df7/console-operator/0.log" Jul 15 17:55:48.512835 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.512817 2551 generic.go:356] "Generic (PLEG): container finished" podID="67315a2e-51bd-4280-9821-5a6fd7b06df7" containerID="64127c02831bb504e42d449414df45f038fd0590264e6169210047d879a83a7a" exitCode=255 Jul 15 17:55:48.513014 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.512982 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-b89jb" event={"ID":"67315a2e-51bd-4280-9821-5a6fd7b06df7","Type":"ContainerDied","Data":"64127c02831bb504e42d449414df45f038fd0590264e6169210047d879a83a7a"} Jul 15 17:55:48.513078 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.513068 2551 scope.go:117] "RemoveContainer" containerID="f54942b021513537478d7e3238ba3e37bd335d64a5fc16cbb2163bd220b59181" Jul 15 17:55:48.513425 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.513228 2551 scope.go:117] "RemoveContainer" containerID="64127c02831bb504e42d449414df45f038fd0590264e6169210047d879a83a7a" Jul 15 17:55:48.513545 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:48.513441 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-b89jb_openshift-console-operator(67315a2e-51bd-4280-9821-5a6fd7b06df7)\"" pod="openshift-console-operator/console-operator-7866497494-b89jb" podUID="67315a2e-51bd-4280-9821-5a6fd7b06df7" Jul 15 17:55:48.555258 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.555226 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:48.653966 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.653929 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:48.657123 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.657096 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-s999x"] Jul 15 17:55:48.686650 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.686614 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:48.686996 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.686974 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s999x"] Jul 15 17:55:48.688825 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.688796 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 17:55:48.688997 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.688795 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 17:55:48.689083 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.689068 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9t2sf\"" Jul 15 17:55:48.710468 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.710441 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:48.773566 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.773497 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-data-volume\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:48.773566 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.773535 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbrbk\" (UniqueName: \"kubernetes.io/projected/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-kube-api-access-xbrbk\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:48.773749 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.773591 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:48.773749 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.773613 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:48.773749 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.773720 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-crio-socket\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:48.874966 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.874932 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-crio-socket\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:48.875116 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.874999 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-data-volume\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:48.875116 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.875032 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbrbk\" (UniqueName: \"kubernetes.io/projected/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-kube-api-access-xbrbk\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:48.875202 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.875120 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:48.875202 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.875143 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:48.875202 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.875191 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-crio-socket\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:48.875296 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:48.875232 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 17:55:48.875296 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:48.875275 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 17:55:48.875385 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:48.875316 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-kube-rbac-proxy-cm podName:3fbeaacd-8c0d-487f-ac81-0c53ebc89f15 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:49.375295585 +0000 UTC m=+47.710603870 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s999x" (UID: "3fbeaacd-8c0d-487f-ac81-0c53ebc89f15") : configmap "kube-rbac-proxy" not found Jul 15 17:55:48.875385 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:48.875337 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-insights-runtime-extractor-tls podName:3fbeaacd-8c0d-487f-ac81-0c53ebc89f15 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:49.375327068 +0000 UTC m=+47.710635353 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s999x" (UID: "3fbeaacd-8c0d-487f-ac81-0c53ebc89f15") : secret "insights-runtime-extractor-tls" not found Jul 15 17:55:48.875474 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.875416 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-data-volume\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:48.890433 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.890404 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbrbk\" (UniqueName: \"kubernetes.io/projected/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-kube-api-access-xbrbk\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:48.994138 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:48.994101 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:49.004458 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:49.004434 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-b89jb" Jul 15 17:55:49.004559 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:49.004473 2551 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-7866497494-b89jb" Jul 15 17:55:49.046039 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:49.045975 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:49.375142 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:49.375109 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:49.379065 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:49.379046 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:49.379126 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:49.379077 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:49.379209 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:49.379191 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 17:55:49.379252 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:49.379226 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 17:55:49.379283 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:49.379255 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-insights-runtime-extractor-tls podName:3fbeaacd-8c0d-487f-ac81-0c53ebc89f15 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:50.379240149 +0000 UTC m=+48.714548431 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s999x" (UID: "3fbeaacd-8c0d-487f-ac81-0c53ebc89f15") : secret "insights-runtime-extractor-tls" not found Jul 15 17:55:49.379283 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:49.379275 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-kube-rbac-proxy-cm podName:3fbeaacd-8c0d-487f-ac81-0c53ebc89f15 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:50.379262038 +0000 UTC m=+48.714570318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s999x" (UID: "3fbeaacd-8c0d-487f-ac81-0c53ebc89f15") : configmap "kube-rbac-proxy" not found Jul 15 17:55:49.471922 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:49.471886 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:49.479959 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:49.479932 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xj5wd\" (UID: \"513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xj5wd" Jul 15 17:55:49.480110 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:49.480094 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 17:55:49.480198 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:49.480169 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-networking-console-plugin-cert podName:513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa nodeName:}" failed. No retries permitted until 2026-07-15 17:55:57.48014956 +0000 UTC m=+55.815457839 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-xj5wd" (UID: "513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa") : secret "networking-console-plugin-cert" not found Jul 15 17:55:49.517158 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:49.517137 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b89jb_67315a2e-51bd-4280-9821-5a6fd7b06df7/console-operator/1.log" Jul 15 17:55:49.517517 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:49.517502 2551 scope.go:117] "RemoveContainer" containerID="64127c02831bb504e42d449414df45f038fd0590264e6169210047d879a83a7a" Jul 15 17:55:49.517691 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:49.517655 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-b89jb_openshift-console-operator(67315a2e-51bd-4280-9821-5a6fd7b06df7)\"" pod="openshift-console-operator/console-operator-7866497494-b89jb" podUID="67315a2e-51bd-4280-9821-5a6fd7b06df7" Jul 15 17:55:49.581565 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:49.581539 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:49.673765 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:49.673650 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:49.733195 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:49.733160 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:50.388704 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:50.388647 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:50.388873 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:50.388712 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:50.388873 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:50.388806 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 17:55:50.388873 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:50.388822 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 17:55:50.388970 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:50.388875 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-kube-rbac-proxy-cm podName:3fbeaacd-8c0d-487f-ac81-0c53ebc89f15 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:52.388861093 +0000 UTC m=+50.724169373 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s999x" (UID: "3fbeaacd-8c0d-487f-ac81-0c53ebc89f15") : configmap "kube-rbac-proxy" not found Jul 15 17:55:50.388970 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:50.388888 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-insights-runtime-extractor-tls podName:3fbeaacd-8c0d-487f-ac81-0c53ebc89f15 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:52.388882018 +0000 UTC m=+50.724190298 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s999x" (UID: "3fbeaacd-8c0d-487f-ac81-0c53ebc89f15") : secret "insights-runtime-extractor-tls" not found Jul 15 17:55:50.483383 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:50.483356 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zskmc_b6285ed2-035b-45f1-9ca7-52023153a5e9/dns-node-resolver/0.log" Jul 15 17:55:50.520299 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:50.520274 2551 scope.go:117] "RemoveContainer" containerID="64127c02831bb504e42d449414df45f038fd0590264e6169210047d879a83a7a" Jul 15 17:55:50.520627 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:50.520419 2551 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-7866497494-b89jb_openshift-console-operator(67315a2e-51bd-4280-9821-5a6fd7b06df7)\"" pod="openshift-console-operator/console-operator-7866497494-b89jb" podUID="67315a2e-51bd-4280-9821-5a6fd7b06df7" Jul 15 17:55:50.947769 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:50.947732 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:51.007973 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:51.007932 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:51.120426 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:51.120380 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:51.222047 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:51.221963 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:51.485567 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:51.485489 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xhh8c_d1ec3250-3d3a-4901-a5e1-8bb3d3e6a0ae/node-ca/0.log" Jul 15 17:55:51.876916 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:51.876890 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:52.084159 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:52.084126 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r97xm_fb5910a7-337b-4b1a-bba2-8ca95b40911e/serve-healthcheck-canary/0.log" Jul 15 17:55:52.407800 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:52.407763 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:52.407976 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:52.407897 2551 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 15 17:55:52.407976 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:52.407971 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-kube-rbac-proxy-cm podName:3fbeaacd-8c0d-487f-ac81-0c53ebc89f15 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:56.407952147 +0000 UTC m=+54.743260442 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-kube-rbac-proxy-cm") pod "insights-runtime-extractor-s999x" (UID: "3fbeaacd-8c0d-487f-ac81-0c53ebc89f15") : configmap "kube-rbac-proxy" not found Jul 15 17:55:52.408052 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:52.407995 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:52.408088 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:52.408079 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 17:55:52.408131 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:52.408120 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-insights-runtime-extractor-tls podName:3fbeaacd-8c0d-487f-ac81-0c53ebc89f15 nodeName:}" failed. No retries permitted until 2026-07-15 17:55:56.40811131 +0000 UTC m=+54.743419589 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s999x" (UID: "3fbeaacd-8c0d-487f-ac81-0c53ebc89f15") : secret "insights-runtime-extractor-tls" not found Jul 15 17:55:52.918086 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:52.918052 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:52.967221 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:52.967195 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:54.082688 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:54.082632 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:54.425250 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:54.425217 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4knf9\" (UID: \"0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9" Jul 15 17:55:54.425412 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:54.425374 2551 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 15 17:55:54.425449 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:54.425435 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-cluster-monitoring-operator-tls podName:0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b nodeName:}" failed. No retries permitted until 2026-07-15 17:56:10.42542073 +0000 UTC m=+68.760729009 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-5f7f494dd4-4knf9" (UID: "0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b") : secret "cluster-monitoring-operator-tls" not found Jul 15 17:55:54.526078 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:54.526040 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-metrics-tls\") pod \"dns-default-sk64p\" (UID: \"64a2bcb4-7c5f-4859-9a19-3de5ec1af440\") " pod="openshift-dns/dns-default-sk64p" Jul 15 17:55:54.526078 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:54.526079 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:55:54.526307 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:54.526111 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95759e5c-f715-4172-a6d2-28c19c18c556-service-ca-bundle\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:54.526307 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:54.526154 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-metrics-certs\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:55:54.526307 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:54.526178 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65bf8fa0-4655-4e61-8b0e-def41e359744-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bv8hk\" (UID: \"65bf8fa0-4655-4e61-8b0e-def41e359744\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bv8hk" Jul 15 17:55:54.526307 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:54.526197 2551 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 15 17:55:54.526307 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:54.526202 2551 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 15 17:55:54.526307 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:54.526279 2551 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-7d45cd845c-n5nn5: secret "image-registry-tls" not found Jul 15 17:55:54.526307 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:54.526295 2551 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 15 17:55:54.526307 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:54.526261 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-metrics-tls podName:64a2bcb4-7c5f-4859-9a19-3de5ec1af440 nodeName:}" failed. No retries permitted until 2026-07-15 17:56:10.526242462 +0000 UTC m=+68.861550742 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-metrics-tls") pod "dns-default-sk64p" (UID: "64a2bcb4-7c5f-4859-9a19-3de5ec1af440") : secret "dns-default-metrics-tls" not found Jul 15 17:55:54.526583 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:54.526326 2551 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 15 17:55:54.526583 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:54.526328 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/95759e5c-f715-4172-a6d2-28c19c18c556-service-ca-bundle podName:95759e5c-f715-4172-a6d2-28c19c18c556 nodeName:}" failed. No retries permitted until 2026-07-15 17:56:10.526314905 +0000 UTC m=+68.861623185 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/95759e5c-f715-4172-a6d2-28c19c18c556-service-ca-bundle") pod "router-default-59dcc44f8-b45fj" (UID: "95759e5c-f715-4172-a6d2-28c19c18c556") : configmap references non-existent config key: service-ca.crt Jul 15 17:55:54.526583 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:54.526352 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls podName:b2688c99-ce3c-4720-8c2c-11043d337b49 nodeName:}" failed. No retries permitted until 2026-07-15 17:56:10.526341376 +0000 UTC m=+68.861649655 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls") pod "image-registry-7d45cd845c-n5nn5" (UID: "b2688c99-ce3c-4720-8c2c-11043d337b49") : secret "image-registry-tls" not found Jul 15 17:55:54.526583 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:54.526371 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/65bf8fa0-4655-4e61-8b0e-def41e359744-samples-operator-tls podName:65bf8fa0-4655-4e61-8b0e-def41e359744 nodeName:}" failed. No retries permitted until 2026-07-15 17:56:10.52636228 +0000 UTC m=+68.861670559 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/65bf8fa0-4655-4e61-8b0e-def41e359744-samples-operator-tls") pod "cluster-samples-operator-65db858894-bv8hk" (UID: "65bf8fa0-4655-4e61-8b0e-def41e359744") : secret "samples-operator-tls" not found Jul 15 17:55:54.526583 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:54.526385 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-metrics-certs podName:95759e5c-f715-4172-a6d2-28c19c18c556 nodeName:}" failed. No retries permitted until 2026-07-15 17:56:10.526380041 +0000 UTC m=+68.861688320 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-metrics-certs") pod "router-default-59dcc44f8-b45fj" (UID: "95759e5c-f715-4172-a6d2-28c19c18c556") : secret "router-metrics-certs-default" not found Jul 15 17:55:55.565373 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:55.565335 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:55.796422 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:55.796392 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:55.902065 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:55.902040 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:55.996441 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:55.996402 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:56.101995 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:56.101963 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:56.395139 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:56.395102 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:56.443671 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:56.443645 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:56.443778 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:56.443703 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:56.443813 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:56.443797 2551 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 15 17:55:56.443872 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:56.443862 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-insights-runtime-extractor-tls podName:3fbeaacd-8c0d-487f-ac81-0c53ebc89f15 nodeName:}" failed. No retries permitted until 2026-07-15 17:56:04.443845324 +0000 UTC m=+62.779153608 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-insights-runtime-extractor-tls") pod "insights-runtime-extractor-s999x" (UID: "3fbeaacd-8c0d-487f-ac81-0c53ebc89f15") : secret "insights-runtime-extractor-tls" not found Jul 15 17:55:56.444247 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:56.444210 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:55:56.638537 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:56.638513 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:57.068686 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:57.068622 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:57.468296 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:57.468264 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:57.552539 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:57.552511 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xj5wd\" (UID: \"513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xj5wd" Jul 15 17:55:57.552701 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:57.552656 2551 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 15 17:55:57.552763 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:55:57.552726 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-networking-console-plugin-cert podName:513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa nodeName:}" failed. No retries permitted until 2026-07-15 17:56:13.5527117 +0000 UTC m=+71.888019979 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-networking-console-plugin-cert") pod "networking-console-plugin-6cf856758c-xj5wd" (UID: "513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa") : secret "networking-console-plugin-cert" not found Jul 15 17:55:57.642190 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:57.642158 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:57.691713 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:57.691660 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:57.877470 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:57.877442 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:58.257140 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:58.257041 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:58.659120 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:58.659088 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:58.908993 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:58.908968 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:59.190913 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:59.190887 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:59.290249 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:59.290209 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:55:59.342988 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:55:59.342949 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:00.061605 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:00.061575 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:00.161969 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:00.161939 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:00.461102 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:00.461065 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:00.658335 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:00.658293 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:00.859931 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:00.859906 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:01.062232 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:01.062134 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:01.205312 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:01.205251 2551 scope.go:117] "RemoveContainer" containerID="64127c02831bb504e42d449414df45f038fd0590264e6169210047d879a83a7a" Jul 15 17:56:01.428313 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:01.428283 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:01.552968 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:01.552895 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b89jb_67315a2e-51bd-4280-9821-5a6fd7b06df7/console-operator/1.log" Jul 15 17:56:01.553106 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:01.552979 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-7866497494-b89jb" event={"ID":"67315a2e-51bd-4280-9821-5a6fd7b06df7","Type":"ContainerStarted","Data":"6ab60fe8a42740b0438f8d89ca41fb0eeea930e28dc9a808370859e99ece7982"} Jul 15 17:56:01.553254 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:01.553234 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-7866497494-b89jb" Jul 15 17:56:01.572421 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:01.572371 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-7866497494-b89jb" podStartSLOduration=37.057265244 podStartE2EDuration="44.572357471s" totalImagesPullingTime="7.515092227s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:56:01.571275745 +0000 UTC m=+59.906584073" watchObservedRunningTime="2026-07-15 17:56:01.572357471 +0000 UTC m=+59.907665771" Jul 15 17:56:01.864264 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:01.864224 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:02.074621 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:02.074596 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-7866497494-b89jb" Jul 15 17:56:02.396357 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:02.396324 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:02.430813 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:02.430793 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-pwzkz" Jul 15 17:56:02.467127 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:02.467101 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:02.537021 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:02.536979 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:02.596576 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:02.596544 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:02.664920 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:02.664860 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:02.833913 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:02.833863 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:03.044503 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:03.044420 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:03.100176 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:03.100132 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:03.264460 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:03.264427 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:03.319782 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:03.319709 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:03.666390 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:03.666362 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:04.145931 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:04.145883 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:04.370442 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:04.370405 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:04.474479 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:04.474391 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:04.508567 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:04.508539 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:56:04.510926 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:04.510906 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/3fbeaacd-8c0d-487f-ac81-0c53ebc89f15-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-s999x\" (UID: \"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15\") " pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:56:04.597597 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:04.597574 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-9t2sf\"" Jul 15 17:56:04.605957 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:04.605941 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-s999x" Jul 15 17:56:04.661352 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:04.661320 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:04.731646 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:04.731582 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-s999x"] Jul 15 17:56:04.734627 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:56:04.734601 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3fbeaacd_8c0d_487f_ac81_0c53ebc89f15.slice/crio-81a4eecf79cf9753970967e911dfcbdd794bcc8d25b5ded02a5f291d33b184ad WatchSource:0}: Error finding container 81a4eecf79cf9753970967e911dfcbdd794bcc8d25b5ded02a5f291d33b184ad: Status 404 returned error can't find the container with id 81a4eecf79cf9753970967e911dfcbdd794bcc8d25b5ded02a5f291d33b184ad Jul 15 17:56:04.886971 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:04.886940 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:05.262599 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:05.262511 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:05.568264 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:05.568117 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s999x" event={"ID":"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15","Type":"ContainerStarted","Data":"81a4eecf79cf9753970967e911dfcbdd794bcc8d25b5ded02a5f291d33b184ad"} Jul 15 17:56:05.668756 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:05.668694 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:06.063149 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:06.063100 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:06.458716 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:06.458685 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:06.662254 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:06.662214 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:07.940658 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:07.940614 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs\") pod \"network-metrics-daemon-fvtvh\" (UID: \"002a3085-9fdc-414b-bbf4-4be0580cf88f\") " pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:56:07.941129 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:07.940702 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret\") pod \"global-pull-secret-syncer-6jz77\" (UID: \"12a379a8-7075-4528-a2c5-9d2750f9e71c\") " pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:56:07.941129 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:07.940779 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7b54p\" (UniqueName: \"kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p\") pod \"network-check-target-rd5vp\" (UID: \"cd44a874-643c-4efc-b8b4-b92449f574e5\") " pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:56:07.943615 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:07.942979 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 17:56:07.943615 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:07.943015 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 17:56:07.943823 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:07.943695 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7b54p\" (UniqueName: \"kubernetes.io/projected/cd44a874-643c-4efc-b8b4-b92449f574e5-kube-api-access-7b54p\") pod \"network-check-target-rd5vp\" (UID: \"cd44a874-643c-4efc-b8b4-b92449f574e5\") " pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:56:07.953923 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:07.953900 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/12a379a8-7075-4528-a2c5-9d2750f9e71c-original-pull-secret\") pod \"global-pull-secret-syncer-6jz77\" (UID: \"12a379a8-7075-4528-a2c5-9d2750f9e71c\") " pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:56:07.958206 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:07.958184 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/002a3085-9fdc-414b-bbf4-4be0580cf88f-metrics-certs\") pod \"network-metrics-daemon-fvtvh\" (UID: \"002a3085-9fdc-414b-bbf4-4be0580cf88f\") " pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:56:08.024891 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:08.024864 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-z65tj\"" Jul 15 17:56:08.033579 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:08.033551 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-fvtvh" Jul 15 17:56:08.035224 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:08.035205 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8g8sx\"" Jul 15 17:56:08.041678 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:08.041640 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-6jz77" Jul 15 17:56:08.043809 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:08.043787 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:56:10.018568 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.018493 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-6jz77"] Jul 15 17:56:10.023745 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:56:10.023714 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod12a379a8_7075_4528_a2c5_9d2750f9e71c.slice/crio-0a0dc7f1ccdcc4e92edc20013496f4e3ea9038678d2dd1d7793391a1428e61f8 WatchSource:0}: Error finding container 0a0dc7f1ccdcc4e92edc20013496f4e3ea9038678d2dd1d7793391a1428e61f8: Status 404 returned error can't find the container with id 0a0dc7f1ccdcc4e92edc20013496f4e3ea9038678d2dd1d7793391a1428e61f8 Jul 15 17:56:10.033963 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.033938 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-fvtvh"] Jul 15 17:56:10.037988 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:56:10.037966 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod002a3085_9fdc_414b_bbf4_4be0580cf88f.slice/crio-33f58b2d74013ad46b806ce0981958456b6bd505515dbe671c22c93c07869ff4 WatchSource:0}: Error finding container 33f58b2d74013ad46b806ce0981958456b6bd505515dbe671c22c93c07869ff4: Status 404 returned error can't find the container with id 33f58b2d74013ad46b806ce0981958456b6bd505515dbe671c22c93c07869ff4 Jul 15 17:56:10.057236 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.057212 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-rd5vp"] Jul 15 17:56:10.060157 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:56:10.060133 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd44a874_643c_4efc_b8b4_b92449f574e5.slice/crio-ae827634c34319a6b7492019fe94383af12f1e009cbf260a44cb587ea33a9e64 WatchSource:0}: Error finding container ae827634c34319a6b7492019fe94383af12f1e009cbf260a44cb587ea33a9e64: Status 404 returned error can't find the container with id ae827634c34319a6b7492019fe94383af12f1e009cbf260a44cb587ea33a9e64 Jul 15 17:56:10.465447 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.464868 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4knf9\" (UID: \"0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9" Jul 15 17:56:10.467917 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.467864 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-5f7f494dd4-4knf9\" (UID: \"0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b\") " pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9" Jul 15 17:56:10.566215 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.565634 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-metrics-tls\") pod \"dns-default-sk64p\" (UID: \"64a2bcb4-7c5f-4859-9a19-3de5ec1af440\") " pod="openshift-dns/dns-default-sk64p" Jul 15 17:56:10.566215 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.565713 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:56:10.566215 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.565747 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95759e5c-f715-4172-a6d2-28c19c18c556-service-ca-bundle\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:56:10.566215 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.565802 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-metrics-certs\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:56:10.566215 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.565831 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65bf8fa0-4655-4e61-8b0e-def41e359744-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bv8hk\" (UID: \"65bf8fa0-4655-4e61-8b0e-def41e359744\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bv8hk" Jul 15 17:56:10.567567 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.567517 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/95759e5c-f715-4172-a6d2-28c19c18c556-service-ca-bundle\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:56:10.570001 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.569944 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls\") pod \"image-registry-7d45cd845c-n5nn5\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:56:10.570645 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.570567 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/65bf8fa0-4655-4e61-8b0e-def41e359744-samples-operator-tls\") pod \"cluster-samples-operator-65db858894-bv8hk\" (UID: \"65bf8fa0-4655-4e61-8b0e-def41e359744\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bv8hk" Jul 15 17:56:10.573942 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.573899 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/64a2bcb4-7c5f-4859-9a19-3de5ec1af440-metrics-tls\") pod \"dns-default-sk64p\" (UID: \"64a2bcb4-7c5f-4859-9a19-3de5ec1af440\") " pod="openshift-dns/dns-default-sk64p" Jul 15 17:56:10.574636 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.574597 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/95759e5c-f715-4172-a6d2-28c19c18c556-metrics-certs\") pod \"router-default-59dcc44f8-b45fj\" (UID: \"95759e5c-f715-4172-a6d2-28c19c18c556\") " pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:56:10.590763 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.590724 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s999x" event={"ID":"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15","Type":"ContainerStarted","Data":"c9682f2dd4fb1ebb5964821870672b56b7371a1bd235d59f5f43ae77bf5788c5"} Jul 15 17:56:10.592408 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.592379 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rd5vp" event={"ID":"cd44a874-643c-4efc-b8b4-b92449f574e5","Type":"ContainerStarted","Data":"4b721a9247034b881a3192cb203d6caa93cdde5f2844a3773b7fc325c37decc9"} Jul 15 17:56:10.592525 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.592432 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-rd5vp" event={"ID":"cd44a874-643c-4efc-b8b4-b92449f574e5","Type":"ContainerStarted","Data":"ae827634c34319a6b7492019fe94383af12f1e009cbf260a44cb587ea33a9e64"} Jul 15 17:56:10.593187 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.593166 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:56:10.594651 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.594621 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6jz77" event={"ID":"12a379a8-7075-4528-a2c5-9d2750f9e71c","Type":"ContainerStarted","Data":"0a0dc7f1ccdcc4e92edc20013496f4e3ea9038678d2dd1d7793391a1428e61f8"} Jul 15 17:56:10.596339 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.596320 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fvtvh" event={"ID":"002a3085-9fdc-414b-bbf4-4be0580cf88f","Type":"ContainerStarted","Data":"33f58b2d74013ad46b806ce0981958456b6bd505515dbe671c22c93c07869ff4"} Jul 15 17:56:10.607943 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.607895 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-rd5vp" podStartSLOduration=67.607877029 podStartE2EDuration="1m7.607877029s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:55:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:56:10.606471639 +0000 UTC m=+68.941779966" watchObservedRunningTime="2026-07-15 17:56:10.607877029 +0000 UTC m=+68.943185315" Jul 15 17:56:10.676053 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.676020 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-g2fx7\"" Jul 15 17:56:10.684712 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.684684 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9" Jul 15 17:56:10.716398 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.715553 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-njx54\"" Jul 15 17:56:10.720651 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.720381 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:56:10.722074 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.721886 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-7b5g7\"" Jul 15 17:56:10.730969 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.730715 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:56:10.750155 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.749942 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5g88f\"" Jul 15 17:56:10.758410 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.758145 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-sk64p" Jul 15 17:56:10.775264 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.775047 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-tgxzj\"" Jul 15 17:56:10.783994 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.783766 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bv8hk" Jul 15 17:56:10.923276 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.923121 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9"] Jul 15 17:56:10.986580 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.986467 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-7d45cd845c-n5nn5"] Jul 15 17:56:10.995610 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:10.995538 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-59dcc44f8-b45fj"] Jul 15 17:56:11.013586 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:11.013393 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-sk64p"] Jul 15 17:56:11.035884 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:11.035841 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bv8hk"] Jul 15 17:56:11.299923 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:56:11.299717 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0e6db71d_1cf5_4d0e_98cd_4aa46b25ba0b.slice/crio-303110f077d5de61769c6e48fc4f6ca2a08c91875eb50a3b0dcb7ccb88a27ca5 WatchSource:0}: Error finding container 303110f077d5de61769c6e48fc4f6ca2a08c91875eb50a3b0dcb7ccb88a27ca5: Status 404 returned error can't find the container with id 303110f077d5de61769c6e48fc4f6ca2a08c91875eb50a3b0dcb7ccb88a27ca5 Jul 15 17:56:11.608853 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:11.607963 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fvtvh" event={"ID":"002a3085-9fdc-414b-bbf4-4be0580cf88f","Type":"ContainerStarted","Data":"0e351d2a6335a49f0db876e3ff07cc556a7a076554f17923362204861f5a7914"} Jul 15 17:56:11.610288 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:11.610226 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bv8hk" event={"ID":"65bf8fa0-4655-4e61-8b0e-def41e359744","Type":"ContainerStarted","Data":"7c9f74a193c083e3435859ddefb1fdf79d8b3c07854b97df2b801426854ef01d"} Jul 15 17:56:11.612355 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:11.612285 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sk64p" event={"ID":"64a2bcb4-7c5f-4859-9a19-3de5ec1af440","Type":"ContainerStarted","Data":"a229a633f82921d8a68a0e758c615738d859dfd0c04bd8ecb17944d3d63f08d5"} Jul 15 17:56:11.614698 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:11.614656 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9" event={"ID":"0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b","Type":"ContainerStarted","Data":"303110f077d5de61769c6e48fc4f6ca2a08c91875eb50a3b0dcb7ccb88a27ca5"} Jul 15 17:56:11.618473 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:11.617761 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59dcc44f8-b45fj" event={"ID":"95759e5c-f715-4172-a6d2-28c19c18c556","Type":"ContainerStarted","Data":"8b8c26d2480c6382628f6eb5ac43b42c8ec72db27c343996986f3575d073b555"} Jul 15 17:56:11.618473 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:11.617802 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-59dcc44f8-b45fj" event={"ID":"95759e5c-f715-4172-a6d2-28c19c18c556","Type":"ContainerStarted","Data":"9feb0d123330f51a12fd4613b00e3f836f81269821292514d64794d35a3afba3"} Jul 15 17:56:11.620458 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:11.620404 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" event={"ID":"b2688c99-ce3c-4720-8c2c-11043d337b49","Type":"ContainerStarted","Data":"7486134592b85cd075301030f19edc2425161d6cc7b042ce9496e092feae7026"} Jul 15 17:56:11.620458 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:11.620444 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" event={"ID":"b2688c99-ce3c-4720-8c2c-11043d337b49","Type":"ContainerStarted","Data":"76528ceb7dd4d950de4dcf930459a90d465b50ae2224587e84206608cdc545e1"} Jul 15 17:56:11.620876 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:11.620830 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:56:11.637283 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:11.637215 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-59dcc44f8-b45fj" podStartSLOduration=55.637196117 podStartE2EDuration="55.637196117s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:55:16 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:56:11.635996275 +0000 UTC m=+69.971304577" watchObservedRunningTime="2026-07-15 17:56:11.637196117 +0000 UTC m=+69.972504420" Jul 15 17:56:11.657833 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:11.657303 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" podStartSLOduration=68.657285961 podStartE2EDuration="1m8.657285961s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:55:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:56:11.656575959 +0000 UTC m=+69.991884282" watchObservedRunningTime="2026-07-15 17:56:11.657285961 +0000 UTC m=+69.992594257" Jul 15 17:56:11.721597 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:11.721517 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:56:11.724441 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:11.724388 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:56:12.631196 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:12.631156 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-fvtvh" event={"ID":"002a3085-9fdc-414b-bbf4-4be0580cf88f","Type":"ContainerStarted","Data":"95bb2689d1e3c4e8f12f454183ecd58ec081bc202810f5642e6bf6e9fa6d4e68"} Jul 15 17:56:12.632340 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:12.632318 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:56:12.633605 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:12.633584 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-59dcc44f8-b45fj" Jul 15 17:56:12.647781 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:12.647331 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-fvtvh" podStartSLOduration=68.328159569 podStartE2EDuration="1m9.647310216s" totalImagesPullingTime="1.319150647s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:56:12.645306297 +0000 UTC m=+70.980614600" watchObservedRunningTime="2026-07-15 17:56:12.647310216 +0000 UTC m=+70.982618522" Jul 15 17:56:13.364545 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:13.364289 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/downloads-68c9cbb497-dmgfp"] Jul 15 17:56:13.371097 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:13.371014 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:13.375137 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:13.375114 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-dmgfp" Jul 15 17:56:13.378424 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:13.378395 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-dmgfp"] Jul 15 17:56:13.379358 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:13.378679 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 17:56:13.379358 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:13.378912 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 17:56:13.379358 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:13.379174 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"default-dockercfg-94kqn\"" Jul 15 17:56:13.432188 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:13.432094 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:13.506064 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:13.506013 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bbqr8\" (UniqueName: \"kubernetes.io/projected/85434ffb-4c25-4714-aec1-0bd9e09c8f80-kube-api-access-bbqr8\") pod \"downloads-68c9cbb497-dmgfp\" (UID: \"85434ffb-4c25-4714-aec1-0bd9e09c8f80\") " pod="openshift-console/downloads-68c9cbb497-dmgfp" Jul 15 17:56:13.539088 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:13.539058 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:13.607091 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:13.607052 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bbqr8\" (UniqueName: \"kubernetes.io/projected/85434ffb-4c25-4714-aec1-0bd9e09c8f80-kube-api-access-bbqr8\") pod \"downloads-68c9cbb497-dmgfp\" (UID: \"85434ffb-4c25-4714-aec1-0bd9e09c8f80\") " pod="openshift-console/downloads-68c9cbb497-dmgfp" Jul 15 17:56:13.607333 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:13.607121 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xj5wd\" (UID: \"513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xj5wd" Jul 15 17:56:13.611206 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:13.610374 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa-networking-console-plugin-cert\") pod \"networking-console-plugin-6cf856758c-xj5wd\" (UID: \"513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa\") " pod="openshift-network-console/networking-console-plugin-6cf856758c-xj5wd" Jul 15 17:56:13.621870 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:13.621836 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bbqr8\" (UniqueName: \"kubernetes.io/projected/85434ffb-4c25-4714-aec1-0bd9e09c8f80-kube-api-access-bbqr8\") pod \"downloads-68c9cbb497-dmgfp\" (UID: \"85434ffb-4c25-4714-aec1-0bd9e09c8f80\") " pod="openshift-console/downloads-68c9cbb497-dmgfp" Jul 15 17:56:13.636004 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:13.635973 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:13.689074 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:13.689034 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/downloads-68c9cbb497-dmgfp" Jul 15 17:56:13.783230 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:13.783125 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:13.850017 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:13.849986 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-mskg5\"" Jul 15 17:56:13.858513 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:13.858443 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6cf856758c-xj5wd" Jul 15 17:56:14.849279 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:14.849242 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:14.908713 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:14.908606 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:17.368127 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:17.368092 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:17.441164 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:17.441133 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:18.711986 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:18.711882 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/downloads-68c9cbb497-dmgfp"] Jul 15 17:56:18.724020 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:18.723686 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6cf856758c-xj5wd"] Jul 15 17:56:18.863975 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:56:18.863931 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85434ffb_4c25_4714_aec1_0bd9e09c8f80.slice/crio-1996769c79ae7ba7f9b287ed18567f65b4e4f9639ff444213e8dc3435d6b0295 WatchSource:0}: Error finding container 1996769c79ae7ba7f9b287ed18567f65b4e4f9639ff444213e8dc3435d6b0295: Status 404 returned error can't find the container with id 1996769c79ae7ba7f9b287ed18567f65b4e4f9639ff444213e8dc3435d6b0295 Jul 15 17:56:18.864776 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:56:18.864736 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod513dcf18_7adc_4c51_b82a_5c2a3c6ee1fa.slice/crio-264d587b5d45f729757c9a176951fe97200223dc6240f542de3ae91651b2f31a WatchSource:0}: Error finding container 264d587b5d45f729757c9a176951fe97200223dc6240f542de3ae91651b2f31a: Status 404 returned error can't find the container with id 264d587b5d45f729757c9a176951fe97200223dc6240f542de3ae91651b2f31a Jul 15 17:56:19.001455 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:19.001335 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:19.104547 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:19.104510 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:19.161353 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:19.161313 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:19.298787 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:19.298704 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:19.373713 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:19.373654 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:19.433173 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:19.433122 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:19.665657 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:19.665617 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-xj5wd" event={"ID":"513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa","Type":"ContainerStarted","Data":"264d587b5d45f729757c9a176951fe97200223dc6240f542de3ae91651b2f31a"} Jul 15 17:56:19.668285 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:19.667856 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-6jz77" event={"ID":"12a379a8-7075-4528-a2c5-9d2750f9e71c","Type":"ContainerStarted","Data":"c69b2aac91fbcc497d3e7fcb80e21c84f2df104fee8f13ca6cf8df920a3d1db3"} Jul 15 17:56:19.672907 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:19.672879 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sk64p" event={"ID":"64a2bcb4-7c5f-4859-9a19-3de5ec1af440","Type":"ContainerStarted","Data":"bb66b93d79198f8cdf66e18363bebd3c0a3a0e1b365c611d4c36c11f1732ce77"} Jul 15 17:56:19.673044 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:19.672935 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-sk64p" event={"ID":"64a2bcb4-7c5f-4859-9a19-3de5ec1af440","Type":"ContainerStarted","Data":"ee105df09f17ae4b8d46633949d904dd1a7748e36ee5cb0023049cf91c4c829e"} Jul 15 17:56:19.673892 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:19.673839 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-sk64p" Jul 15 17:56:19.677456 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:19.676695 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9" event={"ID":"0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b","Type":"ContainerStarted","Data":"e300b5ac6ee19d91bc15824deb5c9a44c705fea7efe229a5394f983052345d3a"} Jul 15 17:56:19.678977 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:19.678949 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s999x" event={"ID":"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15","Type":"ContainerStarted","Data":"3b43a1769f83f9284a2c7837aeba4dd47b08b04e3ae8c98bf3cf001aa2df44bd"} Jul 15 17:56:19.681489 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:19.681440 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bv8hk" event={"ID":"65bf8fa0-4655-4e61-8b0e-def41e359744","Type":"ContainerStarted","Data":"91a0763216b0804b4a7757c5f3ac0ac08088e3d92eacf33de8f6beeaad346bdd"} Jul 15 17:56:19.681600 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:19.681489 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bv8hk" event={"ID":"65bf8fa0-4655-4e61-8b0e-def41e359744","Type":"ContainerStarted","Data":"d232f7399498cdd0c52c03eeda7335b48f43feff6b2f47f6078b3789cfbb071d"} Jul 15 17:56:19.684026 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:19.683988 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-6jz77" podStartSLOduration=68.157708199 podStartE2EDuration="1m16.68397447s" totalImagesPullingTime="8.526266271s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 17:55:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:56:19.682970315 +0000 UTC m=+78.018278617" watchObservedRunningTime="2026-07-15 17:56:19.68397447 +0000 UTC m=+78.019282763" Jul 15 17:56:19.685223 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:19.685186 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-dmgfp" event={"ID":"85434ffb-4c25-4714-aec1-0bd9e09c8f80","Type":"ContainerStarted","Data":"1996769c79ae7ba7f9b287ed18567f65b4e4f9639ff444213e8dc3435d6b0295"} Jul 15 17:56:19.704521 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:19.704457 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-5f7f494dd4-4knf9" podStartSLOduration=56.455938946 podStartE2EDuration="1m3.704440317s" totalImagesPullingTime="7.248501371s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:55:16 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:56:19.703974259 +0000 UTC m=+78.039282574" watchObservedRunningTime="2026-07-15 17:56:19.704440317 +0000 UTC m=+78.039748622" Jul 15 17:56:19.726327 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:19.726270 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-65db858894-bv8hk" podStartSLOduration=55.524318262 podStartE2EDuration="1m2.726251284s" totalImagesPullingTime="7.201933022s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:55:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:56:19.725238106 +0000 UTC m=+78.060546409" watchObservedRunningTime="2026-07-15 17:56:19.726251284 +0000 UTC m=+78.061559586" Jul 15 17:56:19.745182 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:19.745019 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-sk64p" podStartSLOduration=34.499119065 podStartE2EDuration="41.745000584s" totalImagesPullingTime="7.245881519s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:55:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:56:19.744921868 +0000 UTC m=+78.080230172" watchObservedRunningTime="2026-07-15 17:56:19.745000584 +0000 UTC m=+78.080308885" Jul 15 17:56:21.699644 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:21.699603 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6cf856758c-xj5wd" event={"ID":"513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa","Type":"ContainerStarted","Data":"7c7251f4431f40dd80229a7362a39822ea8756669b961dbf1c0d6b9e4b5b83d3"} Jul 15 17:56:21.717272 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:21.717182 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6cf856758c-xj5wd" podStartSLOduration=38.803507175 podStartE2EDuration="40.71715999s" totalImagesPullingTime="1.913652815s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:55:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:56:21.713796003 +0000 UTC m=+80.049104329" watchObservedRunningTime="2026-07-15 17:56:21.71715999 +0000 UTC m=+80.052468295" Jul 15 17:56:21.848178 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:21.848137 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:21.907398 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:21.907366 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:21.965916 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:21.965831 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:22.072042 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:22.072002 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:22.167308 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:22.167275 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:22.219257 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:22.219182 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:23.654373 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:23.653930 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:23.709951 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:23.709915 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-s999x" event={"ID":"3fbeaacd-8c0d-487f-ac81-0c53ebc89f15","Type":"ContainerStarted","Data":"c5c666889abe460d0dac72262fe88e8a6ee4a2f493141d3214768d339972fdbd"} Jul 15 17:56:23.713536 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:23.713503 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:23.727372 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:23.727314 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-s999x" podStartSLOduration=17.432522733 podStartE2EDuration="35.727297749s" totalImagesPullingTime="18.294775016s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 17:55:48 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:56:23.725852399 +0000 UTC m=+82.061160703" watchObservedRunningTime="2026-07-15 17:56:23.727297749 +0000 UTC m=+82.062606071" Jul 15 17:56:23.915111 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:23.915022 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:24.017076 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:24.016996 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:24.193154 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:24.193020 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:24.253449 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:24.253413 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:24.976812 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:24.976772 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:25.031795 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:25.031761 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:25.181643 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:25.181606 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:25.281236 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:25.281147 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:28.374102 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:28.374068 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:28.475036 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:28.474997 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:28.576156 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:28.576100 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:28.727931 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:28.727849 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:30.171102 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.171060 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:30.223355 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.223316 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:30.352852 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.352817 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:30.467896 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.467805 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:30.646653 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.646616 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:30.701888 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.701856 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-sk64p" Jul 15 17:56:30.721255 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.720153 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-krmdj"] Jul 15 17:56:30.729857 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.729832 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.732843 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.732817 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 17:56:30.733122 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.733107 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-scmn4\"" Jul 15 17:56:30.733304 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.733289 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 17:56:30.733470 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.733452 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 17:56:30.733751 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.733538 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 17:56:30.742955 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.742930 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-node-exporter-wtmp\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.743060 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.742974 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-node-exporter-tls\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.743060 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.742998 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.743060 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.743021 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-node-exporter-accelerators-collector-config\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.743286 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.743116 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-root\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.743286 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.743204 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-sys\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.743286 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.743229 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-node-exporter-textfile\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.743286 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.743279 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-metrics-client-ca\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.743525 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.743345 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z2l6w\" (UniqueName: \"kubernetes.io/projected/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-kube-api-access-z2l6w\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.774293 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.774259 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:30.844544 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.844507 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-metrics-client-ca\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.844727 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.844557 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z2l6w\" (UniqueName: \"kubernetes.io/projected/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-kube-api-access-z2l6w\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.844727 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.844584 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-node-exporter-wtmp\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.844727 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.844609 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-node-exporter-tls\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.844727 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.844631 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.844727 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.844653 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-node-exporter-accelerators-collector-config\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.844727 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.844706 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-root\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.845020 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.844768 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-sys\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.845020 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.844777 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-node-exporter-wtmp\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.845020 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.844794 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-node-exporter-textfile\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.845020 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.844881 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-root\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.845207 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.845118 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-node-exporter-textfile\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.845207 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.845180 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-sys\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.845207 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.845195 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-metrics-client-ca\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.845771 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.845691 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-node-exporter-accelerators-collector-config\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.847768 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.847746 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.847860 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.847815 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-node-exporter-tls\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.855118 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.855093 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z2l6w\" (UniqueName: \"kubernetes.io/projected/1d235e73-df9f-444c-8f8f-c5ee1ab9babe-kube-api-access-z2l6w\") pod \"node-exporter-krmdj\" (UID: \"1d235e73-df9f-444c-8f8f-c5ee1ab9babe\") " pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:30.885639 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.885611 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:30.979038 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:30.978942 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:31.042947 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:31.042918 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-krmdj" Jul 15 17:56:31.079201 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:31.079167 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:31.250467 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:31.250380 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:31.304606 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:31.304571 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:31.604827 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:31.604788 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:31.728890 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:31.728852 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:32.113510 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:32.113465 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:32.210336 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:32.210299 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:32.262914 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:32.262879 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:32.987297 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:32.987262 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:33.080471 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:33.080437 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:33.574569 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:33.574531 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:33.640802 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:33.640775 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:56:33.667466 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:33.667430 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:33.725637 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:33.725603 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:33.838116 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:33.838032 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:33.926642 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:33.926607 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:34.369917 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:34.369878 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:34.473202 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:34.473161 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:35.382703 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:35.382644 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:35.464830 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:35.464796 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:35.523858 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:35.523827 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:35.863608 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:35.863564 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d45cd845c-n5nn5"] Jul 15 17:56:35.953925 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:35.953878 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:36.055744 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:36.055614 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:36.467556 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:56:36.467519 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d235e73_df9f_444c_8f8f_c5ee1ab9babe.slice/crio-b288617ff7d3fa182a8923b3b61b8088f9e6f23467db3a8846d75b6acfffc93c WatchSource:0}: Error finding container b288617ff7d3fa182a8923b3b61b8088f9e6f23467db3a8846d75b6acfffc93c: Status 404 returned error can't find the container with id b288617ff7d3fa182a8923b3b61b8088f9e6f23467db3a8846d75b6acfffc93c Jul 15 17:56:36.508616 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:36.508581 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:36.608619 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:36.608586 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:36.709029 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:36.709003 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:36.765548 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:36.765518 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krmdj" event={"ID":"1d235e73-df9f-444c-8f8f-c5ee1ab9babe","Type":"ContainerStarted","Data":"b288617ff7d3fa182a8923b3b61b8088f9e6f23467db3a8846d75b6acfffc93c"} Jul 15 17:56:36.905430 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:36.905394 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:37.772286 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:37.772189 2551 generic.go:356] "Generic (PLEG): container finished" podID="1d235e73-df9f-444c-8f8f-c5ee1ab9babe" containerID="dbc321d5959baa890f7ebe5972006edd1e631af9f2918f1188df204d75975762" exitCode=0 Jul 15 17:56:37.772745 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:37.772287 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krmdj" event={"ID":"1d235e73-df9f-444c-8f8f-c5ee1ab9babe","Type":"ContainerDied","Data":"dbc321d5959baa890f7ebe5972006edd1e631af9f2918f1188df204d75975762"} Jul 15 17:56:37.774320 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:37.774284 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/downloads-68c9cbb497-dmgfp" event={"ID":"85434ffb-4c25-4714-aec1-0bd9e09c8f80","Type":"ContainerStarted","Data":"fd924051b8f53738ea112cc7a5d8f950b79784301cdba86aa22b85f86132dbe9"} Jul 15 17:56:37.774520 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:37.774467 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/downloads-68c9cbb497-dmgfp" Jul 15 17:56:37.786257 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:37.786235 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/downloads-68c9cbb497-dmgfp" Jul 15 17:56:37.809031 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:37.808983 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/downloads-68c9cbb497-dmgfp" podStartSLOduration=6.985383462 podStartE2EDuration="24.808965101s" totalImagesPullingTime="17.823581639s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:56:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:56:37.807606158 +0000 UTC m=+96.142914490" watchObservedRunningTime="2026-07-15 17:56:37.808965101 +0000 UTC m=+96.144273404" Jul 15 17:56:38.781125 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:38.781076 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krmdj" event={"ID":"1d235e73-df9f-444c-8f8f-c5ee1ab9babe","Type":"ContainerStarted","Data":"23e563d164531829be5a5e26b8b486405d949a21ff150ffa8ed6cffdd1221f6f"} Jul 15 17:56:38.781594 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:38.781172 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-krmdj" event={"ID":"1d235e73-df9f-444c-8f8f-c5ee1ab9babe","Type":"ContainerStarted","Data":"e3ce7f940fbded2745ba982424746416d2e8dddc1365c8a0f36ad172fe26820d"} Jul 15 17:56:38.799808 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:38.799751 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-krmdj" podStartSLOduration=7.733089524 podStartE2EDuration="8.79973067s" totalImagesPullingTime="956.905706ms" totalInitContainerRuntime="109.73544ms" isStatefulPod=true podCreationTimestamp="2026-07-15 17:56:30 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:56:38.798335687 +0000 UTC m=+97.133644001" watchObservedRunningTime="2026-07-15 17:56:38.79973067 +0000 UTC m=+97.135038973" Jul 15 17:56:39.982306 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:39.982272 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:40.085685 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:40.085623 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:42.163789 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:42.163749 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:42.262783 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:42.262749 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:42.634826 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:42.634786 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-rd5vp" Jul 15 17:56:47.018958 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:47.018922 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:47.079686 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:47.079642 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:47.139476 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:47.139446 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:48.864950 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:48.864910 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:48.920077 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:48.920041 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:49.373264 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:49.373228 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:56:49.434440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:56:49.434409 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:57:00.893520 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:00.893459 2551 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" podUID="b2688c99-ce3c-4720-8c2c-11043d337b49" containerName="registry" containerID="cri-o://7486134592b85cd075301030f19edc2425161d6cc7b042ce9496e092feae7026" gracePeriod=30 Jul 15 17:57:01.160114 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.160059 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:57:01.314018 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.313991 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8p95j\" (UniqueName: \"kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-kube-api-access-8p95j\") pod \"b2688c99-ce3c-4720-8c2c-11043d337b49\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " Jul 15 17:57:01.314164 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.314034 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls\") pod \"b2688c99-ce3c-4720-8c2c-11043d337b49\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " Jul 15 17:57:01.314164 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.314058 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2688c99-ce3c-4720-8c2c-11043d337b49-installation-pull-secrets\") pod \"b2688c99-ce3c-4720-8c2c-11043d337b49\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " Jul 15 17:57:01.314164 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.314079 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2688c99-ce3c-4720-8c2c-11043d337b49-image-registry-private-configuration\") pod \"b2688c99-ce3c-4720-8c2c-11043d337b49\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " Jul 15 17:57:01.314308 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.314254 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-certificates\") pod \"b2688c99-ce3c-4720-8c2c-11043d337b49\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " Jul 15 17:57:01.314370 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.314319 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-bound-sa-token\") pod \"b2688c99-ce3c-4720-8c2c-11043d337b49\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " Jul 15 17:57:01.314421 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.314366 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2688c99-ce3c-4720-8c2c-11043d337b49-trusted-ca\") pod \"b2688c99-ce3c-4720-8c2c-11043d337b49\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " Jul 15 17:57:01.314421 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.314410 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2688c99-ce3c-4720-8c2c-11043d337b49-ca-trust-extracted\") pod \"b2688c99-ce3c-4720-8c2c-11043d337b49\" (UID: \"b2688c99-ce3c-4720-8c2c-11043d337b49\") " Jul 15 17:57:01.315170 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.315134 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2688c99-ce3c-4720-8c2c-11043d337b49-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "b2688c99-ce3c-4720-8c2c-11043d337b49" (UID: "b2688c99-ce3c-4720-8c2c-11043d337b49"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 17:57:01.315314 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.314761 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "b2688c99-ce3c-4720-8c2c-11043d337b49" (UID: "b2688c99-ce3c-4720-8c2c-11043d337b49"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 17:57:01.316679 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.316621 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2688c99-ce3c-4720-8c2c-11043d337b49-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "b2688c99-ce3c-4720-8c2c-11043d337b49" (UID: "b2688c99-ce3c-4720-8c2c-11043d337b49"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 17:57:01.316793 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.316768 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/b2688c99-ce3c-4720-8c2c-11043d337b49-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "b2688c99-ce3c-4720-8c2c-11043d337b49" (UID: "b2688c99-ce3c-4720-8c2c-11043d337b49"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 17:57:01.316970 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.316937 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "b2688c99-ce3c-4720-8c2c-11043d337b49" (UID: "b2688c99-ce3c-4720-8c2c-11043d337b49"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 17:57:01.317092 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.317070 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-kube-api-access-8p95j" (OuterVolumeSpecName: "kube-api-access-8p95j") pod "b2688c99-ce3c-4720-8c2c-11043d337b49" (UID: "b2688c99-ce3c-4720-8c2c-11043d337b49"). InnerVolumeSpecName "kube-api-access-8p95j". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 17:57:01.317163 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.317146 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "b2688c99-ce3c-4720-8c2c-11043d337b49" (UID: "b2688c99-ce3c-4720-8c2c-11043d337b49"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 17:57:01.324005 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.323984 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b2688c99-ce3c-4720-8c2c-11043d337b49-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "b2688c99-ce3c-4720-8c2c-11043d337b49" (UID: "b2688c99-ce3c-4720-8c2c-11043d337b49"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 17:57:01.415417 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.415332 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8p95j\" (UniqueName: \"kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-kube-api-access-8p95j\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 17:57:01.415417 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.415367 2551 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-tls\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 17:57:01.415417 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.415377 2551 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/b2688c99-ce3c-4720-8c2c-11043d337b49-installation-pull-secrets\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 17:57:01.415417 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.415387 2551 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/b2688c99-ce3c-4720-8c2c-11043d337b49-image-registry-private-configuration\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 17:57:01.415417 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.415396 2551 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/b2688c99-ce3c-4720-8c2c-11043d337b49-registry-certificates\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 17:57:01.415417 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.415405 2551 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/b2688c99-ce3c-4720-8c2c-11043d337b49-bound-sa-token\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 17:57:01.415417 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.415415 2551 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/b2688c99-ce3c-4720-8c2c-11043d337b49-trusted-ca\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 17:57:01.415417 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.415424 2551 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/b2688c99-ce3c-4720-8c2c-11043d337b49-ca-trust-extracted\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 17:57:01.866911 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.866877 2551 generic.go:356] "Generic (PLEG): container finished" podID="b2688c99-ce3c-4720-8c2c-11043d337b49" containerID="7486134592b85cd075301030f19edc2425161d6cc7b042ce9496e092feae7026" exitCode=0 Jul 15 17:57:01.867059 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.866916 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" Jul 15 17:57:01.867059 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.866962 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" event={"ID":"b2688c99-ce3c-4720-8c2c-11043d337b49","Type":"ContainerDied","Data":"7486134592b85cd075301030f19edc2425161d6cc7b042ce9496e092feae7026"} Jul 15 17:57:01.867059 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.867012 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-7d45cd845c-n5nn5" event={"ID":"b2688c99-ce3c-4720-8c2c-11043d337b49","Type":"ContainerDied","Data":"76528ceb7dd4d950de4dcf930459a90d465b50ae2224587e84206608cdc545e1"} Jul 15 17:57:01.867059 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.867031 2551 scope.go:117] "RemoveContainer" containerID="7486134592b85cd075301030f19edc2425161d6cc7b042ce9496e092feae7026" Jul 15 17:57:01.882846 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.882825 2551 scope.go:117] "RemoveContainer" containerID="7486134592b85cd075301030f19edc2425161d6cc7b042ce9496e092feae7026" Jul 15 17:57:01.883088 ip-10-0-128-25 kubenswrapper[2551]: E0715 17:57:01.883067 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7486134592b85cd075301030f19edc2425161d6cc7b042ce9496e092feae7026\": container with ID starting with 7486134592b85cd075301030f19edc2425161d6cc7b042ce9496e092feae7026 not found: ID does not exist" containerID="7486134592b85cd075301030f19edc2425161d6cc7b042ce9496e092feae7026" Jul 15 17:57:01.883140 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.883095 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7486134592b85cd075301030f19edc2425161d6cc7b042ce9496e092feae7026"} err="failed to get container status \"7486134592b85cd075301030f19edc2425161d6cc7b042ce9496e092feae7026\": rpc error: code = NotFound desc = could not find container \"7486134592b85cd075301030f19edc2425161d6cc7b042ce9496e092feae7026\": container with ID starting with 7486134592b85cd075301030f19edc2425161d6cc7b042ce9496e092feae7026 not found: ID does not exist" Jul 15 17:57:01.887256 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.887236 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-7d45cd845c-n5nn5"] Jul 15 17:57:01.892511 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:01.892492 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-7d45cd845c-n5nn5"] Jul 15 17:57:02.210792 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:02.210718 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b2688c99-ce3c-4720-8c2c-11043d337b49" path="/var/lib/kubelet/pods/b2688c99-ce3c-4720-8c2c-11043d337b49/volumes" Jul 15 17:57:04.373225 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:04.373189 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:57:04.476019 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:04.475983 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:57:06.647085 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:06.647045 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:57:06.703823 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:06.703792 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:57:13.909510 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:13.909473 2551 generic.go:356] "Generic (PLEG): container finished" podID="bd7b71a8-c2dc-4c96-998c-2e4f1924c746" containerID="0d905d6e10ba4fea8538b3efdf207557835d086f0ba8f0f51405893a04bfd344" exitCode=0 Jul 15 17:57:13.910000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:13.909534 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9pdlp" event={"ID":"bd7b71a8-c2dc-4c96-998c-2e4f1924c746","Type":"ContainerDied","Data":"0d905d6e10ba4fea8538b3efdf207557835d086f0ba8f0f51405893a04bfd344"} Jul 15 17:57:13.910000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:13.909948 2551 scope.go:117] "RemoveContainer" containerID="0d905d6e10ba4fea8538b3efdf207557835d086f0ba8f0f51405893a04bfd344" Jul 15 17:57:14.914906 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:14.914865 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-799cb7f958-9pdlp" event={"ID":"bd7b71a8-c2dc-4c96-998c-2e4f1924c746","Type":"ContainerStarted","Data":"73938c9e05fb0b63c3bed8a11917e0fc93cd7e58f85dcecb9bc3d04121a513e6"} Jul 15 17:57:17.927195 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:17.927119 2551 generic.go:356] "Generic (PLEG): container finished" podID="d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4" containerID="8432b64d8f6c5124f1cc0390c78415e91ef7c2047dab4ff126c477072a3cb999" exitCode=0 Jul 15 17:57:17.927195 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:17.927161 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" event={"ID":"d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4","Type":"ContainerDied","Data":"8432b64d8f6c5124f1cc0390c78415e91ef7c2047dab4ff126c477072a3cb999"} Jul 15 17:57:17.927567 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:17.927503 2551 scope.go:117] "RemoveContainer" containerID="8432b64d8f6c5124f1cc0390c78415e91ef7c2047dab4ff126c477072a3cb999" Jul 15 17:57:18.932346 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:18.932308 2551 generic.go:356] "Generic (PLEG): container finished" podID="f00291c5-c987-4f12-a396-29617c98c495" containerID="845b35d8e3d7aae490aaf858fdd977bf28ad713a96d0d47687baffcea435a3e7" exitCode=0 Jul 15 17:57:18.932799 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:18.932389 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m9qlq" event={"ID":"f00291c5-c987-4f12-a396-29617c98c495","Type":"ContainerDied","Data":"845b35d8e3d7aae490aaf858fdd977bf28ad713a96d0d47687baffcea435a3e7"} Jul 15 17:57:18.932867 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:18.932802 2551 scope.go:117] "RemoveContainer" containerID="845b35d8e3d7aae490aaf858fdd977bf28ad713a96d0d47687baffcea435a3e7" Jul 15 17:57:18.934327 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:18.934307 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-68d9dd94cf-jrxtm" event={"ID":"d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4","Type":"ContainerStarted","Data":"ed2f8e133b5e19bb88d743ae919c85c54e3c82dfffd6bf39d6a5dbb74cf2a0c2"} Jul 15 17:57:19.940105 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:19.940071 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-7695fc6c8c-m9qlq" event={"ID":"f00291c5-c987-4f12-a396-29617c98c495","Type":"ContainerStarted","Data":"4d4ae9cd7c4837f81c0889ee74ab53523293c61e39364679c19d387221d812eb"} Jul 15 17:57:40.402390 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:40.402354 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:57:49.906004 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:49.905973 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:57:50.208289 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:50.208202 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:57:55.010770 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.010694 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-cd88f6db4-qc95l"] Jul 15 17:57:55.011103 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.010963 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b2688c99-ce3c-4720-8c2c-11043d337b49" containerName="registry" Jul 15 17:57:55.011103 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.010973 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="b2688c99-ce3c-4720-8c2c-11043d337b49" containerName="registry" Jul 15 17:57:55.011103 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.011017 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="b2688c99-ce3c-4720-8c2c-11043d337b49" containerName="registry" Jul 15 17:57:55.013021 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.013003 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.015162 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.015131 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 15 17:57:55.015621 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.015595 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 15 17:57:55.015741 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.015724 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 15 17:57:55.015810 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.015738 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 15 17:57:55.016145 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.016130 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-jftzx\"" Jul 15 17:57:55.016210 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.016135 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 15 17:57:55.022074 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.022050 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 15 17:57:55.026903 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.026882 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-cd88f6db4-qc95l"] Jul 15 17:57:55.093489 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.093458 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ef715998-d30f-422e-8233-b56e608d5f61-federate-client-tls\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.093614 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.093504 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef715998-d30f-422e-8233-b56e608d5f61-serving-certs-ca-bundle\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.093614 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.093522 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef715998-d30f-422e-8233-b56e608d5f61-telemeter-trusted-ca-bundle\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.093614 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.093546 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef715998-d30f-422e-8233-b56e608d5f61-metrics-client-ca\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.093614 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.093572 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef715998-d30f-422e-8233-b56e608d5f61-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.093614 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.093607 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ef715998-d30f-422e-8233-b56e608d5f61-telemeter-client-tls\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.093805 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.093655 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-chk7z\" (UniqueName: \"kubernetes.io/projected/ef715998-d30f-422e-8233-b56e608d5f61-kube-api-access-chk7z\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.093805 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.093701 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ef715998-d30f-422e-8233-b56e608d5f61-secret-telemeter-client\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.194726 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.194697 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-chk7z\" (UniqueName: \"kubernetes.io/projected/ef715998-d30f-422e-8233-b56e608d5f61-kube-api-access-chk7z\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.194853 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.194733 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ef715998-d30f-422e-8233-b56e608d5f61-secret-telemeter-client\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.194853 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.194763 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ef715998-d30f-422e-8233-b56e608d5f61-federate-client-tls\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.194853 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.194783 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef715998-d30f-422e-8233-b56e608d5f61-serving-certs-ca-bundle\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.194853 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.194801 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef715998-d30f-422e-8233-b56e608d5f61-telemeter-trusted-ca-bundle\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.194853 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.194826 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef715998-d30f-422e-8233-b56e608d5f61-metrics-client-ca\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.194853 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.194851 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef715998-d30f-422e-8233-b56e608d5f61-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.195102 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.194890 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ef715998-d30f-422e-8233-b56e608d5f61-telemeter-client-tls\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.195690 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.195648 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef715998-d30f-422e-8233-b56e608d5f61-serving-certs-ca-bundle\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.195938 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.195916 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ef715998-d30f-422e-8233-b56e608d5f61-metrics-client-ca\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.195986 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.195944 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/ef715998-d30f-422e-8233-b56e608d5f61-telemeter-trusted-ca-bundle\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.197379 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.197357 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/ef715998-d30f-422e-8233-b56e608d5f61-secret-telemeter-client\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.197564 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.197530 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ef715998-d30f-422e-8233-b56e608d5f61-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.197846 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.197830 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/ef715998-d30f-422e-8233-b56e608d5f61-telemeter-client-tls\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.197894 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.197862 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/ef715998-d30f-422e-8233-b56e608d5f61-federate-client-tls\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.205920 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.205902 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-chk7z\" (UniqueName: \"kubernetes.io/projected/ef715998-d30f-422e-8233-b56e608d5f61-kube-api-access-chk7z\") pod \"telemeter-client-cd88f6db4-qc95l\" (UID: \"ef715998-d30f-422e-8233-b56e608d5f61\") " pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.323094 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.323040 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" Jul 15 17:57:55.468981 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:55.468868 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-cd88f6db4-qc95l"] Jul 15 17:57:55.471788 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:57:55.471766 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef715998_d30f_422e_8233_b56e608d5f61.slice/crio-9e03c22655610914166632fb4c09baab6bb82fdbe5315a5123872b01271cdd52 WatchSource:0}: Error finding container 9e03c22655610914166632fb4c09baab6bb82fdbe5315a5123872b01271cdd52: Status 404 returned error can't find the container with id 9e03c22655610914166632fb4c09baab6bb82fdbe5315a5123872b01271cdd52 Jul 15 17:57:56.069096 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:56.069060 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" event={"ID":"ef715998-d30f-422e-8233-b56e608d5f61","Type":"ContainerStarted","Data":"9e03c22655610914166632fb4c09baab6bb82fdbe5315a5123872b01271cdd52"} Jul 15 17:57:58.078094 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:58.078063 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" event={"ID":"ef715998-d30f-422e-8233-b56e608d5f61","Type":"ContainerStarted","Data":"8e82a89495af9cfa44eb9940bd878d39f2b4843855e253ca087c49ac48c7cef9"} Jul 15 17:57:59.084627 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:59.084588 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" event={"ID":"ef715998-d30f-422e-8233-b56e608d5f61","Type":"ContainerStarted","Data":"c5085b32eb63f89d87060a4d7304c84905f5bb3e8a12498a327e3e78a6fa81e3"} Jul 15 17:57:59.085017 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:59.084681 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" event={"ID":"ef715998-d30f-422e-8233-b56e608d5f61","Type":"ContainerStarted","Data":"aacf6e8e0d3c4cb92bb74be9002fb95506007d96a12f79386a0f59ff3a8b620a"} Jul 15 17:57:59.111723 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:59.108990 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-cd88f6db4-qc95l" podStartSLOduration=2.332181074 podStartE2EDuration="5.108969486s" totalImagesPullingTime="2.776788412s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:57:54 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:57:59.10700018 +0000 UTC m=+177.442308483" watchObservedRunningTime="2026-07-15 17:57:59.108969486 +0000 UTC m=+177.444277791" Jul 15 17:57:59.812848 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:57:59.812808 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:58:05.216604 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:05.216562 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:58:05.265946 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:05.265913 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:58:06.784122 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:06.784090 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:58:06.885616 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:06.885580 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:58:07.384815 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:07.384783 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:58:07.438110 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:07.438071 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:58:17.064016 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:17.063955 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:58:17.120702 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:17.120653 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:58:17.412711 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:17.412658 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:58:17.467119 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:17.467094 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:58:17.526870 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:17.526838 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:58:21.351401 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:21.351362 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:58:21.452208 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:21.452171 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:58:38.597268 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:38.597231 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:58:52.356246 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:52.356210 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:58:52.523948 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:52.523911 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:58:53.230928 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:53.230895 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d"] Jul 15 17:58:53.234139 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:53.234121 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d" Jul 15 17:58:53.236142 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:53.236112 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 17:58:53.236236 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:53.236152 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 17:58:53.236468 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:53.236454 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-t6jwt\"" Jul 15 17:58:53.250034 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:53.250011 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d"] Jul 15 17:58:53.315492 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:53.315470 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5774691e-d940-4f72-8147-ddb255f877df-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d\" (UID: \"5774691e-d940-4f72-8147-ddb255f877df\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d" Jul 15 17:58:53.315604 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:53.315499 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9lj2h\" (UniqueName: \"kubernetes.io/projected/5774691e-d940-4f72-8147-ddb255f877df-kube-api-access-9lj2h\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d\" (UID: \"5774691e-d940-4f72-8147-ddb255f877df\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d" Jul 15 17:58:53.315604 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:53.315539 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5774691e-d940-4f72-8147-ddb255f877df-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d\" (UID: \"5774691e-d940-4f72-8147-ddb255f877df\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d" Jul 15 17:58:53.416819 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:53.416791 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5774691e-d940-4f72-8147-ddb255f877df-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d\" (UID: \"5774691e-d940-4f72-8147-ddb255f877df\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d" Jul 15 17:58:53.417248 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:53.416835 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9lj2h\" (UniqueName: \"kubernetes.io/projected/5774691e-d940-4f72-8147-ddb255f877df-kube-api-access-9lj2h\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d\" (UID: \"5774691e-d940-4f72-8147-ddb255f877df\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d" Jul 15 17:58:53.417248 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:53.416888 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5774691e-d940-4f72-8147-ddb255f877df-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d\" (UID: \"5774691e-d940-4f72-8147-ddb255f877df\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d" Jul 15 17:58:53.417248 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:53.417095 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5774691e-d940-4f72-8147-ddb255f877df-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d\" (UID: \"5774691e-d940-4f72-8147-ddb255f877df\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d" Jul 15 17:58:53.417248 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:53.417159 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5774691e-d940-4f72-8147-ddb255f877df-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d\" (UID: \"5774691e-d940-4f72-8147-ddb255f877df\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d" Jul 15 17:58:53.424752 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:53.424729 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9lj2h\" (UniqueName: \"kubernetes.io/projected/5774691e-d940-4f72-8147-ddb255f877df-kube-api-access-9lj2h\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d\" (UID: \"5774691e-d940-4f72-8147-ddb255f877df\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d" Jul 15 17:58:53.542714 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:53.542626 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d" Jul 15 17:58:53.672480 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:53.672448 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d"] Jul 15 17:58:53.675917 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:58:53.675889 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5774691e_d940_4f72_8147_ddb255f877df.slice/crio-d7a600e7ac4f4a1f568a5c7c423beba04460a60ac42c8cedb87dd49864a8d915 WatchSource:0}: Error finding container d7a600e7ac4f4a1f568a5c7c423beba04460a60ac42c8cedb87dd49864a8d915: Status 404 returned error can't find the container with id d7a600e7ac4f4a1f568a5c7c423beba04460a60ac42c8cedb87dd49864a8d915 Jul 15 17:58:54.277859 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:54.277821 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d" event={"ID":"5774691e-d940-4f72-8147-ddb255f877df","Type":"ContainerStarted","Data":"d7a600e7ac4f4a1f568a5c7c423beba04460a60ac42c8cedb87dd49864a8d915"} Jul 15 17:58:54.522295 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:54.522256 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:58:58.173081 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:58:58.173039 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:59:01.305085 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:01.305046 2551 generic.go:356] "Generic (PLEG): container finished" podID="5774691e-d940-4f72-8147-ddb255f877df" containerID="b523f41edc1b5e3449f198916d3e1fe0111107dd8ce9a41905a1dc2781dcf486" exitCode=0 Jul 15 17:59:01.305085 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:01.305087 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d" event={"ID":"5774691e-d940-4f72-8147-ddb255f877df","Type":"ContainerDied","Data":"b523f41edc1b5e3449f198916d3e1fe0111107dd8ce9a41905a1dc2781dcf486"} Jul 15 17:59:03.315379 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:03.315350 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d" event={"ID":"5774691e-d940-4f72-8147-ddb255f877df","Type":"ContainerStarted","Data":"aa04b8bfc9ac9fb8807dd54afe7068c43f7b9f85a2c9f77eb607e81cba8b85a7"} Jul 15 17:59:04.320976 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:04.320945 2551 generic.go:356] "Generic (PLEG): container finished" podID="5774691e-d940-4f72-8147-ddb255f877df" containerID="aa04b8bfc9ac9fb8807dd54afe7068c43f7b9f85a2c9f77eb607e81cba8b85a7" exitCode=0 Jul 15 17:59:04.321450 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:04.321019 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d" event={"ID":"5774691e-d940-4f72-8147-ddb255f877df","Type":"ContainerDied","Data":"aa04b8bfc9ac9fb8807dd54afe7068c43f7b9f85a2c9f77eb607e81cba8b85a7"} Jul 15 17:59:11.351578 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:11.351550 2551 generic.go:356] "Generic (PLEG): container finished" podID="5774691e-d940-4f72-8147-ddb255f877df" containerID="9aaceaac48524103d562440cdde830827bd812ea1d0bbecba74d04438c18fe7a" exitCode=0 Jul 15 17:59:11.352003 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:11.351634 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d" event={"ID":"5774691e-d940-4f72-8147-ddb255f877df","Type":"ContainerDied","Data":"9aaceaac48524103d562440cdde830827bd812ea1d0bbecba74d04438c18fe7a"} Jul 15 17:59:12.478002 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:12.477979 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d" Jul 15 17:59:12.570116 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:12.570079 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5774691e-d940-4f72-8147-ddb255f877df-util\") pod \"5774691e-d940-4f72-8147-ddb255f877df\" (UID: \"5774691e-d940-4f72-8147-ddb255f877df\") " Jul 15 17:59:12.570268 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:12.570143 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5774691e-d940-4f72-8147-ddb255f877df-bundle\") pod \"5774691e-d940-4f72-8147-ddb255f877df\" (UID: \"5774691e-d940-4f72-8147-ddb255f877df\") " Jul 15 17:59:12.570268 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:12.570179 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-9lj2h\" (UniqueName: \"kubernetes.io/projected/5774691e-d940-4f72-8147-ddb255f877df-kube-api-access-9lj2h\") pod \"5774691e-d940-4f72-8147-ddb255f877df\" (UID: \"5774691e-d940-4f72-8147-ddb255f877df\") " Jul 15 17:59:12.570844 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:12.570820 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5774691e-d940-4f72-8147-ddb255f877df-bundle" (OuterVolumeSpecName: "bundle") pod "5774691e-d940-4f72-8147-ddb255f877df" (UID: "5774691e-d940-4f72-8147-ddb255f877df"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 17:59:12.572425 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:12.572398 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5774691e-d940-4f72-8147-ddb255f877df-kube-api-access-9lj2h" (OuterVolumeSpecName: "kube-api-access-9lj2h") pod "5774691e-d940-4f72-8147-ddb255f877df" (UID: "5774691e-d940-4f72-8147-ddb255f877df"). InnerVolumeSpecName "kube-api-access-9lj2h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 17:59:12.574139 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:12.574118 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5774691e-d940-4f72-8147-ddb255f877df-util" (OuterVolumeSpecName: "util") pod "5774691e-d940-4f72-8147-ddb255f877df" (UID: "5774691e-d940-4f72-8147-ddb255f877df"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 17:59:12.671458 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:12.671364 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5774691e-d940-4f72-8147-ddb255f877df-bundle\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 17:59:12.671458 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:12.671403 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-9lj2h\" (UniqueName: \"kubernetes.io/projected/5774691e-d940-4f72-8147-ddb255f877df-kube-api-access-9lj2h\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 17:59:12.671458 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:12.671414 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5774691e-d940-4f72-8147-ddb255f877df-util\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 17:59:13.361396 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:13.361359 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d" event={"ID":"5774691e-d940-4f72-8147-ddb255f877df","Type":"ContainerDied","Data":"d7a600e7ac4f4a1f568a5c7c423beba04460a60ac42c8cedb87dd49864a8d915"} Jul 15 17:59:13.361560 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:13.361415 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d7a600e7ac4f4a1f568a5c7c423beba04460a60ac42c8cedb87dd49864a8d915" Jul 15 17:59:13.361560 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:13.361372 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540jdp2d" Jul 15 17:59:19.488510 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:19.488469 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:59:20.832074 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:20.832031 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:59:21.465303 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:21.465269 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lfp4g"] Jul 15 17:59:21.465622 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:21.465604 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5774691e-d940-4f72-8147-ddb255f877df" containerName="util" Jul 15 17:59:21.465734 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:21.465625 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="5774691e-d940-4f72-8147-ddb255f877df" containerName="util" Jul 15 17:59:21.465734 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:21.465651 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5774691e-d940-4f72-8147-ddb255f877df" containerName="extract" Jul 15 17:59:21.465734 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:21.465659 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="5774691e-d940-4f72-8147-ddb255f877df" containerName="extract" Jul 15 17:59:21.465734 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:21.465691 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5774691e-d940-4f72-8147-ddb255f877df" containerName="pull" Jul 15 17:59:21.465734 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:21.465700 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="5774691e-d940-4f72-8147-ddb255f877df" containerName="pull" Jul 15 17:59:21.465967 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:21.465790 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="5774691e-d940-4f72-8147-ddb255f877df" containerName="extract" Jul 15 17:59:21.468929 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:21.468907 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lfp4g" Jul 15 17:59:21.470948 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:21.470928 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 15 17:59:21.471047 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:21.471021 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-v5pnz\"" Jul 15 17:59:21.471101 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:21.471027 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 15 17:59:21.485106 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:21.485082 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lfp4g"] Jul 15 17:59:21.535318 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:21.535295 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a93f55dd-2aba-4b0d-8cc3-13ab7e7510df-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lfp4g\" (UID: \"a93f55dd-2aba-4b0d-8cc3-13ab7e7510df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lfp4g" Jul 15 17:59:21.535411 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:21.535336 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qs9k4\" (UniqueName: \"kubernetes.io/projected/a93f55dd-2aba-4b0d-8cc3-13ab7e7510df-kube-api-access-qs9k4\") pod \"cert-manager-operator-controller-manager-55c444bf86-lfp4g\" (UID: \"a93f55dd-2aba-4b0d-8cc3-13ab7e7510df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lfp4g" Jul 15 17:59:21.635795 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:21.635766 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qs9k4\" (UniqueName: \"kubernetes.io/projected/a93f55dd-2aba-4b0d-8cc3-13ab7e7510df-kube-api-access-qs9k4\") pod \"cert-manager-operator-controller-manager-55c444bf86-lfp4g\" (UID: \"a93f55dd-2aba-4b0d-8cc3-13ab7e7510df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lfp4g" Jul 15 17:59:21.635895 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:21.635829 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a93f55dd-2aba-4b0d-8cc3-13ab7e7510df-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lfp4g\" (UID: \"a93f55dd-2aba-4b0d-8cc3-13ab7e7510df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lfp4g" Jul 15 17:59:21.636107 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:21.636093 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/a93f55dd-2aba-4b0d-8cc3-13ab7e7510df-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-lfp4g\" (UID: \"a93f55dd-2aba-4b0d-8cc3-13ab7e7510df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lfp4g" Jul 15 17:59:21.646571 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:21.646544 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qs9k4\" (UniqueName: \"kubernetes.io/projected/a93f55dd-2aba-4b0d-8cc3-13ab7e7510df-kube-api-access-qs9k4\") pod \"cert-manager-operator-controller-manager-55c444bf86-lfp4g\" (UID: \"a93f55dd-2aba-4b0d-8cc3-13ab7e7510df\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lfp4g" Jul 15 17:59:21.778047 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:21.777985 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lfp4g" Jul 15 17:59:21.914486 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:21.914462 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lfp4g"] Jul 15 17:59:21.917617 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:59:21.917593 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda93f55dd_2aba_4b0d_8cc3_13ab7e7510df.slice/crio-a27ac2570bdb4c0fa7b2016826a7c955944cf41f63543e82d1dace08845ed1f1 WatchSource:0}: Error finding container a27ac2570bdb4c0fa7b2016826a7c955944cf41f63543e82d1dace08845ed1f1: Status 404 returned error can't find the container with id a27ac2570bdb4c0fa7b2016826a7c955944cf41f63543e82d1dace08845ed1f1 Jul 15 17:59:22.396103 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:22.396070 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lfp4g" event={"ID":"a93f55dd-2aba-4b0d-8cc3-13ab7e7510df","Type":"ContainerStarted","Data":"a27ac2570bdb4c0fa7b2016826a7c955944cf41f63543e82d1dace08845ed1f1"} Jul 15 17:59:23.143869 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:23.143788 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:59:23.243362 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:23.243325 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:59:24.406187 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:24.406148 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lfp4g" event={"ID":"a93f55dd-2aba-4b0d-8cc3-13ab7e7510df","Type":"ContainerStarted","Data":"e51efb11d65957c802cc744d5599617127c75ee070cb9df50074af4bd4c80cd6"} Jul 15 17:59:24.429859 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:24.429799 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-lfp4g" podStartSLOduration=1.659994687 podStartE2EDuration="3.429780524s" totalImagesPullingTime="1.769785837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:59:21 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:59:24.427986536 +0000 UTC m=+262.763294855" watchObservedRunningTime="2026-07-15 17:59:24.429780524 +0000 UTC m=+262.765088828" Jul 15 17:59:24.608221 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:24.608184 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:59:24.713126 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:24.713047 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:59:24.833826 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:24.833799 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:59:24.928126 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:24.928096 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:59:26.140481 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:26.140448 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2"] Jul 15 17:59:26.143820 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:26.143803 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2" Jul 15 17:59:26.146053 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:26.146029 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 17:59:26.146499 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:26.146483 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 17:59:26.146577 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:26.146486 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-t6jwt\"" Jul 15 17:59:26.155912 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:26.155891 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2"] Jul 15 17:59:26.170558 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:26.170536 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fhktz\" (UniqueName: \"kubernetes.io/projected/cb4a9891-0bc6-4edd-9ad0-0795a582822c-kube-api-access-fhktz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2\" (UID: \"cb4a9891-0bc6-4edd-9ad0-0795a582822c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2" Jul 15 17:59:26.170647 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:26.170596 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb4a9891-0bc6-4edd-9ad0-0795a582822c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2\" (UID: \"cb4a9891-0bc6-4edd-9ad0-0795a582822c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2" Jul 15 17:59:26.170647 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:26.170613 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb4a9891-0bc6-4edd-9ad0-0795a582822c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2\" (UID: \"cb4a9891-0bc6-4edd-9ad0-0795a582822c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2" Jul 15 17:59:26.271766 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:26.271730 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fhktz\" (UniqueName: \"kubernetes.io/projected/cb4a9891-0bc6-4edd-9ad0-0795a582822c-kube-api-access-fhktz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2\" (UID: \"cb4a9891-0bc6-4edd-9ad0-0795a582822c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2" Jul 15 17:59:26.271923 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:26.271793 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb4a9891-0bc6-4edd-9ad0-0795a582822c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2\" (UID: \"cb4a9891-0bc6-4edd-9ad0-0795a582822c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2" Jul 15 17:59:26.271923 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:26.271811 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb4a9891-0bc6-4edd-9ad0-0795a582822c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2\" (UID: \"cb4a9891-0bc6-4edd-9ad0-0795a582822c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2" Jul 15 17:59:26.272134 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:26.272115 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb4a9891-0bc6-4edd-9ad0-0795a582822c-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2\" (UID: \"cb4a9891-0bc6-4edd-9ad0-0795a582822c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2" Jul 15 17:59:26.272201 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:26.272168 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb4a9891-0bc6-4edd-9ad0-0795a582822c-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2\" (UID: \"cb4a9891-0bc6-4edd-9ad0-0795a582822c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2" Jul 15 17:59:26.281857 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:26.281828 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fhktz\" (UniqueName: \"kubernetes.io/projected/cb4a9891-0bc6-4edd-9ad0-0795a582822c-kube-api-access-fhktz\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2\" (UID: \"cb4a9891-0bc6-4edd-9ad0-0795a582822c\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2" Jul 15 17:59:26.452633 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:26.452550 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2" Jul 15 17:59:26.582821 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:26.582789 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2"] Jul 15 17:59:26.585822 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:59:26.585797 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcb4a9891_0bc6_4edd_9ad0_0795a582822c.slice/crio-65603551d8d566654353356a1b84c0934d52b2f7011b1735a75b2d17959ad15f WatchSource:0}: Error finding container 65603551d8d566654353356a1b84c0934d52b2f7011b1735a75b2d17959ad15f: Status 404 returned error can't find the container with id 65603551d8d566654353356a1b84c0934d52b2f7011b1735a75b2d17959ad15f Jul 15 17:59:27.018811 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:27.018780 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:59:27.411060 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:27.411027 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:59:27.419617 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:27.419592 2551 generic.go:356] "Generic (PLEG): container finished" podID="cb4a9891-0bc6-4edd-9ad0-0795a582822c" containerID="4f1577d548ee34a1b0fe400ccc93d99bfb5a206414c5643f576ee15608416cab" exitCode=0 Jul 15 17:59:27.419748 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:27.419625 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2" event={"ID":"cb4a9891-0bc6-4edd-9ad0-0795a582822c","Type":"ContainerDied","Data":"4f1577d548ee34a1b0fe400ccc93d99bfb5a206414c5643f576ee15608416cab"} Jul 15 17:59:27.419748 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:27.419711 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2" event={"ID":"cb4a9891-0bc6-4edd-9ad0-0795a582822c","Type":"ContainerStarted","Data":"65603551d8d566654353356a1b84c0934d52b2f7011b1735a75b2d17959ad15f"} Jul 15 17:59:28.194807 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:28.194773 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-75vr2"] Jul 15 17:59:28.197995 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:28.197973 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-75vr2" Jul 15 17:59:28.200225 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:28.200186 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-gtn4k\"" Jul 15 17:59:28.200225 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:28.200207 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 15 17:59:28.200414 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:28.200268 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 15 17:59:28.212994 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:28.212975 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-75vr2"] Jul 15 17:59:28.289608 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:28.289527 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/beb3aff4-b0d3-4543-b781-6a3c6a062835-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-75vr2\" (UID: \"beb3aff4-b0d3-4543-b781-6a3c6a062835\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-75vr2" Jul 15 17:59:28.289608 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:28.289558 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9b7wv\" (UniqueName: \"kubernetes.io/projected/beb3aff4-b0d3-4543-b781-6a3c6a062835-kube-api-access-9b7wv\") pod \"cert-manager-cainjector-559cdd8c87-75vr2\" (UID: \"beb3aff4-b0d3-4543-b781-6a3c6a062835\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-75vr2" Jul 15 17:59:28.390857 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:28.390823 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/beb3aff4-b0d3-4543-b781-6a3c6a062835-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-75vr2\" (UID: \"beb3aff4-b0d3-4543-b781-6a3c6a062835\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-75vr2" Jul 15 17:59:28.391060 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:28.390864 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9b7wv\" (UniqueName: \"kubernetes.io/projected/beb3aff4-b0d3-4543-b781-6a3c6a062835-kube-api-access-9b7wv\") pod \"cert-manager-cainjector-559cdd8c87-75vr2\" (UID: \"beb3aff4-b0d3-4543-b781-6a3c6a062835\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-75vr2" Jul 15 17:59:28.400370 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:28.400330 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/beb3aff4-b0d3-4543-b781-6a3c6a062835-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-75vr2\" (UID: \"beb3aff4-b0d3-4543-b781-6a3c6a062835\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-75vr2" Jul 15 17:59:28.400532 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:28.400332 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9b7wv\" (UniqueName: \"kubernetes.io/projected/beb3aff4-b0d3-4543-b781-6a3c6a062835-kube-api-access-9b7wv\") pod \"cert-manager-cainjector-559cdd8c87-75vr2\" (UID: \"beb3aff4-b0d3-4543-b781-6a3c6a062835\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-75vr2" Jul 15 17:59:28.517349 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:28.517267 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-75vr2" Jul 15 17:59:28.661259 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:28.661216 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-75vr2"] Jul 15 17:59:29.303389 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:59:29.303355 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podbeb3aff4_b0d3_4543_b781_6a3c6a062835.slice/crio-f10670e1cc3eb5c3c6098e441aa1f977bb250645efa8374dc37ffb5625a1879f WatchSource:0}: Error finding container f10670e1cc3eb5c3c6098e441aa1f977bb250645efa8374dc37ffb5625a1879f: Status 404 returned error can't find the container with id f10670e1cc3eb5c3c6098e441aa1f977bb250645efa8374dc37ffb5625a1879f Jul 15 17:59:29.429309 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:29.429281 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-75vr2" event={"ID":"beb3aff4-b0d3-4543-b781-6a3c6a062835","Type":"ContainerStarted","Data":"f10670e1cc3eb5c3c6098e441aa1f977bb250645efa8374dc37ffb5625a1879f"} Jul 15 17:59:29.431345 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:29.431322 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2" event={"ID":"cb4a9891-0bc6-4edd-9ad0-0795a582822c","Type":"ContainerStarted","Data":"d7b602b674eda6b84f8fe89158c34054493ef25a328a5635f8974a05e0d03e83"} Jul 15 17:59:29.934425 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:29.934392 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:59:30.040873 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:30.040842 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:59:30.438251 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:30.438206 2551 generic.go:356] "Generic (PLEG): container finished" podID="cb4a9891-0bc6-4edd-9ad0-0795a582822c" containerID="d7b602b674eda6b84f8fe89158c34054493ef25a328a5635f8974a05e0d03e83" exitCode=0 Jul 15 17:59:30.438433 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:30.438294 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2" event={"ID":"cb4a9891-0bc6-4edd-9ad0-0795a582822c","Type":"ContainerDied","Data":"d7b602b674eda6b84f8fe89158c34054493ef25a328a5635f8974a05e0d03e83"} Jul 15 17:59:31.444213 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:31.444174 2551 generic.go:356] "Generic (PLEG): container finished" podID="cb4a9891-0bc6-4edd-9ad0-0795a582822c" containerID="5802a4ffb85129ef4c1e90b6c67a35212e516c16d7b7027eb52f3082a9662aab" exitCode=0 Jul 15 17:59:31.444564 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:31.444241 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2" event={"ID":"cb4a9891-0bc6-4edd-9ad0-0795a582822c","Type":"ContainerDied","Data":"5802a4ffb85129ef4c1e90b6c67a35212e516c16d7b7027eb52f3082a9662aab"} Jul 15 17:59:32.605111 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.605085 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2" Jul 15 17:59:32.727000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.726929 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-fhktz\" (UniqueName: \"kubernetes.io/projected/cb4a9891-0bc6-4edd-9ad0-0795a582822c-kube-api-access-fhktz\") pod \"cb4a9891-0bc6-4edd-9ad0-0795a582822c\" (UID: \"cb4a9891-0bc6-4edd-9ad0-0795a582822c\") " Jul 15 17:59:32.727000 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.726986 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb4a9891-0bc6-4edd-9ad0-0795a582822c-bundle\") pod \"cb4a9891-0bc6-4edd-9ad0-0795a582822c\" (UID: \"cb4a9891-0bc6-4edd-9ad0-0795a582822c\") " Jul 15 17:59:32.727149 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.727027 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb4a9891-0bc6-4edd-9ad0-0795a582822c-util\") pod \"cb4a9891-0bc6-4edd-9ad0-0795a582822c\" (UID: \"cb4a9891-0bc6-4edd-9ad0-0795a582822c\") " Jul 15 17:59:32.727346 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.727326 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb4a9891-0bc6-4edd-9ad0-0795a582822c-bundle" (OuterVolumeSpecName: "bundle") pod "cb4a9891-0bc6-4edd-9ad0-0795a582822c" (UID: "cb4a9891-0bc6-4edd-9ad0-0795a582822c"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 17:59:32.729591 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.729559 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/cb4a9891-0bc6-4edd-9ad0-0795a582822c-kube-api-access-fhktz" (OuterVolumeSpecName: "kube-api-access-fhktz") pod "cb4a9891-0bc6-4edd-9ad0-0795a582822c" (UID: "cb4a9891-0bc6-4edd-9ad0-0795a582822c"). InnerVolumeSpecName "kube-api-access-fhktz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 17:59:32.733279 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.733227 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/cb4a9891-0bc6-4edd-9ad0-0795a582822c-util" (OuterVolumeSpecName: "util") pod "cb4a9891-0bc6-4edd-9ad0-0795a582822c" (UID: "cb4a9891-0bc6-4edd-9ad0-0795a582822c"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 17:59:32.797769 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.797730 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qxh9q"] Jul 15 17:59:32.798043 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.798030 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb4a9891-0bc6-4edd-9ad0-0795a582822c" containerName="extract" Jul 15 17:59:32.798043 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.798043 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb4a9891-0bc6-4edd-9ad0-0795a582822c" containerName="extract" Jul 15 17:59:32.798150 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.798063 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb4a9891-0bc6-4edd-9ad0-0795a582822c" containerName="pull" Jul 15 17:59:32.798150 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.798074 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb4a9891-0bc6-4edd-9ad0-0795a582822c" containerName="pull" Jul 15 17:59:32.798150 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.798088 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="cb4a9891-0bc6-4edd-9ad0-0795a582822c" containerName="util" Jul 15 17:59:32.798150 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.798096 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="cb4a9891-0bc6-4edd-9ad0-0795a582822c" containerName="util" Jul 15 17:59:32.798150 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.798144 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="cb4a9891-0bc6-4edd-9ad0-0795a582822c" containerName="extract" Jul 15 17:59:32.800265 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.800244 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qxh9q" Jul 15 17:59:32.802654 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.802631 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-mtbcp\"" Jul 15 17:59:32.812264 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.812241 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qxh9q"] Jul 15 17:59:32.828521 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.828498 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/cb4a9891-0bc6-4edd-9ad0-0795a582822c-bundle\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 17:59:32.828521 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.828520 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/cb4a9891-0bc6-4edd-9ad0-0795a582822c-util\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 17:59:32.828684 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.828529 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-fhktz\" (UniqueName: \"kubernetes.io/projected/cb4a9891-0bc6-4edd-9ad0-0795a582822c-kube-api-access-fhktz\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 17:59:32.929440 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.929403 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-svklg\" (UniqueName: \"kubernetes.io/projected/2eec1b20-e0f5-4409-9dfe-99c4ca646733-kube-api-access-svklg\") pod \"cert-manager-webhook-6486ffd997-qxh9q\" (UID: \"2eec1b20-e0f5-4409-9dfe-99c4ca646733\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qxh9q" Jul 15 17:59:32.929619 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:32.929462 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2eec1b20-e0f5-4409-9dfe-99c4ca646733-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qxh9q\" (UID: \"2eec1b20-e0f5-4409-9dfe-99c4ca646733\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qxh9q" Jul 15 17:59:33.030047 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:33.029959 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-svklg\" (UniqueName: \"kubernetes.io/projected/2eec1b20-e0f5-4409-9dfe-99c4ca646733-kube-api-access-svklg\") pod \"cert-manager-webhook-6486ffd997-qxh9q\" (UID: \"2eec1b20-e0f5-4409-9dfe-99c4ca646733\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qxh9q" Jul 15 17:59:33.030047 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:33.030019 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2eec1b20-e0f5-4409-9dfe-99c4ca646733-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qxh9q\" (UID: \"2eec1b20-e0f5-4409-9dfe-99c4ca646733\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qxh9q" Jul 15 17:59:33.038448 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:33.038421 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/2eec1b20-e0f5-4409-9dfe-99c4ca646733-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-qxh9q\" (UID: \"2eec1b20-e0f5-4409-9dfe-99c4ca646733\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qxh9q" Jul 15 17:59:33.038642 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:33.038623 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-svklg\" (UniqueName: \"kubernetes.io/projected/2eec1b20-e0f5-4409-9dfe-99c4ca646733-kube-api-access-svklg\") pod \"cert-manager-webhook-6486ffd997-qxh9q\" (UID: \"2eec1b20-e0f5-4409-9dfe-99c4ca646733\") " pod="cert-manager/cert-manager-webhook-6486ffd997-qxh9q" Jul 15 17:59:33.110415 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:33.110384 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-qxh9q" Jul 15 17:59:33.241174 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:33.241114 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-qxh9q"] Jul 15 17:59:33.244285 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:59:33.244259 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod2eec1b20_e0f5_4409_9dfe_99c4ca646733.slice/crio-56586c870151b529ae510a7a0d5016fd5197a4a5d17e14122a840f4f6602f572 WatchSource:0}: Error finding container 56586c870151b529ae510a7a0d5016fd5197a4a5d17e14122a840f4f6602f572: Status 404 returned error can't find the container with id 56586c870151b529ae510a7a0d5016fd5197a4a5d17e14122a840f4f6602f572 Jul 15 17:59:33.454394 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:33.454355 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-75vr2" event={"ID":"beb3aff4-b0d3-4543-b781-6a3c6a062835","Type":"ContainerStarted","Data":"e81af3f5bc2c28c4e3f10f6c4ebdd7b0aa2df87c49672e696114d412df239ba8"} Jul 15 17:59:33.456011 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:33.455980 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qxh9q" event={"ID":"2eec1b20-e0f5-4409-9dfe-99c4ca646733","Type":"ContainerStarted","Data":"d984b49f4c6b881e77ab875251312210832124baf254385de93e481160aa0216"} Jul 15 17:59:33.456130 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:33.456023 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qxh9q" Jul 15 17:59:33.456130 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:33.456039 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-qxh9q" event={"ID":"2eec1b20-e0f5-4409-9dfe-99c4ca646733","Type":"ContainerStarted","Data":"56586c870151b529ae510a7a0d5016fd5197a4a5d17e14122a840f4f6602f572"} Jul 15 17:59:33.457829 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:33.457809 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2" event={"ID":"cb4a9891-0bc6-4edd-9ad0-0795a582822c","Type":"ContainerDied","Data":"65603551d8d566654353356a1b84c0934d52b2f7011b1735a75b2d17959ad15f"} Jul 15 17:59:33.457939 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:33.457840 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="65603551d8d566654353356a1b84c0934d52b2f7011b1735a75b2d17959ad15f" Jul 15 17:59:33.457939 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:33.457811 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87frrcr2" Jul 15 17:59:33.469482 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:33.469439 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-75vr2" podStartSLOduration=2.177499964 podStartE2EDuration="5.469425801s" totalImagesPullingTime="3.291925837s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:59:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:59:33.468697171 +0000 UTC m=+271.804005474" watchObservedRunningTime="2026-07-15 17:59:33.469425801 +0000 UTC m=+271.804734103" Jul 15 17:59:33.484775 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:33.484724 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-qxh9q" podStartSLOduration=1.484712384 podStartE2EDuration="1.484712384s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 17:59:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 17:59:33.484021261 +0000 UTC m=+271.819329584" watchObservedRunningTime="2026-07-15 17:59:33.484712384 +0000 UTC m=+271.820020691" Jul 15 17:59:33.488503 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:33.488477 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:59:34.416490 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:34.416457 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:59:37.799811 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:37.799781 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:59:37.914792 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:37.914761 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:59:39.465307 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:39.465277 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-qxh9q" Jul 15 17:59:44.316558 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:44.316523 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:59:45.922081 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:45.922040 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:59:46.049134 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:46.049104 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq"] Jul 15 17:59:46.092439 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:46.092408 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq"] Jul 15 17:59:46.092579 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:46.092503 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq" Jul 15 17:59:46.094950 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:46.094928 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 17:59:46.095065 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:46.095047 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 17:59:46.095106 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:46.095075 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-t6jwt\"" Jul 15 17:59:46.236744 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:46.236659 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1281785c-6e27-4f00-9c1f-372e1f37c073-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq\" (UID: \"1281785c-6e27-4f00-9c1f-372e1f37c073\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq" Jul 15 17:59:46.236744 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:46.236729 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1281785c-6e27-4f00-9c1f-372e1f37c073-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq\" (UID: \"1281785c-6e27-4f00-9c1f-372e1f37c073\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq" Jul 15 17:59:46.236893 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:46.236778 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qc8nc\" (UniqueName: \"kubernetes.io/projected/1281785c-6e27-4f00-9c1f-372e1f37c073-kube-api-access-qc8nc\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq\" (UID: \"1281785c-6e27-4f00-9c1f-372e1f37c073\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq" Jul 15 17:59:46.338065 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:46.338036 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qc8nc\" (UniqueName: \"kubernetes.io/projected/1281785c-6e27-4f00-9c1f-372e1f37c073-kube-api-access-qc8nc\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq\" (UID: \"1281785c-6e27-4f00-9c1f-372e1f37c073\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq" Jul 15 17:59:46.338203 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:46.338097 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1281785c-6e27-4f00-9c1f-372e1f37c073-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq\" (UID: \"1281785c-6e27-4f00-9c1f-372e1f37c073\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq" Jul 15 17:59:46.338203 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:46.338123 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1281785c-6e27-4f00-9c1f-372e1f37c073-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq\" (UID: \"1281785c-6e27-4f00-9c1f-372e1f37c073\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq" Jul 15 17:59:46.338413 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:46.338395 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1281785c-6e27-4f00-9c1f-372e1f37c073-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq\" (UID: \"1281785c-6e27-4f00-9c1f-372e1f37c073\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq" Jul 15 17:59:46.338448 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:46.338421 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1281785c-6e27-4f00-9c1f-372e1f37c073-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq\" (UID: \"1281785c-6e27-4f00-9c1f-372e1f37c073\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq" Jul 15 17:59:46.346363 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:46.346333 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qc8nc\" (UniqueName: \"kubernetes.io/projected/1281785c-6e27-4f00-9c1f-372e1f37c073-kube-api-access-qc8nc\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq\" (UID: \"1281785c-6e27-4f00-9c1f-372e1f37c073\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq" Jul 15 17:59:46.402169 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:46.402144 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq" Jul 15 17:59:46.530476 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:46.530448 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq"] Jul 15 17:59:46.532967 ip-10-0-128-25 kubenswrapper[2551]: W0715 17:59:46.532938 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1281785c_6e27_4f00_9c1f_372e1f37c073.slice/crio-c100349160242ffa3b559209d55f531029e2d711806ede26600ee30fb3492593 WatchSource:0}: Error finding container c100349160242ffa3b559209d55f531029e2d711806ede26600ee30fb3492593: Status 404 returned error can't find the container with id c100349160242ffa3b559209d55f531029e2d711806ede26600ee30fb3492593 Jul 15 17:59:46.596558 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:46.596532 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 17:59:47.520623 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:47.520584 2551 generic.go:356] "Generic (PLEG): container finished" podID="1281785c-6e27-4f00-9c1f-372e1f37c073" containerID="fb2762e30874ed5d6a44d2822f988b5c6894393c18225deabf19410eec23884d" exitCode=0 Jul 15 17:59:47.521031 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:47.520661 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq" event={"ID":"1281785c-6e27-4f00-9c1f-372e1f37c073","Type":"ContainerDied","Data":"fb2762e30874ed5d6a44d2822f988b5c6894393c18225deabf19410eec23884d"} Jul 15 17:59:47.521031 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:47.520721 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq" event={"ID":"1281785c-6e27-4f00-9c1f-372e1f37c073","Type":"ContainerStarted","Data":"c100349160242ffa3b559209d55f531029e2d711806ede26600ee30fb3492593"} Jul 15 17:59:48.526864 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:48.526826 2551 generic.go:356] "Generic (PLEG): container finished" podID="1281785c-6e27-4f00-9c1f-372e1f37c073" containerID="0dbe01a440d8f86a1afe0c5e3414eae58460b501d6ac26bbf9b9fbf93ae0add9" exitCode=0 Jul 15 17:59:48.527227 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:48.526918 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq" event={"ID":"1281785c-6e27-4f00-9c1f-372e1f37c073","Type":"ContainerDied","Data":"0dbe01a440d8f86a1afe0c5e3414eae58460b501d6ac26bbf9b9fbf93ae0add9"} Jul 15 17:59:49.534173 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:49.534131 2551 generic.go:356] "Generic (PLEG): container finished" podID="1281785c-6e27-4f00-9c1f-372e1f37c073" containerID="de263cd7699fe48015bddd88140aa4a1168288150d62c236242ea46cf52b5864" exitCode=0 Jul 15 17:59:49.534537 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:49.534215 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq" event={"ID":"1281785c-6e27-4f00-9c1f-372e1f37c073","Type":"ContainerDied","Data":"de263cd7699fe48015bddd88140aa4a1168288150d62c236242ea46cf52b5864"} Jul 15 17:59:50.666007 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:50.665979 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq" Jul 15 17:59:50.770428 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:50.770401 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qc8nc\" (UniqueName: \"kubernetes.io/projected/1281785c-6e27-4f00-9c1f-372e1f37c073-kube-api-access-qc8nc\") pod \"1281785c-6e27-4f00-9c1f-372e1f37c073\" (UID: \"1281785c-6e27-4f00-9c1f-372e1f37c073\") " Jul 15 17:59:50.770595 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:50.770450 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1281785c-6e27-4f00-9c1f-372e1f37c073-util\") pod \"1281785c-6e27-4f00-9c1f-372e1f37c073\" (UID: \"1281785c-6e27-4f00-9c1f-372e1f37c073\") " Jul 15 17:59:50.770595 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:50.770525 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1281785c-6e27-4f00-9c1f-372e1f37c073-bundle\") pod \"1281785c-6e27-4f00-9c1f-372e1f37c073\" (UID: \"1281785c-6e27-4f00-9c1f-372e1f37c073\") " Jul 15 17:59:50.771241 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:50.771213 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1281785c-6e27-4f00-9c1f-372e1f37c073-bundle" (OuterVolumeSpecName: "bundle") pod "1281785c-6e27-4f00-9c1f-372e1f37c073" (UID: "1281785c-6e27-4f00-9c1f-372e1f37c073"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 17:59:50.772611 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:50.772586 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1281785c-6e27-4f00-9c1f-372e1f37c073-kube-api-access-qc8nc" (OuterVolumeSpecName: "kube-api-access-qc8nc") pod "1281785c-6e27-4f00-9c1f-372e1f37c073" (UID: "1281785c-6e27-4f00-9c1f-372e1f37c073"). InnerVolumeSpecName "kube-api-access-qc8nc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 17:59:50.776121 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:50.776102 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1281785c-6e27-4f00-9c1f-372e1f37c073-util" (OuterVolumeSpecName: "util") pod "1281785c-6e27-4f00-9c1f-372e1f37c073" (UID: "1281785c-6e27-4f00-9c1f-372e1f37c073"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 17:59:50.871573 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:50.871544 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/1281785c-6e27-4f00-9c1f-372e1f37c073-util\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 17:59:50.871573 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:50.871571 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/1281785c-6e27-4f00-9c1f-372e1f37c073-bundle\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 17:59:50.871740 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:50.871580 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qc8nc\" (UniqueName: \"kubernetes.io/projected/1281785c-6e27-4f00-9c1f-372e1f37c073-kube-api-access-qc8nc\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 17:59:51.544614 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:51.544573 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq" event={"ID":"1281785c-6e27-4f00-9c1f-372e1f37c073","Type":"ContainerDied","Data":"c100349160242ffa3b559209d55f531029e2d711806ede26600ee30fb3492593"} Jul 15 17:59:51.544614 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:51.544600 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afmdctq" Jul 15 17:59:51.544614 ip-10-0-128-25 kubenswrapper[2551]: I0715 17:59:51.544622 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c100349160242ffa3b559209d55f531029e2d711806ede26600ee30fb3492593" Jul 15 18:00:00.873134 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:00.873103 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:00.995040 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:00.995015 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:02.044808 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.044768 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:02.080448 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.080422 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b89jb_67315a2e-51bd-4280-9821-5a6fd7b06df7/console-operator/1.log" Jul 15 18:00:02.081398 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.081372 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b89jb_67315a2e-51bd-4280-9821-5a6fd7b06df7/console-operator/1.log" Jul 15 18:00:02.090484 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.090465 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwzkz_ff5857c7-97d1-467d-8b6f-8691f7e0d6dc/ovn-acl-logging/0.log" Jul 15 18:00:02.091444 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.091424 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwzkz_ff5857c7-97d1-467d-8b6f-8691f7e0d6dc/ovn-acl-logging/0.log" Jul 15 18:00:02.093614 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.093597 2551 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 18:00:02.136945 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.136803 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:02.653957 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.653914 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:02.802123 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.802093 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:02.904825 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.904743 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:02.928202 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.928176 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg"] Jul 15 18:00:02.928518 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.928504 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1281785c-6e27-4f00-9c1f-372e1f37c073" containerName="extract" Jul 15 18:00:02.928564 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.928523 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="1281785c-6e27-4f00-9c1f-372e1f37c073" containerName="extract" Jul 15 18:00:02.928564 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.928541 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1281785c-6e27-4f00-9c1f-372e1f37c073" containerName="pull" Jul 15 18:00:02.928564 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.928546 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="1281785c-6e27-4f00-9c1f-372e1f37c073" containerName="pull" Jul 15 18:00:02.928564 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.928555 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1281785c-6e27-4f00-9c1f-372e1f37c073" containerName="util" Jul 15 18:00:02.928564 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.928560 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="1281785c-6e27-4f00-9c1f-372e1f37c073" containerName="util" Jul 15 18:00:02.928732 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.928621 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="1281785c-6e27-4f00-9c1f-372e1f37c073" containerName="extract" Jul 15 18:00:02.935457 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.935440 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" Jul 15 18:00:02.939984 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.939966 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 18:00:02.940384 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.940355 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 18:00:02.940384 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.940372 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 18:00:02.940544 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.940466 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-gxjnc\"" Jul 15 18:00:02.940544 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.940509 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 18:00:02.975713 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:02.975681 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg"] Jul 15 18:00:03.056578 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:03.056552 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c940b77-709f-40c5-9b8e-051ad8e97743-tmp\") pod \"opendatahub-operator-controller-manager-748f9847bf-vrlkg\" (UID: \"6c940b77-709f-40c5-9b8e-051ad8e97743\") " pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" Jul 15 18:00:03.056931 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:03.056598 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c940b77-709f-40c5-9b8e-051ad8e97743-webhook-cert\") pod \"opendatahub-operator-controller-manager-748f9847bf-vrlkg\" (UID: \"6c940b77-709f-40c5-9b8e-051ad8e97743\") " pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" Jul 15 18:00:03.056931 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:03.056661 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bt7gb\" (UniqueName: \"kubernetes.io/projected/6c940b77-709f-40c5-9b8e-051ad8e97743-kube-api-access-bt7gb\") pod \"opendatahub-operator-controller-manager-748f9847bf-vrlkg\" (UID: \"6c940b77-709f-40c5-9b8e-051ad8e97743\") " pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" Jul 15 18:00:03.056931 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:03.056745 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6c940b77-709f-40c5-9b8e-051ad8e97743-manifests\") pod \"opendatahub-operator-controller-manager-748f9847bf-vrlkg\" (UID: \"6c940b77-709f-40c5-9b8e-051ad8e97743\") " pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" Jul 15 18:00:03.056931 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:03.056771 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6c940b77-709f-40c5-9b8e-051ad8e97743-apiservice-cert\") pod \"opendatahub-operator-controller-manager-748f9847bf-vrlkg\" (UID: \"6c940b77-709f-40c5-9b8e-051ad8e97743\") " pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" Jul 15 18:00:03.097661 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:03.097630 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:03.157831 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:03.157774 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6c940b77-709f-40c5-9b8e-051ad8e97743-manifests\") pod \"opendatahub-operator-controller-manager-748f9847bf-vrlkg\" (UID: \"6c940b77-709f-40c5-9b8e-051ad8e97743\") " pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" Jul 15 18:00:03.157831 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:03.157803 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6c940b77-709f-40c5-9b8e-051ad8e97743-apiservice-cert\") pod \"opendatahub-operator-controller-manager-748f9847bf-vrlkg\" (UID: \"6c940b77-709f-40c5-9b8e-051ad8e97743\") " pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" Jul 15 18:00:03.157831 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:03.157827 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c940b77-709f-40c5-9b8e-051ad8e97743-tmp\") pod \"opendatahub-operator-controller-manager-748f9847bf-vrlkg\" (UID: \"6c940b77-709f-40c5-9b8e-051ad8e97743\") " pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" Jul 15 18:00:03.158006 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:03.157872 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c940b77-709f-40c5-9b8e-051ad8e97743-webhook-cert\") pod \"opendatahub-operator-controller-manager-748f9847bf-vrlkg\" (UID: \"6c940b77-709f-40c5-9b8e-051ad8e97743\") " pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" Jul 15 18:00:03.158006 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:03.157907 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bt7gb\" (UniqueName: \"kubernetes.io/projected/6c940b77-709f-40c5-9b8e-051ad8e97743-kube-api-access-bt7gb\") pod \"opendatahub-operator-controller-manager-748f9847bf-vrlkg\" (UID: \"6c940b77-709f-40c5-9b8e-051ad8e97743\") " pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" Jul 15 18:00:03.158156 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:03.158138 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/6c940b77-709f-40c5-9b8e-051ad8e97743-manifests\") pod \"opendatahub-operator-controller-manager-748f9847bf-vrlkg\" (UID: \"6c940b77-709f-40c5-9b8e-051ad8e97743\") " pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" Jul 15 18:00:03.160377 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:03.160355 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/6c940b77-709f-40c5-9b8e-051ad8e97743-tmp\") pod \"opendatahub-operator-controller-manager-748f9847bf-vrlkg\" (UID: \"6c940b77-709f-40c5-9b8e-051ad8e97743\") " pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" Jul 15 18:00:03.160481 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:03.160435 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/6c940b77-709f-40c5-9b8e-051ad8e97743-apiservice-cert\") pod \"opendatahub-operator-controller-manager-748f9847bf-vrlkg\" (UID: \"6c940b77-709f-40c5-9b8e-051ad8e97743\") " pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" Jul 15 18:00:03.160567 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:03.160548 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/6c940b77-709f-40c5-9b8e-051ad8e97743-webhook-cert\") pod \"opendatahub-operator-controller-manager-748f9847bf-vrlkg\" (UID: \"6c940b77-709f-40c5-9b8e-051ad8e97743\") " pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" Jul 15 18:00:03.174524 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:03.174499 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bt7gb\" (UniqueName: \"kubernetes.io/projected/6c940b77-709f-40c5-9b8e-051ad8e97743-kube-api-access-bt7gb\") pod \"opendatahub-operator-controller-manager-748f9847bf-vrlkg\" (UID: \"6c940b77-709f-40c5-9b8e-051ad8e97743\") " pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" Jul 15 18:00:03.245289 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:03.245256 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" Jul 15 18:00:03.400279 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:03.400248 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg"] Jul 15 18:00:03.403367 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:00:03.403339 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6c940b77_709f_40c5_9b8e_051ad8e97743.slice/crio-8bce6beccf19f9c84022febdea04c05d0dd92da80e64bf711f721b24181f59c9 WatchSource:0}: Error finding container 8bce6beccf19f9c84022febdea04c05d0dd92da80e64bf711f721b24181f59c9: Status 404 returned error can't find the container with id 8bce6beccf19f9c84022febdea04c05d0dd92da80e64bf711f721b24181f59c9 Jul 15 18:00:03.405144 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:03.405123 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 18:00:03.412028 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:03.411967 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:03.515485 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:03.515449 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:03.600876 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:03.600846 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" event={"ID":"6c940b77-709f-40c5-9b8e-051ad8e97743","Type":"ContainerStarted","Data":"8bce6beccf19f9c84022febdea04c05d0dd92da80e64bf711f721b24181f59c9"} Jul 15 18:00:07.622221 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:07.622182 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" event={"ID":"6c940b77-709f-40c5-9b8e-051ad8e97743","Type":"ContainerStarted","Data":"d32b172e9ed11427ca4475efe675216a63f0d0dc3a0faa96c0ba64e685193d5f"} Jul 15 18:00:08.627935 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:08.627900 2551 generic.go:356] "Generic (PLEG): container finished" podID="6c940b77-709f-40c5-9b8e-051ad8e97743" containerID="d32b172e9ed11427ca4475efe675216a63f0d0dc3a0faa96c0ba64e685193d5f" exitCode=0 Jul 15 18:00:08.628327 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:08.627946 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" event={"ID":"6c940b77-709f-40c5-9b8e-051ad8e97743","Type":"ContainerDied","Data":"d32b172e9ed11427ca4475efe675216a63f0d0dc3a0faa96c0ba64e685193d5f"} Jul 15 18:00:09.634802 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:09.634766 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" event={"ID":"6c940b77-709f-40c5-9b8e-051ad8e97743","Type":"ContainerStarted","Data":"e2e00a9cdf0929c6c46e994b82abd6058ddea9d486b0b7add628dd1376c4de5f"} Jul 15 18:00:09.635159 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:09.634879 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" Jul 15 18:00:09.660056 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:09.660013 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" podStartSLOduration=2.803210944 podStartE2EDuration="7.659999486s" totalImagesPullingTime="3.8477489s" totalInitContainerRuntime="1.009039642s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:00:02 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:00:09.656737598 +0000 UTC m=+307.992045898" watchObservedRunningTime="2026-07-15 18:00:09.659999486 +0000 UTC m=+307.995307787" Jul 15 18:00:20.641832 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:20.641799 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-748f9847bf-vrlkg" Jul 15 18:00:23.956825 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:23.956776 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:24.235340 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.235260 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-785fddc5dc-7778q"] Jul 15 18:00:24.237625 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.237605 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-785fddc5dc-7778q" Jul 15 18:00:24.240724 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.240705 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 15 18:00:24.241149 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.241125 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 15 18:00:24.257109 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.257084 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-785fddc5dc-7778q"] Jul 15 18:00:24.313240 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.313218 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/551ef68f-1e91-4421-83fe-f621c8b8969b-tmp\") pod \"kube-auth-proxy-785fddc5dc-7778q\" (UID: \"551ef68f-1e91-4421-83fe-f621c8b8969b\") " pod="openshift-ingress/kube-auth-proxy-785fddc5dc-7778q" Jul 15 18:00:24.313355 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.313317 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lcx5p\" (UniqueName: \"kubernetes.io/projected/551ef68f-1e91-4421-83fe-f621c8b8969b-kube-api-access-lcx5p\") pod \"kube-auth-proxy-785fddc5dc-7778q\" (UID: \"551ef68f-1e91-4421-83fe-f621c8b8969b\") " pod="openshift-ingress/kube-auth-proxy-785fddc5dc-7778q" Jul 15 18:00:24.313355 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.313344 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/551ef68f-1e91-4421-83fe-f621c8b8969b-tls-certs\") pod \"kube-auth-proxy-785fddc5dc-7778q\" (UID: \"551ef68f-1e91-4421-83fe-f621c8b8969b\") " pod="openshift-ingress/kube-auth-proxy-785fddc5dc-7778q" Jul 15 18:00:24.414502 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.414467 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/551ef68f-1e91-4421-83fe-f621c8b8969b-tls-certs\") pod \"kube-auth-proxy-785fddc5dc-7778q\" (UID: \"551ef68f-1e91-4421-83fe-f621c8b8969b\") " pod="openshift-ingress/kube-auth-proxy-785fddc5dc-7778q" Jul 15 18:00:24.414686 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.414535 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/551ef68f-1e91-4421-83fe-f621c8b8969b-tmp\") pod \"kube-auth-proxy-785fddc5dc-7778q\" (UID: \"551ef68f-1e91-4421-83fe-f621c8b8969b\") " pod="openshift-ingress/kube-auth-proxy-785fddc5dc-7778q" Jul 15 18:00:24.414686 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.414634 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lcx5p\" (UniqueName: \"kubernetes.io/projected/551ef68f-1e91-4421-83fe-f621c8b8969b-kube-api-access-lcx5p\") pod \"kube-auth-proxy-785fddc5dc-7778q\" (UID: \"551ef68f-1e91-4421-83fe-f621c8b8969b\") " pod="openshift-ingress/kube-auth-proxy-785fddc5dc-7778q" Jul 15 18:00:24.417108 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.417080 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/551ef68f-1e91-4421-83fe-f621c8b8969b-tmp\") pod \"kube-auth-proxy-785fddc5dc-7778q\" (UID: \"551ef68f-1e91-4421-83fe-f621c8b8969b\") " pod="openshift-ingress/kube-auth-proxy-785fddc5dc-7778q" Jul 15 18:00:24.417216 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.417190 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/551ef68f-1e91-4421-83fe-f621c8b8969b-tls-certs\") pod \"kube-auth-proxy-785fddc5dc-7778q\" (UID: \"551ef68f-1e91-4421-83fe-f621c8b8969b\") " pod="openshift-ingress/kube-auth-proxy-785fddc5dc-7778q" Jul 15 18:00:24.422685 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.422641 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lcx5p\" (UniqueName: \"kubernetes.io/projected/551ef68f-1e91-4421-83fe-f621c8b8969b-kube-api-access-lcx5p\") pod \"kube-auth-proxy-785fddc5dc-7778q\" (UID: \"551ef68f-1e91-4421-83fe-f621c8b8969b\") " pod="openshift-ingress/kube-auth-proxy-785fddc5dc-7778q" Jul 15 18:00:24.437787 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.437756 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:24.508049 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.507974 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4nszb"] Jul 15 18:00:24.510137 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.510121 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4nszb" Jul 15 18:00:24.512365 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.512343 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-lr52b\"" Jul 15 18:00:24.512473 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.512404 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 15 18:00:24.515105 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.515087 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cacce62-6cbc-4f7e-a7c8-6054a1e02865-cert\") pod \"odh-model-controller-7998c67dc4-4nszb\" (UID: \"4cacce62-6cbc-4f7e-a7c8-6054a1e02865\") " pod="opendatahub/odh-model-controller-7998c67dc4-4nszb" Jul 15 18:00:24.515240 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.515223 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g7nxh\" (UniqueName: \"kubernetes.io/projected/4cacce62-6cbc-4f7e-a7c8-6054a1e02865-kube-api-access-g7nxh\") pod \"odh-model-controller-7998c67dc4-4nszb\" (UID: \"4cacce62-6cbc-4f7e-a7c8-6054a1e02865\") " pod="opendatahub/odh-model-controller-7998c67dc4-4nszb" Jul 15 18:00:24.516166 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.516142 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:24.520050 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.520030 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4nszb"] Jul 15 18:00:24.547181 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.547151 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-785fddc5dc-7778q" Jul 15 18:00:24.576641 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.576610 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:24.616269 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.616227 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g7nxh\" (UniqueName: \"kubernetes.io/projected/4cacce62-6cbc-4f7e-a7c8-6054a1e02865-kube-api-access-g7nxh\") pod \"odh-model-controller-7998c67dc4-4nszb\" (UID: \"4cacce62-6cbc-4f7e-a7c8-6054a1e02865\") " pod="opendatahub/odh-model-controller-7998c67dc4-4nszb" Jul 15 18:00:24.616421 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.616301 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cacce62-6cbc-4f7e-a7c8-6054a1e02865-cert\") pod \"odh-model-controller-7998c67dc4-4nszb\" (UID: \"4cacce62-6cbc-4f7e-a7c8-6054a1e02865\") " pod="opendatahub/odh-model-controller-7998c67dc4-4nszb" Jul 15 18:00:24.616521 ip-10-0-128-25 kubenswrapper[2551]: E0715 18:00:24.616503 2551 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 15 18:00:24.616595 ip-10-0-128-25 kubenswrapper[2551]: E0715 18:00:24.616567 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4cacce62-6cbc-4f7e-a7c8-6054a1e02865-cert podName:4cacce62-6cbc-4f7e-a7c8-6054a1e02865 nodeName:}" failed. No retries permitted until 2026-07-15 18:00:25.116544451 +0000 UTC m=+323.451852749 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/4cacce62-6cbc-4f7e-a7c8-6054a1e02865-cert") pod "odh-model-controller-7998c67dc4-4nszb" (UID: "4cacce62-6cbc-4f7e-a7c8-6054a1e02865") : secret "odh-model-controller-webhook-cert" not found Jul 15 18:00:24.630562 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.630540 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g7nxh\" (UniqueName: \"kubernetes.io/projected/4cacce62-6cbc-4f7e-a7c8-6054a1e02865-kube-api-access-g7nxh\") pod \"odh-model-controller-7998c67dc4-4nszb\" (UID: \"4cacce62-6cbc-4f7e-a7c8-6054a1e02865\") " pod="opendatahub/odh-model-controller-7998c67dc4-4nszb" Jul 15 18:00:24.693993 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.693957 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:24.710295 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.710160 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-785fddc5dc-7778q"] Jul 15 18:00:24.712977 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:00:24.712951 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod551ef68f_1e91_4421_83fe_f621c8b8969b.slice/crio-64e238fba7c5631000a4ca47adbde33e9237996e9aad16e7f952840b3b8b9204 WatchSource:0}: Error finding container 64e238fba7c5631000a4ca47adbde33e9237996e9aad16e7f952840b3b8b9204: Status 404 returned error can't find the container with id 64e238fba7c5631000a4ca47adbde33e9237996e9aad16e7f952840b3b8b9204 Jul 15 18:00:24.783045 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.782958 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:24.878906 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:24.878872 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:25.124907 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:25.124873 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cacce62-6cbc-4f7e-a7c8-6054a1e02865-cert\") pod \"odh-model-controller-7998c67dc4-4nszb\" (UID: \"4cacce62-6cbc-4f7e-a7c8-6054a1e02865\") " pod="opendatahub/odh-model-controller-7998c67dc4-4nszb" Jul 15 18:00:25.127335 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:25.127315 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/4cacce62-6cbc-4f7e-a7c8-6054a1e02865-cert\") pod \"odh-model-controller-7998c67dc4-4nszb\" (UID: \"4cacce62-6cbc-4f7e-a7c8-6054a1e02865\") " pod="opendatahub/odh-model-controller-7998c67dc4-4nszb" Jul 15 18:00:25.421459 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:25.421383 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-4nszb" Jul 15 18:00:25.566253 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:25.565809 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-4nszb"] Jul 15 18:00:25.568573 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:00:25.568546 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4cacce62_6cbc_4f7e_a7c8_6054a1e02865.slice/crio-40288db3542deaf7fc626be8f0c988bbe338c950ded64d62a82d2cd09544db53 WatchSource:0}: Error finding container 40288db3542deaf7fc626be8f0c988bbe338c950ded64d62a82d2cd09544db53: Status 404 returned error can't find the container with id 40288db3542deaf7fc626be8f0c988bbe338c950ded64d62a82d2cd09544db53 Jul 15 18:00:25.706064 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:25.705988 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-v8qnj"] Jul 15 18:00:25.708604 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:25.708572 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-v8qnj" Jul 15 18:00:25.713984 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:25.713945 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4nszb" event={"ID":"4cacce62-6cbc-4f7e-a7c8-6054a1e02865","Type":"ContainerStarted","Data":"40288db3542deaf7fc626be8f0c988bbe338c950ded64d62a82d2cd09544db53"} Jul 15 18:00:25.715437 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:25.715412 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-785fddc5dc-7778q" event={"ID":"551ef68f-1e91-4421-83fe-f621c8b8969b","Type":"ContainerStarted","Data":"64e238fba7c5631000a4ca47adbde33e9237996e9aad16e7f952840b3b8b9204"} Jul 15 18:00:25.719213 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:25.719009 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 15 18:00:25.731576 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:25.731545 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hdq2m\" (UniqueName: \"kubernetes.io/projected/321bd427-6ea0-4195-9ec4-1f4d077f337b-kube-api-access-hdq2m\") pod \"model-serving-api-54d89bd5fc-v8qnj\" (UID: \"321bd427-6ea0-4195-9ec4-1f4d077f337b\") " pod="opendatahub/model-serving-api-54d89bd5fc-v8qnj" Jul 15 18:00:25.731718 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:25.731631 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/321bd427-6ea0-4195-9ec4-1f4d077f337b-tls-certs\") pod \"model-serving-api-54d89bd5fc-v8qnj\" (UID: \"321bd427-6ea0-4195-9ec4-1f4d077f337b\") " pod="opendatahub/model-serving-api-54d89bd5fc-v8qnj" Jul 15 18:00:25.736478 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:25.735619 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-v8qnj"] Jul 15 18:00:25.744419 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:25.744367 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:25.832303 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:25.832266 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/321bd427-6ea0-4195-9ec4-1f4d077f337b-tls-certs\") pod \"model-serving-api-54d89bd5fc-v8qnj\" (UID: \"321bd427-6ea0-4195-9ec4-1f4d077f337b\") " pod="opendatahub/model-serving-api-54d89bd5fc-v8qnj" Jul 15 18:00:25.832519 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:25.832375 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hdq2m\" (UniqueName: \"kubernetes.io/projected/321bd427-6ea0-4195-9ec4-1f4d077f337b-kube-api-access-hdq2m\") pod \"model-serving-api-54d89bd5fc-v8qnj\" (UID: \"321bd427-6ea0-4195-9ec4-1f4d077f337b\") " pod="opendatahub/model-serving-api-54d89bd5fc-v8qnj" Jul 15 18:00:25.832519 ip-10-0-128-25 kubenswrapper[2551]: E0715 18:00:25.832401 2551 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 15 18:00:25.832519 ip-10-0-128-25 kubenswrapper[2551]: E0715 18:00:25.832481 2551 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/321bd427-6ea0-4195-9ec4-1f4d077f337b-tls-certs podName:321bd427-6ea0-4195-9ec4-1f4d077f337b nodeName:}" failed. No retries permitted until 2026-07-15 18:00:26.332460679 +0000 UTC m=+324.667768979 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/321bd427-6ea0-4195-9ec4-1f4d077f337b-tls-certs") pod "model-serving-api-54d89bd5fc-v8qnj" (UID: "321bd427-6ea0-4195-9ec4-1f4d077f337b") : secret "model-serving-api-tls" not found Jul 15 18:00:25.846119 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:25.846088 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hdq2m\" (UniqueName: \"kubernetes.io/projected/321bd427-6ea0-4195-9ec4-1f4d077f337b-kube-api-access-hdq2m\") pod \"model-serving-api-54d89bd5fc-v8qnj\" (UID: \"321bd427-6ea0-4195-9ec4-1f4d077f337b\") " pod="opendatahub/model-serving-api-54d89bd5fc-v8qnj" Jul 15 18:00:26.018930 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.018835 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:26.049730 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.049699 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7"] Jul 15 18:00:26.051866 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.051849 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.055714 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.055690 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 15 18:00:26.055833 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.055690 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 15 18:00:26.055833 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.055714 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-tflbm\"" Jul 15 18:00:26.055964 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.055948 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 15 18:00:26.056413 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.056394 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 18:00:26.071227 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.071204 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7"] Jul 15 18:00:26.114845 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.114808 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:26.135398 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.135367 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c99e36ea-244d-426a-9b2a-31b6368e7f01-local-certs\") pod \"istiod-openshift-gateway-7574459656-jj9w7\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.135854 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.135414 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-jj9w7\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.135854 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.135533 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m2qrl\" (UniqueName: \"kubernetes.io/projected/c99e36ea-244d-426a-9b2a-31b6368e7f01-kube-api-access-m2qrl\") pod \"istiod-openshift-gateway-7574459656-jj9w7\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.135854 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.135586 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-token\") pod \"istiod-openshift-gateway-7574459656-jj9w7\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.135854 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.135636 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c99e36ea-244d-426a-9b2a-31b6368e7f01-cacerts\") pod \"istiod-openshift-gateway-7574459656-jj9w7\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.135854 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.135687 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-jj9w7\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.135854 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.135738 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-jj9w7\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.236760 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.236715 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c99e36ea-244d-426a-9b2a-31b6368e7f01-local-certs\") pod \"istiod-openshift-gateway-7574459656-jj9w7\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.236938 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.236764 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-jj9w7\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.237011 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.236948 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m2qrl\" (UniqueName: \"kubernetes.io/projected/c99e36ea-244d-426a-9b2a-31b6368e7f01-kube-api-access-m2qrl\") pod \"istiod-openshift-gateway-7574459656-jj9w7\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.237072 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.237022 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-token\") pod \"istiod-openshift-gateway-7574459656-jj9w7\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.237072 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.237060 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c99e36ea-244d-426a-9b2a-31b6368e7f01-cacerts\") pod \"istiod-openshift-gateway-7574459656-jj9w7\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.237187 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.237090 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-jj9w7\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.237187 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.237158 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-jj9w7\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.238052 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.237848 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-7574459656-jj9w7\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.239801 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.239766 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c99e36ea-244d-426a-9b2a-31b6368e7f01-cacerts\") pod \"istiod-openshift-gateway-7574459656-jj9w7\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.240038 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.239963 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c99e36ea-244d-426a-9b2a-31b6368e7f01-local-certs\") pod \"istiod-openshift-gateway-7574459656-jj9w7\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.240174 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.240138 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-kubeconfig\") pod \"istiod-openshift-gateway-7574459656-jj9w7\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.240256 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.240169 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-7574459656-jj9w7\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.246886 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.246720 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-token\") pod \"istiod-openshift-gateway-7574459656-jj9w7\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.247156 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.247129 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m2qrl\" (UniqueName: \"kubernetes.io/projected/c99e36ea-244d-426a-9b2a-31b6368e7f01-kube-api-access-m2qrl\") pod \"istiod-openshift-gateway-7574459656-jj9w7\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.338528 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.338432 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/321bd427-6ea0-4195-9ec4-1f4d077f337b-tls-certs\") pod \"model-serving-api-54d89bd5fc-v8qnj\" (UID: \"321bd427-6ea0-4195-9ec4-1f4d077f337b\") " pod="opendatahub/model-serving-api-54d89bd5fc-v8qnj" Jul 15 18:00:26.341295 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.341262 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/321bd427-6ea0-4195-9ec4-1f4d077f337b-tls-certs\") pod \"model-serving-api-54d89bd5fc-v8qnj\" (UID: \"321bd427-6ea0-4195-9ec4-1f4d077f337b\") " pod="opendatahub/model-serving-api-54d89bd5fc-v8qnj" Jul 15 18:00:26.364856 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.364821 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:26.544043 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.543967 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7"] Jul 15 18:00:26.546657 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:00:26.546619 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc99e36ea_244d_426a_9b2a_31b6368e7f01.slice/crio-bfe5b6f648aa5a794c08c29fb7277fe26c73590567cc9c0e200b4d983fbc0762 WatchSource:0}: Error finding container bfe5b6f648aa5a794c08c29fb7277fe26c73590567cc9c0e200b4d983fbc0762: Status 404 returned error can't find the container with id bfe5b6f648aa5a794c08c29fb7277fe26c73590567cc9c0e200b4d983fbc0762 Jul 15 18:00:26.623377 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.623342 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-v8qnj" Jul 15 18:00:26.723906 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.723867 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" event={"ID":"c99e36ea-244d-426a-9b2a-31b6368e7f01","Type":"ContainerStarted","Data":"bfe5b6f648aa5a794c08c29fb7277fe26c73590567cc9c0e200b4d983fbc0762"} Jul 15 18:00:26.798562 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:26.798527 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-v8qnj"] Jul 15 18:00:26.801022 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:00:26.800977 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod321bd427_6ea0_4195_9ec4_1f4d077f337b.slice/crio-ca8862d048846593441ecc59b74c11efe52ade6e6fc630dd4c9a5833816e1fea WatchSource:0}: Error finding container ca8862d048846593441ecc59b74c11efe52ade6e6fc630dd4c9a5833816e1fea: Status 404 returned error can't find the container with id ca8862d048846593441ecc59b74c11efe52ade6e6fc630dd4c9a5833816e1fea Jul 15 18:00:27.337464 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:27.337430 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:27.730017 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:27.729973 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-v8qnj" event={"ID":"321bd427-6ea0-4195-9ec4-1f4d077f337b","Type":"ContainerStarted","Data":"ca8862d048846593441ecc59b74c11efe52ade6e6fc630dd4c9a5833816e1fea"} Jul 15 18:00:30.747697 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:30.747642 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-785fddc5dc-7778q" event={"ID":"551ef68f-1e91-4421-83fe-f621c8b8969b","Type":"ContainerStarted","Data":"dfdd40df1f7f42b123a9d1aeca08b2c14fd3d32c9ccb591c838224aa1281b154"} Jul 15 18:00:30.749654 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:30.749618 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-v8qnj" event={"ID":"321bd427-6ea0-4195-9ec4-1f4d077f337b","Type":"ContainerStarted","Data":"db37c1f320514ecf061afa8032ca60135da9a57362c4e7ed502e20578d20c764"} Jul 15 18:00:30.749814 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:30.749732 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-v8qnj" Jul 15 18:00:30.751483 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:30.751451 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-4nszb" event={"ID":"4cacce62-6cbc-4f7e-a7c8-6054a1e02865","Type":"ContainerStarted","Data":"cfef6c78fc790efaf9d86b04a646ae9457bea018b20ca52fd84a62a2584c39a8"} Jul 15 18:00:30.751618 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:30.751506 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-4nszb" Jul 15 18:00:30.765121 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:30.765058 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-785fddc5dc-7778q" podStartSLOduration=1.660442129 podStartE2EDuration="6.765045012s" totalImagesPullingTime="5.104602883s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:00:30.76438376 +0000 UTC m=+329.099692062" watchObservedRunningTime="2026-07-15 18:00:30.765045012 +0000 UTC m=+329.100353314" Jul 15 18:00:30.785428 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:30.785372 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-v8qnj" podStartSLOduration=2.765321555 podStartE2EDuration="5.785352876s" totalImagesPullingTime="3.020031321s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:00:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:00:30.78336394 +0000 UTC m=+329.118672268" watchObservedRunningTime="2026-07-15 18:00:30.785352876 +0000 UTC m=+329.120661179" Jul 15 18:00:30.803387 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:30.803334 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-4nszb" podStartSLOduration=2.538943338 podStartE2EDuration="6.803314781s" totalImagesPullingTime="4.264371443s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:00:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:00:30.801606892 +0000 UTC m=+329.136915195" watchObservedRunningTime="2026-07-15 18:00:30.803314781 +0000 UTC m=+329.138623085" Jul 15 18:00:33.033560 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.033518 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh"] Jul 15 18:00:33.040573 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.040554 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.100730 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.100698 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh"] Jul 15 18:00:33.105561 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.105516 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f6cd5862-ace4-4695-bf49-e38f1d0a5113-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-wc9bh\" (UID: \"f6cd5862-ace4-4695-bf49-e38f1d0a5113\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.105718 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.105625 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6cd5862-ace4-4695-bf49-e38f1d0a5113-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-wc9bh\" (UID: \"f6cd5862-ace4-4695-bf49-e38f1d0a5113\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.105718 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.105703 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f6cd5862-ace4-4695-bf49-e38f1d0a5113-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-wc9bh\" (UID: \"f6cd5862-ace4-4695-bf49-e38f1d0a5113\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.105856 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.105739 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f6cd5862-ace4-4695-bf49-e38f1d0a5113-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-wc9bh\" (UID: \"f6cd5862-ace4-4695-bf49-e38f1d0a5113\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.105856 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.105770 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f6cd5862-ace4-4695-bf49-e38f1d0a5113-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-wc9bh\" (UID: \"f6cd5862-ace4-4695-bf49-e38f1d0a5113\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.105856 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.105799 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2c5ck\" (UniqueName: \"kubernetes.io/projected/f6cd5862-ace4-4695-bf49-e38f1d0a5113-kube-api-access-2c5ck\") pod \"istiod-openshift-gateway-94bb8fbfd-wc9bh\" (UID: \"f6cd5862-ace4-4695-bf49-e38f1d0a5113\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.105856 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.105828 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6cd5862-ace4-4695-bf49-e38f1d0a5113-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-wc9bh\" (UID: \"f6cd5862-ace4-4695-bf49-e38f1d0a5113\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.207216 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.207179 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f6cd5862-ace4-4695-bf49-e38f1d0a5113-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-wc9bh\" (UID: \"f6cd5862-ace4-4695-bf49-e38f1d0a5113\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.207397 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.207237 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f6cd5862-ace4-4695-bf49-e38f1d0a5113-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-wc9bh\" (UID: \"f6cd5862-ace4-4695-bf49-e38f1d0a5113\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.207397 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.207266 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f6cd5862-ace4-4695-bf49-e38f1d0a5113-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-wc9bh\" (UID: \"f6cd5862-ace4-4695-bf49-e38f1d0a5113\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.207397 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.207289 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2c5ck\" (UniqueName: \"kubernetes.io/projected/f6cd5862-ace4-4695-bf49-e38f1d0a5113-kube-api-access-2c5ck\") pod \"istiod-openshift-gateway-94bb8fbfd-wc9bh\" (UID: \"f6cd5862-ace4-4695-bf49-e38f1d0a5113\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.207397 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.207311 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6cd5862-ace4-4695-bf49-e38f1d0a5113-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-wc9bh\" (UID: \"f6cd5862-ace4-4695-bf49-e38f1d0a5113\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.207397 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.207356 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f6cd5862-ace4-4695-bf49-e38f1d0a5113-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-wc9bh\" (UID: \"f6cd5862-ace4-4695-bf49-e38f1d0a5113\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.207649 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.207406 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6cd5862-ace4-4695-bf49-e38f1d0a5113-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-wc9bh\" (UID: \"f6cd5862-ace4-4695-bf49-e38f1d0a5113\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.208387 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.208342 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/f6cd5862-ace4-4695-bf49-e38f1d0a5113-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-wc9bh\" (UID: \"f6cd5862-ace4-4695-bf49-e38f1d0a5113\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.210451 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.210423 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/f6cd5862-ace4-4695-bf49-e38f1d0a5113-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-wc9bh\" (UID: \"f6cd5862-ace4-4695-bf49-e38f1d0a5113\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.210561 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.210426 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/f6cd5862-ace4-4695-bf49-e38f1d0a5113-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-wc9bh\" (UID: \"f6cd5862-ace4-4695-bf49-e38f1d0a5113\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.210618 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.210583 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/f6cd5862-ace4-4695-bf49-e38f1d0a5113-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-wc9bh\" (UID: \"f6cd5862-ace4-4695-bf49-e38f1d0a5113\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.210912 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.210892 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/f6cd5862-ace4-4695-bf49-e38f1d0a5113-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-wc9bh\" (UID: \"f6cd5862-ace4-4695-bf49-e38f1d0a5113\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.217159 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.217134 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2c5ck\" (UniqueName: \"kubernetes.io/projected/f6cd5862-ace4-4695-bf49-e38f1d0a5113-kube-api-access-2c5ck\") pod \"istiod-openshift-gateway-94bb8fbfd-wc9bh\" (UID: \"f6cd5862-ace4-4695-bf49-e38f1d0a5113\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.217430 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.217407 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/f6cd5862-ace4-4695-bf49-e38f1d0a5113-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-wc9bh\" (UID: \"f6cd5862-ace4-4695-bf49-e38f1d0a5113\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.351647 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.351617 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:33.789024 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.788967 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 15 18:00:33.789103 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.789077 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 15 18:00:33.869252 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.869187 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh"] Jul 15 18:00:33.872457 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:00:33.872429 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf6cd5862_ace4_4695_bf49_e38f1d0a5113.slice/crio-a59afb8854d228ea1b3463f28252c374273b057655d4e69ff7c45eaebc7bc0f4 WatchSource:0}: Error finding container a59afb8854d228ea1b3463f28252c374273b057655d4e69ff7c45eaebc7bc0f4: Status 404 returned error can't find the container with id a59afb8854d228ea1b3463f28252c374273b057655d4e69ff7c45eaebc7bc0f4 Jul 15 18:00:33.875762 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.875727 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 15 18:00:33.875858 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:33.875788 2551 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 15 18:00:34.465333 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:34.465301 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:34.632538 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:34.632470 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:34.772298 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:34.772183 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" event={"ID":"c99e36ea-244d-426a-9b2a-31b6368e7f01","Type":"ContainerStarted","Data":"e9b6be4e24d6e7b990c5432896faf3c6a3fca2e30f44f50784595dd53585de5a"} Jul 15 18:00:34.772468 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:34.772405 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:34.774175 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:34.774146 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" event={"ID":"f6cd5862-ace4-4695-bf49-e38f1d0a5113","Type":"ContainerStarted","Data":"f885d5a81c108a365dec237f2405bc13181a76cba6673dbdd2226761e6379c42"} Jul 15 18:00:34.774295 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:34.774191 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" event={"ID":"f6cd5862-ace4-4695-bf49-e38f1d0a5113","Type":"ContainerStarted","Data":"a59afb8854d228ea1b3463f28252c374273b057655d4e69ff7c45eaebc7bc0f4"} Jul 15 18:00:34.774377 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:34.774362 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:34.774743 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:34.774719 2551 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-jj9w7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 18:00:34.774855 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:34.774771 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" podUID="c99e36ea-244d-426a-9b2a-31b6368e7f01" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 18:00:34.775800 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:34.775778 2551 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-wc9bh container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 18:00:34.775873 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:34.775826 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" podUID="f6cd5862-ace4-4695-bf49-e38f1d0a5113" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 18:00:34.838833 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:34.838794 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" podStartSLOduration=1.599886914 podStartE2EDuration="8.838781111s" totalImagesPullingTime="7.238894197s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:00:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:00:34.836391389 +0000 UTC m=+333.171699691" watchObservedRunningTime="2026-07-15 18:00:34.838781111 +0000 UTC m=+333.174089412" Jul 15 18:00:34.902233 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:34.902185 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" podStartSLOduration=2.902172521 podStartE2EDuration="2.902172521s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:00:32 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:00:34.89292707 +0000 UTC m=+333.228235373" watchObservedRunningTime="2026-07-15 18:00:34.902172521 +0000 UTC m=+333.237480823" Jul 15 18:00:35.718561 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:35.718523 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:35.779181 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:35.779149 2551 patch_prober.go:28] interesting pod/istiod-openshift-gateway-7574459656-jj9w7 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 18:00:35.779181 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:35.779172 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-wc9bh" Jul 15 18:00:35.779390 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:35.779201 2551 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" podUID="c99e36ea-244d-426a-9b2a-31b6368e7f01" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 18:00:35.832551 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:35.832521 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:35.957632 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:35.957598 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7"] Jul 15 18:00:36.073363 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:36.073278 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:36.191455 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:36.191419 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:36.265376 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:36.265341 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:36.345223 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:36.345134 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:36.731739 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:36.731686 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:36.784082 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:36.784042 2551 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" podUID="c99e36ea-244d-426a-9b2a-31b6368e7f01" containerName="discovery" containerID="cri-o://e9b6be4e24d6e7b990c5432896faf3c6a3fca2e30f44f50784595dd53585de5a" gracePeriod=30 Jul 15 18:00:36.784750 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:36.784564 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:37.003966 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.003886 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:37.043357 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.043335 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:37.142916 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.142884 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c99e36ea-244d-426a-9b2a-31b6368e7f01-cacerts\") pod \"c99e36ea-244d-426a-9b2a-31b6368e7f01\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " Jul 15 18:00:37.143076 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.142934 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-csr-dns-cert\") pod \"c99e36ea-244d-426a-9b2a-31b6368e7f01\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " Jul 15 18:00:37.143076 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.142963 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-m2qrl\" (UniqueName: \"kubernetes.io/projected/c99e36ea-244d-426a-9b2a-31b6368e7f01-kube-api-access-m2qrl\") pod \"c99e36ea-244d-426a-9b2a-31b6368e7f01\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " Jul 15 18:00:37.143076 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.143012 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-token\") pod \"c99e36ea-244d-426a-9b2a-31b6368e7f01\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " Jul 15 18:00:37.143076 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.143037 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-kubeconfig\") pod \"c99e36ea-244d-426a-9b2a-31b6368e7f01\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " Jul 15 18:00:37.143076 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.143076 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-csr-ca-configmap\") pod \"c99e36ea-244d-426a-9b2a-31b6368e7f01\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " Jul 15 18:00:37.143333 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.143102 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c99e36ea-244d-426a-9b2a-31b6368e7f01-local-certs\") pod \"c99e36ea-244d-426a-9b2a-31b6368e7f01\" (UID: \"c99e36ea-244d-426a-9b2a-31b6368e7f01\") " Jul 15 18:00:37.143563 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.143517 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-csr-ca-configmap" (OuterVolumeSpecName: "istio-csr-ca-configmap") pod "c99e36ea-244d-426a-9b2a-31b6368e7f01" (UID: "c99e36ea-244d-426a-9b2a-31b6368e7f01"). InnerVolumeSpecName "istio-csr-ca-configmap". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 18:00:37.145695 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.145641 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-kubeconfig" (OuterVolumeSpecName: "istio-kubeconfig") pod "c99e36ea-244d-426a-9b2a-31b6368e7f01" (UID: "c99e36ea-244d-426a-9b2a-31b6368e7f01"). InnerVolumeSpecName "istio-kubeconfig". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 18:00:37.145805 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.145736 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-csr-dns-cert" (OuterVolumeSpecName: "istio-csr-dns-cert") pod "c99e36ea-244d-426a-9b2a-31b6368e7f01" (UID: "c99e36ea-244d-426a-9b2a-31b6368e7f01"). InnerVolumeSpecName "istio-csr-dns-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 18:00:37.146010 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.145964 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c99e36ea-244d-426a-9b2a-31b6368e7f01-kube-api-access-m2qrl" (OuterVolumeSpecName: "kube-api-access-m2qrl") pod "c99e36ea-244d-426a-9b2a-31b6368e7f01" (UID: "c99e36ea-244d-426a-9b2a-31b6368e7f01"). InnerVolumeSpecName "kube-api-access-m2qrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 18:00:37.146078 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.146048 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c99e36ea-244d-426a-9b2a-31b6368e7f01-local-certs" (OuterVolumeSpecName: "local-certs") pod "c99e36ea-244d-426a-9b2a-31b6368e7f01" (UID: "c99e36ea-244d-426a-9b2a-31b6368e7f01"). InnerVolumeSpecName "local-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 18:00:37.146078 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.146051 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-token" (OuterVolumeSpecName: "istio-token") pod "c99e36ea-244d-426a-9b2a-31b6368e7f01" (UID: "c99e36ea-244d-426a-9b2a-31b6368e7f01"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 18:00:37.146144 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.146070 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/c99e36ea-244d-426a-9b2a-31b6368e7f01-cacerts" (OuterVolumeSpecName: "cacerts") pod "c99e36ea-244d-426a-9b2a-31b6368e7f01" (UID: "c99e36ea-244d-426a-9b2a-31b6368e7f01"). InnerVolumeSpecName "cacerts". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 18:00:37.244487 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.244465 2551 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-token\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:00:37.244487 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.244487 2551 reconciler_common.go:299] "Volume detached for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-kubeconfig\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:00:37.244633 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.244497 2551 reconciler_common.go:299] "Volume detached for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-csr-ca-configmap\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:00:37.244633 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.244507 2551 reconciler_common.go:299] "Volume detached for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/c99e36ea-244d-426a-9b2a-31b6368e7f01-local-certs\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:00:37.244633 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.244515 2551 reconciler_common.go:299] "Volume detached for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/c99e36ea-244d-426a-9b2a-31b6368e7f01-cacerts\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:00:37.244633 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.244523 2551 reconciler_common.go:299] "Volume detached for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/c99e36ea-244d-426a-9b2a-31b6368e7f01-istio-csr-dns-cert\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:00:37.244633 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.244531 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-m2qrl\" (UniqueName: \"kubernetes.io/projected/c99e36ea-244d-426a-9b2a-31b6368e7f01-kube-api-access-m2qrl\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:00:37.505723 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.505660 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:37.605052 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.605019 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:37.789569 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.789483 2551 generic.go:356] "Generic (PLEG): container finished" podID="c99e36ea-244d-426a-9b2a-31b6368e7f01" containerID="e9b6be4e24d6e7b990c5432896faf3c6a3fca2e30f44f50784595dd53585de5a" exitCode=0 Jul 15 18:00:37.789569 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.789530 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" Jul 15 18:00:37.790088 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.789579 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" event={"ID":"c99e36ea-244d-426a-9b2a-31b6368e7f01","Type":"ContainerDied","Data":"e9b6be4e24d6e7b990c5432896faf3c6a3fca2e30f44f50784595dd53585de5a"} Jul 15 18:00:37.790088 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.789632 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7" event={"ID":"c99e36ea-244d-426a-9b2a-31b6368e7f01","Type":"ContainerDied","Data":"bfe5b6f648aa5a794c08c29fb7277fe26c73590567cc9c0e200b4d983fbc0762"} Jul 15 18:00:37.790088 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.789653 2551 scope.go:117] "RemoveContainer" containerID="e9b6be4e24d6e7b990c5432896faf3c6a3fca2e30f44f50784595dd53585de5a" Jul 15 18:00:37.799377 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.799362 2551 scope.go:117] "RemoveContainer" containerID="e9b6be4e24d6e7b990c5432896faf3c6a3fca2e30f44f50784595dd53585de5a" Jul 15 18:00:37.799615 ip-10-0-128-25 kubenswrapper[2551]: E0715 18:00:37.799599 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e9b6be4e24d6e7b990c5432896faf3c6a3fca2e30f44f50784595dd53585de5a\": container with ID starting with e9b6be4e24d6e7b990c5432896faf3c6a3fca2e30f44f50784595dd53585de5a not found: ID does not exist" containerID="e9b6be4e24d6e7b990c5432896faf3c6a3fca2e30f44f50784595dd53585de5a" Jul 15 18:00:37.799657 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.799622 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e9b6be4e24d6e7b990c5432896faf3c6a3fca2e30f44f50784595dd53585de5a"} err="failed to get container status \"e9b6be4e24d6e7b990c5432896faf3c6a3fca2e30f44f50784595dd53585de5a\": rpc error: code = NotFound desc = could not find container \"e9b6be4e24d6e7b990c5432896faf3c6a3fca2e30f44f50784595dd53585de5a\": container with ID starting with e9b6be4e24d6e7b990c5432896faf3c6a3fca2e30f44f50784595dd53585de5a not found: ID does not exist" Jul 15 18:00:37.817202 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.817182 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7"] Jul 15 18:00:37.823213 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:37.823193 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-7574459656-jj9w7"] Jul 15 18:00:38.213020 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:38.212991 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c99e36ea-244d-426a-9b2a-31b6368e7f01" path="/var/lib/kubelet/pods/c99e36ea-244d-426a-9b2a-31b6368e7f01/volumes" Jul 15 18:00:38.283063 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:38.283025 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:41.758494 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:41.758462 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-4nszb" Jul 15 18:00:41.760087 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:41.760066 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-v8qnj" Jul 15 18:00:45.042234 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:45.042200 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:00:45.108362 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:00:45.108331 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:01:25.081765 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:25.081694 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:01:25.171887 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:25.171853 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:01:25.224409 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:25.224379 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-49fsr"] Jul 15 18:01:25.224796 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:25.224778 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c99e36ea-244d-426a-9b2a-31b6368e7f01" containerName="discovery" Jul 15 18:01:25.224861 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:25.224798 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="c99e36ea-244d-426a-9b2a-31b6368e7f01" containerName="discovery" Jul 15 18:01:25.224910 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:25.224877 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="c99e36ea-244d-426a-9b2a-31b6368e7f01" containerName="discovery" Jul 15 18:01:25.227162 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:25.227139 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-49fsr" Jul 15 18:01:25.229426 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:25.229401 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 18:01:25.229930 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:25.229908 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 18:01:25.230059 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:25.229908 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-t6c8r\"" Jul 15 18:01:25.238511 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:25.238487 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-49fsr"] Jul 15 18:01:25.265882 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:25.265852 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:01:25.318740 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:25.318696 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjk6v\" (UniqueName: \"kubernetes.io/projected/0a76593d-0fde-4b2a-ae7a-ac3a79e3acd2-kube-api-access-pjk6v\") pod \"kuadrant-operator-catalog-49fsr\" (UID: \"0a76593d-0fde-4b2a-ae7a-ac3a79e3acd2\") " pod="kuadrant-system/kuadrant-operator-catalog-49fsr" Jul 15 18:01:25.419785 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:25.419753 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjk6v\" (UniqueName: \"kubernetes.io/projected/0a76593d-0fde-4b2a-ae7a-ac3a79e3acd2-kube-api-access-pjk6v\") pod \"kuadrant-operator-catalog-49fsr\" (UID: \"0a76593d-0fde-4b2a-ae7a-ac3a79e3acd2\") " pod="kuadrant-system/kuadrant-operator-catalog-49fsr" Jul 15 18:01:25.428089 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:25.428064 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjk6v\" (UniqueName: \"kubernetes.io/projected/0a76593d-0fde-4b2a-ae7a-ac3a79e3acd2-kube-api-access-pjk6v\") pod \"kuadrant-operator-catalog-49fsr\" (UID: \"0a76593d-0fde-4b2a-ae7a-ac3a79e3acd2\") " pod="kuadrant-system/kuadrant-operator-catalog-49fsr" Jul 15 18:01:25.536954 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:25.536926 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-49fsr" Jul 15 18:01:25.685546 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:25.685468 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-49fsr"] Jul 15 18:01:25.688612 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:01:25.688588 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a76593d_0fde_4b2a_ae7a_ac3a79e3acd2.slice/crio-d58716d397358ef0afc217b202eac2ab5e397701ead810db439615072c94f69f WatchSource:0}: Error finding container d58716d397358ef0afc217b202eac2ab5e397701ead810db439615072c94f69f: Status 404 returned error can't find the container with id d58716d397358ef0afc217b202eac2ab5e397701ead810db439615072c94f69f Jul 15 18:01:26.016160 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:26.016078 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-49fsr" event={"ID":"0a76593d-0fde-4b2a-ae7a-ac3a79e3acd2","Type":"ContainerStarted","Data":"d58716d397358ef0afc217b202eac2ab5e397701ead810db439615072c94f69f"} Jul 15 18:01:29.032031 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:29.031988 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-49fsr" event={"ID":"0a76593d-0fde-4b2a-ae7a-ac3a79e3acd2","Type":"ContainerStarted","Data":"c29ab8c879be1771f7c98ed391f9e467d96519eeed17a20bc2db156fd5ade354"} Jul 15 18:01:29.047853 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:29.047809 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-49fsr" podStartSLOduration=1.360349786 podStartE2EDuration="4.047794513s" totalImagesPullingTime="2.687444727s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:01:25 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:01:29.046365828 +0000 UTC m=+387.381674130" watchObservedRunningTime="2026-07-15 18:01:29.047794513 +0000 UTC m=+387.383102815" Jul 15 18:01:32.898203 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:32.898163 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:01:32.952559 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:32.952524 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:01:35.537237 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:35.537201 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-49fsr" Jul 15 18:01:35.537641 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:35.537263 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-49fsr" Jul 15 18:01:35.561300 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:35.561275 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-49fsr" Jul 15 18:01:36.087198 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:36.087173 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-49fsr" Jul 15 18:01:43.181005 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.180964 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l"] Jul 15 18:01:43.184195 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.184176 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l" Jul 15 18:01:43.186587 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.186569 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4gth7\"" Jul 15 18:01:43.195089 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.195066 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l"] Jul 15 18:01:43.265762 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.265731 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d65wp\" (UniqueName: \"kubernetes.io/projected/f87b806e-12b6-4569-ab94-51875e605cec-kube-api-access-d65wp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l\" (UID: \"f87b806e-12b6-4569-ab94-51875e605cec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l" Jul 15 18:01:43.265909 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.265771 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f87b806e-12b6-4569-ab94-51875e605cec-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l\" (UID: \"f87b806e-12b6-4569-ab94-51875e605cec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l" Jul 15 18:01:43.265909 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.265808 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f87b806e-12b6-4569-ab94-51875e605cec-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l\" (UID: \"f87b806e-12b6-4569-ab94-51875e605cec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l" Jul 15 18:01:43.274981 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.274956 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j"] Jul 15 18:01:43.277312 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.277298 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j" Jul 15 18:01:43.288321 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.288298 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j"] Jul 15 18:01:43.367053 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.367011 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f87b806e-12b6-4569-ab94-51875e605cec-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l\" (UID: \"f87b806e-12b6-4569-ab94-51875e605cec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l" Jul 15 18:01:43.367240 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.367082 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3be92a5-bf27-46bf-82a3-7ef1d795558b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j\" (UID: \"f3be92a5-bf27-46bf-82a3-7ef1d795558b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j" Jul 15 18:01:43.367240 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.367153 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d65wp\" (UniqueName: \"kubernetes.io/projected/f87b806e-12b6-4569-ab94-51875e605cec-kube-api-access-d65wp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l\" (UID: \"f87b806e-12b6-4569-ab94-51875e605cec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l" Jul 15 18:01:43.367240 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.367180 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hslvs\" (UniqueName: \"kubernetes.io/projected/f3be92a5-bf27-46bf-82a3-7ef1d795558b-kube-api-access-hslvs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j\" (UID: \"f3be92a5-bf27-46bf-82a3-7ef1d795558b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j" Jul 15 18:01:43.367240 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.367217 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f87b806e-12b6-4569-ab94-51875e605cec-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l\" (UID: \"f87b806e-12b6-4569-ab94-51875e605cec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l" Jul 15 18:01:43.367427 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.367264 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3be92a5-bf27-46bf-82a3-7ef1d795558b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j\" (UID: \"f3be92a5-bf27-46bf-82a3-7ef1d795558b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j" Jul 15 18:01:43.367467 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.367429 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f87b806e-12b6-4569-ab94-51875e605cec-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l\" (UID: \"f87b806e-12b6-4569-ab94-51875e605cec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l" Jul 15 18:01:43.367501 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.367479 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f87b806e-12b6-4569-ab94-51875e605cec-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l\" (UID: \"f87b806e-12b6-4569-ab94-51875e605cec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l" Jul 15 18:01:43.376267 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.376243 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-d65wp\" (UniqueName: \"kubernetes.io/projected/f87b806e-12b6-4569-ab94-51875e605cec-kube-api-access-d65wp\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l\" (UID: \"f87b806e-12b6-4569-ab94-51875e605cec\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l" Jul 15 18:01:43.468355 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.468285 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3be92a5-bf27-46bf-82a3-7ef1d795558b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j\" (UID: \"f3be92a5-bf27-46bf-82a3-7ef1d795558b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j" Jul 15 18:01:43.468355 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.468326 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3be92a5-bf27-46bf-82a3-7ef1d795558b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j\" (UID: \"f3be92a5-bf27-46bf-82a3-7ef1d795558b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j" Jul 15 18:01:43.468504 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.468370 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hslvs\" (UniqueName: \"kubernetes.io/projected/f3be92a5-bf27-46bf-82a3-7ef1d795558b-kube-api-access-hslvs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j\" (UID: \"f3be92a5-bf27-46bf-82a3-7ef1d795558b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j" Jul 15 18:01:43.468637 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.468620 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3be92a5-bf27-46bf-82a3-7ef1d795558b-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j\" (UID: \"f3be92a5-bf27-46bf-82a3-7ef1d795558b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j" Jul 15 18:01:43.468705 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.468653 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3be92a5-bf27-46bf-82a3-7ef1d795558b-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j\" (UID: \"f3be92a5-bf27-46bf-82a3-7ef1d795558b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j" Jul 15 18:01:43.476835 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.476810 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hslvs\" (UniqueName: \"kubernetes.io/projected/f3be92a5-bf27-46bf-82a3-7ef1d795558b-kube-api-access-hslvs\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j\" (UID: \"f3be92a5-bf27-46bf-82a3-7ef1d795558b\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j" Jul 15 18:01:43.493613 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.493588 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l" Jul 15 18:01:43.571495 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.571465 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt"] Jul 15 18:01:43.574602 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.574580 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt" Jul 15 18:01:43.584354 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.583901 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt"] Jul 15 18:01:43.586369 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.586345 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j" Jul 15 18:01:43.633979 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.633713 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l"] Jul 15 18:01:43.636440 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:01:43.636411 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf87b806e_12b6_4569_ab94_51875e605cec.slice/crio-cc2bffbc55dd4696430c2b9e663422e7d106e0dc1e612442945c93baa29fd59b WatchSource:0}: Error finding container cc2bffbc55dd4696430c2b9e663422e7d106e0dc1e612442945c93baa29fd59b: Status 404 returned error can't find the container with id cc2bffbc55dd4696430c2b9e663422e7d106e0dc1e612442945c93baa29fd59b Jul 15 18:01:43.669983 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.669954 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cae8f56-f307-4b24-9276-32e649aa95a6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt\" (UID: \"5cae8f56-f307-4b24-9276-32e649aa95a6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt" Jul 15 18:01:43.670104 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.670003 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cae8f56-f307-4b24-9276-32e649aa95a6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt\" (UID: \"5cae8f56-f307-4b24-9276-32e649aa95a6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt" Jul 15 18:01:43.670104 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.670024 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p7tsn\" (UniqueName: \"kubernetes.io/projected/5cae8f56-f307-4b24-9276-32e649aa95a6-kube-api-access-p7tsn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt\" (UID: \"5cae8f56-f307-4b24-9276-32e649aa95a6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt" Jul 15 18:01:43.728099 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.728059 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j"] Jul 15 18:01:43.730032 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:01:43.730006 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf3be92a5_bf27_46bf_82a3_7ef1d795558b.slice/crio-42f75e5233beca70cbe3229d4cc6329acb22a448b012d8c03744efa5378be9ba WatchSource:0}: Error finding container 42f75e5233beca70cbe3229d4cc6329acb22a448b012d8c03744efa5378be9ba: Status 404 returned error can't find the container with id 42f75e5233beca70cbe3229d4cc6329acb22a448b012d8c03744efa5378be9ba Jul 15 18:01:43.771129 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.771106 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cae8f56-f307-4b24-9276-32e649aa95a6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt\" (UID: \"5cae8f56-f307-4b24-9276-32e649aa95a6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt" Jul 15 18:01:43.771224 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.771155 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cae8f56-f307-4b24-9276-32e649aa95a6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt\" (UID: \"5cae8f56-f307-4b24-9276-32e649aa95a6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt" Jul 15 18:01:43.771285 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.771266 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p7tsn\" (UniqueName: \"kubernetes.io/projected/5cae8f56-f307-4b24-9276-32e649aa95a6-kube-api-access-p7tsn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt\" (UID: \"5cae8f56-f307-4b24-9276-32e649aa95a6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt" Jul 15 18:01:43.771443 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.771429 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cae8f56-f307-4b24-9276-32e649aa95a6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt\" (UID: \"5cae8f56-f307-4b24-9276-32e649aa95a6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt" Jul 15 18:01:43.771480 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.771449 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cae8f56-f307-4b24-9276-32e649aa95a6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt\" (UID: \"5cae8f56-f307-4b24-9276-32e649aa95a6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt" Jul 15 18:01:43.779426 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.779405 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p7tsn\" (UniqueName: \"kubernetes.io/projected/5cae8f56-f307-4b24-9276-32e649aa95a6-kube-api-access-p7tsn\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt\" (UID: \"5cae8f56-f307-4b24-9276-32e649aa95a6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt" Jul 15 18:01:43.887104 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.887072 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt" Jul 15 18:01:43.972223 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.972186 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq"] Jul 15 18:01:43.975721 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.975698 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq" Jul 15 18:01:43.985238 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:43.984977 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq"] Jul 15 18:01:44.029216 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:44.029184 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt"] Jul 15 18:01:44.029789 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:01:44.029760 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cae8f56_f307_4b24_9276_32e649aa95a6.slice/crio-ddb9d86d25f5c4d205437bab0c6bf8bb157bada88cac9830ab5cf3680ddd0b03 WatchSource:0}: Error finding container ddb9d86d25f5c4d205437bab0c6bf8bb157bada88cac9830ab5cf3680ddd0b03: Status 404 returned error can't find the container with id ddb9d86d25f5c4d205437bab0c6bf8bb157bada88cac9830ab5cf3680ddd0b03 Jul 15 18:01:44.074274 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:44.074246 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f439522-6ed9-41b0-a0d6-bac70c5c806f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq\" (UID: \"6f439522-6ed9-41b0-a0d6-bac70c5c806f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq" Jul 15 18:01:44.074418 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:44.074285 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f439522-6ed9-41b0-a0d6-bac70c5c806f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq\" (UID: \"6f439522-6ed9-41b0-a0d6-bac70c5c806f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq" Jul 15 18:01:44.074418 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:44.074386 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hh2m6\" (UniqueName: \"kubernetes.io/projected/6f439522-6ed9-41b0-a0d6-bac70c5c806f-kube-api-access-hh2m6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq\" (UID: \"6f439522-6ed9-41b0-a0d6-bac70c5c806f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq" Jul 15 18:01:44.104820 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:44.104788 2551 generic.go:356] "Generic (PLEG): container finished" podID="f87b806e-12b6-4569-ab94-51875e605cec" containerID="f3ec43ff588cf9910e89f6f057bc2ade0fa5efa66d20ddea6b58667759ca20a9" exitCode=0 Jul 15 18:01:44.104972 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:44.104860 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l" event={"ID":"f87b806e-12b6-4569-ab94-51875e605cec","Type":"ContainerDied","Data":"f3ec43ff588cf9910e89f6f057bc2ade0fa5efa66d20ddea6b58667759ca20a9"} Jul 15 18:01:44.104972 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:44.104921 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l" event={"ID":"f87b806e-12b6-4569-ab94-51875e605cec","Type":"ContainerStarted","Data":"cc2bffbc55dd4696430c2b9e663422e7d106e0dc1e612442945c93baa29fd59b"} Jul 15 18:01:44.106638 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:44.106611 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt" event={"ID":"5cae8f56-f307-4b24-9276-32e649aa95a6","Type":"ContainerStarted","Data":"ddb9d86d25f5c4d205437bab0c6bf8bb157bada88cac9830ab5cf3680ddd0b03"} Jul 15 18:01:44.108134 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:44.108110 2551 generic.go:356] "Generic (PLEG): container finished" podID="f3be92a5-bf27-46bf-82a3-7ef1d795558b" containerID="07888c10fbd06b99f7c7df5c6306c281e517407a57c38e31837fb29921a559bc" exitCode=0 Jul 15 18:01:44.108258 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:44.108215 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j" event={"ID":"f3be92a5-bf27-46bf-82a3-7ef1d795558b","Type":"ContainerDied","Data":"07888c10fbd06b99f7c7df5c6306c281e517407a57c38e31837fb29921a559bc"} Jul 15 18:01:44.108383 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:44.108264 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j" event={"ID":"f3be92a5-bf27-46bf-82a3-7ef1d795558b","Type":"ContainerStarted","Data":"42f75e5233beca70cbe3229d4cc6329acb22a448b012d8c03744efa5378be9ba"} Jul 15 18:01:44.174969 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:44.174932 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f439522-6ed9-41b0-a0d6-bac70c5c806f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq\" (UID: \"6f439522-6ed9-41b0-a0d6-bac70c5c806f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq" Jul 15 18:01:44.175126 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:44.174977 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f439522-6ed9-41b0-a0d6-bac70c5c806f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq\" (UID: \"6f439522-6ed9-41b0-a0d6-bac70c5c806f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq" Jul 15 18:01:44.175126 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:44.175055 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hh2m6\" (UniqueName: \"kubernetes.io/projected/6f439522-6ed9-41b0-a0d6-bac70c5c806f-kube-api-access-hh2m6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq\" (UID: \"6f439522-6ed9-41b0-a0d6-bac70c5c806f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq" Jul 15 18:01:44.175383 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:44.175360 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f439522-6ed9-41b0-a0d6-bac70c5c806f-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq\" (UID: \"6f439522-6ed9-41b0-a0d6-bac70c5c806f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq" Jul 15 18:01:44.175456 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:44.175356 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f439522-6ed9-41b0-a0d6-bac70c5c806f-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq\" (UID: \"6f439522-6ed9-41b0-a0d6-bac70c5c806f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq" Jul 15 18:01:44.183993 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:44.183969 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hh2m6\" (UniqueName: \"kubernetes.io/projected/6f439522-6ed9-41b0-a0d6-bac70c5c806f-kube-api-access-hh2m6\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq\" (UID: \"6f439522-6ed9-41b0-a0d6-bac70c5c806f\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq" Jul 15 18:01:44.288210 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:44.288134 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq" Jul 15 18:01:44.424231 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:44.424195 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq"] Jul 15 18:01:44.426273 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:01:44.426239 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6f439522_6ed9_41b0_a0d6_bac70c5c806f.slice/crio-4c887ddc86f1bfe50b9c56459528712660ca9c6f953d9712ccbbe18b04573ce4 WatchSource:0}: Error finding container 4c887ddc86f1bfe50b9c56459528712660ca9c6f953d9712ccbbe18b04573ce4: Status 404 returned error can't find the container with id 4c887ddc86f1bfe50b9c56459528712660ca9c6f953d9712ccbbe18b04573ce4 Jul 15 18:01:45.114748 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:45.114722 2551 generic.go:356] "Generic (PLEG): container finished" podID="f87b806e-12b6-4569-ab94-51875e605cec" containerID="869ae94fd1f671be70901da554441d732a8b6fab1f6eba9b8114fa6ea4c44220" exitCode=0 Jul 15 18:01:45.114860 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:45.114786 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l" event={"ID":"f87b806e-12b6-4569-ab94-51875e605cec","Type":"ContainerDied","Data":"869ae94fd1f671be70901da554441d732a8b6fab1f6eba9b8114fa6ea4c44220"} Jul 15 18:01:45.116351 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:45.116331 2551 generic.go:356] "Generic (PLEG): container finished" podID="5cae8f56-f307-4b24-9276-32e649aa95a6" containerID="e532810a474e655ab70d1f523c6b00c843978d63f39baa550dc98e048d85f529" exitCode=0 Jul 15 18:01:45.116427 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:45.116407 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt" event={"ID":"5cae8f56-f307-4b24-9276-32e649aa95a6","Type":"ContainerDied","Data":"e532810a474e655ab70d1f523c6b00c843978d63f39baa550dc98e048d85f529"} Jul 15 18:01:45.118244 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:45.118220 2551 generic.go:356] "Generic (PLEG): container finished" podID="f3be92a5-bf27-46bf-82a3-7ef1d795558b" containerID="591f788ef8d79a053abcddcc33f61597fc6a988cbbce1d3dabbdddeaef72381f" exitCode=0 Jul 15 18:01:45.118336 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:45.118274 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j" event={"ID":"f3be92a5-bf27-46bf-82a3-7ef1d795558b","Type":"ContainerDied","Data":"591f788ef8d79a053abcddcc33f61597fc6a988cbbce1d3dabbdddeaef72381f"} Jul 15 18:01:45.120273 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:45.120076 2551 generic.go:356] "Generic (PLEG): container finished" podID="6f439522-6ed9-41b0-a0d6-bac70c5c806f" containerID="f2b8f142e9621aeb72ae9fbde6e5c6ac9946131adb85f2581d58056727adbded" exitCode=0 Jul 15 18:01:45.120273 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:45.120140 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq" event={"ID":"6f439522-6ed9-41b0-a0d6-bac70c5c806f","Type":"ContainerDied","Data":"f2b8f142e9621aeb72ae9fbde6e5c6ac9946131adb85f2581d58056727adbded"} Jul 15 18:01:45.120273 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:45.120169 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq" event={"ID":"6f439522-6ed9-41b0-a0d6-bac70c5c806f","Type":"ContainerStarted","Data":"4c887ddc86f1bfe50b9c56459528712660ca9c6f953d9712ccbbe18b04573ce4"} Jul 15 18:01:46.129938 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:46.129904 2551 generic.go:356] "Generic (PLEG): container finished" podID="f87b806e-12b6-4569-ab94-51875e605cec" containerID="06bbfca376e4b79ae0f125f9ff272c9b3468381933f5672fa6b35eb827c227c5" exitCode=0 Jul 15 18:01:46.130334 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:46.129947 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l" event={"ID":"f87b806e-12b6-4569-ab94-51875e605cec","Type":"ContainerDied","Data":"06bbfca376e4b79ae0f125f9ff272c9b3468381933f5672fa6b35eb827c227c5"} Jul 15 18:01:46.131712 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:46.131694 2551 generic.go:356] "Generic (PLEG): container finished" podID="5cae8f56-f307-4b24-9276-32e649aa95a6" containerID="a6f4aaee1cd64874f1e842e6254b4d0f584eedccee529dc30b0b1784e92b4a0a" exitCode=0 Jul 15 18:01:46.131798 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:46.131756 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt" event={"ID":"5cae8f56-f307-4b24-9276-32e649aa95a6","Type":"ContainerDied","Data":"a6f4aaee1cd64874f1e842e6254b4d0f584eedccee529dc30b0b1784e92b4a0a"} Jul 15 18:01:46.133987 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:46.133962 2551 generic.go:356] "Generic (PLEG): container finished" podID="f3be92a5-bf27-46bf-82a3-7ef1d795558b" containerID="01e17cd13c502197c8d72b00d251e7d3b2bc88d84cbc977d6ad8e4783ce6e800" exitCode=0 Jul 15 18:01:46.134091 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:46.134042 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j" event={"ID":"f3be92a5-bf27-46bf-82a3-7ef1d795558b","Type":"ContainerDied","Data":"01e17cd13c502197c8d72b00d251e7d3b2bc88d84cbc977d6ad8e4783ce6e800"} Jul 15 18:01:47.141157 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:47.141125 2551 generic.go:356] "Generic (PLEG): container finished" podID="5cae8f56-f307-4b24-9276-32e649aa95a6" containerID="957cff13b2f28674598950a284e2a9b7d191b7bf51117d33fb483c12b0436357" exitCode=0 Jul 15 18:01:47.141615 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:47.141215 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt" event={"ID":"5cae8f56-f307-4b24-9276-32e649aa95a6","Type":"ContainerDied","Data":"957cff13b2f28674598950a284e2a9b7d191b7bf51117d33fb483c12b0436357"} Jul 15 18:01:47.303021 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:47.302996 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j" Jul 15 18:01:47.305894 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:47.305874 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l" Jul 15 18:01:47.401380 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:47.401286 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f87b806e-12b6-4569-ab94-51875e605cec-bundle\") pod \"f87b806e-12b6-4569-ab94-51875e605cec\" (UID: \"f87b806e-12b6-4569-ab94-51875e605cec\") " Jul 15 18:01:47.401380 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:47.401323 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3be92a5-bf27-46bf-82a3-7ef1d795558b-bundle\") pod \"f3be92a5-bf27-46bf-82a3-7ef1d795558b\" (UID: \"f3be92a5-bf27-46bf-82a3-7ef1d795558b\") " Jul 15 18:01:47.401380 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:47.401356 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hslvs\" (UniqueName: \"kubernetes.io/projected/f3be92a5-bf27-46bf-82a3-7ef1d795558b-kube-api-access-hslvs\") pod \"f3be92a5-bf27-46bf-82a3-7ef1d795558b\" (UID: \"f3be92a5-bf27-46bf-82a3-7ef1d795558b\") " Jul 15 18:01:47.401634 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:47.401417 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d65wp\" (UniqueName: \"kubernetes.io/projected/f87b806e-12b6-4569-ab94-51875e605cec-kube-api-access-d65wp\") pod \"f87b806e-12b6-4569-ab94-51875e605cec\" (UID: \"f87b806e-12b6-4569-ab94-51875e605cec\") " Jul 15 18:01:47.401634 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:47.401444 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f87b806e-12b6-4569-ab94-51875e605cec-util\") pod \"f87b806e-12b6-4569-ab94-51875e605cec\" (UID: \"f87b806e-12b6-4569-ab94-51875e605cec\") " Jul 15 18:01:47.401634 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:47.401464 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3be92a5-bf27-46bf-82a3-7ef1d795558b-util\") pod \"f3be92a5-bf27-46bf-82a3-7ef1d795558b\" (UID: \"f3be92a5-bf27-46bf-82a3-7ef1d795558b\") " Jul 15 18:01:47.401901 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:47.401874 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f87b806e-12b6-4569-ab94-51875e605cec-bundle" (OuterVolumeSpecName: "bundle") pod "f87b806e-12b6-4569-ab94-51875e605cec" (UID: "f87b806e-12b6-4569-ab94-51875e605cec"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 18:01:47.402029 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:47.402005 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3be92a5-bf27-46bf-82a3-7ef1d795558b-bundle" (OuterVolumeSpecName: "bundle") pod "f3be92a5-bf27-46bf-82a3-7ef1d795558b" (UID: "f3be92a5-bf27-46bf-82a3-7ef1d795558b"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 18:01:47.403854 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:47.403822 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f87b806e-12b6-4569-ab94-51875e605cec-kube-api-access-d65wp" (OuterVolumeSpecName: "kube-api-access-d65wp") pod "f87b806e-12b6-4569-ab94-51875e605cec" (UID: "f87b806e-12b6-4569-ab94-51875e605cec"). InnerVolumeSpecName "kube-api-access-d65wp". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 18:01:47.403961 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:47.403937 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/f3be92a5-bf27-46bf-82a3-7ef1d795558b-kube-api-access-hslvs" (OuterVolumeSpecName: "kube-api-access-hslvs") pod "f3be92a5-bf27-46bf-82a3-7ef1d795558b" (UID: "f3be92a5-bf27-46bf-82a3-7ef1d795558b"). InnerVolumeSpecName "kube-api-access-hslvs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 18:01:47.407805 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:47.407769 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f3be92a5-bf27-46bf-82a3-7ef1d795558b-util" (OuterVolumeSpecName: "util") pod "f3be92a5-bf27-46bf-82a3-7ef1d795558b" (UID: "f3be92a5-bf27-46bf-82a3-7ef1d795558b"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 18:01:47.408326 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:47.408303 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/f87b806e-12b6-4569-ab94-51875e605cec-util" (OuterVolumeSpecName: "util") pod "f87b806e-12b6-4569-ab94-51875e605cec" (UID: "f87b806e-12b6-4569-ab94-51875e605cec"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 18:01:47.502941 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:47.502916 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f87b806e-12b6-4569-ab94-51875e605cec-bundle\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:01:47.502941 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:47.502939 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/f3be92a5-bf27-46bf-82a3-7ef1d795558b-bundle\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:01:47.503059 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:47.502948 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hslvs\" (UniqueName: \"kubernetes.io/projected/f3be92a5-bf27-46bf-82a3-7ef1d795558b-kube-api-access-hslvs\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:01:47.503059 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:47.502958 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d65wp\" (UniqueName: \"kubernetes.io/projected/f87b806e-12b6-4569-ab94-51875e605cec-kube-api-access-d65wp\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:01:47.503059 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:47.502967 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f87b806e-12b6-4569-ab94-51875e605cec-util\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:01:47.503059 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:47.502975 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/f3be92a5-bf27-46bf-82a3-7ef1d795558b-util\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:01:48.148368 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:48.148336 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l" Jul 15 18:01:48.148801 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:48.148359 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l" event={"ID":"f87b806e-12b6-4569-ab94-51875e605cec","Type":"ContainerDied","Data":"cc2bffbc55dd4696430c2b9e663422e7d106e0dc1e612442945c93baa29fd59b"} Jul 15 18:01:48.148801 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:48.148409 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="cc2bffbc55dd4696430c2b9e663422e7d106e0dc1e612442945c93baa29fd59b" Jul 15 18:01:48.150332 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:48.150315 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j" Jul 15 18:01:48.150444 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:48.150347 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j" event={"ID":"f3be92a5-bf27-46bf-82a3-7ef1d795558b","Type":"ContainerDied","Data":"42f75e5233beca70cbe3229d4cc6329acb22a448b012d8c03744efa5378be9ba"} Jul 15 18:01:48.150444 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:48.150392 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="42f75e5233beca70cbe3229d4cc6329acb22a448b012d8c03744efa5378be9ba" Jul 15 18:01:48.268643 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:48.268614 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt" Jul 15 18:01:48.308805 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:48.308780 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cae8f56-f307-4b24-9276-32e649aa95a6-util\") pod \"5cae8f56-f307-4b24-9276-32e649aa95a6\" (UID: \"5cae8f56-f307-4b24-9276-32e649aa95a6\") " Jul 15 18:01:48.308927 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:48.308834 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-p7tsn\" (UniqueName: \"kubernetes.io/projected/5cae8f56-f307-4b24-9276-32e649aa95a6-kube-api-access-p7tsn\") pod \"5cae8f56-f307-4b24-9276-32e649aa95a6\" (UID: \"5cae8f56-f307-4b24-9276-32e649aa95a6\") " Jul 15 18:01:48.308927 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:48.308877 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cae8f56-f307-4b24-9276-32e649aa95a6-bundle\") pod \"5cae8f56-f307-4b24-9276-32e649aa95a6\" (UID: \"5cae8f56-f307-4b24-9276-32e649aa95a6\") " Jul 15 18:01:48.309356 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:48.309334 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cae8f56-f307-4b24-9276-32e649aa95a6-bundle" (OuterVolumeSpecName: "bundle") pod "5cae8f56-f307-4b24-9276-32e649aa95a6" (UID: "5cae8f56-f307-4b24-9276-32e649aa95a6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 18:01:48.310952 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:48.310933 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5cae8f56-f307-4b24-9276-32e649aa95a6-kube-api-access-p7tsn" (OuterVolumeSpecName: "kube-api-access-p7tsn") pod "5cae8f56-f307-4b24-9276-32e649aa95a6" (UID: "5cae8f56-f307-4b24-9276-32e649aa95a6"). InnerVolumeSpecName "kube-api-access-p7tsn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 18:01:48.316956 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:48.316925 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5cae8f56-f307-4b24-9276-32e649aa95a6-util" (OuterVolumeSpecName: "util") pod "5cae8f56-f307-4b24-9276-32e649aa95a6" (UID: "5cae8f56-f307-4b24-9276-32e649aa95a6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 18:01:48.410114 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:48.410037 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-p7tsn\" (UniqueName: \"kubernetes.io/projected/5cae8f56-f307-4b24-9276-32e649aa95a6-kube-api-access-p7tsn\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:01:48.410114 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:48.410063 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5cae8f56-f307-4b24-9276-32e649aa95a6-bundle\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:01:48.410114 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:48.410074 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5cae8f56-f307-4b24-9276-32e649aa95a6-util\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:01:49.157725 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:49.157689 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt" event={"ID":"5cae8f56-f307-4b24-9276-32e649aa95a6","Type":"ContainerDied","Data":"ddb9d86d25f5c4d205437bab0c6bf8bb157bada88cac9830ab5cf3680ddd0b03"} Jul 15 18:01:49.157725 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:49.157721 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt" Jul 15 18:01:49.158122 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:49.157736 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ddb9d86d25f5c4d205437bab0c6bf8bb157bada88cac9830ab5cf3680ddd0b03" Jul 15 18:01:50.164530 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:50.164495 2551 generic.go:356] "Generic (PLEG): container finished" podID="6f439522-6ed9-41b0-a0d6-bac70c5c806f" containerID="c2a1b98e376394f060fbaba3df11a3e639b26f7445a74db9eb1a6b853f9d1e37" exitCode=0 Jul 15 18:01:50.164940 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:50.164582 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq" event={"ID":"6f439522-6ed9-41b0-a0d6-bac70c5c806f","Type":"ContainerDied","Data":"c2a1b98e376394f060fbaba3df11a3e639b26f7445a74db9eb1a6b853f9d1e37"} Jul 15 18:01:51.171755 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:51.171718 2551 generic.go:356] "Generic (PLEG): container finished" podID="6f439522-6ed9-41b0-a0d6-bac70c5c806f" containerID="d9a1a501ba9df3df6fff27d0bc7467eaa9e24f920ce4579f967e18742fda8eed" exitCode=0 Jul 15 18:01:51.172257 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:51.171768 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq" event={"ID":"6f439522-6ed9-41b0-a0d6-bac70c5c806f","Type":"ContainerDied","Data":"d9a1a501ba9df3df6fff27d0bc7467eaa9e24f920ce4579f967e18742fda8eed"} Jul 15 18:01:52.313653 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:52.313627 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq" Jul 15 18:01:52.445567 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:52.445503 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f439522-6ed9-41b0-a0d6-bac70c5c806f-bundle\") pod \"6f439522-6ed9-41b0-a0d6-bac70c5c806f\" (UID: \"6f439522-6ed9-41b0-a0d6-bac70c5c806f\") " Jul 15 18:01:52.445567 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:52.445546 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f439522-6ed9-41b0-a0d6-bac70c5c806f-util\") pod \"6f439522-6ed9-41b0-a0d6-bac70c5c806f\" (UID: \"6f439522-6ed9-41b0-a0d6-bac70c5c806f\") " Jul 15 18:01:52.445732 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:52.445575 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hh2m6\" (UniqueName: \"kubernetes.io/projected/6f439522-6ed9-41b0-a0d6-bac70c5c806f-kube-api-access-hh2m6\") pod \"6f439522-6ed9-41b0-a0d6-bac70c5c806f\" (UID: \"6f439522-6ed9-41b0-a0d6-bac70c5c806f\") " Jul 15 18:01:52.446039 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:52.446008 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f439522-6ed9-41b0-a0d6-bac70c5c806f-bundle" (OuterVolumeSpecName: "bundle") pod "6f439522-6ed9-41b0-a0d6-bac70c5c806f" (UID: "6f439522-6ed9-41b0-a0d6-bac70c5c806f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 18:01:52.447803 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:52.447782 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f439522-6ed9-41b0-a0d6-bac70c5c806f-kube-api-access-hh2m6" (OuterVolumeSpecName: "kube-api-access-hh2m6") pod "6f439522-6ed9-41b0-a0d6-bac70c5c806f" (UID: "6f439522-6ed9-41b0-a0d6-bac70c5c806f"). InnerVolumeSpecName "kube-api-access-hh2m6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 18:01:52.450098 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:52.450076 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6f439522-6ed9-41b0-a0d6-bac70c5c806f-util" (OuterVolumeSpecName: "util") pod "6f439522-6ed9-41b0-a0d6-bac70c5c806f" (UID: "6f439522-6ed9-41b0-a0d6-bac70c5c806f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 18:01:52.546309 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:52.546281 2551 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6f439522-6ed9-41b0-a0d6-bac70c5c806f-bundle\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:01:52.546309 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:52.546306 2551 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6f439522-6ed9-41b0-a0d6-bac70c5c806f-util\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:01:52.546465 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:52.546315 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hh2m6\" (UniqueName: \"kubernetes.io/projected/6f439522-6ed9-41b0-a0d6-bac70c5c806f-kube-api-access-hh2m6\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:01:53.185897 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:53.185869 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq" Jul 15 18:01:53.186040 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:53.185905 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq" event={"ID":"6f439522-6ed9-41b0-a0d6-bac70c5c806f","Type":"ContainerDied","Data":"4c887ddc86f1bfe50b9c56459528712660ca9c6f953d9712ccbbe18b04573ce4"} Jul 15 18:01:53.186040 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:53.185949 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4c887ddc86f1bfe50b9c56459528712660ca9c6f953d9712ccbbe18b04573ce4" Jul 15 18:01:57.302934 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:57.302894 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:01:57.402501 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:57.402462 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:01:59.634395 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634363 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kq6jr"] Jul 15 18:01:59.634774 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634740 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f87b806e-12b6-4569-ab94-51875e605cec" containerName="extract" Jul 15 18:01:59.634774 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634755 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="f87b806e-12b6-4569-ab94-51875e605cec" containerName="extract" Jul 15 18:01:59.634774 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634763 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f439522-6ed9-41b0-a0d6-bac70c5c806f" containerName="pull" Jul 15 18:01:59.634774 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634768 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f439522-6ed9-41b0-a0d6-bac70c5c806f" containerName="pull" Jul 15 18:01:59.634774 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634777 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3be92a5-bf27-46bf-82a3-7ef1d795558b" containerName="pull" Jul 15 18:01:59.634935 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634783 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3be92a5-bf27-46bf-82a3-7ef1d795558b" containerName="pull" Jul 15 18:01:59.634935 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634797 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f87b806e-12b6-4569-ab94-51875e605cec" containerName="util" Jul 15 18:01:59.634935 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634807 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="f87b806e-12b6-4569-ab94-51875e605cec" containerName="util" Jul 15 18:01:59.634935 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634817 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cae8f56-f307-4b24-9276-32e649aa95a6" containerName="extract" Jul 15 18:01:59.634935 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634822 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cae8f56-f307-4b24-9276-32e649aa95a6" containerName="extract" Jul 15 18:01:59.634935 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634828 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3be92a5-bf27-46bf-82a3-7ef1d795558b" containerName="extract" Jul 15 18:01:59.634935 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634833 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3be92a5-bf27-46bf-82a3-7ef1d795558b" containerName="extract" Jul 15 18:01:59.634935 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634838 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f3be92a5-bf27-46bf-82a3-7ef1d795558b" containerName="util" Jul 15 18:01:59.634935 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634843 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="f3be92a5-bf27-46bf-82a3-7ef1d795558b" containerName="util" Jul 15 18:01:59.634935 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634849 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f439522-6ed9-41b0-a0d6-bac70c5c806f" containerName="extract" Jul 15 18:01:59.634935 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634854 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f439522-6ed9-41b0-a0d6-bac70c5c806f" containerName="extract" Jul 15 18:01:59.634935 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634860 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f439522-6ed9-41b0-a0d6-bac70c5c806f" containerName="util" Jul 15 18:01:59.634935 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634867 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f439522-6ed9-41b0-a0d6-bac70c5c806f" containerName="util" Jul 15 18:01:59.634935 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634873 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cae8f56-f307-4b24-9276-32e649aa95a6" containerName="util" Jul 15 18:01:59.634935 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634880 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cae8f56-f307-4b24-9276-32e649aa95a6" containerName="util" Jul 15 18:01:59.634935 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634889 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5cae8f56-f307-4b24-9276-32e649aa95a6" containerName="pull" Jul 15 18:01:59.634935 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634894 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="5cae8f56-f307-4b24-9276-32e649aa95a6" containerName="pull" Jul 15 18:01:59.634935 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634901 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f87b806e-12b6-4569-ab94-51875e605cec" containerName="pull" Jul 15 18:01:59.634935 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634906 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="f87b806e-12b6-4569-ab94-51875e605cec" containerName="pull" Jul 15 18:01:59.635484 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634959 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="f3be92a5-bf27-46bf-82a3-7ef1d795558b" containerName="extract" Jul 15 18:01:59.635484 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634972 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="5cae8f56-f307-4b24-9276-32e649aa95a6" containerName="extract" Jul 15 18:01:59.635484 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634978 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="f87b806e-12b6-4569-ab94-51875e605cec" containerName="extract" Jul 15 18:01:59.635484 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.634984 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f439522-6ed9-41b0-a0d6-bac70c5c806f" containerName="extract" Jul 15 18:01:59.638225 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.638209 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kq6jr" Jul 15 18:01:59.640603 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.640583 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-fmbpg\"" Jul 15 18:01:59.651391 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.651368 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kq6jr"] Jul 15 18:01:59.706878 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.706856 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-v2g42\" (UniqueName: \"kubernetes.io/projected/dc0b5373-56fb-4d66-9e01-1e9ccc1ba106-kube-api-access-v2g42\") pod \"authorino-operator-75cc8d5cb7-kq6jr\" (UID: \"dc0b5373-56fb-4d66-9e01-1e9ccc1ba106\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kq6jr" Jul 15 18:01:59.807934 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.807901 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-v2g42\" (UniqueName: \"kubernetes.io/projected/dc0b5373-56fb-4d66-9e01-1e9ccc1ba106-kube-api-access-v2g42\") pod \"authorino-operator-75cc8d5cb7-kq6jr\" (UID: \"dc0b5373-56fb-4d66-9e01-1e9ccc1ba106\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kq6jr" Jul 15 18:01:59.816623 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.816593 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-v2g42\" (UniqueName: \"kubernetes.io/projected/dc0b5373-56fb-4d66-9e01-1e9ccc1ba106-kube-api-access-v2g42\") pod \"authorino-operator-75cc8d5cb7-kq6jr\" (UID: \"dc0b5373-56fb-4d66-9e01-1e9ccc1ba106\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-kq6jr" Jul 15 18:01:59.947523 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:01:59.947430 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kq6jr" Jul 15 18:02:00.083603 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:00.083576 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-kq6jr"] Jul 15 18:02:00.086175 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:02:00.086145 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddc0b5373_56fb_4d66_9e01_1e9ccc1ba106.slice/crio-527d46f9831fd7c5d2a8b8578fa95fecb5efdff7aaf242d8f1ff71dded15ff9f WatchSource:0}: Error finding container 527d46f9831fd7c5d2a8b8578fa95fecb5efdff7aaf242d8f1ff71dded15ff9f: Status 404 returned error can't find the container with id 527d46f9831fd7c5d2a8b8578fa95fecb5efdff7aaf242d8f1ff71dded15ff9f Jul 15 18:02:00.221138 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:00.221057 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kq6jr" event={"ID":"dc0b5373-56fb-4d66-9e01-1e9ccc1ba106","Type":"ContainerStarted","Data":"527d46f9831fd7c5d2a8b8578fa95fecb5efdff7aaf242d8f1ff71dded15ff9f"} Jul 15 18:02:00.725324 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:00.725291 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:02.479447 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:02.479412 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9bng4"] Jul 15 18:02:02.483505 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:02.483485 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9bng4" Jul 15 18:02:02.486428 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:02.486011 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-env\"" Jul 15 18:02:02.486428 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:02.486109 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"dns-operator-controller-manager-dockercfg-cg87z\"" Jul 15 18:02:02.497164 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:02.497141 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9bng4"] Jul 15 18:02:02.633020 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:02.632984 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlrzz\" (UniqueName: \"kubernetes.io/projected/5eb633d9-5a5b-4684-8106-33b32753ff4a-kube-api-access-hlrzz\") pod \"dns-operator-controller-manager-864dd78c4c-9bng4\" (UID: \"5eb633d9-5a5b-4684-8106-33b32753ff4a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9bng4" Jul 15 18:02:02.733448 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:02.733421 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlrzz\" (UniqueName: \"kubernetes.io/projected/5eb633d9-5a5b-4684-8106-33b32753ff4a-kube-api-access-hlrzz\") pod \"dns-operator-controller-manager-864dd78c4c-9bng4\" (UID: \"5eb633d9-5a5b-4684-8106-33b32753ff4a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9bng4" Jul 15 18:02:02.746035 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:02.746015 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlrzz\" (UniqueName: \"kubernetes.io/projected/5eb633d9-5a5b-4684-8106-33b32753ff4a-kube-api-access-hlrzz\") pod \"dns-operator-controller-manager-864dd78c4c-9bng4\" (UID: \"5eb633d9-5a5b-4684-8106-33b32753ff4a\") " pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9bng4" Jul 15 18:02:02.796396 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:02.796378 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9bng4" Jul 15 18:02:02.936577 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:02.936555 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/dns-operator-controller-manager-864dd78c4c-9bng4"] Jul 15 18:02:02.938348 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:02:02.938318 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5eb633d9_5a5b_4684_8106_33b32753ff4a.slice/crio-4b78c7c59cac371a387c05532f8f2eaeeb2e1b02ba7065d6de701e5f9d17c3dc WatchSource:0}: Error finding container 4b78c7c59cac371a387c05532f8f2eaeeb2e1b02ba7065d6de701e5f9d17c3dc: Status 404 returned error can't find the container with id 4b78c7c59cac371a387c05532f8f2eaeeb2e1b02ba7065d6de701e5f9d17c3dc Jul 15 18:02:03.128860 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:03.128819 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:03.241464 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:03.241411 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kq6jr" event={"ID":"dc0b5373-56fb-4d66-9e01-1e9ccc1ba106","Type":"ContainerStarted","Data":"2317f12941f424e9765a2bd32006d3fc0a50b42a6f8c9c7805dbfadcfc43179f"} Jul 15 18:02:03.241644 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:03.241509 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kq6jr" Jul 15 18:02:03.242775 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:03.242751 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9bng4" event={"ID":"5eb633d9-5a5b-4684-8106-33b32753ff4a","Type":"ContainerStarted","Data":"4b78c7c59cac371a387c05532f8f2eaeeb2e1b02ba7065d6de701e5f9d17c3dc"} Jul 15 18:02:03.263323 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:03.263277 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kq6jr" podStartSLOduration=1.6211562339999999 podStartE2EDuration="4.26326209s" totalImagesPullingTime="2.642105856s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:01:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:02:03.262203026 +0000 UTC m=+421.597511328" watchObservedRunningTime="2026-07-15 18:02:03.26326209 +0000 UTC m=+421.598570392" Jul 15 18:02:03.367894 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:03.367852 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:05.119147 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:05.119111 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn"] Jul 15 18:02:05.123236 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:05.123215 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn" Jul 15 18:02:05.126032 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:05.126008 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-vgb8l\"" Jul 15 18:02:05.137914 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:05.137887 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn"] Jul 15 18:02:05.257475 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:05.257445 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hl7xj\" (UniqueName: \"kubernetes.io/projected/8f84e56f-dc02-4377-affb-61c9a0bfb4a5-kube-api-access-hl7xj\") pod \"limitador-operator-controller-manager-859d7b78bd-bgppn\" (UID: \"8f84e56f-dc02-4377-affb-61c9a0bfb4a5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn" Jul 15 18:02:05.359037 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:05.358998 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hl7xj\" (UniqueName: \"kubernetes.io/projected/8f84e56f-dc02-4377-affb-61c9a0bfb4a5-kube-api-access-hl7xj\") pod \"limitador-operator-controller-manager-859d7b78bd-bgppn\" (UID: \"8f84e56f-dc02-4377-affb-61c9a0bfb4a5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn" Jul 15 18:02:05.367947 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:05.367923 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hl7xj\" (UniqueName: \"kubernetes.io/projected/8f84e56f-dc02-4377-affb-61c9a0bfb4a5-kube-api-access-hl7xj\") pod \"limitador-operator-controller-manager-859d7b78bd-bgppn\" (UID: \"8f84e56f-dc02-4377-affb-61c9a0bfb4a5\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn" Jul 15 18:02:05.434163 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:05.434100 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn" Jul 15 18:02:05.568932 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:05.568866 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:05.607935 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:05.607907 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn"] Jul 15 18:02:05.742823 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:05.742725 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:05.888713 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:02:05.888617 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8f84e56f_dc02_4377_affb_61c9a0bfb4a5.slice/crio-634e51e6642c3444818426a98bebe2b004615fc1611b08860d96963cf11e7154 WatchSource:0}: Error finding container 634e51e6642c3444818426a98bebe2b004615fc1611b08860d96963cf11e7154: Status 404 returned error can't find the container with id 634e51e6642c3444818426a98bebe2b004615fc1611b08860d96963cf11e7154 Jul 15 18:02:06.259530 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:06.259433 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9bng4" event={"ID":"5eb633d9-5a5b-4684-8106-33b32753ff4a","Type":"ContainerStarted","Data":"2fe9773e6988956b8d15e023e491f6138eb4fd8576aa1fd4367728727ab73035"} Jul 15 18:02:06.259971 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:06.259551 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9bng4" Jul 15 18:02:06.261079 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:06.261048 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn" event={"ID":"8f84e56f-dc02-4377-affb-61c9a0bfb4a5","Type":"ContainerStarted","Data":"634e51e6642c3444818426a98bebe2b004615fc1611b08860d96963cf11e7154"} Jul 15 18:02:06.278617 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:06.278572 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9bng4" podStartSLOduration=1.2809709360000001 podStartE2EDuration="4.278558776s" totalImagesPullingTime="2.99758784s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:02:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:02:06.275934626 +0000 UTC m=+424.611242928" watchObservedRunningTime="2026-07-15 18:02:06.278558776 +0000 UTC m=+424.613867077" Jul 15 18:02:08.240904 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:08.240864 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:08.276369 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:08.276338 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn" event={"ID":"8f84e56f-dc02-4377-affb-61c9a0bfb4a5","Type":"ContainerStarted","Data":"160138524d9f35c01616740c6cab14b105fbd6562bc5e40ff2f0e23629990059"} Jul 15 18:02:08.276515 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:08.276502 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn" Jul 15 18:02:08.315163 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:08.315108 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn" podStartSLOduration=1.523649059 podStartE2EDuration="3.315093776s" totalImagesPullingTime="1.791444717s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:02:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:02:08.312754844 +0000 UTC m=+426.648063146" watchObservedRunningTime="2026-07-15 18:02:08.315093776 +0000 UTC m=+426.650402149" Jul 15 18:02:11.134814 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:11.134782 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:11.234233 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:11.234159 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:11.345509 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:11.345465 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:11.445988 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:11.445877 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:14.250656 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:14.250625 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-kq6jr" Jul 15 18:02:14.932961 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:14.932930 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:15.037400 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:15.037360 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:17.271544 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:17.271512 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/dns-operator-controller-manager-864dd78c4c-9bng4" Jul 15 18:02:18.942913 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:18.942877 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:19.048270 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:19.048233 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:19.283225 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:19.283142 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn" Jul 15 18:02:20.676690 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:20.676633 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:20.794797 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:20.794754 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:22.526497 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:22.526462 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:22.622781 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:22.622754 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:30.375739 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:30.375628 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:30.482985 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:30.482951 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:30.762526 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:30.762431 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:30.870148 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:30.870110 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:31.042947 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.042872 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn"] Jul 15 18:02:31.043151 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.043126 2551 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn" podUID="8f84e56f-dc02-4377-affb-61c9a0bfb4a5" containerName="manager" containerID="cri-o://160138524d9f35c01616740c6cab14b105fbd6562bc5e40ff2f0e23629990059" gracePeriod=2 Jul 15 18:02:31.058451 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.058423 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn"] Jul 15 18:02:31.061378 ip-10-0-128-25 kubenswrapper[2551]: E0715 18:02:31.061347 2551 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"8f84e56f-dc02-4377-affb-61c9a0bfb4a5\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"limitador-operator-controller-manager-859d7b78bd-bgppn\": pods \"limitador-operator-controller-manager-859d7b78bd-bgppn\" not found" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn" Jul 15 18:02:31.075376 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.075350 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nnkc2"] Jul 15 18:02:31.075713 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.075699 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8f84e56f-dc02-4377-affb-61c9a0bfb4a5" containerName="manager" Jul 15 18:02:31.075713 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.075713 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="8f84e56f-dc02-4377-affb-61c9a0bfb4a5" containerName="manager" Jul 15 18:02:31.075854 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.075823 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="8f84e56f-dc02-4377-affb-61c9a0bfb4a5" containerName="manager" Jul 15 18:02:31.079168 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.079148 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nnkc2" Jul 15 18:02:31.080969 ip-10-0-128-25 kubenswrapper[2551]: E0715 18:02:31.080938 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bgppn\" is forbidden: User \"system:node:ip-10-0-128-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-25.ec2.internal' and this object" podUID="8f84e56f-dc02-4377-affb-61c9a0bfb4a5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn" Jul 15 18:02:31.091620 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.091595 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nnkc2"] Jul 15 18:02:31.158905 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.158883 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9t8xf\" (UniqueName: \"kubernetes.io/projected/4955461b-024f-4661-b4d2-a91740e26e90-kube-api-access-9t8xf\") pod \"limitador-operator-controller-manager-859d7b78bd-nnkc2\" (UID: \"4955461b-024f-4661-b4d2-a91740e26e90\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nnkc2" Jul 15 18:02:31.260217 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.260182 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9t8xf\" (UniqueName: \"kubernetes.io/projected/4955461b-024f-4661-b4d2-a91740e26e90-kube-api-access-9t8xf\") pod \"limitador-operator-controller-manager-859d7b78bd-nnkc2\" (UID: \"4955461b-024f-4661-b4d2-a91740e26e90\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nnkc2" Jul 15 18:02:31.272603 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.272578 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9t8xf\" (UniqueName: \"kubernetes.io/projected/4955461b-024f-4661-b4d2-a91740e26e90-kube-api-access-9t8xf\") pod \"limitador-operator-controller-manager-859d7b78bd-nnkc2\" (UID: \"4955461b-024f-4661-b4d2-a91740e26e90\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nnkc2" Jul 15 18:02:31.294357 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.294304 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn" Jul 15 18:02:31.299884 ip-10-0-128-25 kubenswrapper[2551]: E0715 18:02:31.299859 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bgppn\" is forbidden: User \"system:node:ip-10-0-128-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-25.ec2.internal' and this object" podUID="8f84e56f-dc02-4377-affb-61c9a0bfb4a5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn" Jul 15 18:02:31.361354 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.361330 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hl7xj\" (UniqueName: \"kubernetes.io/projected/8f84e56f-dc02-4377-affb-61c9a0bfb4a5-kube-api-access-hl7xj\") pod \"8f84e56f-dc02-4377-affb-61c9a0bfb4a5\" (UID: \"8f84e56f-dc02-4377-affb-61c9a0bfb4a5\") " Jul 15 18:02:31.363388 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.363364 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8f84e56f-dc02-4377-affb-61c9a0bfb4a5-kube-api-access-hl7xj" (OuterVolumeSpecName: "kube-api-access-hl7xj") pod "8f84e56f-dc02-4377-affb-61c9a0bfb4a5" (UID: "8f84e56f-dc02-4377-affb-61c9a0bfb4a5"). InnerVolumeSpecName "kube-api-access-hl7xj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 18:02:31.397401 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.397376 2551 generic.go:356] "Generic (PLEG): container finished" podID="8f84e56f-dc02-4377-affb-61c9a0bfb4a5" containerID="160138524d9f35c01616740c6cab14b105fbd6562bc5e40ff2f0e23629990059" exitCode=0 Jul 15 18:02:31.397739 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.397418 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn" Jul 15 18:02:31.397739 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.397477 2551 scope.go:117] "RemoveContainer" containerID="160138524d9f35c01616740c6cab14b105fbd6562bc5e40ff2f0e23629990059" Jul 15 18:02:31.399857 ip-10-0-128-25 kubenswrapper[2551]: E0715 18:02:31.399832 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bgppn\" is forbidden: User \"system:node:ip-10-0-128-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-25.ec2.internal' and this object" podUID="8f84e56f-dc02-4377-affb-61c9a0bfb4a5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn" Jul 15 18:02:31.407234 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.407220 2551 scope.go:117] "RemoveContainer" containerID="160138524d9f35c01616740c6cab14b105fbd6562bc5e40ff2f0e23629990059" Jul 15 18:02:31.407464 ip-10-0-128-25 kubenswrapper[2551]: E0715 18:02:31.407448 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"160138524d9f35c01616740c6cab14b105fbd6562bc5e40ff2f0e23629990059\": container with ID starting with 160138524d9f35c01616740c6cab14b105fbd6562bc5e40ff2f0e23629990059 not found: ID does not exist" containerID="160138524d9f35c01616740c6cab14b105fbd6562bc5e40ff2f0e23629990059" Jul 15 18:02:31.407515 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.407471 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"160138524d9f35c01616740c6cab14b105fbd6562bc5e40ff2f0e23629990059"} err="failed to get container status \"160138524d9f35c01616740c6cab14b105fbd6562bc5e40ff2f0e23629990059\": rpc error: code = NotFound desc = could not find container \"160138524d9f35c01616740c6cab14b105fbd6562bc5e40ff2f0e23629990059\": container with ID starting with 160138524d9f35c01616740c6cab14b105fbd6562bc5e40ff2f0e23629990059 not found: ID does not exist" Jul 15 18:02:31.408084 ip-10-0-128-25 kubenswrapper[2551]: E0715 18:02:31.408065 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bgppn\" is forbidden: User \"system:node:ip-10-0-128-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-25.ec2.internal' and this object" podUID="8f84e56f-dc02-4377-affb-61c9a0bfb4a5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn" Jul 15 18:02:31.421212 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.421193 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nnkc2" Jul 15 18:02:31.461924 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.461899 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hl7xj\" (UniqueName: \"kubernetes.io/projected/8f84e56f-dc02-4377-affb-61c9a0bfb4a5-kube-api-access-hl7xj\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:02:31.565537 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:31.565512 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nnkc2"] Jul 15 18:02:31.567842 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:02:31.567811 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4955461b_024f_4661_b4d2_a91740e26e90.slice/crio-369b2406a913d7c956cd5243b8aae2fefa960965d199a8ca0a46fa349b0d721b WatchSource:0}: Error finding container 369b2406a913d7c956cd5243b8aae2fefa960965d199a8ca0a46fa349b0d721b: Status 404 returned error can't find the container with id 369b2406a913d7c956cd5243b8aae2fefa960965d199a8ca0a46fa349b0d721b Jul 15 18:02:32.209812 ip-10-0-128-25 kubenswrapper[2551]: E0715 18:02:32.209772 2551 status_manager.go:1018] "Failed to get status for pod" err="pods \"limitador-operator-controller-manager-859d7b78bd-bgppn\" is forbidden: User \"system:node:ip-10-0-128-25.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-128-25.ec2.internal' and this object" podUID="8f84e56f-dc02-4377-affb-61c9a0bfb4a5" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-bgppn" Jul 15 18:02:32.211756 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:32.211724 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8f84e56f-dc02-4377-affb-61c9a0bfb4a5" path="/var/lib/kubelet/pods/8f84e56f-dc02-4377-affb-61c9a0bfb4a5/volumes" Jul 15 18:02:32.404072 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:32.404034 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nnkc2" event={"ID":"4955461b-024f-4661-b4d2-a91740e26e90","Type":"ContainerStarted","Data":"950d8b04200231f878a717fac34305da345d16e9e406d59445843095853b0ba6"} Jul 15 18:02:32.404493 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:32.404117 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nnkc2" event={"ID":"4955461b-024f-4661-b4d2-a91740e26e90","Type":"ContainerStarted","Data":"369b2406a913d7c956cd5243b8aae2fefa960965d199a8ca0a46fa349b0d721b"} Jul 15 18:02:32.404493 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:32.404151 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nnkc2" Jul 15 18:02:32.434030 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:32.433988 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nnkc2" podStartSLOduration=1.433974184 podStartE2EDuration="1.433974184s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:02:31 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:02:32.433222649 +0000 UTC m=+450.768530951" watchObservedRunningTime="2026-07-15 18:02:32.433974184 +0000 UTC m=+450.769282486" Jul 15 18:02:33.402041 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:33.402005 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:33.502621 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:33.502585 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:38.558367 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:38.558330 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:38.659926 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:38.659876 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:43.272733 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:43.272696 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:43.372173 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:43.372133 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:02:43.412528 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:02:43.412504 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-nnkc2" Jul 15 18:03:02.264101 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:02.264054 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:03:02.327979 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:02.327946 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:03:03.227834 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:03.227793 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:03:13.964338 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:13.964296 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:03:14.073524 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:14.073487 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:03:20.059261 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:20.059228 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:03:20.346171 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:20.346093 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:03:22.539311 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:22.539274 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:03:22.548992 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:22.548962 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m5ngw"] Jul 15 18:03:22.552044 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:22.552027 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-m5ngw" Jul 15 18:03:22.554005 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:22.553984 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 15 18:03:22.554113 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:22.554036 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-4gth7\"" Jul 15 18:03:22.582215 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:22.582191 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m5ngw"] Jul 15 18:03:22.644801 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:22.644765 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m5ngw"] Jul 15 18:03:22.653619 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:22.653591 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:03:22.698271 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:22.698246 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5mqp2\" (UniqueName: \"kubernetes.io/projected/feb1db76-8242-4d89-9629-25f510115637-kube-api-access-5mqp2\") pod \"limitador-limitador-64c94fd64f-m5ngw\" (UID: \"feb1db76-8242-4d89-9629-25f510115637\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m5ngw" Jul 15 18:03:22.698404 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:22.698288 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/feb1db76-8242-4d89-9629-25f510115637-config-file\") pod \"limitador-limitador-64c94fd64f-m5ngw\" (UID: \"feb1db76-8242-4d89-9629-25f510115637\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m5ngw" Jul 15 18:03:22.721397 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:22.721368 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:03:22.799815 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:22.799740 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5mqp2\" (UniqueName: \"kubernetes.io/projected/feb1db76-8242-4d89-9629-25f510115637-kube-api-access-5mqp2\") pod \"limitador-limitador-64c94fd64f-m5ngw\" (UID: \"feb1db76-8242-4d89-9629-25f510115637\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m5ngw" Jul 15 18:03:22.799815 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:22.799777 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/feb1db76-8242-4d89-9629-25f510115637-config-file\") pod \"limitador-limitador-64c94fd64f-m5ngw\" (UID: \"feb1db76-8242-4d89-9629-25f510115637\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m5ngw" Jul 15 18:03:22.800348 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:22.800327 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/feb1db76-8242-4d89-9629-25f510115637-config-file\") pod \"limitador-limitador-64c94fd64f-m5ngw\" (UID: \"feb1db76-8242-4d89-9629-25f510115637\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m5ngw" Jul 15 18:03:22.813512 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:22.813482 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5mqp2\" (UniqueName: \"kubernetes.io/projected/feb1db76-8242-4d89-9629-25f510115637-kube-api-access-5mqp2\") pod \"limitador-limitador-64c94fd64f-m5ngw\" (UID: \"feb1db76-8242-4d89-9629-25f510115637\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-m5ngw" Jul 15 18:03:22.861958 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:22.861929 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-m5ngw" Jul 15 18:03:22.999831 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:22.999808 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m5ngw"] Jul 15 18:03:23.002233 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:03:23.002206 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb1db76_8242_4d89_9629_25f510115637.slice/crio-5b29d86267c21a4506ab4b8e169f3b4390d7bbc7f90b0b367af7915e800bdb01 WatchSource:0}: Error finding container 5b29d86267c21a4506ab4b8e169f3b4390d7bbc7f90b0b367af7915e800bdb01: Status 404 returned error can't find the container with id 5b29d86267c21a4506ab4b8e169f3b4390d7bbc7f90b0b367af7915e800bdb01 Jul 15 18:03:23.404864 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:23.404815 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:03:23.501546 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:23.501512 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:03:23.691276 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:23.691183 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-m5ngw" event={"ID":"feb1db76-8242-4d89-9629-25f510115637","Type":"ContainerStarted","Data":"5b29d86267c21a4506ab4b8e169f3b4390d7bbc7f90b0b367af7915e800bdb01"} Jul 15 18:03:26.708089 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:26.708050 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-m5ngw" event={"ID":"feb1db76-8242-4d89-9629-25f510115637","Type":"ContainerStarted","Data":"f41512bd21569d63a327e64804eab368227816450c271c874083482ea8723ab2"} Jul 15 18:03:26.708479 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:26.708171 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-m5ngw" Jul 15 18:03:26.728966 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:26.728913 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-m5ngw" podStartSLOduration=2.07780409 podStartE2EDuration="4.728899506s" totalImagesPullingTime="2.651095416s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:03:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:03:26.72792968 +0000 UTC m=+505.063237983" watchObservedRunningTime="2026-07-15 18:03:26.728899506 +0000 UTC m=+505.064207809" Jul 15 18:03:37.714986 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:37.714955 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-m5ngw" Jul 15 18:03:39.030561 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:39.030499 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:03:39.132857 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:39.132825 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:03:39.797658 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:39.797612 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m5ngw"] Jul 15 18:03:39.797911 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:39.797875 2551 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-m5ngw" podUID="feb1db76-8242-4d89-9629-25f510115637" containerName="limitador" containerID="cri-o://f41512bd21569d63a327e64804eab368227816450c271c874083482ea8723ab2" gracePeriod=30 Jul 15 18:03:40.343651 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:40.343630 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-m5ngw" Jul 15 18:03:40.435363 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:40.435285 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5mqp2\" (UniqueName: \"kubernetes.io/projected/feb1db76-8242-4d89-9629-25f510115637-kube-api-access-5mqp2\") pod \"feb1db76-8242-4d89-9629-25f510115637\" (UID: \"feb1db76-8242-4d89-9629-25f510115637\") " Jul 15 18:03:40.435363 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:40.435314 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/feb1db76-8242-4d89-9629-25f510115637-config-file\") pod \"feb1db76-8242-4d89-9629-25f510115637\" (UID: \"feb1db76-8242-4d89-9629-25f510115637\") " Jul 15 18:03:40.435707 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:40.435685 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/feb1db76-8242-4d89-9629-25f510115637-config-file" (OuterVolumeSpecName: "config-file") pod "feb1db76-8242-4d89-9629-25f510115637" (UID: "feb1db76-8242-4d89-9629-25f510115637"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 18:03:40.437211 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:40.437188 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/feb1db76-8242-4d89-9629-25f510115637-kube-api-access-5mqp2" (OuterVolumeSpecName: "kube-api-access-5mqp2") pod "feb1db76-8242-4d89-9629-25f510115637" (UID: "feb1db76-8242-4d89-9629-25f510115637"). InnerVolumeSpecName "kube-api-access-5mqp2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 18:03:40.535840 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:40.535810 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5mqp2\" (UniqueName: \"kubernetes.io/projected/feb1db76-8242-4d89-9629-25f510115637-kube-api-access-5mqp2\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:03:40.535840 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:40.535842 2551 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/feb1db76-8242-4d89-9629-25f510115637-config-file\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:03:40.785067 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:40.784975 2551 generic.go:356] "Generic (PLEG): container finished" podID="feb1db76-8242-4d89-9629-25f510115637" containerID="f41512bd21569d63a327e64804eab368227816450c271c874083482ea8723ab2" exitCode=0 Jul 15 18:03:40.785067 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:40.785006 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-m5ngw" event={"ID":"feb1db76-8242-4d89-9629-25f510115637","Type":"ContainerDied","Data":"f41512bd21569d63a327e64804eab368227816450c271c874083482ea8723ab2"} Jul 15 18:03:40.785067 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:40.785053 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-m5ngw" Jul 15 18:03:40.785284 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:40.785100 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-m5ngw" event={"ID":"feb1db76-8242-4d89-9629-25f510115637","Type":"ContainerDied","Data":"5b29d86267c21a4506ab4b8e169f3b4390d7bbc7f90b0b367af7915e800bdb01"} Jul 15 18:03:40.785284 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:40.785125 2551 scope.go:117] "RemoveContainer" containerID="f41512bd21569d63a327e64804eab368227816450c271c874083482ea8723ab2" Jul 15 18:03:40.794659 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:40.794644 2551 scope.go:117] "RemoveContainer" containerID="f41512bd21569d63a327e64804eab368227816450c271c874083482ea8723ab2" Jul 15 18:03:40.794957 ip-10-0-128-25 kubenswrapper[2551]: E0715 18:03:40.794930 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f41512bd21569d63a327e64804eab368227816450c271c874083482ea8723ab2\": container with ID starting with f41512bd21569d63a327e64804eab368227816450c271c874083482ea8723ab2 not found: ID does not exist" containerID="f41512bd21569d63a327e64804eab368227816450c271c874083482ea8723ab2" Jul 15 18:03:40.795050 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:40.794968 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f41512bd21569d63a327e64804eab368227816450c271c874083482ea8723ab2"} err="failed to get container status \"f41512bd21569d63a327e64804eab368227816450c271c874083482ea8723ab2\": rpc error: code = NotFound desc = could not find container \"f41512bd21569d63a327e64804eab368227816450c271c874083482ea8723ab2\": container with ID starting with f41512bd21569d63a327e64804eab368227816450c271c874083482ea8723ab2 not found: ID does not exist" Jul 15 18:03:40.811550 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:40.811528 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m5ngw"] Jul 15 18:03:40.817851 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:40.817832 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-m5ngw"] Jul 15 18:03:40.823706 ip-10-0-128-25 kubenswrapper[2551]: E0715 18:03:40.823685 2551 cadvisor_stats_provider.go:567] "Partial failure issuing cadvisor.ContainerInfoV2" err="partial failures: [\"/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfeb1db76_8242_4d89_9629_25f510115637.slice\": RecentStats: unable to find data in memory cache]" Jul 15 18:03:42.211368 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:42.211333 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="feb1db76-8242-4d89-9629-25f510115637" path="/var/lib/kubelet/pods/feb1db76-8242-4d89-9629-25f510115637/volumes" Jul 15 18:03:43.728957 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:43.728927 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:03:43.840430 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:43.840393 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:03:44.212193 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:44.212165 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-t5f6r"] Jul 15 18:03:44.212503 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:44.212490 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="feb1db76-8242-4d89-9629-25f510115637" containerName="limitador" Jul 15 18:03:44.212549 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:44.212505 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="feb1db76-8242-4d89-9629-25f510115637" containerName="limitador" Jul 15 18:03:44.212588 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:44.212577 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="feb1db76-8242-4d89-9629-25f510115637" containerName="limitador" Jul 15 18:03:44.215159 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:44.215141 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t5f6r" Jul 15 18:03:44.216984 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:44.216962 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 15 18:03:44.217198 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:44.217184 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-4kls8\"" Jul 15 18:03:44.217410 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:44.217394 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 18:03:44.217489 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:44.217431 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 15 18:03:44.222612 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:44.222405 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-t5f6r"] Jul 15 18:03:44.231722 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:44.231697 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:03:44.268622 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:44.268584 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ed6625e8-8e2e-4f01-ba50-b5e7831a93eb-data\") pod \"postgres-69fb4594cf-t5f6r\" (UID: \"ed6625e8-8e2e-4f01-ba50-b5e7831a93eb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t5f6r" Jul 15 18:03:44.268813 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:44.268654 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6582r\" (UniqueName: \"kubernetes.io/projected/ed6625e8-8e2e-4f01-ba50-b5e7831a93eb-kube-api-access-6582r\") pod \"postgres-69fb4594cf-t5f6r\" (UID: \"ed6625e8-8e2e-4f01-ba50-b5e7831a93eb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t5f6r" Jul 15 18:03:44.369067 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:44.369034 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6582r\" (UniqueName: \"kubernetes.io/projected/ed6625e8-8e2e-4f01-ba50-b5e7831a93eb-kube-api-access-6582r\") pod \"postgres-69fb4594cf-t5f6r\" (UID: \"ed6625e8-8e2e-4f01-ba50-b5e7831a93eb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t5f6r" Jul 15 18:03:44.369242 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:44.369085 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ed6625e8-8e2e-4f01-ba50-b5e7831a93eb-data\") pod \"postgres-69fb4594cf-t5f6r\" (UID: \"ed6625e8-8e2e-4f01-ba50-b5e7831a93eb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t5f6r" Jul 15 18:03:44.369427 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:44.369410 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/ed6625e8-8e2e-4f01-ba50-b5e7831a93eb-data\") pod \"postgres-69fb4594cf-t5f6r\" (UID: \"ed6625e8-8e2e-4f01-ba50-b5e7831a93eb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t5f6r" Jul 15 18:03:44.377158 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:44.377131 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6582r\" (UniqueName: \"kubernetes.io/projected/ed6625e8-8e2e-4f01-ba50-b5e7831a93eb-kube-api-access-6582r\") pod \"postgres-69fb4594cf-t5f6r\" (UID: \"ed6625e8-8e2e-4f01-ba50-b5e7831a93eb\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-t5f6r" Jul 15 18:03:44.526902 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:44.526809 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t5f6r" Jul 15 18:03:44.675568 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:44.675526 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-t5f6r"] Jul 15 18:03:44.681482 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:03:44.681454 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poded6625e8_8e2e_4f01_ba50_b5e7831a93eb.slice/crio-51a4679bfdfbc4503e2e4da23a4c70d889265964fde08a62d404605acc717543 WatchSource:0}: Error finding container 51a4679bfdfbc4503e2e4da23a4c70d889265964fde08a62d404605acc717543: Status 404 returned error can't find the container with id 51a4679bfdfbc4503e2e4da23a4c70d889265964fde08a62d404605acc717543 Jul 15 18:03:44.808486 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:44.808393 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t5f6r" event={"ID":"ed6625e8-8e2e-4f01-ba50-b5e7831a93eb","Type":"ContainerStarted","Data":"51a4679bfdfbc4503e2e4da23a4c70d889265964fde08a62d404605acc717543"} Jul 15 18:03:49.840396 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:49.840301 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t5f6r" event={"ID":"ed6625e8-8e2e-4f01-ba50-b5e7831a93eb","Type":"ContainerStarted","Data":"f6693e57e55877651e9913e46910cfddd93746e15b604f40b0205c05a4aae844"} Jul 15 18:03:49.840396 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:49.840363 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t5f6r" Jul 15 18:03:49.858775 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:49.858731 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t5f6r" podStartSLOduration=1.136886254 podStartE2EDuration="5.858716313s" totalImagesPullingTime="4.721830059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:03:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:03:49.856410125 +0000 UTC m=+528.191718426" watchObservedRunningTime="2026-07-15 18:03:49.858716313 +0000 UTC m=+528.194024615" Jul 15 18:03:55.875937 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:55.875858 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-t5f6r" Jul 15 18:03:56.203594 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:56.203488 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:03:56.997827 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:03:56.997794 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:04:03.918611 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:03.918556 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:04:03.947493 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:03.947458 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85d7d995bd-jzlgx"] Jul 15 18:04:03.966789 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:03.966755 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85d7d995bd-jzlgx"] Jul 15 18:04:03.966948 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:03.966870 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85d7d995bd-jzlgx" Jul 15 18:04:03.969071 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:03.969047 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 15 18:04:03.969233 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:03.969075 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-x7vcb\"" Jul 15 18:04:03.969314 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:03.969261 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 18:04:03.991420 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:03.991382 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:04:04.049025 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.048986 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc4f19f8-6cb1-417a-9378-5ecda31005ca-webhook-cert\") pod \"maas-controller-85d7d995bd-jzlgx\" (UID: \"bc4f19f8-6cb1-417a-9378-5ecda31005ca\") " pod="opendatahub/maas-controller-85d7d995bd-jzlgx" Jul 15 18:04:04.049025 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.049025 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-75tkq\" (UniqueName: \"kubernetes.io/projected/bc4f19f8-6cb1-417a-9378-5ecda31005ca-kube-api-access-75tkq\") pod \"maas-controller-85d7d995bd-jzlgx\" (UID: \"bc4f19f8-6cb1-417a-9378-5ecda31005ca\") " pod="opendatahub/maas-controller-85d7d995bd-jzlgx" Jul 15 18:04:04.050081 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.050051 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:04:04.135456 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.135420 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-778dc5db77-zmgxz"] Jul 15 18:04:04.138085 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.138061 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-778dc5db77-zmgxz" Jul 15 18:04:04.150382 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.150357 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc4f19f8-6cb1-417a-9378-5ecda31005ca-webhook-cert\") pod \"maas-controller-85d7d995bd-jzlgx\" (UID: \"bc4f19f8-6cb1-417a-9378-5ecda31005ca\") " pod="opendatahub/maas-controller-85d7d995bd-jzlgx" Jul 15 18:04:04.150518 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.150395 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-75tkq\" (UniqueName: \"kubernetes.io/projected/bc4f19f8-6cb1-417a-9378-5ecda31005ca-kube-api-access-75tkq\") pod \"maas-controller-85d7d995bd-jzlgx\" (UID: \"bc4f19f8-6cb1-417a-9378-5ecda31005ca\") " pod="opendatahub/maas-controller-85d7d995bd-jzlgx" Jul 15 18:04:04.150852 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.150824 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-778dc5db77-zmgxz"] Jul 15 18:04:04.153216 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.153196 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc4f19f8-6cb1-417a-9378-5ecda31005ca-webhook-cert\") pod \"maas-controller-85d7d995bd-jzlgx\" (UID: \"bc4f19f8-6cb1-417a-9378-5ecda31005ca\") " pod="opendatahub/maas-controller-85d7d995bd-jzlgx" Jul 15 18:04:04.160762 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.160735 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-75tkq\" (UniqueName: \"kubernetes.io/projected/bc4f19f8-6cb1-417a-9378-5ecda31005ca-kube-api-access-75tkq\") pod \"maas-controller-85d7d995bd-jzlgx\" (UID: \"bc4f19f8-6cb1-417a-9378-5ecda31005ca\") " pod="opendatahub/maas-controller-85d7d995bd-jzlgx" Jul 15 18:04:04.171028 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.170956 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:04:04.251588 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.251555 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vlqz4\" (UniqueName: \"kubernetes.io/projected/dbd390ac-107c-4357-b9fe-d65a46a41212-kube-api-access-vlqz4\") pod \"maas-controller-778dc5db77-zmgxz\" (UID: \"dbd390ac-107c-4357-b9fe-d65a46a41212\") " pod="opendatahub/maas-controller-778dc5db77-zmgxz" Jul 15 18:04:04.251775 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.251609 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dbd390ac-107c-4357-b9fe-d65a46a41212-webhook-cert\") pod \"maas-controller-778dc5db77-zmgxz\" (UID: \"dbd390ac-107c-4357-b9fe-d65a46a41212\") " pod="opendatahub/maas-controller-778dc5db77-zmgxz" Jul 15 18:04:04.278512 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.278481 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85d7d995bd-jzlgx" Jul 15 18:04:04.352988 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.352942 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vlqz4\" (UniqueName: \"kubernetes.io/projected/dbd390ac-107c-4357-b9fe-d65a46a41212-kube-api-access-vlqz4\") pod \"maas-controller-778dc5db77-zmgxz\" (UID: \"dbd390ac-107c-4357-b9fe-d65a46a41212\") " pod="opendatahub/maas-controller-778dc5db77-zmgxz" Jul 15 18:04:04.353159 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.353040 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dbd390ac-107c-4357-b9fe-d65a46a41212-webhook-cert\") pod \"maas-controller-778dc5db77-zmgxz\" (UID: \"dbd390ac-107c-4357-b9fe-d65a46a41212\") " pod="opendatahub/maas-controller-778dc5db77-zmgxz" Jul 15 18:04:04.357313 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.357280 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dbd390ac-107c-4357-b9fe-d65a46a41212-webhook-cert\") pod \"maas-controller-778dc5db77-zmgxz\" (UID: \"dbd390ac-107c-4357-b9fe-d65a46a41212\") " pod="opendatahub/maas-controller-778dc5db77-zmgxz" Jul 15 18:04:04.362623 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.362597 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vlqz4\" (UniqueName: \"kubernetes.io/projected/dbd390ac-107c-4357-b9fe-d65a46a41212-kube-api-access-vlqz4\") pod \"maas-controller-778dc5db77-zmgxz\" (UID: \"dbd390ac-107c-4357-b9fe-d65a46a41212\") " pod="opendatahub/maas-controller-778dc5db77-zmgxz" Jul 15 18:04:04.420385 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.420351 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85d7d995bd-jzlgx"] Jul 15 18:04:04.422621 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:04:04.422550 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbc4f19f8_6cb1_417a_9378_5ecda31005ca.slice/crio-33ec471df672b28c98631f80834470d153cff7b9a875a2b3f2213b65c3e1038f WatchSource:0}: Error finding container 33ec471df672b28c98631f80834470d153cff7b9a875a2b3f2213b65c3e1038f: Status 404 returned error can't find the container with id 33ec471df672b28c98631f80834470d153cff7b9a875a2b3f2213b65c3e1038f Jul 15 18:04:04.447914 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.447884 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-778dc5db77-zmgxz" Jul 15 18:04:04.592235 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.592178 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-778dc5db77-zmgxz"] Jul 15 18:04:04.594475 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:04:04.594450 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddbd390ac_107c_4357_b9fe_d65a46a41212.slice/crio-2fb8e2a4ce1b07ccddfc1c0da87fe6591a3fabec113347dec1e77d1efa265419 WatchSource:0}: Error finding container 2fb8e2a4ce1b07ccddfc1c0da87fe6591a3fabec113347dec1e77d1efa265419: Status 404 returned error can't find the container with id 2fb8e2a4ce1b07ccddfc1c0da87fe6591a3fabec113347dec1e77d1efa265419 Jul 15 18:04:04.928161 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.928118 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85d7d995bd-jzlgx" event={"ID":"bc4f19f8-6cb1-417a-9378-5ecda31005ca","Type":"ContainerStarted","Data":"33ec471df672b28c98631f80834470d153cff7b9a875a2b3f2213b65c3e1038f"} Jul 15 18:04:04.929332 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:04.929306 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-778dc5db77-zmgxz" event={"ID":"dbd390ac-107c-4357-b9fe-d65a46a41212","Type":"ContainerStarted","Data":"2fb8e2a4ce1b07ccddfc1c0da87fe6591a3fabec113347dec1e77d1efa265419"} Jul 15 18:04:07.355349 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:07.355311 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:04:07.452861 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:07.452754 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:04:07.951261 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:07.951227 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85d7d995bd-jzlgx" event={"ID":"bc4f19f8-6cb1-417a-9378-5ecda31005ca","Type":"ContainerStarted","Data":"1ec54c73e2f8220f8f8088f8f11f987dcd8b1343bc9aab93f2bb070c05c15919"} Jul 15 18:04:07.951464 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:07.951324 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85d7d995bd-jzlgx" Jul 15 18:04:07.952844 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:07.952816 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-778dc5db77-zmgxz" event={"ID":"dbd390ac-107c-4357-b9fe-d65a46a41212","Type":"ContainerStarted","Data":"f25fab2a0e12c4057ba4ad5377879da4f195d8f1e54e51b018571c845abef21b"} Jul 15 18:04:07.952960 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:07.952937 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-778dc5db77-zmgxz" Jul 15 18:04:07.969645 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:07.969570 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85d7d995bd-jzlgx" podStartSLOduration=2.265180763 podStartE2EDuration="4.969549235s" totalImagesPullingTime="2.704368472s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:04:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:04:07.969111905 +0000 UTC m=+546.304420210" watchObservedRunningTime="2026-07-15 18:04:07.969549235 +0000 UTC m=+546.304857538" Jul 15 18:04:07.988409 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:07.988345 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-778dc5db77-zmgxz" podStartSLOduration=1.466196453 podStartE2EDuration="3.98832834s" totalImagesPullingTime="2.522131887s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:04:04 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:04:07.985920213 +0000 UTC m=+546.321228532" watchObservedRunningTime="2026-07-15 18:04:07.98832834 +0000 UTC m=+546.323636684" Jul 15 18:04:18.961096 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:18.961061 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-778dc5db77-zmgxz" Jul 15 18:04:18.961539 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:18.961234 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85d7d995bd-jzlgx" Jul 15 18:04:19.027353 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:19.027307 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85d7d995bd-jzlgx"] Jul 15 18:04:19.027572 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:19.027548 2551 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-85d7d995bd-jzlgx" podUID="bc4f19f8-6cb1-417a-9378-5ecda31005ca" containerName="manager" containerID="cri-o://1ec54c73e2f8220f8f8088f8f11f987dcd8b1343bc9aab93f2bb070c05c15919" gracePeriod=30 Jul 15 18:04:19.271190 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:19.271164 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85d7d995bd-jzlgx" Jul 15 18:04:19.394043 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:19.394004 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc4f19f8-6cb1-417a-9378-5ecda31005ca-webhook-cert\") pod \"bc4f19f8-6cb1-417a-9378-5ecda31005ca\" (UID: \"bc4f19f8-6cb1-417a-9378-5ecda31005ca\") " Jul 15 18:04:19.394242 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:19.394080 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-75tkq\" (UniqueName: \"kubernetes.io/projected/bc4f19f8-6cb1-417a-9378-5ecda31005ca-kube-api-access-75tkq\") pod \"bc4f19f8-6cb1-417a-9378-5ecda31005ca\" (UID: \"bc4f19f8-6cb1-417a-9378-5ecda31005ca\") " Jul 15 18:04:19.396512 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:19.396478 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bc4f19f8-6cb1-417a-9378-5ecda31005ca-kube-api-access-75tkq" (OuterVolumeSpecName: "kube-api-access-75tkq") pod "bc4f19f8-6cb1-417a-9378-5ecda31005ca" (UID: "bc4f19f8-6cb1-417a-9378-5ecda31005ca"). InnerVolumeSpecName "kube-api-access-75tkq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 18:04:19.396512 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:19.396488 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bc4f19f8-6cb1-417a-9378-5ecda31005ca-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "bc4f19f8-6cb1-417a-9378-5ecda31005ca" (UID: "bc4f19f8-6cb1-417a-9378-5ecda31005ca"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 18:04:19.495522 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:19.495483 2551 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bc4f19f8-6cb1-417a-9378-5ecda31005ca-webhook-cert\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:04:19.495522 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:19.495514 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-75tkq\" (UniqueName: \"kubernetes.io/projected/bc4f19f8-6cb1-417a-9378-5ecda31005ca-kube-api-access-75tkq\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:04:20.019846 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:20.019809 2551 generic.go:356] "Generic (PLEG): container finished" podID="bc4f19f8-6cb1-417a-9378-5ecda31005ca" containerID="1ec54c73e2f8220f8f8088f8f11f987dcd8b1343bc9aab93f2bb070c05c15919" exitCode=0 Jul 15 18:04:20.020330 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:20.019859 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85d7d995bd-jzlgx" event={"ID":"bc4f19f8-6cb1-417a-9378-5ecda31005ca","Type":"ContainerDied","Data":"1ec54c73e2f8220f8f8088f8f11f987dcd8b1343bc9aab93f2bb070c05c15919"} Jul 15 18:04:20.020330 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:20.019862 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85d7d995bd-jzlgx" Jul 15 18:04:20.020330 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:20.019901 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85d7d995bd-jzlgx" event={"ID":"bc4f19f8-6cb1-417a-9378-5ecda31005ca","Type":"ContainerDied","Data":"33ec471df672b28c98631f80834470d153cff7b9a875a2b3f2213b65c3e1038f"} Jul 15 18:04:20.020330 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:20.019922 2551 scope.go:117] "RemoveContainer" containerID="1ec54c73e2f8220f8f8088f8f11f987dcd8b1343bc9aab93f2bb070c05c15919" Jul 15 18:04:20.029788 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:20.029624 2551 scope.go:117] "RemoveContainer" containerID="1ec54c73e2f8220f8f8088f8f11f987dcd8b1343bc9aab93f2bb070c05c15919" Jul 15 18:04:20.029995 ip-10-0-128-25 kubenswrapper[2551]: E0715 18:04:20.029975 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1ec54c73e2f8220f8f8088f8f11f987dcd8b1343bc9aab93f2bb070c05c15919\": container with ID starting with 1ec54c73e2f8220f8f8088f8f11f987dcd8b1343bc9aab93f2bb070c05c15919 not found: ID does not exist" containerID="1ec54c73e2f8220f8f8088f8f11f987dcd8b1343bc9aab93f2bb070c05c15919" Jul 15 18:04:20.030051 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:20.030003 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1ec54c73e2f8220f8f8088f8f11f987dcd8b1343bc9aab93f2bb070c05c15919"} err="failed to get container status \"1ec54c73e2f8220f8f8088f8f11f987dcd8b1343bc9aab93f2bb070c05c15919\": rpc error: code = NotFound desc = could not find container \"1ec54c73e2f8220f8f8088f8f11f987dcd8b1343bc9aab93f2bb070c05c15919\": container with ID starting with 1ec54c73e2f8220f8f8088f8f11f987dcd8b1343bc9aab93f2bb070c05c15919 not found: ID does not exist" Jul 15 18:04:20.041924 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:20.041890 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85d7d995bd-jzlgx"] Jul 15 18:04:20.048375 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:20.048347 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85d7d995bd-jzlgx"] Jul 15 18:04:20.212143 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:20.212108 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bc4f19f8-6cb1-417a-9378-5ecda31005ca" path="/var/lib/kubelet/pods/bc4f19f8-6cb1-417a-9378-5ecda31005ca/volumes" Jul 15 18:04:40.160289 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:40.160233 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:04:40.265123 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:40.265089 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:04:40.823014 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:40.822970 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:04:41.424267 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.424227 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:04:41.572780 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.572681 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:04:41.672094 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.672053 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:04:41.721590 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.721554 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-q5n7q"] Jul 15 18:04:41.721958 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.721945 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bc4f19f8-6cb1-417a-9378-5ecda31005ca" containerName="manager" Jul 15 18:04:41.722003 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.721961 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="bc4f19f8-6cb1-417a-9378-5ecda31005ca" containerName="manager" Jul 15 18:04:41.722038 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.722019 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="bc4f19f8-6cb1-417a-9378-5ecda31005ca" containerName="manager" Jul 15 18:04:41.727206 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.727186 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-q5n7q" Jul 15 18:04:41.730072 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.730048 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-gxfb4\"" Jul 15 18:04:41.730379 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.730359 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 15 18:04:41.745137 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.745106 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-q5n7q"] Jul 15 18:04:41.773094 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.773059 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1715edc0-8fb8-4b67-84cf-77a19e17d940-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-q5n7q\" (UID: \"1715edc0-8fb8-4b67-84cf-77a19e17d940\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-q5n7q" Jul 15 18:04:41.773259 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.773156 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-884nr\" (UniqueName: \"kubernetes.io/projected/1715edc0-8fb8-4b67-84cf-77a19e17d940-kube-api-access-884nr\") pod \"payload-processing-f9b8d9b9b-q5n7q\" (UID: \"1715edc0-8fb8-4b67-84cf-77a19e17d940\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-q5n7q" Jul 15 18:04:41.787763 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.787730 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-v8g59"] Jul 15 18:04:41.790363 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.790343 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-v8g59" Jul 15 18:04:41.802890 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.802864 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-v8g59"] Jul 15 18:04:41.874425 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.874391 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1715edc0-8fb8-4b67-84cf-77a19e17d940-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-q5n7q\" (UID: \"1715edc0-8fb8-4b67-84cf-77a19e17d940\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-q5n7q" Jul 15 18:04:41.874643 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.874458 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c16eff1b-6881-4007-b4a3-1068d01dc292-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-v8g59\" (UID: \"c16eff1b-6881-4007-b4a3-1068d01dc292\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-v8g59" Jul 15 18:04:41.874643 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.874513 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-884nr\" (UniqueName: \"kubernetes.io/projected/1715edc0-8fb8-4b67-84cf-77a19e17d940-kube-api-access-884nr\") pod \"payload-processing-f9b8d9b9b-q5n7q\" (UID: \"1715edc0-8fb8-4b67-84cf-77a19e17d940\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-q5n7q" Jul 15 18:04:41.874643 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.874586 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ftlbx\" (UniqueName: \"kubernetes.io/projected/c16eff1b-6881-4007-b4a3-1068d01dc292-kube-api-access-ftlbx\") pod \"payload-pre-processing-74584bb9f8-v8g59\" (UID: \"c16eff1b-6881-4007-b4a3-1068d01dc292\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-v8g59" Jul 15 18:04:41.875204 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.875181 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/1715edc0-8fb8-4b67-84cf-77a19e17d940-plugins-config-volume\") pod \"payload-processing-f9b8d9b9b-q5n7q\" (UID: \"1715edc0-8fb8-4b67-84cf-77a19e17d940\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-q5n7q" Jul 15 18:04:41.882832 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.882801 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-884nr\" (UniqueName: \"kubernetes.io/projected/1715edc0-8fb8-4b67-84cf-77a19e17d940-kube-api-access-884nr\") pod \"payload-processing-f9b8d9b9b-q5n7q\" (UID: \"1715edc0-8fb8-4b67-84cf-77a19e17d940\") " pod="openshift-ingress/payload-processing-f9b8d9b9b-q5n7q" Jul 15 18:04:41.975262 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.975226 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ftlbx\" (UniqueName: \"kubernetes.io/projected/c16eff1b-6881-4007-b4a3-1068d01dc292-kube-api-access-ftlbx\") pod \"payload-pre-processing-74584bb9f8-v8g59\" (UID: \"c16eff1b-6881-4007-b4a3-1068d01dc292\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-v8g59" Jul 15 18:04:41.975448 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.975310 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c16eff1b-6881-4007-b4a3-1068d01dc292-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-v8g59\" (UID: \"c16eff1b-6881-4007-b4a3-1068d01dc292\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-v8g59" Jul 15 18:04:41.976063 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.976041 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/c16eff1b-6881-4007-b4a3-1068d01dc292-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-v8g59\" (UID: \"c16eff1b-6881-4007-b4a3-1068d01dc292\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-v8g59" Jul 15 18:04:41.988503 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:41.988474 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ftlbx\" (UniqueName: \"kubernetes.io/projected/c16eff1b-6881-4007-b4a3-1068d01dc292-kube-api-access-ftlbx\") pod \"payload-pre-processing-74584bb9f8-v8g59\" (UID: \"c16eff1b-6881-4007-b4a3-1068d01dc292\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-v8g59" Jul 15 18:04:42.038884 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:42.038838 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-f9b8d9b9b-q5n7q" Jul 15 18:04:42.101026 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:42.100924 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-v8g59" Jul 15 18:04:42.197272 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:42.197236 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-f9b8d9b9b-q5n7q"] Jul 15 18:04:42.198503 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:04:42.198474 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1715edc0_8fb8_4b67_84cf_77a19e17d940.slice/crio-95e08d694a6cd4e03ada5f4ebdc99103bca302f44e8f87abafe727599ad14e2b WatchSource:0}: Error finding container 95e08d694a6cd4e03ada5f4ebdc99103bca302f44e8f87abafe727599ad14e2b: Status 404 returned error can't find the container with id 95e08d694a6cd4e03ada5f4ebdc99103bca302f44e8f87abafe727599ad14e2b Jul 15 18:04:42.266479 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:42.266449 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-v8g59"] Jul 15 18:04:42.267844 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:04:42.267818 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc16eff1b_6881_4007_b4a3_1068d01dc292.slice/crio-7ef9a027cd2695db8c1213e406725cf1be60efc04e4c216e1102bc569698c339 WatchSource:0}: Error finding container 7ef9a027cd2695db8c1213e406725cf1be60efc04e4c216e1102bc569698c339: Status 404 returned error can't find the container with id 7ef9a027cd2695db8c1213e406725cf1be60efc04e4c216e1102bc569698c339 Jul 15 18:04:43.155059 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:43.154974 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-v8g59" event={"ID":"c16eff1b-6881-4007-b4a3-1068d01dc292","Type":"ContainerStarted","Data":"7ef9a027cd2695db8c1213e406725cf1be60efc04e4c216e1102bc569698c339"} Jul 15 18:04:43.156991 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:43.156957 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-q5n7q" event={"ID":"1715edc0-8fb8-4b67-84cf-77a19e17d940","Type":"ContainerStarted","Data":"95e08d694a6cd4e03ada5f4ebdc99103bca302f44e8f87abafe727599ad14e2b"} Jul 15 18:04:44.164623 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:44.164581 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-f9b8d9b9b-q5n7q" event={"ID":"1715edc0-8fb8-4b67-84cf-77a19e17d940","Type":"ContainerStarted","Data":"c7d39aa224f3cb68cf875bda863bf593088763b789b0b2f316b731ab6ac085fd"} Jul 15 18:04:44.165122 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:44.164652 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-q5n7q" Jul 15 18:04:44.166328 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:44.166293 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-v8g59" event={"ID":"c16eff1b-6881-4007-b4a3-1068d01dc292","Type":"ContainerStarted","Data":"f9affb999cb61af9e01988ec797c40db00a9ca78897e1a20197cbea8f7f98912"} Jul 15 18:04:44.166447 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:44.166361 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-v8g59" Jul 15 18:04:44.188267 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:44.188205 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-f9b8d9b9b-q5n7q" podStartSLOduration=1.663675145 podStartE2EDuration="3.188185959s" totalImagesPullingTime="1.524510814s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:04:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:04:44.18595588 +0000 UTC m=+582.521264187" watchObservedRunningTime="2026-07-15 18:04:44.188185959 +0000 UTC m=+582.523494261" Jul 15 18:04:44.210091 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:44.210038 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-v8g59" podStartSLOduration=1.7527259050000001 podStartE2EDuration="3.210023385s" totalImagesPullingTime="1.45729748s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:04:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:04:44.207795932 +0000 UTC m=+582.543104249" watchObservedRunningTime="2026-07-15 18:04:44.210023385 +0000 UTC m=+582.545331686" Jul 15 18:04:52.868234 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:52.868189 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:04:54.096410 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:54.096370 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:04:55.176226 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:55.176193 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-f9b8d9b9b-q5n7q" Jul 15 18:04:55.176642 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:04:55.176271 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-v8g59" Jul 15 18:05:02.121284 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:02.121256 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b89jb_67315a2e-51bd-4280-9821-5a6fd7b06df7/console-operator/1.log" Jul 15 18:05:02.121284 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:02.121271 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b89jb_67315a2e-51bd-4280-9821-5a6fd7b06df7/console-operator/1.log" Jul 15 18:05:02.130339 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:02.130316 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwzkz_ff5857c7-97d1-467d-8b6f-8691f7e0d6dc/ovn-acl-logging/0.log" Jul 15 18:05:02.130546 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:02.130528 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwzkz_ff5857c7-97d1-467d-8b6f-8691f7e0d6dc/ovn-acl-logging/0.log" Jul 15 18:05:02.244319 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:02.244272 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:05:14.502075 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.502039 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8"] Jul 15 18:05:14.506292 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.506270 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:14.508780 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.508757 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 18:05:14.509155 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.509134 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 18:05:14.509252 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.509194 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-5zf97\"" Jul 15 18:05:14.509313 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.509248 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 15 18:05:14.518757 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.518732 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8"] Jul 15 18:05:14.541302 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.541270 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:05:14.663127 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.663096 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8dc8daea-8ec8-4ea1-a0e4-18608edf8306-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8\" (UID: \"8dc8daea-8ec8-4ea1-a0e4-18608edf8306\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:14.663294 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.663141 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dc8daea-8ec8-4ea1-a0e4-18608edf8306-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8\" (UID: \"8dc8daea-8ec8-4ea1-a0e4-18608edf8306\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:14.663294 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.663176 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8dc8daea-8ec8-4ea1-a0e4-18608edf8306-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8\" (UID: \"8dc8daea-8ec8-4ea1-a0e4-18608edf8306\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:14.663294 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.663201 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8dc8daea-8ec8-4ea1-a0e4-18608edf8306-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8\" (UID: \"8dc8daea-8ec8-4ea1-a0e4-18608edf8306\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:14.663294 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.663279 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8dc8daea-8ec8-4ea1-a0e4-18608edf8306-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8\" (UID: \"8dc8daea-8ec8-4ea1-a0e4-18608edf8306\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:14.663451 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.663311 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hlms7\" (UniqueName: \"kubernetes.io/projected/8dc8daea-8ec8-4ea1-a0e4-18608edf8306-kube-api-access-hlms7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8\" (UID: \"8dc8daea-8ec8-4ea1-a0e4-18608edf8306\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:14.764624 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.764544 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8dc8daea-8ec8-4ea1-a0e4-18608edf8306-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8\" (UID: \"8dc8daea-8ec8-4ea1-a0e4-18608edf8306\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:14.764624 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.764594 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8dc8daea-8ec8-4ea1-a0e4-18608edf8306-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8\" (UID: \"8dc8daea-8ec8-4ea1-a0e4-18608edf8306\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:14.764624 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.764615 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hlms7\" (UniqueName: \"kubernetes.io/projected/8dc8daea-8ec8-4ea1-a0e4-18608edf8306-kube-api-access-hlms7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8\" (UID: \"8dc8daea-8ec8-4ea1-a0e4-18608edf8306\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:14.764948 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.764712 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8dc8daea-8ec8-4ea1-a0e4-18608edf8306-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8\" (UID: \"8dc8daea-8ec8-4ea1-a0e4-18608edf8306\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:14.764948 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.764737 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dc8daea-8ec8-4ea1-a0e4-18608edf8306-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8\" (UID: \"8dc8daea-8ec8-4ea1-a0e4-18608edf8306\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:14.764948 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.764763 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8dc8daea-8ec8-4ea1-a0e4-18608edf8306-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8\" (UID: \"8dc8daea-8ec8-4ea1-a0e4-18608edf8306\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:14.765121 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.765099 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/8dc8daea-8ec8-4ea1-a0e4-18608edf8306-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8\" (UID: \"8dc8daea-8ec8-4ea1-a0e4-18608edf8306\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:14.765173 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.765123 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/8dc8daea-8ec8-4ea1-a0e4-18608edf8306-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8\" (UID: \"8dc8daea-8ec8-4ea1-a0e4-18608edf8306\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:14.765219 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.765172 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/8dc8daea-8ec8-4ea1-a0e4-18608edf8306-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8\" (UID: \"8dc8daea-8ec8-4ea1-a0e4-18608edf8306\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:14.767491 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.767461 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/8dc8daea-8ec8-4ea1-a0e4-18608edf8306-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8\" (UID: \"8dc8daea-8ec8-4ea1-a0e4-18608edf8306\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:14.767728 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.767710 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/8dc8daea-8ec8-4ea1-a0e4-18608edf8306-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8\" (UID: \"8dc8daea-8ec8-4ea1-a0e4-18608edf8306\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:14.779483 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.779452 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hlms7\" (UniqueName: \"kubernetes.io/projected/8dc8daea-8ec8-4ea1-a0e4-18608edf8306-kube-api-access-hlms7\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8\" (UID: \"8dc8daea-8ec8-4ea1-a0e4-18608edf8306\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:14.817291 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.817259 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:14.964937 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.964909 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8"] Jul 15 18:05:14.967267 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:05:14.967236 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8dc8daea_8ec8_4ea1_a0e4_18608edf8306.slice/crio-4ed8a4aa3fec964213c2b4b895200ac6787ca3c4285f4bd7be0fa1a2ad06241b WatchSource:0}: Error finding container 4ed8a4aa3fec964213c2b4b895200ac6787ca3c4285f4bd7be0fa1a2ad06241b: Status 404 returned error can't find the container with id 4ed8a4aa3fec964213c2b4b895200ac6787ca3c4285f4bd7be0fa1a2ad06241b Jul 15 18:05:14.968730 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:14.968711 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 18:05:15.342080 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:15.342040 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" event={"ID":"8dc8daea-8ec8-4ea1-a0e4-18608edf8306","Type":"ContainerStarted","Data":"4ed8a4aa3fec964213c2b4b895200ac6787ca3c4285f4bd7be0fa1a2ad06241b"} Jul 15 18:05:17.355922 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:17.355886 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" event={"ID":"8dc8daea-8ec8-4ea1-a0e4-18608edf8306","Type":"ContainerStarted","Data":"60ecaa6324f8eea29519a08f22c60a9ed021db1401fa4635c3ad7476d0ede336"} Jul 15 18:05:17.380417 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:17.380362 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" podStartSLOduration=2.000361997 podStartE2EDuration="3.380344182s" totalImagesPullingTime="1.379982185s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:05:14 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:05:17.379473736 +0000 UTC m=+615.714782057" watchObservedRunningTime="2026-07-15 18:05:17.380344182 +0000 UTC m=+615.715652484" Jul 15 18:05:17.430892 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:17.430857 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:05:17.495543 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:17.495509 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:05:19.949263 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:19.949228 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx"] Jul 15 18:05:19.953033 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:19.953009 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:19.956539 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:19.956513 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 15 18:05:19.967266 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:19.967234 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:05:19.969426 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:19.969398 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx"] Jul 15 18:05:20.115896 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:20.115854 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e8b4949-759e-4504-9ef1-414611194d4c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qvxvx\" (UID: \"9e8b4949-759e-4504-9ef1-414611194d4c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:20.116072 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:20.115931 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e8b4949-759e-4504-9ef1-414611194d4c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qvxvx\" (UID: \"9e8b4949-759e-4504-9ef1-414611194d4c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:20.116072 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:20.115988 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e8b4949-759e-4504-9ef1-414611194d4c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qvxvx\" (UID: \"9e8b4949-759e-4504-9ef1-414611194d4c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:20.116072 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:20.116013 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zxlzm\" (UniqueName: \"kubernetes.io/projected/9e8b4949-759e-4504-9ef1-414611194d4c-kube-api-access-zxlzm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qvxvx\" (UID: \"9e8b4949-759e-4504-9ef1-414611194d4c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:20.116172 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:20.116124 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e8b4949-759e-4504-9ef1-414611194d4c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qvxvx\" (UID: \"9e8b4949-759e-4504-9ef1-414611194d4c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:20.116172 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:20.116149 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e8b4949-759e-4504-9ef1-414611194d4c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qvxvx\" (UID: \"9e8b4949-759e-4504-9ef1-414611194d4c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:20.216908 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:20.216824 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e8b4949-759e-4504-9ef1-414611194d4c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qvxvx\" (UID: \"9e8b4949-759e-4504-9ef1-414611194d4c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:20.216908 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:20.216861 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e8b4949-759e-4504-9ef1-414611194d4c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qvxvx\" (UID: \"9e8b4949-759e-4504-9ef1-414611194d4c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:20.216908 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:20.216903 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e8b4949-759e-4504-9ef1-414611194d4c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qvxvx\" (UID: \"9e8b4949-759e-4504-9ef1-414611194d4c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:20.217199 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:20.216943 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e8b4949-759e-4504-9ef1-414611194d4c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qvxvx\" (UID: \"9e8b4949-759e-4504-9ef1-414611194d4c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:20.217199 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:20.216994 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e8b4949-759e-4504-9ef1-414611194d4c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qvxvx\" (UID: \"9e8b4949-759e-4504-9ef1-414611194d4c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:20.217199 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:20.217017 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zxlzm\" (UniqueName: \"kubernetes.io/projected/9e8b4949-759e-4504-9ef1-414611194d4c-kube-api-access-zxlzm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qvxvx\" (UID: \"9e8b4949-759e-4504-9ef1-414611194d4c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:20.217356 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:20.217269 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/9e8b4949-759e-4504-9ef1-414611194d4c-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qvxvx\" (UID: \"9e8b4949-759e-4504-9ef1-414611194d4c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:20.217356 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:20.217315 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/9e8b4949-759e-4504-9ef1-414611194d4c-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qvxvx\" (UID: \"9e8b4949-759e-4504-9ef1-414611194d4c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:20.217490 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:20.217395 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/9e8b4949-759e-4504-9ef1-414611194d4c-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qvxvx\" (UID: \"9e8b4949-759e-4504-9ef1-414611194d4c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:20.219477 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:20.219447 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/9e8b4949-759e-4504-9ef1-414611194d4c-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qvxvx\" (UID: \"9e8b4949-759e-4504-9ef1-414611194d4c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:20.219597 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:20.219544 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/9e8b4949-759e-4504-9ef1-414611194d4c-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qvxvx\" (UID: \"9e8b4949-759e-4504-9ef1-414611194d4c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:20.227832 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:20.227800 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zxlzm\" (UniqueName: \"kubernetes.io/projected/9e8b4949-759e-4504-9ef1-414611194d4c-kube-api-access-zxlzm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-qvxvx\" (UID: \"9e8b4949-759e-4504-9ef1-414611194d4c\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:20.264175 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:20.264136 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:20.411142 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:20.411117 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx"] Jul 15 18:05:20.414347 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:05:20.414309 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9e8b4949_759e_4504_9ef1_414611194d4c.slice/crio-3afad753cf7d1060168d8710c5de8edc4a41e148ee77a4d9d4de51dc82e4e366 WatchSource:0}: Error finding container 3afad753cf7d1060168d8710c5de8edc4a41e148ee77a4d9d4de51dc82e4e366: Status 404 returned error can't find the container with id 3afad753cf7d1060168d8710c5de8edc4a41e148ee77a4d9d4de51dc82e4e366 Jul 15 18:05:21.381133 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:21.381101 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" event={"ID":"9e8b4949-759e-4504-9ef1-414611194d4c","Type":"ContainerStarted","Data":"bc99af3435adb1f43e9be1c3d3046e15f1fbf7c6c99af145aea15fbd07d7fc12"} Jul 15 18:05:21.381507 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:21.381175 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" event={"ID":"9e8b4949-759e-4504-9ef1-414611194d4c","Type":"ContainerStarted","Data":"3afad753cf7d1060168d8710c5de8edc4a41e148ee77a4d9d4de51dc82e4e366"} Jul 15 18:05:21.416916 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:21.416865 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" podStartSLOduration=2.214776656 podStartE2EDuration="2.416849788s" totalImagesPullingTime="202.073132ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:05:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:05:21.415170581 +0000 UTC m=+619.750478876" watchObservedRunningTime="2026-07-15 18:05:21.416849788 +0000 UTC m=+619.752158090" Jul 15 18:05:24.817896 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:24.817809 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:24.817896 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:24.817874 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:24.830763 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:24.830737 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:25.414431 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:25.414396 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8" Jul 15 18:05:30.264876 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:30.264829 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:30.265285 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:30.264912 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:30.277577 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:30.277543 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:30.441771 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:30.441740 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-qvxvx" Jul 15 18:05:37.162963 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:37.162927 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:05:40.413749 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:40.413712 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:05:51.576397 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.576356 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf"] Jul 15 18:05:51.582446 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.582425 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:05:51.584478 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.584455 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 15 18:05:51.588949 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.588929 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf"] Jul 15 18:05:51.698248 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.698214 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97bf7649-1954-423f-a367-d2d2818d0868-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gtvmf\" (UID: \"97bf7649-1954-423f-a367-d2d2818d0868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:05:51.698248 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.698247 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cnxx2\" (UniqueName: \"kubernetes.io/projected/97bf7649-1954-423f-a367-d2d2818d0868-kube-api-access-cnxx2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gtvmf\" (UID: \"97bf7649-1954-423f-a367-d2d2818d0868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:05:51.698469 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.698302 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97bf7649-1954-423f-a367-d2d2818d0868-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gtvmf\" (UID: \"97bf7649-1954-423f-a367-d2d2818d0868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:05:51.698469 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.698329 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97bf7649-1954-423f-a367-d2d2818d0868-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gtvmf\" (UID: \"97bf7649-1954-423f-a367-d2d2818d0868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:05:51.698469 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.698360 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97bf7649-1954-423f-a367-d2d2818d0868-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gtvmf\" (UID: \"97bf7649-1954-423f-a367-d2d2818d0868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:05:51.698469 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.698384 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97bf7649-1954-423f-a367-d2d2818d0868-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gtvmf\" (UID: \"97bf7649-1954-423f-a367-d2d2818d0868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:05:51.740121 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.740083 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:05:51.799623 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.799589 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97bf7649-1954-423f-a367-d2d2818d0868-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gtvmf\" (UID: \"97bf7649-1954-423f-a367-d2d2818d0868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:05:51.799851 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.799657 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97bf7649-1954-423f-a367-d2d2818d0868-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gtvmf\" (UID: \"97bf7649-1954-423f-a367-d2d2818d0868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:05:51.799851 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.799717 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cnxx2\" (UniqueName: \"kubernetes.io/projected/97bf7649-1954-423f-a367-d2d2818d0868-kube-api-access-cnxx2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gtvmf\" (UID: \"97bf7649-1954-423f-a367-d2d2818d0868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:05:51.799851 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.799779 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97bf7649-1954-423f-a367-d2d2818d0868-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gtvmf\" (UID: \"97bf7649-1954-423f-a367-d2d2818d0868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:05:51.799851 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.799809 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97bf7649-1954-423f-a367-d2d2818d0868-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gtvmf\" (UID: \"97bf7649-1954-423f-a367-d2d2818d0868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:05:51.800102 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.799855 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97bf7649-1954-423f-a367-d2d2818d0868-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gtvmf\" (UID: \"97bf7649-1954-423f-a367-d2d2818d0868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:05:51.800179 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.800154 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/97bf7649-1954-423f-a367-d2d2818d0868-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gtvmf\" (UID: \"97bf7649-1954-423f-a367-d2d2818d0868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:05:51.800234 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.800200 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/97bf7649-1954-423f-a367-d2d2818d0868-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gtvmf\" (UID: \"97bf7649-1954-423f-a367-d2d2818d0868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:05:51.800234 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.800223 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/97bf7649-1954-423f-a367-d2d2818d0868-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gtvmf\" (UID: \"97bf7649-1954-423f-a367-d2d2818d0868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:05:51.802160 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.802138 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/97bf7649-1954-423f-a367-d2d2818d0868-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gtvmf\" (UID: \"97bf7649-1954-423f-a367-d2d2818d0868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:05:51.802301 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.802285 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/97bf7649-1954-423f-a367-d2d2818d0868-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gtvmf\" (UID: \"97bf7649-1954-423f-a367-d2d2818d0868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:05:51.809193 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.809164 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cnxx2\" (UniqueName: \"kubernetes.io/projected/97bf7649-1954-423f-a367-d2d2818d0868-kube-api-access-cnxx2\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-gtvmf\" (UID: \"97bf7649-1954-423f-a367-d2d2818d0868\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:05:51.894887 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:51.894853 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:05:52.030980 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:52.030944 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:05:52.032882 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:52.032861 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf"] Jul 15 18:05:52.034716 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:05:52.034689 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod97bf7649_1954_423f_a367_d2d2818d0868.slice/crio-457a41719f6fef126605c9178b8d0f7d2cae766109c713d606cc9f3eb1c68c4f WatchSource:0}: Error finding container 457a41719f6fef126605c9178b8d0f7d2cae766109c713d606cc9f3eb1c68c4f: Status 404 returned error can't find the container with id 457a41719f6fef126605c9178b8d0f7d2cae766109c713d606cc9f3eb1c68c4f Jul 15 18:05:52.128878 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:52.128838 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:05:52.554645 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:52.554553 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" event={"ID":"97bf7649-1954-423f-a367-d2d2818d0868","Type":"ContainerStarted","Data":"b27f03d73a6854aff3d96faa38ca1bb74044dacb97dec11a941853cc79bf44bf"} Jul 15 18:05:52.554645 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:52.554636 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" event={"ID":"97bf7649-1954-423f-a367-d2d2818d0868","Type":"ContainerStarted","Data":"457a41719f6fef126605c9178b8d0f7d2cae766109c713d606cc9f3eb1c68c4f"} Jul 15 18:05:52.574888 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:52.574841 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" podStartSLOduration=1.3122169399999999 podStartE2EDuration="1.574826676s" totalImagesPullingTime="262.609736ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:05:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:05:52.57288234 +0000 UTC m=+650.908190643" watchObservedRunningTime="2026-07-15 18:05:52.574826676 +0000 UTC m=+650.910134980" Jul 15 18:05:57.686426 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:05:57.686389 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:06:01.895869 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:06:01.895823 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:06:01.896328 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:06:01.895891 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:06:01.908507 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:06:01.908479 2551 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:06:02.621920 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:06:02.621892 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-gtvmf" Jul 15 18:06:15.039305 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:06:15.039266 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:06:29.939153 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:06:29.939112 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:06:30.453626 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:06:30.453582 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:06:31.444008 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:06:31.443972 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:07:06.197549 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:07:06.197458 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:07:06.291710 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:07:06.291658 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:07:07.393782 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:07:07.393749 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:07:07.482962 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:07:07.482910 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:08:27.690536 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:27.690441 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:08:27.794816 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:27.794782 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-778dc5db77-zmgxz"] Jul 15 18:08:27.795063 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:27.795038 2551 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-778dc5db77-zmgxz" podUID="dbd390ac-107c-4357-b9fe-d65a46a41212" containerName="manager" containerID="cri-o://f25fab2a0e12c4057ba4ad5377879da4f195d8f1e54e51b018571c845abef21b" gracePeriod=30 Jul 15 18:08:28.049872 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:28.049845 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-778dc5db77-zmgxz" Jul 15 18:08:28.210612 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:28.210581 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dbd390ac-107c-4357-b9fe-d65a46a41212-webhook-cert\") pod \"dbd390ac-107c-4357-b9fe-d65a46a41212\" (UID: \"dbd390ac-107c-4357-b9fe-d65a46a41212\") " Jul 15 18:08:28.210823 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:28.210636 2551 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vlqz4\" (UniqueName: \"kubernetes.io/projected/dbd390ac-107c-4357-b9fe-d65a46a41212-kube-api-access-vlqz4\") pod \"dbd390ac-107c-4357-b9fe-d65a46a41212\" (UID: \"dbd390ac-107c-4357-b9fe-d65a46a41212\") " Jul 15 18:08:28.213124 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:28.213055 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dbd390ac-107c-4357-b9fe-d65a46a41212-kube-api-access-vlqz4" (OuterVolumeSpecName: "kube-api-access-vlqz4") pod "dbd390ac-107c-4357-b9fe-d65a46a41212" (UID: "dbd390ac-107c-4357-b9fe-d65a46a41212"). InnerVolumeSpecName "kube-api-access-vlqz4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 18:08:28.213124 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:28.213061 2551 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/dbd390ac-107c-4357-b9fe-d65a46a41212-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "dbd390ac-107c-4357-b9fe-d65a46a41212" (UID: "dbd390ac-107c-4357-b9fe-d65a46a41212"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 18:08:28.311598 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:28.311558 2551 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/dbd390ac-107c-4357-b9fe-d65a46a41212-webhook-cert\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:08:28.311598 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:28.311594 2551 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vlqz4\" (UniqueName: \"kubernetes.io/projected/dbd390ac-107c-4357-b9fe-d65a46a41212-kube-api-access-vlqz4\") on node \"ip-10-0-128-25.ec2.internal\" DevicePath \"\"" Jul 15 18:08:28.442124 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:28.442086 2551 generic.go:356] "Generic (PLEG): container finished" podID="dbd390ac-107c-4357-b9fe-d65a46a41212" containerID="f25fab2a0e12c4057ba4ad5377879da4f195d8f1e54e51b018571c845abef21b" exitCode=0 Jul 15 18:08:28.442281 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:28.442135 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-778dc5db77-zmgxz" Jul 15 18:08:28.442281 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:28.442179 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-778dc5db77-zmgxz" event={"ID":"dbd390ac-107c-4357-b9fe-d65a46a41212","Type":"ContainerDied","Data":"f25fab2a0e12c4057ba4ad5377879da4f195d8f1e54e51b018571c845abef21b"} Jul 15 18:08:28.442281 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:28.442232 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-778dc5db77-zmgxz" event={"ID":"dbd390ac-107c-4357-b9fe-d65a46a41212","Type":"ContainerDied","Data":"2fb8e2a4ce1b07ccddfc1c0da87fe6591a3fabec113347dec1e77d1efa265419"} Jul 15 18:08:28.442281 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:28.442259 2551 scope.go:117] "RemoveContainer" containerID="f25fab2a0e12c4057ba4ad5377879da4f195d8f1e54e51b018571c845abef21b" Jul 15 18:08:28.452246 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:28.452228 2551 scope.go:117] "RemoveContainer" containerID="f25fab2a0e12c4057ba4ad5377879da4f195d8f1e54e51b018571c845abef21b" Jul 15 18:08:28.452541 ip-10-0-128-25 kubenswrapper[2551]: E0715 18:08:28.452519 2551 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f25fab2a0e12c4057ba4ad5377879da4f195d8f1e54e51b018571c845abef21b\": container with ID starting with f25fab2a0e12c4057ba4ad5377879da4f195d8f1e54e51b018571c845abef21b not found: ID does not exist" containerID="f25fab2a0e12c4057ba4ad5377879da4f195d8f1e54e51b018571c845abef21b" Jul 15 18:08:28.452609 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:28.452549 2551 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f25fab2a0e12c4057ba4ad5377879da4f195d8f1e54e51b018571c845abef21b"} err="failed to get container status \"f25fab2a0e12c4057ba4ad5377879da4f195d8f1e54e51b018571c845abef21b\": rpc error: code = NotFound desc = could not find container \"f25fab2a0e12c4057ba4ad5377879da4f195d8f1e54e51b018571c845abef21b\": container with ID starting with f25fab2a0e12c4057ba4ad5377879da4f195d8f1e54e51b018571c845abef21b not found: ID does not exist" Jul 15 18:08:28.464103 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:28.464041 2551 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-778dc5db77-zmgxz"] Jul 15 18:08:28.469415 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:28.469391 2551 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-778dc5db77-zmgxz"] Jul 15 18:08:29.097924 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:29.097888 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:08:29.216393 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:29.216358 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-778dc5db77-lv8mb"] Jul 15 18:08:29.216773 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:29.216760 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dbd390ac-107c-4357-b9fe-d65a46a41212" containerName="manager" Jul 15 18:08:29.216832 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:29.216774 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="dbd390ac-107c-4357-b9fe-d65a46a41212" containerName="manager" Jul 15 18:08:29.216867 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:29.216845 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="dbd390ac-107c-4357-b9fe-d65a46a41212" containerName="manager" Jul 15 18:08:29.221216 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:29.221196 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-778dc5db77-lv8mb" Jul 15 18:08:29.224384 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:29.224357 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 15 18:08:29.224513 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:29.224358 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 15 18:08:29.224513 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:29.224365 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-x7vcb\"" Jul 15 18:08:29.230207 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:29.230186 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-778dc5db77-lv8mb"] Jul 15 18:08:29.320598 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:29.320562 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/128a2718-4b9e-45da-9955-275ce9e3d063-webhook-cert\") pod \"maas-controller-778dc5db77-lv8mb\" (UID: \"128a2718-4b9e-45da-9955-275ce9e3d063\") " pod="opendatahub/maas-controller-778dc5db77-lv8mb" Jul 15 18:08:29.320786 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:29.320628 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27bs5\" (UniqueName: \"kubernetes.io/projected/128a2718-4b9e-45da-9955-275ce9e3d063-kube-api-access-27bs5\") pod \"maas-controller-778dc5db77-lv8mb\" (UID: \"128a2718-4b9e-45da-9955-275ce9e3d063\") " pod="opendatahub/maas-controller-778dc5db77-lv8mb" Jul 15 18:08:29.421405 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:29.421363 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/128a2718-4b9e-45da-9955-275ce9e3d063-webhook-cert\") pod \"maas-controller-778dc5db77-lv8mb\" (UID: \"128a2718-4b9e-45da-9955-275ce9e3d063\") " pod="opendatahub/maas-controller-778dc5db77-lv8mb" Jul 15 18:08:29.421586 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:29.421429 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27bs5\" (UniqueName: \"kubernetes.io/projected/128a2718-4b9e-45da-9955-275ce9e3d063-kube-api-access-27bs5\") pod \"maas-controller-778dc5db77-lv8mb\" (UID: \"128a2718-4b9e-45da-9955-275ce9e3d063\") " pod="opendatahub/maas-controller-778dc5db77-lv8mb" Jul 15 18:08:29.424075 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:29.424039 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/128a2718-4b9e-45da-9955-275ce9e3d063-webhook-cert\") pod \"maas-controller-778dc5db77-lv8mb\" (UID: \"128a2718-4b9e-45da-9955-275ce9e3d063\") " pod="opendatahub/maas-controller-778dc5db77-lv8mb" Jul 15 18:08:29.429996 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:29.429974 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27bs5\" (UniqueName: \"kubernetes.io/projected/128a2718-4b9e-45da-9955-275ce9e3d063-kube-api-access-27bs5\") pod \"maas-controller-778dc5db77-lv8mb\" (UID: \"128a2718-4b9e-45da-9955-275ce9e3d063\") " pod="opendatahub/maas-controller-778dc5db77-lv8mb" Jul 15 18:08:29.532784 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:29.532747 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-778dc5db77-lv8mb" Jul 15 18:08:29.673601 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:29.673569 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-778dc5db77-lv8mb"] Jul 15 18:08:29.675153 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:08:29.675129 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod128a2718_4b9e_45da_9955_275ce9e3d063.slice/crio-b32451ee213b3d516c94c117c5c336d97dd14766e33207cc1be17aa2923bc689 WatchSource:0}: Error finding container b32451ee213b3d516c94c117c5c336d97dd14766e33207cc1be17aa2923bc689: Status 404 returned error can't find the container with id b32451ee213b3d516c94c117c5c336d97dd14766e33207cc1be17aa2923bc689 Jul 15 18:08:30.213239 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:30.213211 2551 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dbd390ac-107c-4357-b9fe-d65a46a41212" path="/var/lib/kubelet/pods/dbd390ac-107c-4357-b9fe-d65a46a41212/volumes" Jul 15 18:08:30.457689 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:30.457561 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-778dc5db77-lv8mb" event={"ID":"128a2718-4b9e-45da-9955-275ce9e3d063","Type":"ContainerStarted","Data":"0d9819e6dd9bebc9bac44ad3ee3a012d87cde020a23a6d42475f74328ba232ba"} Jul 15 18:08:30.457689 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:30.457628 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-778dc5db77-lv8mb" event={"ID":"128a2718-4b9e-45da-9955-275ce9e3d063","Type":"ContainerStarted","Data":"b32451ee213b3d516c94c117c5c336d97dd14766e33207cc1be17aa2923bc689"} Jul 15 18:08:30.457933 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:30.457760 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-778dc5db77-lv8mb" Jul 15 18:08:30.476829 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:30.476769 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-778dc5db77-lv8mb" podStartSLOduration=0.972527247 podStartE2EDuration="1.476748421s" totalImagesPullingTime="504.221174ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 18:08:29 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:08:30.475602293 +0000 UTC m=+808.810910648" watchObservedRunningTime="2026-07-15 18:08:30.476748421 +0000 UTC m=+808.812056725" Jul 15 18:08:41.466085 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:08:41.466055 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-778dc5db77-lv8mb" Jul 15 18:09:15.002583 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:09:15.002540 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:09:15.097273 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:09:15.097244 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:09:15.252699 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:09:15.252587 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:09:21.606147 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:09:21.606102 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:09:21.712923 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:09:21.712879 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:09:21.867259 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:09:21.867168 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:09:22.062378 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:09:22.062343 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:09:28.105993 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:09:28.105963 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:09:28.208217 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:09:28.208172 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:10:02.164018 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:10:02.163912 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b89jb_67315a2e-51bd-4280-9821-5a6fd7b06df7/console-operator/1.log" Jul 15 18:10:02.164018 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:10:02.163930 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b89jb_67315a2e-51bd-4280-9821-5a6fd7b06df7/console-operator/1.log" Jul 15 18:10:02.172721 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:10:02.172704 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwzkz_ff5857c7-97d1-467d-8b6f-8691f7e0d6dc/ovn-acl-logging/0.log" Jul 15 18:10:02.173043 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:10:02.173027 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwzkz_ff5857c7-97d1-467d-8b6f-8691f7e0d6dc/ovn-acl-logging/0.log" Jul 15 18:10:18.083169 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:10:18.083136 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:10:19.853012 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:10:19.852973 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:12:01.227658 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:12:01.227626 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:13:35.042637 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:13:35.042606 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:15:00.172781 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:15:00.172745 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735655-4fkdm"] Jul 15 18:15:00.176314 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:15:00.176296 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735655-4fkdm" Jul 15 18:15:00.179178 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:15:00.179155 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-cfs2x\"" Jul 15 18:15:00.185095 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:15:00.185067 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735655-4fkdm"] Jul 15 18:15:00.187718 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:15:00.187702 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735655-4fkdm" Jul 15 18:15:00.325504 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:15:00.325471 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735655-4fkdm"] Jul 15 18:15:00.327403 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:15:00.327368 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a259989_8eae_4b40_a05a_78808216398d.slice/crio-6dcf30514764ebdafaf02edc5666b20b57c5aed50347767d9327000d396873ac WatchSource:0}: Error finding container 6dcf30514764ebdafaf02edc5666b20b57c5aed50347767d9327000d396873ac: Status 404 returned error can't find the container with id 6dcf30514764ebdafaf02edc5666b20b57c5aed50347767d9327000d396873ac Jul 15 18:15:00.329342 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:15:00.329327 2551 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 18:15:00.648311 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:15:00.648269 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735655-4fkdm" event={"ID":"3a259989-8eae-4b40-a05a-78808216398d","Type":"ContainerStarted","Data":"6dcf30514764ebdafaf02edc5666b20b57c5aed50347767d9327000d396873ac"} Jul 15 18:15:02.543268 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:15:02.543234 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b89jb_67315a2e-51bd-4280-9821-5a6fd7b06df7/console-operator/1.log" Jul 15 18:15:02.545083 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:15:02.543629 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b89jb_67315a2e-51bd-4280-9821-5a6fd7b06df7/console-operator/1.log" Jul 15 18:15:02.552230 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:15:02.552207 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwzkz_ff5857c7-97d1-467d-8b6f-8691f7e0d6dc/ovn-acl-logging/0.log" Jul 15 18:15:02.552925 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:15:02.552902 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwzkz_ff5857c7-97d1-467d-8b6f-8691f7e0d6dc/ovn-acl-logging/0.log" Jul 15 18:15:03.668213 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:15:03.668179 2551 generic.go:356] "Generic (PLEG): container finished" podID="3a259989-8eae-4b40-a05a-78808216398d" containerID="115d9be2d14264029c325a68127dc196491f92003864f9ae0967735f49eadbbc" exitCode=0 Jul 15 18:15:03.668213 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:15:03.668216 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735655-4fkdm" event={"ID":"3a259989-8eae-4b40-a05a-78808216398d","Type":"ContainerDied","Data":"115d9be2d14264029c325a68127dc196491f92003864f9ae0967735f49eadbbc"} Jul 15 18:15:04.806744 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:15:04.806722 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735655-4fkdm" Jul 15 18:15:05.686453 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:15:05.686420 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735655-4fkdm" event={"ID":"3a259989-8eae-4b40-a05a-78808216398d","Type":"ContainerDied","Data":"6dcf30514764ebdafaf02edc5666b20b57c5aed50347767d9327000d396873ac"} Jul 15 18:15:05.686630 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:15:05.686495 2551 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6dcf30514764ebdafaf02edc5666b20b57c5aed50347767d9327000d396873ac" Jul 15 18:15:05.686630 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:15:05.686425 2551 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735655-4fkdm" Jul 15 18:15:24.759853 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:15:24.759821 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:17:28.462690 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:17:28.462587 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:17:29.317517 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:17:29.317472 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:20:02.599327 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:20:02.599204 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b89jb_67315a2e-51bd-4280-9821-5a6fd7b06df7/console-operator/1.log" Jul 15 18:20:02.603060 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:20:02.602722 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b89jb_67315a2e-51bd-4280-9821-5a6fd7b06df7/console-operator/1.log" Jul 15 18:20:02.608478 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:20:02.608449 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwzkz_ff5857c7-97d1-467d-8b6f-8691f7e0d6dc/ovn-acl-logging/0.log" Jul 15 18:20:02.611922 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:20:02.611902 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-pwzkz_ff5857c7-97d1-467d-8b6f-8691f7e0d6dc/ovn-acl-logging/0.log" Jul 15 18:20:11.945168 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:20:11.945138 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:20:42.324766 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:20:42.324692 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:20:43.968025 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:20:43.967989 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:21:54.399391 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:21:54.399306 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:22:42.486351 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:42.486318 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-778dc5db77-lv8mb_128a2718-4b9e-45da-9955-275ce9e3d063/manager/0.log" Jul 15 18:22:42.617371 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:42.617344 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-v8qnj_321bd427-6ea0-4195-9ec4-1f4d077f337b/server/0.log" Jul 15 18:22:42.738341 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:42.738261 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4nszb_4cacce62-6cbc-4f7e-a7c8-6054a1e02865/manager/0.log" Jul 15 18:22:43.116055 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:43.116021 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-748f9847bf-vrlkg_6c940b77-709f-40c5-9b8e-051ad8e97743/copy-manifests/0.log" Jul 15 18:22:43.137214 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:43.137185 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-748f9847bf-vrlkg_6c940b77-709f-40c5-9b8e-051ad8e97743/manager/0.log" Jul 15 18:22:43.636192 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:43.636160 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735655-4fkdm_3a259989-8eae-4b40-a05a-78808216398d/cleanup/0.log" Jul 15 18:22:43.750823 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:43.750788 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-t5f6r_ed6625e8-8e2e-4f01-ba50-b5e7831a93eb/postgres/0.log" Jul 15 18:22:44.521855 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:44.521823 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l_f87b806e-12b6-4569-ab94-51875e605cec/pull/0.log" Jul 15 18:22:44.527961 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:44.527938 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l_f87b806e-12b6-4569-ab94-51875e605cec/extract/0.log" Jul 15 18:22:44.534957 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:44.534936 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l_f87b806e-12b6-4569-ab94-51875e605cec/util/0.log" Jul 15 18:22:44.644166 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:44.644145 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt_5cae8f56-f307-4b24-9276-32e649aa95a6/util/0.log" Jul 15 18:22:44.649764 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:44.649733 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt_5cae8f56-f307-4b24-9276-32e649aa95a6/pull/0.log" Jul 15 18:22:44.655715 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:44.655700 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt_5cae8f56-f307-4b24-9276-32e649aa95a6/extract/0.log" Jul 15 18:22:44.769940 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:44.769914 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j_f3be92a5-bf27-46bf-82a3-7ef1d795558b/util/0.log" Jul 15 18:22:44.776261 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:44.776192 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j_f3be92a5-bf27-46bf-82a3-7ef1d795558b/pull/0.log" Jul 15 18:22:44.782405 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:44.782385 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j_f3be92a5-bf27-46bf-82a3-7ef1d795558b/extract/0.log" Jul 15 18:22:44.893842 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:44.893816 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq_6f439522-6ed9-41b0-a0d6-bac70c5c806f/extract/0.log" Jul 15 18:22:44.900163 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:44.900141 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq_6f439522-6ed9-41b0-a0d6-bac70c5c806f/util/0.log" Jul 15 18:22:44.906098 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:44.906082 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq_6f439522-6ed9-41b0-a0d6-bac70c5c806f/pull/0.log" Jul 15 18:22:45.141653 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:45.141626 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kq6jr_dc0b5373-56fb-4d66-9e01-1e9ccc1ba106/manager/0.log" Jul 15 18:22:45.270331 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:45.270303 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9bng4_5eb633d9-5a5b-4684-8106-33b32753ff4a/manager/0.log" Jul 15 18:22:45.504572 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:45.504496 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-49fsr_0a76593d-0fde-4b2a-ae7a-ac3a79e3acd2/registry-server/0.log" Jul 15 18:22:45.868817 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:45.868789 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-nnkc2_4955461b-024f-4661-b4d2-a91740e26e90/manager/0.log" Jul 15 18:22:46.343236 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:46.343157 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wc9bh_f6cd5862-ace4-4695-bf49-e38f1d0a5113/discovery/0.log" Jul 15 18:22:46.477037 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:46.477007 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-785fddc5dc-7778q_551ef68f-1e91-4421-83fe-f621c8b8969b/kube-auth-proxy/0.log" Jul 15 18:22:46.826836 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:46.826805 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-v8g59_c16eff1b-6881-4007-b4a3-1068d01dc292/payload-pre-processing/0.log" Jul 15 18:22:46.943321 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:46.943295 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-q5n7q_1715edc0-8fb8-4b67-84cf-77a19e17d940/payload-processing/0.log" Jul 15 18:22:47.057230 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:47.057208 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59dcc44f8-b45fj_95759e5c-f715-4172-a6d2-28c19c18c556/router/0.log" Jul 15 18:22:47.410542 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:47.410509 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-g4qz8_8dc8daea-8ec8-4ea1-a0e4-18608edf8306/main/0.log" Jul 15 18:22:47.523105 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:47.523075 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-qvxvx_9e8b4949-759e-4504-9ef1-414611194d4c/main/0.log" Jul 15 18:22:47.865864 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:47.865837 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-gtvmf_97bf7649-1954-423f-a367-d2d2818d0868/main/0.log" Jul 15 18:22:54.025328 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:54.025295 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:22:54.130233 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:54.130193 2551 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" limit=1024 Jul 15 18:22:56.982382 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:56.982356 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-6jz77_12a379a8-7075-4528-a2c5-9d2750f9e71c/global-pull-secret-syncer/0.log" Jul 15 18:22:57.067499 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:57.067471 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-h74qh_3c4f7d00-4a62-47f2-89d4-bc4f7d1c94da/konnectivity-agent/0.log" Jul 15 18:22:57.157133 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:22:57.157107 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-128-25.ec2.internal_713382c42dd951a131036f50252694db/haproxy/0.log" Jul 15 18:23:01.843178 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:01.843094 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l_f87b806e-12b6-4569-ab94-51875e605cec/extract/0.log" Jul 15 18:23:01.880490 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:01.880470 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l_f87b806e-12b6-4569-ab94-51875e605cec/util/0.log" Jul 15 18:23:01.906078 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:01.906049 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759hnb4l_f87b806e-12b6-4569-ab94-51875e605cec/pull/0.log" Jul 15 18:23:01.940427 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:01.940404 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt_5cae8f56-f307-4b24-9276-32e649aa95a6/extract/0.log" Jul 15 18:23:01.962326 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:01.962297 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt_5cae8f56-f307-4b24-9276-32e649aa95a6/util/0.log" Jul 15 18:23:01.992969 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:01.992946 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e02t9rt_5cae8f56-f307-4b24-9276-32e649aa95a6/pull/0.log" Jul 15 18:23:02.020568 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:02.020547 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j_f3be92a5-bf27-46bf-82a3-7ef1d795558b/extract/0.log" Jul 15 18:23:02.049846 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:02.049825 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j_f3be92a5-bf27-46bf-82a3-7ef1d795558b/util/0.log" Jul 15 18:23:02.077249 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:02.077221 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73mgr2j_f3be92a5-bf27-46bf-82a3-7ef1d795558b/pull/0.log" Jul 15 18:23:02.112551 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:02.112535 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq_6f439522-6ed9-41b0-a0d6-bac70c5c806f/extract/0.log" Jul 15 18:23:02.136529 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:02.136502 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq_6f439522-6ed9-41b0-a0d6-bac70c5c806f/util/0.log" Jul 15 18:23:02.163225 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:02.163202 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1qldlq_6f439522-6ed9-41b0-a0d6-bac70c5c806f/pull/0.log" Jul 15 18:23:02.512273 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:02.512186 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-kq6jr_dc0b5373-56fb-4d66-9e01-1e9ccc1ba106/manager/0.log" Jul 15 18:23:02.558288 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:02.558261 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_dns-operator-controller-manager-864dd78c4c-9bng4_5eb633d9-5a5b-4684-8106-33b32753ff4a/manager/0.log" Jul 15 18:23:02.634251 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:02.631837 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-49fsr_0a76593d-0fde-4b2a-ae7a-ac3a79e3acd2/registry-server/0.log" Jul 15 18:23:02.759426 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:02.759391 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-nnkc2_4955461b-024f-4661-b4d2-a91740e26e90/manager/0.log" Jul 15 18:23:04.602816 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:04.602786 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-5f7f494dd4-4knf9_0e6db71d-1cf5-4d0e-98cd-4aa46b25ba0b/cluster-monitoring-operator/0.log" Jul 15 18:23:04.873879 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:04.873809 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-krmdj_1d235e73-df9f-444c-8f8f-c5ee1ab9babe/node-exporter/0.log" Jul 15 18:23:04.899202 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:04.899178 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-krmdj_1d235e73-df9f-444c-8f8f-c5ee1ab9babe/kube-rbac-proxy/0.log" Jul 15 18:23:04.920645 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:04.920626 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-krmdj_1d235e73-df9f-444c-8f8f-c5ee1ab9babe/init-textfile/0.log" Jul 15 18:23:05.431785 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:05.431748 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-cd88f6db4-qc95l_ef715998-d30f-422e-8233-b56e608d5f61/telemeter-client/0.log" Jul 15 18:23:05.460483 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:05.460460 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-cd88f6db4-qc95l_ef715998-d30f-422e-8233-b56e608d5f61/reload/0.log" Jul 15 18:23:05.486261 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:05.486239 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-cd88f6db4-qc95l_ef715998-d30f-422e-8233-b56e608d5f61/kube-rbac-proxy/0.log" Jul 15 18:23:06.895648 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:06.895613 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6cf856758c-xj5wd_513dcf18-7adc-4c51-b82a-5c2a3c6ee1fa/networking-console-plugin/0.log" Jul 15 18:23:07.004525 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.004495 2551 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l"] Jul 15 18:23:07.004978 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.004954 2551 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a259989-8eae-4b40-a05a-78808216398d" containerName="cleanup" Jul 15 18:23:07.004978 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.004974 2551 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a259989-8eae-4b40-a05a-78808216398d" containerName="cleanup" Jul 15 18:23:07.005154 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.005064 2551 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a259989-8eae-4b40-a05a-78808216398d" containerName="cleanup" Jul 15 18:23:07.008266 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.008240 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l" Jul 15 18:23:07.010358 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.010337 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-86htr\"/\"kube-root-ca.crt\"" Jul 15 18:23:07.010468 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.010338 2551 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-86htr\"/\"openshift-service-ca.crt\"" Jul 15 18:23:07.010468 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.010404 2551 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-86htr\"/\"default-dockercfg-gdz2m\"" Jul 15 18:23:07.019315 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.019295 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l"] Jul 15 18:23:07.127398 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.121124 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac9ebc1b-81cf-4bc9-96e7-e40acf894371-lib-modules\") pod \"perf-node-gather-daemonset-8pb2l\" (UID: \"ac9ebc1b-81cf-4bc9-96e7-e40acf894371\") " pod="openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l" Jul 15 18:23:07.127398 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.121242 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hrv5\" (UniqueName: \"kubernetes.io/projected/ac9ebc1b-81cf-4bc9-96e7-e40acf894371-kube-api-access-8hrv5\") pod \"perf-node-gather-daemonset-8pb2l\" (UID: \"ac9ebc1b-81cf-4bc9-96e7-e40acf894371\") " pod="openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l" Jul 15 18:23:07.127398 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.121313 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac9ebc1b-81cf-4bc9-96e7-e40acf894371-podres\") pod \"perf-node-gather-daemonset-8pb2l\" (UID: \"ac9ebc1b-81cf-4bc9-96e7-e40acf894371\") " pod="openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l" Jul 15 18:23:07.127398 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.121348 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac9ebc1b-81cf-4bc9-96e7-e40acf894371-sys\") pod \"perf-node-gather-daemonset-8pb2l\" (UID: \"ac9ebc1b-81cf-4bc9-96e7-e40acf894371\") " pod="openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l" Jul 15 18:23:07.127398 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.121396 2551 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac9ebc1b-81cf-4bc9-96e7-e40acf894371-proc\") pod \"perf-node-gather-daemonset-8pb2l\" (UID: \"ac9ebc1b-81cf-4bc9-96e7-e40acf894371\") " pod="openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l" Jul 15 18:23:07.222364 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.222300 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac9ebc1b-81cf-4bc9-96e7-e40acf894371-proc\") pod \"perf-node-gather-daemonset-8pb2l\" (UID: \"ac9ebc1b-81cf-4bc9-96e7-e40acf894371\") " pod="openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l" Jul 15 18:23:07.222364 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.222332 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac9ebc1b-81cf-4bc9-96e7-e40acf894371-lib-modules\") pod \"perf-node-gather-daemonset-8pb2l\" (UID: \"ac9ebc1b-81cf-4bc9-96e7-e40acf894371\") " pod="openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l" Jul 15 18:23:07.222520 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.222383 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hrv5\" (UniqueName: \"kubernetes.io/projected/ac9ebc1b-81cf-4bc9-96e7-e40acf894371-kube-api-access-8hrv5\") pod \"perf-node-gather-daemonset-8pb2l\" (UID: \"ac9ebc1b-81cf-4bc9-96e7-e40acf894371\") " pod="openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l" Jul 15 18:23:07.222520 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.222412 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac9ebc1b-81cf-4bc9-96e7-e40acf894371-podres\") pod \"perf-node-gather-daemonset-8pb2l\" (UID: \"ac9ebc1b-81cf-4bc9-96e7-e40acf894371\") " pod="openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l" Jul 15 18:23:07.222520 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.222414 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/ac9ebc1b-81cf-4bc9-96e7-e40acf894371-proc\") pod \"perf-node-gather-daemonset-8pb2l\" (UID: \"ac9ebc1b-81cf-4bc9-96e7-e40acf894371\") " pod="openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l" Jul 15 18:23:07.222520 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.222431 2551 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac9ebc1b-81cf-4bc9-96e7-e40acf894371-sys\") pod \"perf-node-gather-daemonset-8pb2l\" (UID: \"ac9ebc1b-81cf-4bc9-96e7-e40acf894371\") " pod="openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l" Jul 15 18:23:07.222520 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.222493 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ac9ebc1b-81cf-4bc9-96e7-e40acf894371-sys\") pod \"perf-node-gather-daemonset-8pb2l\" (UID: \"ac9ebc1b-81cf-4bc9-96e7-e40acf894371\") " pod="openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l" Jul 15 18:23:07.222700 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.222529 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/ac9ebc1b-81cf-4bc9-96e7-e40acf894371-podres\") pod \"perf-node-gather-daemonset-8pb2l\" (UID: \"ac9ebc1b-81cf-4bc9-96e7-e40acf894371\") " pod="openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l" Jul 15 18:23:07.222700 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.222537 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/ac9ebc1b-81cf-4bc9-96e7-e40acf894371-lib-modules\") pod \"perf-node-gather-daemonset-8pb2l\" (UID: \"ac9ebc1b-81cf-4bc9-96e7-e40acf894371\") " pod="openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l" Jul 15 18:23:07.232278 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.232259 2551 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hrv5\" (UniqueName: \"kubernetes.io/projected/ac9ebc1b-81cf-4bc9-96e7-e40acf894371-kube-api-access-8hrv5\") pod \"perf-node-gather-daemonset-8pb2l\" (UID: \"ac9ebc1b-81cf-4bc9-96e7-e40acf894371\") " pod="openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l" Jul 15 18:23:07.318715 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.318693 2551 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l" Jul 15 18:23:07.456800 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.456776 2551 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l"] Jul 15 18:23:07.458248 ip-10-0-128-25 kubenswrapper[2551]: W0715 18:23:07.458208 2551 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podac9ebc1b_81cf_4bc9_96e7_e40acf894371.slice/crio-58647d9f1d54ff829c40d8cb289f5cb8ad4b83eeea77c05f58aba01c2f586bd3 WatchSource:0}: Error finding container 58647d9f1d54ff829c40d8cb289f5cb8ad4b83eeea77c05f58aba01c2f586bd3: Status 404 returned error can't find the container with id 58647d9f1d54ff829c40d8cb289f5cb8ad4b83eeea77c05f58aba01c2f586bd3 Jul 15 18:23:07.663449 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.663425 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b89jb_67315a2e-51bd-4280-9821-5a6fd7b06df7/console-operator/1.log" Jul 15 18:23:07.667852 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:07.667832 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-7866497494-b89jb_67315a2e-51bd-4280-9821-5a6fd7b06df7/console-operator/2.log" Jul 15 18:23:08.252656 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:08.252626 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_downloads-68c9cbb497-dmgfp_85434ffb-4c25-4714-aec1-0bd9e09c8f80/download-server/0.log" Jul 15 18:23:08.392368 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:08.392340 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l" event={"ID":"ac9ebc1b-81cf-4bc9-96e7-e40acf894371","Type":"ContainerStarted","Data":"709aa082646ee30fd5337d460b23e1aca743fdc9ffceb1b3aa12abbd807b0a38"} Jul 15 18:23:08.392531 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:08.392384 2551 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l" event={"ID":"ac9ebc1b-81cf-4bc9-96e7-e40acf894371","Type":"ContainerStarted","Data":"58647d9f1d54ff829c40d8cb289f5cb8ad4b83eeea77c05f58aba01c2f586bd3"} Jul 15 18:23:08.392531 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:08.392468 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l" Jul 15 18:23:08.411376 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:08.411333 2551 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l" podStartSLOduration=2.411319359 podStartE2EDuration="2.411319359s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 18:23:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 18:23:08.408076041 +0000 UTC m=+1686.743384343" watchObservedRunningTime="2026-07-15 18:23:08.411319359 +0000 UTC m=+1686.746627661" Jul 15 18:23:08.913347 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:08.913315 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-78495597f6-cbzbw_d7bface4-5e90-4274-806e-b1b8fea7e0e3/volume-data-source-validator/0.log" Jul 15 18:23:10.081046 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:10.081016 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sk64p_64a2bcb4-7c5f-4859-9a19-3de5ec1af440/dns/0.log" Jul 15 18:23:10.100975 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:10.100946 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-sk64p_64a2bcb4-7c5f-4859-9a19-3de5ec1af440/kube-rbac-proxy/0.log" Jul 15 18:23:10.170905 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:10.170880 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-zskmc_b6285ed2-035b-45f1-9ca7-52023153a5e9/dns-node-resolver/0.log" Jul 15 18:23:10.812575 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:10.812551 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-xhh8c_d1ec3250-3d3a-4901-a5e1-8bb3d3e6a0ae/node-ca/0.log" Jul 15 18:23:11.851117 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:11.851087 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wc9bh_f6cd5862-ace4-4695-bf49-e38f1d0a5113/discovery/0.log" Jul 15 18:23:11.870741 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:11.870712 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-785fddc5dc-7778q_551ef68f-1e91-4421-83fe-f621c8b8969b/kube-auth-proxy/0.log" Jul 15 18:23:11.979325 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:11.979301 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-v8g59_c16eff1b-6881-4007-b4a3-1068d01dc292/payload-pre-processing/0.log" Jul 15 18:23:12.005854 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:12.005832 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-q5n7q_1715edc0-8fb8-4b67-84cf-77a19e17d940/payload-processing/0.log" Jul 15 18:23:12.028793 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:12.028757 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59dcc44f8-b45fj_95759e5c-f715-4172-a6d2-28c19c18c556/router/0.log" Jul 15 18:23:12.675575 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:12.675543 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-r97xm_fb5910a7-337b-4b1a-bba2-8ca95b40911e/serve-healthcheck-canary/0.log" Jul 15 18:23:13.203682 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:13.203643 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-jrxtm_d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4/insights-operator/0.log" Jul 15 18:23:13.204946 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:13.204915 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-68d9dd94cf-jrxtm_d92bdd5d-2ff9-4525-9d19-9b4b2e2c82f4/insights-operator/1.log" Jul 15 18:23:13.370134 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:13.370104 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s999x_3fbeaacd-8c0d-487f-ac81-0c53ebc89f15/kube-rbac-proxy/0.log" Jul 15 18:23:13.390578 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:13.390553 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s999x_3fbeaacd-8c0d-487f-ac81-0c53ebc89f15/exporter/0.log" Jul 15 18:23:13.411290 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:13.411259 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-s999x_3fbeaacd-8c0d-487f-ac81-0c53ebc89f15/extractor/0.log" Jul 15 18:23:14.408500 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:14.408472 2551 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-86htr/perf-node-gather-daemonset-8pb2l" Jul 15 18:23:15.856068 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:15.856038 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-778dc5db77-lv8mb_128a2718-4b9e-45da-9955-275ce9e3d063/manager/0.log" Jul 15 18:23:15.889966 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:15.889937 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-v8qnj_321bd427-6ea0-4195-9ec4-1f4d077f337b/server/0.log" Jul 15 18:23:15.943387 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:15.943321 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-4nszb_4cacce62-6cbc-4f7e-a7c8-6054a1e02865/manager/0.log" Jul 15 18:23:16.133453 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:16.133424 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-748f9847bf-vrlkg_6c940b77-709f-40c5-9b8e-051ad8e97743/manager/0.log" Jul 15 18:23:16.150596 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:16.150575 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-748f9847bf-vrlkg_6c940b77-709f-40c5-9b8e-051ad8e97743/copy-manifests/0.log" Jul 15 18:23:17.863099 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:17.863059 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wc9bh_f6cd5862-ace4-4695-bf49-e38f1d0a5113/discovery/0.log" Jul 15 18:23:17.873597 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:17.873572 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-785fddc5dc-7778q_551ef68f-1e91-4421-83fe-f621c8b8969b/kube-auth-proxy/0.log" Jul 15 18:23:17.955765 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:17.955737 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-v8g59_c16eff1b-6881-4007-b4a3-1068d01dc292/payload-pre-processing/0.log" Jul 15 18:23:17.969806 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:17.969785 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-q5n7q_1715edc0-8fb8-4b67-84cf-77a19e17d940/payload-processing/0.log" Jul 15 18:23:17.984935 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:17.984913 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59dcc44f8-b45fj_95759e5c-f715-4172-a6d2-28c19c18c556/router/0.log" Jul 15 18:23:19.184446 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:19.184417 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-wc9bh_f6cd5862-ace4-4695-bf49-e38f1d0a5113/discovery/0.log" Jul 15 18:23:19.195627 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:19.195567 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-785fddc5dc-7778q_551ef68f-1e91-4421-83fe-f621c8b8969b/kube-auth-proxy/0.log" Jul 15 18:23:19.267799 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:19.267777 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-v8g59_c16eff1b-6881-4007-b4a3-1068d01dc292/payload-pre-processing/0.log" Jul 15 18:23:19.289845 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:19.289825 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-f9b8d9b9b-q5n7q_1715edc0-8fb8-4b67-84cf-77a19e17d940/payload-processing/0.log" Jul 15 18:23:19.302481 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:19.302461 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-59dcc44f8-b45fj_95759e5c-f715-4172-a6d2-28c19c18c556/router/0.log" Jul 15 18:23:23.339172 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:23.339086 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-9pdlp_bd7b71a8-c2dc-4c96-998c-2e4f1924c746/kube-storage-version-migrator-operator/1.log" Jul 15 18:23:23.339923 ip-10-0-128-25 kubenswrapper[2551]: I0715 18:23:23.339905 2551 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-799cb7f958-9pdlp_bd7b71a8-c2dc-4c96-998c-2e4f1924c746/kube-storage-version-migrator-operator/0.log"