Jul 08 22:29:49.549393 ip-10-0-131-200 systemd[1]: Starting Kubernetes Kubelet... Jul 08 22:29:49.982066 ip-10-0-131-200 kubenswrapper[2573]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 22:29:49.982066 ip-10-0-131-200 kubenswrapper[2573]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 08 22:29:49.982066 ip-10-0-131-200 kubenswrapper[2573]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 22:29:49.982066 ip-10-0-131-200 kubenswrapper[2573]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 08 22:29:49.982066 ip-10-0-131-200 kubenswrapper[2573]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 08 22:29:49.984308 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.984221 2573 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 08 22:29:49.990286 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990265 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 22:29:49.990286 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990284 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 22:29:49.990286 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990288 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 22:29:49.990286 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990291 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 22:29:49.990451 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990295 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 22:29:49.990451 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990298 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 22:29:49.990451 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990301 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 22:29:49.990451 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990304 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 22:29:49.990451 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990307 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 22:29:49.990451 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990309 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 22:29:49.990451 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990312 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 22:29:49.990451 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990314 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 22:29:49.990451 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990317 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 22:29:49.990451 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990319 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 22:29:49.990451 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990322 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 22:29:49.990451 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990324 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 22:29:49.990451 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990327 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 22:29:49.990451 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990329 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 22:29:49.990451 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990332 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 22:29:49.990451 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990334 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 22:29:49.990451 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990337 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 22:29:49.990451 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990342 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 22:29:49.990451 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990345 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 22:29:49.990451 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990347 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 22:29:49.990936 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990350 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 22:29:49.990936 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990354 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 22:29:49.990936 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990358 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 22:29:49.990936 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990361 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 22:29:49.990936 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990363 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 22:29:49.990936 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990366 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 22:29:49.990936 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990369 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 22:29:49.990936 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990371 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 22:29:49.990936 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990374 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 22:29:49.990936 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990376 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 22:29:49.990936 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990379 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 08 22:29:49.990936 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990381 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 22:29:49.990936 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990394 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 22:29:49.990936 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990398 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 22:29:49.990936 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990402 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 22:29:49.990936 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990404 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 22:29:49.990936 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990407 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 22:29:49.990936 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990409 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 22:29:49.990936 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990412 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 22:29:49.990936 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990415 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 22:29:49.991414 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990417 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 22:29:49.991414 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990421 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 22:29:49.991414 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990425 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 22:29:49.991414 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990428 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 22:29:49.991414 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990430 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 22:29:49.991414 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990433 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 22:29:49.991414 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990436 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 22:29:49.991414 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990438 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 22:29:49.991414 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990441 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 22:29:49.991414 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990444 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 22:29:49.991414 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990446 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 22:29:49.991414 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990449 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 22:29:49.991414 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990451 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 22:29:49.991414 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990454 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 22:29:49.991414 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990456 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 22:29:49.991414 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990459 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 22:29:49.991414 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990462 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 22:29:49.991414 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990464 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 22:29:49.991414 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990467 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 22:29:49.991882 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990469 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 22:29:49.991882 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990474 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 22:29:49.991882 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990477 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 22:29:49.991882 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990480 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 22:29:49.991882 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990482 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 22:29:49.991882 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990485 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 22:29:49.991882 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990488 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 22:29:49.991882 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990492 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 22:29:49.991882 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990495 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 22:29:49.991882 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990498 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 22:29:49.991882 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990500 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 22:29:49.991882 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990503 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 22:29:49.991882 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990505 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 22:29:49.991882 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990508 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 22:29:49.991882 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990510 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 22:29:49.991882 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990513 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 22:29:49.991882 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990515 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 22:29:49.991882 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990518 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 22:29:49.991882 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990520 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 22:29:49.992432 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990522 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 22:29:49.992432 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990526 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 22:29:49.992432 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990528 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 22:29:49.992432 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990531 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 22:29:49.992432 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990533 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 22:29:49.992432 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990535 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 22:29:49.992432 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990538 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 22:29:49.992432 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990540 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 22:29:49.992432 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990542 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 22:29:49.992432 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990545 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 22:29:49.992432 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990548 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 22:29:49.992432 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990564 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 22:29:49.992432 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990567 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 22:29:49.992432 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990569 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 22:29:49.992432 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990572 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 22:29:49.992432 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990574 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 22:29:49.992432 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.990577 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 22:29:49.992432 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991286 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 22:29:49.992432 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991293 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 22:29:49.992432 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991298 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 22:29:49.992941 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991301 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 22:29:49.992941 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991304 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 22:29:49.992941 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991306 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 22:29:49.992941 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991311 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 22:29:49.992941 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991314 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 22:29:49.992941 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991318 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 22:29:49.992941 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991321 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 22:29:49.992941 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991323 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 22:29:49.992941 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991326 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 22:29:49.992941 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991329 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 22:29:49.992941 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991331 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 22:29:49.992941 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991334 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 22:29:49.992941 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991336 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 22:29:49.992941 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991338 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 22:29:49.992941 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991342 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 22:29:49.992941 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991344 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 22:29:49.992941 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991347 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 22:29:49.992941 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991349 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 22:29:49.992941 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991352 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 22:29:49.993457 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991354 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 22:29:49.993457 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991356 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 22:29:49.993457 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991359 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 22:29:49.993457 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991361 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 22:29:49.993457 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991364 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 22:29:49.993457 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991366 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 22:29:49.993457 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991370 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 22:29:49.993457 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991372 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 22:29:49.993457 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991374 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 22:29:49.993457 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991377 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 22:29:49.993457 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991379 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 22:29:49.993457 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991381 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 22:29:49.993457 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991384 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 22:29:49.993457 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991388 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 22:29:49.993457 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991391 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 22:29:49.993457 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991394 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 22:29:49.993457 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991397 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 22:29:49.993457 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991399 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 22:29:49.993457 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991401 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 22:29:49.993927 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991404 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 22:29:49.993927 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991406 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 22:29:49.993927 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991408 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 22:29:49.993927 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991411 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 22:29:49.993927 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991413 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 22:29:49.993927 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991416 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 22:29:49.993927 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991418 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 22:29:49.993927 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991421 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 22:29:49.993927 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991423 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 22:29:49.993927 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991427 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 22:29:49.993927 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991429 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 22:29:49.993927 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991432 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 22:29:49.993927 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991434 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 22:29:49.993927 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991437 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 22:29:49.993927 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991440 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 22:29:49.993927 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991442 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 22:29:49.993927 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991445 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 22:29:49.993927 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991447 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 22:29:49.993927 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991449 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 22:29:49.993927 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991453 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 22:29:49.994412 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991456 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 22:29:49.994412 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991458 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 22:29:49.994412 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991460 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 22:29:49.994412 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991463 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 22:29:49.994412 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991466 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 22:29:49.994412 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991468 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 22:29:49.994412 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991471 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 22:29:49.994412 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991473 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 22:29:49.994412 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991476 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 22:29:49.994412 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991478 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 22:29:49.994412 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991481 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 22:29:49.994412 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991483 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 22:29:49.994412 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991485 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 22:29:49.994412 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991488 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 22:29:49.994412 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991490 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 22:29:49.994412 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991493 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 22:29:49.994412 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991495 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 22:29:49.994412 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991498 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 22:29:49.994412 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991500 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 22:29:49.994412 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991503 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 22:29:49.994909 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991505 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 22:29:49.994909 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991507 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 22:29:49.994909 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991514 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 22:29:49.994909 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991518 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 22:29:49.994909 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991521 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 08 22:29:49.994909 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991525 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 22:29:49.994909 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991527 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 22:29:49.994909 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991530 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 22:29:49.994909 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991533 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 22:29:49.994909 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991535 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 22:29:49.994909 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991538 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 22:29:49.994909 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991540 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 22:29:49.994909 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991543 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 22:29:49.994909 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991545 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 22:29:49.994909 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991548 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 22:29:49.994909 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991566 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 22:29:49.994909 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991569 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 22:29:49.994909 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991572 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 22:29:49.994909 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991945 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 22:29:49.994909 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991950 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 22:29:49.995385 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991953 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 22:29:49.995385 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991956 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 22:29:49.995385 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991959 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 22:29:49.995385 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991961 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 22:29:49.995385 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991964 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 22:29:49.995385 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991966 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 22:29:49.995385 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991969 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 08 22:29:49.995385 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991971 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 22:29:49.995385 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991973 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 22:29:49.995385 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991976 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 22:29:49.995385 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991979 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 22:29:49.995385 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991981 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 22:29:49.995385 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991984 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 22:29:49.995385 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991987 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 22:29:49.995385 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991992 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 22:29:49.995385 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991994 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 22:29:49.995385 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991997 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 22:29:49.995385 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.991999 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 22:29:49.995385 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992002 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 22:29:49.995385 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992004 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 22:29:49.995873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992006 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 22:29:49.995873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992009 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 22:29:49.995873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992011 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 22:29:49.995873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992014 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 22:29:49.995873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992016 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 22:29:49.995873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992019 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 22:29:49.995873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992021 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 22:29:49.995873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992024 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 22:29:49.995873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992026 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 22:29:49.995873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992028 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 22:29:49.995873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992031 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 22:29:49.995873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992033 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 22:29:49.995873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992036 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 22:29:49.995873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992038 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 22:29:49.995873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992040 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 22:29:49.995873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992043 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 22:29:49.995873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992045 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 22:29:49.995873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992047 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 22:29:49.995873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992050 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 22:29:49.995873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992052 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 22:29:49.996363 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992055 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 22:29:49.996363 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992057 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 22:29:49.996363 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992059 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 22:29:49.996363 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992062 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 22:29:49.996363 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992064 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 22:29:49.996363 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992067 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 22:29:49.996363 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992071 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 22:29:49.996363 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992078 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 22:29:49.996363 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992083 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 22:29:49.996363 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992086 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 22:29:49.996363 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992089 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 22:29:49.996363 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992092 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 22:29:49.996363 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992094 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 22:29:49.996363 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992097 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 22:29:49.996363 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992099 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 22:29:49.996363 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992102 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 22:29:49.996363 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992105 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 22:29:49.996363 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992107 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 22:29:49.996363 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992110 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 22:29:49.996850 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992113 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 22:29:49.996850 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992115 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 22:29:49.996850 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992118 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 22:29:49.996850 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992120 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 22:29:49.996850 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992123 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 22:29:49.996850 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992126 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 22:29:49.996850 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992128 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 22:29:49.996850 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992130 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 22:29:49.996850 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992133 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 22:29:49.996850 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992135 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 22:29:49.996850 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992138 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 22:29:49.996850 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992140 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 22:29:49.996850 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992142 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 22:29:49.996850 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992145 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 22:29:49.996850 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992147 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 22:29:49.996850 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992149 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 22:29:49.996850 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992153 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 22:29:49.996850 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992156 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 22:29:49.996850 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992158 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 22:29:49.996850 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992162 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 22:29:49.997320 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992164 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 22:29:49.997320 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992176 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 22:29:49.997320 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992179 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 22:29:49.997320 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992182 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 22:29:49.997320 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992184 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 22:29:49.997320 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992187 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 22:29:49.997320 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992189 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 22:29:49.997320 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992191 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 22:29:49.997320 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992194 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 22:29:49.997320 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992196 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 22:29:49.997320 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992199 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 22:29:49.997320 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992202 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 22:29:49.997320 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992206 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 22:29:49.997320 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992209 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 22:29:49.997320 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992213 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 22:29:49.997320 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992216 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 22:29:49.997320 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992218 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 22:29:49.997320 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992221 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 22:29:49.997320 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992288 2573 flags.go:64] FLAG: --address="0.0.0.0" Jul 08 22:29:49.997320 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992295 2573 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992311 2573 flags.go:64] FLAG: --anonymous-auth="true" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992315 2573 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992319 2573 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992322 2573 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992326 2573 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992330 2573 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992332 2573 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992335 2573 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992340 2573 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992343 2573 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992346 2573 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992350 2573 flags.go:64] FLAG: --cgroup-root="" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992353 2573 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992356 2573 flags.go:64] FLAG: --client-ca-file="" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992366 2573 flags.go:64] FLAG: --cloud-provider="external" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992369 2573 flags.go:64] FLAG: --cluster-dns="[]" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992375 2573 flags.go:64] FLAG: --cluster-domain="" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992378 2573 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992381 2573 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992384 2573 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992387 2573 flags.go:64] FLAG: --container-log-max-files="5" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992390 2573 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 08 22:29:49.997818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992393 2573 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992396 2573 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992399 2573 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992401 2573 flags.go:64] FLAG: --contention-profiling="false" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992404 2573 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992407 2573 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992410 2573 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992412 2573 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992416 2573 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992419 2573 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992422 2573 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992425 2573 flags.go:64] FLAG: --enable-load-reader="false" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992428 2573 flags.go:64] FLAG: --enable-server="true" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992430 2573 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992436 2573 flags.go:64] FLAG: --event-burst="100" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992439 2573 flags.go:64] FLAG: --event-qps="50" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992442 2573 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992445 2573 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992449 2573 flags.go:64] FLAG: --eviction-hard="" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992452 2573 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992455 2573 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992460 2573 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992463 2573 flags.go:64] FLAG: --eviction-soft="" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992465 2573 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992468 2573 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 08 22:29:49.998385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992471 2573 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992474 2573 flags.go:64] FLAG: --experimental-mounter-path="" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992476 2573 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992479 2573 flags.go:64] FLAG: --fail-swap-on="true" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992482 2573 flags.go:64] FLAG: --feature-gates="" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992489 2573 flags.go:64] FLAG: --file-check-frequency="20s" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992492 2573 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992495 2573 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992498 2573 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992501 2573 flags.go:64] FLAG: --healthz-port="10248" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992504 2573 flags.go:64] FLAG: --help="false" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992506 2573 flags.go:64] FLAG: --hostname-override="ip-10-0-131-200.ec2.internal" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992509 2573 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992512 2573 flags.go:64] FLAG: --http-check-frequency="20s" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992514 2573 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992517 2573 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992520 2573 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992523 2573 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992526 2573 flags.go:64] FLAG: --image-service-endpoint="" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992528 2573 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992531 2573 flags.go:64] FLAG: --kube-api-burst="100" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992533 2573 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992536 2573 flags.go:64] FLAG: --kube-api-qps="50" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992539 2573 flags.go:64] FLAG: --kube-reserved="" Jul 08 22:29:49.999014 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992541 2573 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992545 2573 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992548 2573 flags.go:64] FLAG: --kubelet-cgroups="" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992564 2573 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992569 2573 flags.go:64] FLAG: --lock-file="" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992571 2573 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992574 2573 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992577 2573 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992582 2573 flags.go:64] FLAG: --log-json-split-stream="false" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992585 2573 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992588 2573 flags.go:64] FLAG: --log-text-split-stream="false" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992591 2573 flags.go:64] FLAG: --logging-format="text" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992593 2573 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992596 2573 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992599 2573 flags.go:64] FLAG: --manifest-url="" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992602 2573 flags.go:64] FLAG: --manifest-url-header="" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992606 2573 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992609 2573 flags.go:64] FLAG: --max-open-files="1000000" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992612 2573 flags.go:64] FLAG: --max-pods="110" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992615 2573 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992618 2573 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992620 2573 flags.go:64] FLAG: --memory-manager-policy="None" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992623 2573 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992626 2573 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992629 2573 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 08 22:29:49.999606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992631 2573 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992638 2573 flags.go:64] FLAG: --node-status-max-images="50" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992641 2573 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992644 2573 flags.go:64] FLAG: --oom-score-adj="-999" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992647 2573 flags.go:64] FLAG: --pod-cidr="" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992649 2573 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:ce93f6b4197b9c62a26a3131f8057ffe9c9379c5079a4f62e5919b75151394e5" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992655 2573 flags.go:64] FLAG: --pod-manifest-path="" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992657 2573 flags.go:64] FLAG: --pod-max-pids="-1" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992662 2573 flags.go:64] FLAG: --pods-per-core="0" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992665 2573 flags.go:64] FLAG: --port="10250" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992668 2573 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992671 2573 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06474a57ef3026de3" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992675 2573 flags.go:64] FLAG: --qos-reserved="" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992678 2573 flags.go:64] FLAG: --read-only-port="10255" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992681 2573 flags.go:64] FLAG: --register-node="true" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992683 2573 flags.go:64] FLAG: --register-with-taints="" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992693 2573 flags.go:64] FLAG: --registry-burst="10" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992707 2573 flags.go:64] FLAG: --registry-qps="5" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992710 2573 flags.go:64] FLAG: --reserved-cpus="" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992712 2573 flags.go:64] FLAG: --reserved-memory="" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992716 2573 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992719 2573 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992722 2573 flags.go:64] FLAG: --rotate-certificates="false" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992724 2573 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992727 2573 flags.go:64] FLAG: --runonce="false" Jul 08 22:29:50.000580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992730 2573 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992733 2573 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992735 2573 flags.go:64] FLAG: --seccomp-default="false" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992738 2573 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992740 2573 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992743 2573 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992746 2573 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992749 2573 flags.go:64] FLAG: --storage-driver-password="root" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992751 2573 flags.go:64] FLAG: --storage-driver-secure="false" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992754 2573 flags.go:64] FLAG: --storage-driver-table="stats" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992757 2573 flags.go:64] FLAG: --storage-driver-user="root" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992759 2573 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992762 2573 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992765 2573 flags.go:64] FLAG: --system-cgroups="" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992767 2573 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992774 2573 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992776 2573 flags.go:64] FLAG: --tls-cert-file="" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992779 2573 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992783 2573 flags.go:64] FLAG: --tls-min-version="" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992786 2573 flags.go:64] FLAG: --tls-private-key-file="" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992789 2573 flags.go:64] FLAG: --topology-manager-policy="none" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992792 2573 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992794 2573 flags.go:64] FLAG: --topology-manager-scope="container" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992797 2573 flags.go:64] FLAG: --v="2" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992801 2573 flags.go:64] FLAG: --version="false" Jul 08 22:29:50.001731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992810 2573 flags.go:64] FLAG: --vmodule="" Jul 08 22:29:50.002830 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992814 2573 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 08 22:29:50.002830 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.992817 2573 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 08 22:29:50.002830 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992937 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 22:29:50.002830 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992941 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 22:29:50.002830 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992944 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 22:29:50.002830 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992947 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 22:29:50.002830 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992950 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 22:29:50.002830 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992953 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 22:29:50.002830 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992957 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 22:29:50.002830 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992960 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 22:29:50.002830 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992964 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 22:29:50.002830 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992967 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 22:29:50.002830 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992970 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 22:29:50.002830 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992972 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 22:29:50.002830 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992975 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 22:29:50.002830 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992977 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 22:29:50.002830 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992980 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 22:29:50.002830 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992982 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 22:29:50.002830 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992984 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 22:29:50.002830 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992987 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 22:29:50.003668 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992989 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 22:29:50.003668 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992993 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 22:29:50.003668 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992996 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 22:29:50.003668 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.992998 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 22:29:50.003668 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993001 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 22:29:50.003668 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993004 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 22:29:50.003668 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993007 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 22:29:50.003668 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993011 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 22:29:50.003668 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993015 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 22:29:50.003668 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993018 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 22:29:50.003668 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993020 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 22:29:50.003668 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993023 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 22:29:50.003668 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993027 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 22:29:50.003668 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993031 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 22:29:50.003668 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993033 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 22:29:50.003668 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993036 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 22:29:50.003668 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993038 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 22:29:50.003668 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993041 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 22:29:50.003668 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993043 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 22:29:50.003668 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993045 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 22:29:50.004263 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993049 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 22:29:50.004263 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993052 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 22:29:50.004263 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993055 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 22:29:50.004263 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993058 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 22:29:50.004263 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993061 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 22:29:50.004263 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993063 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 22:29:50.004263 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993066 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 22:29:50.004263 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993068 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 22:29:50.004263 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993071 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 22:29:50.004263 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993074 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 22:29:50.004263 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993076 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 22:29:50.004263 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993079 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 22:29:50.004263 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993081 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 22:29:50.004263 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993085 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 08 22:29:50.004263 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993087 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 22:29:50.004263 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993090 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 22:29:50.004263 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993092 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 22:29:50.004263 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993096 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 22:29:50.004263 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993099 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 22:29:50.005150 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993101 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 22:29:50.005150 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993104 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 22:29:50.005150 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993106 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 22:29:50.005150 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993109 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 22:29:50.005150 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993111 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 22:29:50.005150 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993114 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 22:29:50.005150 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993117 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 22:29:50.005150 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993119 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 22:29:50.005150 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993122 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 22:29:50.005150 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993124 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 22:29:50.005150 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993127 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 22:29:50.005150 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993129 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 22:29:50.005150 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993132 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 22:29:50.005150 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993135 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 22:29:50.005150 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993137 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 22:29:50.005150 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993140 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 22:29:50.005150 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993142 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 22:29:50.005150 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993145 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 22:29:50.005150 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993147 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 22:29:50.005150 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993150 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 22:29:50.005789 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993152 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 22:29:50.005789 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993155 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 22:29:50.005789 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993157 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 22:29:50.005789 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993159 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 22:29:50.005789 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993162 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 22:29:50.005789 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993164 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 22:29:50.005789 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993168 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 22:29:50.005789 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993171 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 22:29:50.005789 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993173 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 22:29:50.005789 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993175 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 22:29:50.005789 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993180 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 22:29:50.005789 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993183 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 22:29:50.005789 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993185 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 22:29:50.005789 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993188 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 22:29:50.005789 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993190 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 22:29:50.005789 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993193 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 22:29:50.005789 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993195 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 22:29:50.005789 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993198 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 22:29:50.005789 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993200 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 22:29:50.005789 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993203 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 22:29:50.006287 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993206 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 22:29:50.006287 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:49.993208 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 22:29:50.006287 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:49.993903 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 22:29:50.006287 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.001989 2573 server.go:529] "Kubelet version" kubeletVersion="v1.34.8" Jul 08 22:29:50.006287 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.002009 2573 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 08 22:29:50.006287 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.002040 2573 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 08 22:29:50.006287 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.002050 2573 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 08 22:29:50.006287 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002134 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 22:29:50.006287 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002143 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 22:29:50.006287 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002148 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 22:29:50.006287 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002153 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 22:29:50.006287 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002158 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 22:29:50.006287 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002162 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 22:29:50.006287 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002166 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 22:29:50.006748 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002170 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 22:29:50.006748 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002174 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 22:29:50.006748 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002178 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 22:29:50.006748 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002183 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 22:29:50.006748 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002187 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 22:29:50.006748 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002191 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 22:29:50.006748 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002195 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 22:29:50.006748 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002199 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 22:29:50.006748 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002204 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 22:29:50.006748 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002207 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 22:29:50.006748 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002211 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 22:29:50.006748 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002215 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 22:29:50.006748 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002220 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 22:29:50.006748 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002224 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 22:29:50.006748 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002228 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 22:29:50.006748 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002232 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 22:29:50.006748 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002238 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 22:29:50.006748 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002244 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 22:29:50.006748 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002248 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 22:29:50.007284 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002252 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 22:29:50.007284 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002256 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 22:29:50.007284 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002261 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 22:29:50.007284 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002267 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 22:29:50.007284 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002272 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 22:29:50.007284 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002276 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 22:29:50.007284 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002280 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 22:29:50.007284 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002284 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 22:29:50.007284 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002288 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 22:29:50.007284 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002292 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 22:29:50.007284 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002296 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 22:29:50.007284 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002300 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 22:29:50.007284 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002304 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 22:29:50.007284 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002308 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 22:29:50.007284 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002312 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 22:29:50.007284 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002316 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 22:29:50.007284 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002320 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 22:29:50.007284 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002324 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 22:29:50.007284 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002328 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 22:29:50.007284 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002332 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 22:29:50.007840 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002336 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 22:29:50.007840 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002340 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 22:29:50.007840 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002344 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 22:29:50.007840 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002348 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 22:29:50.007840 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002352 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 22:29:50.007840 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002357 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 22:29:50.007840 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002361 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 22:29:50.007840 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002366 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 22:29:50.007840 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002369 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 22:29:50.007840 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002373 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 22:29:50.007840 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002377 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 22:29:50.007840 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002381 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 22:29:50.007840 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002385 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 22:29:50.007840 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002389 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 22:29:50.007840 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002393 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 22:29:50.007840 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002398 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 22:29:50.007840 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002403 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 22:29:50.007840 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002408 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 22:29:50.007840 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002412 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 22:29:50.007840 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002416 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 22:29:50.008342 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002422 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 22:29:50.008342 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002427 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 22:29:50.008342 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002432 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 22:29:50.008342 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002436 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 22:29:50.008342 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002441 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 22:29:50.008342 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002445 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 08 22:29:50.008342 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002449 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 22:29:50.008342 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002453 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 22:29:50.008342 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002457 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 22:29:50.008342 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002462 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 22:29:50.008342 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002465 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 22:29:50.008342 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002470 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 22:29:50.008342 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002473 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 22:29:50.008342 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002478 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 22:29:50.008342 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002482 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 22:29:50.008342 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002486 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 22:29:50.008342 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002490 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 22:29:50.008342 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002494 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 22:29:50.008342 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002499 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 22:29:50.008940 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002503 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 22:29:50.008940 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002507 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 22:29:50.008940 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002513 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 22:29:50.008940 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002517 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 22:29:50.008940 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002521 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 22:29:50.008940 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002525 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 22:29:50.008940 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002530 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 22:29:50.008940 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002534 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 22:29:50.008940 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002538 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 22:29:50.008940 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002542 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 22:29:50.008940 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002547 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 22:29:50.008940 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002573 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 22:29:50.008940 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002579 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 22:29:50.008940 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002585 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 22:29:50.008940 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.002593 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 22:29:50.009305 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002776 2573 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 08 22:29:50.009305 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002785 2573 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 08 22:29:50.009305 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002790 2573 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 08 22:29:50.009305 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002794 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 08 22:29:50.009305 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002799 2573 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 08 22:29:50.009305 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002804 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 08 22:29:50.009305 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002808 2573 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 08 22:29:50.009305 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002813 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 08 22:29:50.009305 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002817 2573 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 08 22:29:50.009305 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002821 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 08 22:29:50.009305 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002825 2573 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 08 22:29:50.009305 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002829 2573 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 08 22:29:50.009305 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002832 2573 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 08 22:29:50.009305 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002836 2573 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 08 22:29:50.009305 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002839 2573 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 08 22:29:50.009305 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002843 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 08 22:29:50.009305 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002848 2573 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 08 22:29:50.009305 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002852 2573 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 08 22:29:50.009305 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002856 2573 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 08 22:29:50.009305 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002860 2573 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 08 22:29:50.009873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002864 2573 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 08 22:29:50.009873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002868 2573 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 08 22:29:50.009873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002872 2573 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 08 22:29:50.009873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002876 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 08 22:29:50.009873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002880 2573 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 08 22:29:50.009873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002884 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 08 22:29:50.009873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002888 2573 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 08 22:29:50.009873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002893 2573 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 08 22:29:50.009873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002901 2573 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 08 22:29:50.009873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002908 2573 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 08 22:29:50.009873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002913 2573 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 08 22:29:50.009873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002919 2573 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 08 22:29:50.009873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002924 2573 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 08 22:29:50.009873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002929 2573 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 08 22:29:50.009873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002934 2573 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 08 22:29:50.009873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002939 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 08 22:29:50.009873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002943 2573 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 08 22:29:50.009873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002947 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 08 22:29:50.009873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002951 2573 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 08 22:29:50.010327 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002955 2573 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 08 22:29:50.010327 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002959 2573 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 08 22:29:50.010327 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002963 2573 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 08 22:29:50.010327 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002967 2573 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 08 22:29:50.010327 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002971 2573 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 08 22:29:50.010327 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002975 2573 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 08 22:29:50.010327 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002979 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 08 22:29:50.010327 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002983 2573 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 08 22:29:50.010327 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002987 2573 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 08 22:29:50.010327 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002991 2573 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 08 22:29:50.010327 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002995 2573 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 08 22:29:50.010327 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.002999 2573 feature_gate.go:328] unrecognized feature gate: Example2 Jul 08 22:29:50.010327 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003003 2573 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 08 22:29:50.010327 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003008 2573 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 08 22:29:50.010327 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003012 2573 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 08 22:29:50.010327 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003016 2573 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 08 22:29:50.010327 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003020 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 08 22:29:50.010327 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003024 2573 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 08 22:29:50.010327 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003028 2573 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 08 22:29:50.010327 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003031 2573 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 08 22:29:50.010820 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003036 2573 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 08 22:29:50.010820 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003040 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 08 22:29:50.010820 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003045 2573 feature_gate.go:328] unrecognized feature gate: Example Jul 08 22:29:50.010820 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003048 2573 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 08 22:29:50.010820 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003052 2573 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 08 22:29:50.010820 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003055 2573 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 08 22:29:50.010820 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003059 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 08 22:29:50.010820 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003064 2573 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 08 22:29:50.010820 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003068 2573 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 08 22:29:50.010820 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003071 2573 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 08 22:29:50.010820 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003075 2573 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 08 22:29:50.010820 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003079 2573 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 08 22:29:50.010820 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003085 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 08 22:29:50.010820 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003089 2573 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 08 22:29:50.010820 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003095 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 08 22:29:50.010820 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003099 2573 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 08 22:29:50.010820 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003103 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 08 22:29:50.010820 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003107 2573 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 08 22:29:50.010820 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003111 2573 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 08 22:29:50.010820 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003115 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 08 22:29:50.011325 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003119 2573 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 08 22:29:50.011325 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003123 2573 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 08 22:29:50.011325 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003127 2573 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 08 22:29:50.011325 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003131 2573 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 08 22:29:50.011325 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003135 2573 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 08 22:29:50.011325 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003140 2573 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 08 22:29:50.011325 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003144 2573 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 08 22:29:50.011325 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003148 2573 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 08 22:29:50.011325 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003152 2573 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 08 22:29:50.011325 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003156 2573 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 08 22:29:50.011325 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003160 2573 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 08 22:29:50.011325 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003164 2573 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 08 22:29:50.011325 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003169 2573 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 08 22:29:50.011325 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003172 2573 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 08 22:29:50.011325 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003176 2573 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 08 22:29:50.011325 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003181 2573 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 08 22:29:50.011325 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003185 2573 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 08 22:29:50.011325 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003190 2573 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 08 22:29:50.011325 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003193 2573 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 08 22:29:50.011325 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:50.003199 2573 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 08 22:29:50.011828 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.003208 2573 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 08 22:29:50.011828 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.003365 2573 server.go:962] "Client rotation is on, will bootstrap in background" Jul 08 22:29:50.011828 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.007179 2573 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 08 22:29:50.011828 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.008792 2573 server.go:1019] "Starting client certificate rotation" Jul 08 22:29:50.011828 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.008898 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 22:29:50.011828 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.008936 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 08 22:29:50.012410 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.012393 2573 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 22:29:50.017810 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.017787 2573 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 08 22:29:50.027105 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.027087 2573 log.go:25] "Validated CRI v1 runtime API" Jul 08 22:29:50.029619 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.029605 2573 log.go:25] "Validated CRI v1 image API" Jul 08 22:29:50.030361 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.030348 2573 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 08 22:29:50.032975 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.032953 2573 fs.go:135] Filesystem UUIDs: map[2a6a5f95-88f8-4acf-98db-e624fba42921:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2 cd6176f3-dc9b-40e9-85bf-0c14a39eee3a:/dev/nvme0n1p3] Jul 08 22:29:50.033048 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.032973 2573 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 08 22:29:50.038215 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.038103 2573 manager.go:216] Machine: {Timestamp:2026-07-08 22:29:50.036581593 +0000 UTC m=+0.375288557 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100229 MemoryCapacity:32812179456 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2b6e45eaee93e6eaae3c26a2bf2155 SystemUUID:ec2b6e45-eaee-93e6-eaae-3c26a2bf2155 BootID:b7b4b55a-cd47-4833-8f4c-bb1ed67db921 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406089728 Type:vfs Inodes:4005393 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562439168 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406089728 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:8a:d0:4c:b5:41 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:8a:d0:4c:b5:41 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:b6:7b:7e:ef:36:f1 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812179456 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 08 22:29:50.038215 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.038204 2573 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 08 22:29:50.038331 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.038281 2573 manager.go:232] Version: {KernelVersion:5.14.0-570.125.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260630-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 08 22:29:50.040638 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.040619 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 22:29:50.041837 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.041810 2573 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 08 22:29:50.041983 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.041842 2573 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-131-200.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 08 22:29:50.042823 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.042812 2573 topology_manager.go:138] "Creating topology manager with none policy" Jul 08 22:29:50.042862 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.042825 2573 container_manager_linux.go:309] "Creating device plugin manager" Jul 08 22:29:50.042862 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.042834 2573 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 22:29:50.043638 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.043628 2573 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 08 22:29:50.045437 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.045427 2573 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 08 22:29:50.049073 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.049061 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 08 22:29:50.049388 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.049377 2573 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 08 22:29:50.049422 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.049410 2573 kubelet.go:486] "Attempting to sync node with API server" Jul 08 22:29:50.049422 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.049421 2573 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 08 22:29:50.049475 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.049432 2573 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 08 22:29:50.049475 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.049443 2573 kubelet.go:398] "Adding apiserver pod source" Jul 08 22:29:50.049475 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.049453 2573 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 08 22:29:50.049822 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.049811 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 22:29:50.049866 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.049830 2573 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 08 22:29:50.052936 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.052157 2573 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.8-3.rhaos4.21.git91b4b0b.el9" apiVersion="v1" Jul 08 22:29:50.053891 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.053878 2573 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 08 22:29:50.053931 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.053909 2573 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 08 22:29:50.055849 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.055838 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 08 22:29:50.055884 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.055854 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 08 22:29:50.055884 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.055860 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 08 22:29:50.055884 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.055865 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 08 22:29:50.055884 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.055874 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 08 22:29:50.055884 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.055879 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 08 22:29:50.055884 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.055887 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 08 22:29:50.056038 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.055893 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 08 22:29:50.056038 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.055900 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 08 22:29:50.056038 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.055906 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 08 22:29:50.056038 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.055915 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 08 22:29:50.056038 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.055920 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 08 22:29:50.056750 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.056741 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 08 22:29:50.056817 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.056752 2573 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 08 22:29:50.062590 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.062543 2573 server.go:1268] "Started kubelet" Jul 08 22:29:50.062708 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.062668 2573 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 08 22:29:50.063305 ip-10-0-131-200 systemd[1]: Started Kubernetes Kubelet. Jul 08 22:29:50.063441 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.063286 2573 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 08 22:29:50.063441 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.063379 2573 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 08 22:29:50.064661 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.064642 2573 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-131-200.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 08 22:29:50.064835 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.064815 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 08 22:29:50.064894 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.064845 2573 server.go:310] "Adding debug handlers to kubelet server" Jul 08 22:29:50.064894 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.064881 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-131-200.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 08 22:29:50.064982 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.064968 2573 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 08 22:29:50.068984 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.068966 2573 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 08 22:29:50.073041 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.073016 2573 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 08 22:29:50.073041 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.073028 2573 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 08 22:29:50.073188 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.073088 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found" Jul 08 22:29:50.073745 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.073726 2573 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 08 22:29:50.073745 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.073748 2573 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 08 22:29:50.073889 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.073726 2573 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 08 22:29:50.073889 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.073873 2573 reconstruct.go:97] "Volume reconstruction finished" Jul 08 22:29:50.073889 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.073883 2573 reconciler.go:29] "Reconciler: start to sync state" Jul 08 22:29:50.074130 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.074110 2573 factory.go:55] Registering systemd factory Jul 08 22:29:50.074130 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.074130 2573 factory.go:223] Registration of the systemd container factory successfully Jul 08 22:29:50.074324 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.074311 2573 factory.go:153] Registering CRI-O factory Jul 08 22:29:50.074324 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.074325 2573 factory.go:223] Registration of the crio container factory successfully Jul 08 22:29:50.074427 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.074373 2573 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 08 22:29:50.074427 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.074392 2573 factory.go:103] Registering Raw factory Jul 08 22:29:50.074427 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.074402 2573 manager.go:1196] Started watching for new ooms in manager Jul 08 22:29:50.075429 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.075412 2573 manager.go:349] Starting recovery of all containers Jul 08 22:29:50.077080 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.077057 2573 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-131-200.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 08 22:29:50.077159 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.077081 2573 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 08 22:29:50.078330 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.077203 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-200.ec2.internal.18c071159be5ea9e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-200.ec2.internal,UID:ip-10-0-131-200.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-131-200.ec2.internal,},FirstTimestamp:2026-07-08 22:29:50.062504606 +0000 UTC m=+0.401211569,LastTimestamp:2026-07-08 22:29:50.062504606 +0000 UTC m=+0.401211569,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-200.ec2.internal,}" Jul 08 22:29:50.084976 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.084794 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sztwl" Jul 08 22:29:50.087736 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.087714 2573 manager.go:354] Recovery completed Jul 08 22:29:50.091649 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.091630 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-sztwl" Jul 08 22:29:50.092730 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.092715 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 22:29:50.094594 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.094543 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientMemory" Jul 08 22:29:50.094594 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.094591 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 22:29:50.094717 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.094612 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientPID" Jul 08 22:29:50.095205 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.095185 2573 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 08 22:29:50.095205 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.095197 2573 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 08 22:29:50.095320 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.095210 2573 state_mem.go:36] "Initialized new in-memory state store" Jul 08 22:29:50.095320 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.095240 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 22:29:50.095939 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.095923 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientMemory" Jul 08 22:29:50.096007 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.095952 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 22:29:50.096007 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.095967 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientPID" Jul 08 22:29:50.096138 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.096123 2573 policy_none.go:49] "None policy: Start" Jul 08 22:29:50.096191 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.096143 2573 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 08 22:29:50.096191 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.096158 2573 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 08 22:29:50.096415 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.096352 2573 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-131-200.ec2.internal.18c071159dcf43cb default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-131-200.ec2.internal,UID:ip-10-0-131-200.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-131-200.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-131-200.ec2.internal,},FirstTimestamp:2026-07-08 22:29:50.094574539 +0000 UTC m=+0.433281506,LastTimestamp:2026-07-08 22:29:50.094574539 +0000 UTC m=+0.433281506,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-131-200.ec2.internal,}" Jul 08 22:29:50.097000 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.096988 2573 policy_none.go:47] "Start" Jul 08 22:29:50.151146 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.138094 2573 manager.go:337] "Starting Device Plugin manager" Jul 08 22:29:50.151146 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.138124 2573 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 08 22:29:50.151146 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.138134 2573 server.go:87] "Starting device plugin registration server" Jul 08 22:29:50.151146 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.138374 2573 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 08 22:29:50.151146 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.138384 2573 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 08 22:29:50.151146 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.138479 2573 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 08 22:29:50.151146 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.138544 2573 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 08 22:29:50.151146 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.138572 2573 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 08 22:29:50.151146 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.139109 2573 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 08 22:29:50.151146 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.139157 2573 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-131-200.ec2.internal\" not found" Jul 08 22:29:50.174629 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.174605 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 08 22:29:50.175932 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.175914 2573 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 08 22:29:50.176040 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.175958 2573 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 08 22:29:50.176040 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.175979 2573 kubelet.go:2448] "Starting kubelet main sync loop" Jul 08 22:29:50.176040 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.176010 2573 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 08 22:29:50.178102 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.178083 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 22:29:50.239298 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.239207 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 22:29:50.240389 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.240373 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientMemory" Jul 08 22:29:50.240468 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.240408 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 22:29:50.240468 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.240423 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientPID" Jul 08 22:29:50.240468 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.240450 2573 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-131-200.ec2.internal" Jul 08 22:29:50.249880 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.249865 2573 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-131-200.ec2.internal" Jul 08 22:29:50.249934 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.249889 2573 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-131-200.ec2.internal\": node \"ip-10-0-131-200.ec2.internal\" not found" Jul 08 22:29:50.272026 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.272008 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found" Jul 08 22:29:50.276260 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.276229 2573 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-131-200.ec2.internal"] Jul 08 22:29:50.276359 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.276301 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 22:29:50.277717 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.277699 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientMemory" Jul 08 22:29:50.277790 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.277737 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 22:29:50.277790 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.277751 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientPID" Jul 08 22:29:50.280027 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.280015 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 22:29:50.280157 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.280131 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal" Jul 08 22:29:50.280192 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.280174 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 22:29:50.280681 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.280665 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientMemory" Jul 08 22:29:50.280775 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.280701 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 22:29:50.280775 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.280714 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientPID" Jul 08 22:29:50.280775 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.280746 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientMemory" Jul 08 22:29:50.280775 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.280773 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 22:29:50.280910 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.280790 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientPID" Jul 08 22:29:50.282946 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.282929 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-200.ec2.internal" Jul 08 22:29:50.283007 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.282965 2573 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 08 22:29:50.283621 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.283606 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientMemory" Jul 08 22:29:50.283705 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.283636 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasNoDiskPressure" Jul 08 22:29:50.283705 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.283651 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeHasSufficientPID" Jul 08 22:29:50.311179 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.311161 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-200.ec2.internal\" not found" node="ip-10-0-131-200.ec2.internal" Jul 08 22:29:50.315595 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.315579 2573 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-131-200.ec2.internal\" not found" node="ip-10-0-131-200.ec2.internal" Jul 08 22:29:50.372135 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.372096 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found" Jul 08 22:29:50.375396 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.375374 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20a2b64c52acbf1e12a73711c6a93783-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal\" (UID: \"20a2b64c52acbf1e12a73711c6a93783\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal" Jul 08 22:29:50.375491 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.375407 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20a2b64c52acbf1e12a73711c6a93783-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal\" (UID: \"20a2b64c52acbf1e12a73711c6a93783\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal" Jul 08 22:29:50.375491 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.375425 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b88aa8db4d51f2f1daa8b6c561a11e94-config\") pod \"kube-apiserver-proxy-ip-10-0-131-200.ec2.internal\" (UID: \"b88aa8db4d51f2f1daa8b6c561a11e94\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-200.ec2.internal" Jul 08 22:29:50.472605 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.472541 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found" Jul 08 22:29:50.475856 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.475836 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b88aa8db4d51f2f1daa8b6c561a11e94-config\") pod \"kube-apiserver-proxy-ip-10-0-131-200.ec2.internal\" (UID: \"b88aa8db4d51f2f1daa8b6c561a11e94\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-200.ec2.internal" Jul 08 22:29:50.475949 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.475868 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20a2b64c52acbf1e12a73711c6a93783-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal\" (UID: \"20a2b64c52acbf1e12a73711c6a93783\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal" Jul 08 22:29:50.475949 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.475891 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20a2b64c52acbf1e12a73711c6a93783-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal\" (UID: \"20a2b64c52acbf1e12a73711c6a93783\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal" Jul 08 22:29:50.475949 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.475926 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/20a2b64c52acbf1e12a73711c6a93783-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal\" (UID: \"20a2b64c52acbf1e12a73711c6a93783\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal" Jul 08 22:29:50.475949 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.475937 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/b88aa8db4d51f2f1daa8b6c561a11e94-config\") pod \"kube-apiserver-proxy-ip-10-0-131-200.ec2.internal\" (UID: \"b88aa8db4d51f2f1daa8b6c561a11e94\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-131-200.ec2.internal" Jul 08 22:29:50.476084 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.475946 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/20a2b64c52acbf1e12a73711c6a93783-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal\" (UID: \"20a2b64c52acbf1e12a73711c6a93783\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal" Jul 08 22:29:50.573388 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.573292 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found" Jul 08 22:29:50.613658 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.613612 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal" Jul 08 22:29:50.619081 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:50.618803 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-200.ec2.internal" Jul 08 22:29:50.674456 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.674420 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found" Jul 08 22:29:50.774850 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.774822 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found" Jul 08 22:29:50.875381 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.875309 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found" Jul 08 22:29:50.975876 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:50.975844 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found" Jul 08 22:29:51.008151 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:51.008122 2573 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 08 22:29:51.008769 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:51.008300 2573 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 08 22:29:51.076585 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:51.076544 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found" Jul 08 22:29:51.093718 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:51.093684 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-07 22:24:50 +0000 UTC" deadline="2028-03-13 22:04:40.180384483 +0000 UTC" Jul 08 22:29:51.093718 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:51.093712 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14735h34m49.08667525s" Jul 08 22:29:51.177115 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:51.177058 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found" Jul 08 22:29:51.277823 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:51.277789 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found" Jul 08 22:29:51.319031 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:51.318988 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb88aa8db4d51f2f1daa8b6c561a11e94.slice/crio-ae1a3e8fcb84e67c65c7d798c360e5d6f8ec7c933fb25dbb2c35c2c7397be184 WatchSource:0}: Error finding container ae1a3e8fcb84e67c65c7d798c360e5d6f8ec7c933fb25dbb2c35c2c7397be184: Status 404 returned error can't find the container with id ae1a3e8fcb84e67c65c7d798c360e5d6f8ec7c933fb25dbb2c35c2c7397be184 Jul 08 22:29:51.319247 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:51.319221 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20a2b64c52acbf1e12a73711c6a93783.slice/crio-b439284a9f4a19ff92f96a34de637da2f22b8902741c68d9dea9433a8b4dff04 WatchSource:0}: Error finding container b439284a9f4a19ff92f96a34de637da2f22b8902741c68d9dea9433a8b4dff04: Status 404 returned error can't find the container with id b439284a9f4a19ff92f96a34de637da2f22b8902741c68d9dea9433a8b4dff04 Jul 08 22:29:51.323242 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:51.323229 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 22:29:51.378038 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:51.377998 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found" Jul 08 22:29:51.478649 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:51.478586 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found" Jul 08 22:29:51.564656 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:51.564633 2573 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 22:29:51.578995 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:51.578971 2573 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-131-200.ec2.internal\" not found" Jul 08 22:29:51.598515 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:51.598491 2573 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 22:29:51.631010 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:51.630988 2573 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 22:29:51.673942 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:51.673911 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal" Jul 08 22:29:51.689485 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:51.689458 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 22:29:51.690460 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:51.690447 2573 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-200.ec2.internal" Jul 08 22:29:51.697117 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:51.697096 2573 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 08 22:29:52.050705 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.050659 2573 apiserver.go:52] "Watching apiserver" Jul 08 22:29:52.059491 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.059464 2573 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 08 22:29:52.060853 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.060824 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-2t2gl","openshift-network-diagnostics/network-check-target-pts6q","openshift-network-operator/iptables-alerter-kfjcx","kube-system/konnectivity-agent-j9nc8","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq","openshift-dns/node-resolver-pn7b8","openshift-image-registry/node-ca-rm7kj","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal","openshift-ovn-kubernetes/ovnkube-node-wsj6p","kube-system/global-pull-secret-syncer-58csw","kube-system/kube-apiserver-proxy-ip-10-0-131-200.ec2.internal","openshift-cluster-node-tuning-operator/tuned-qqltd","openshift-multus/multus-8pfgv","openshift-multus/multus-additional-cni-plugins-mtwhq"] Jul 08 22:29:52.063981 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.063633 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kfjcx" Jul 08 22:29:52.065905 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.065876 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pn7b8" Jul 08 22:29:52.066472 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.066456 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 08 22:29:52.066666 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.066652 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-pqnhb\"" Jul 08 22:29:52.066823 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.066806 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 08 22:29:52.066962 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.066954 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 08 22:29:52.069053 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.068134 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rm7kj" Jul 08 22:29:52.069724 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.069492 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-28rqv\"" Jul 08 22:29:52.069724 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.069540 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 08 22:29:52.069861 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.069784 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 08 22:29:52.070317 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.070297 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 08 22:29:52.071026 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.070686 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-vqd5q\"" Jul 08 22:29:52.071026 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.070706 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 08 22:29:52.071026 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.070689 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j9nc8" Jul 08 22:29:52.071198 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.071177 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 08 22:29:52.073686 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.072849 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-m5gp6\"" Jul 08 22:29:52.073686 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.073133 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 08 22:29:52.073686 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.073315 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 08 22:29:52.073686 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.073573 2573 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 08 22:29:52.075271 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.074754 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.076822 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.076799 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:29:52.076900 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:52.076879 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pts6q" podUID="e46b9a2f-6200-4556-9b64-ddc55dc0be5e" Jul 08 22:29:52.076968 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.076922 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 08 22:29:52.077159 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.077136 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 08 22:29:52.077435 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.077419 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 08 22:29:52.077927 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.077904 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-8clrf\"" Jul 08 22:29:52.079623 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.079605 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:29:52.079697 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:52.079677 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2gl" podUID="83988472-fc5e-4e4a-a7ab-248bd26e4a48" Jul 08 22:29:52.081977 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.081956 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.083100 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.083069 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jrm6n\" (UniqueName: \"kubernetes.io/projected/901cfe25-d655-4c55-8eda-68305dc9b179-kube-api-access-jrm6n\") pod \"iptables-alerter-kfjcx\" (UID: \"901cfe25-d655-4c55-8eda-68305dc9b179\") " pod="openshift-network-operator/iptables-alerter-kfjcx" Jul 08 22:29:52.083228 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.083104 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5aaf8eb4-8a4e-43e1-a844-2226f1ca100b-host\") pod \"node-ca-rm7kj\" (UID: \"5aaf8eb4-8a4e-43e1-a844-2226f1ca100b\") " pod="openshift-image-registry/node-ca-rm7kj" Jul 08 22:29:52.083228 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.083128 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5aaf8eb4-8a4e-43e1-a844-2226f1ca100b-serviceca\") pod \"node-ca-rm7kj\" (UID: \"5aaf8eb4-8a4e-43e1-a844-2226f1ca100b\") " pod="openshift-image-registry/node-ca-rm7kj" Jul 08 22:29:52.083228 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.083143 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kwmbc\" (UniqueName: \"kubernetes.io/projected/5aaf8eb4-8a4e-43e1-a844-2226f1ca100b-kube-api-access-kwmbc\") pod \"node-ca-rm7kj\" (UID: \"5aaf8eb4-8a4e-43e1-a844-2226f1ca100b\") " pod="openshift-image-registry/node-ca-rm7kj" Jul 08 22:29:52.083228 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.083163 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/901cfe25-d655-4c55-8eda-68305dc9b179-iptables-alerter-script\") pod \"iptables-alerter-kfjcx\" (UID: \"901cfe25-d655-4c55-8eda-68305dc9b179\") " pod="openshift-network-operator/iptables-alerter-kfjcx" Jul 08 22:29:52.083228 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.083177 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/901cfe25-d655-4c55-8eda-68305dc9b179-host-slash\") pod \"iptables-alerter-kfjcx\" (UID: \"901cfe25-d655-4c55-8eda-68305dc9b179\") " pod="openshift-network-operator/iptables-alerter-kfjcx" Jul 08 22:29:52.083228 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.083197 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5pfpt\" (UniqueName: \"kubernetes.io/projected/6863dfc5-3c16-42a7-93a6-dc36e4722c27-kube-api-access-5pfpt\") pod \"node-resolver-pn7b8\" (UID: \"6863dfc5-3c16-42a7-93a6-dc36e4722c27\") " pod="openshift-dns/node-resolver-pn7b8" Jul 08 22:29:52.083526 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.083254 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7ec2b7c-a8c1-402e-9166-6cfc487a0115-konnectivity-ca\") pod \"konnectivity-agent-j9nc8\" (UID: \"f7ec2b7c-a8c1-402e-9166-6cfc487a0115\") " pod="kube-system/konnectivity-agent-j9nc8" Jul 08 22:29:52.083526 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.083289 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3157419c-e9ba-48ef-a9f9-302b0aa3cc1a-etc-selinux\") pod \"aws-ebs-csi-driver-node-6dhlq\" (UID: \"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.083526 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.083312 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3157419c-e9ba-48ef-a9f9-302b0aa3cc1a-sys-fs\") pod \"aws-ebs-csi-driver-node-6dhlq\" (UID: \"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.083526 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.083328 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5wrc\" (UniqueName: \"kubernetes.io/projected/3157419c-e9ba-48ef-a9f9-302b0aa3cc1a-kube-api-access-l5wrc\") pod \"aws-ebs-csi-driver-node-6dhlq\" (UID: \"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.083526 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.083345 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6863dfc5-3c16-42a7-93a6-dc36e4722c27-tmp-dir\") pod \"node-resolver-pn7b8\" (UID: \"6863dfc5-3c16-42a7-93a6-dc36e4722c27\") " pod="openshift-dns/node-resolver-pn7b8" Jul 08 22:29:52.083526 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.083372 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3157419c-e9ba-48ef-a9f9-302b0aa3cc1a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6dhlq\" (UID: \"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.083526 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.083397 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3157419c-e9ba-48ef-a9f9-302b0aa3cc1a-socket-dir\") pod \"aws-ebs-csi-driver-node-6dhlq\" (UID: \"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.083526 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.083442 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6863dfc5-3c16-42a7-93a6-dc36e4722c27-hosts-file\") pod \"node-resolver-pn7b8\" (UID: \"6863dfc5-3c16-42a7-93a6-dc36e4722c27\") " pod="openshift-dns/node-resolver-pn7b8" Jul 08 22:29:52.083526 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.083486 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7ec2b7c-a8c1-402e-9166-6cfc487a0115-agent-certs\") pod \"konnectivity-agent-j9nc8\" (UID: \"f7ec2b7c-a8c1-402e-9166-6cfc487a0115\") " pod="kube-system/konnectivity-agent-j9nc8" Jul 08 22:29:52.083526 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.083522 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3157419c-e9ba-48ef-a9f9-302b0aa3cc1a-registration-dir\") pod \"aws-ebs-csi-driver-node-6dhlq\" (UID: \"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.084061 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.083573 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3157419c-e9ba-48ef-a9f9-302b0aa3cc1a-device-dir\") pod \"aws-ebs-csi-driver-node-6dhlq\" (UID: \"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.084337 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.084316 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:29:52.084433 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:52.084387 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58csw" podUID="98d1079e-ad90-4a60-bcaf-9005a7796b03" Jul 08 22:29:52.088771 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.088749 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 08 22:29:52.089250 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.089228 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-gx6mx\"" Jul 08 22:29:52.089545 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.089500 2573 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 08 22:29:52.090017 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.089993 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 08 22:29:52.090881 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.090861 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.090986 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.090968 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 08 22:29:52.091270 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.091256 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 08 22:29:52.091476 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.091461 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 08 22:29:52.091528 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.091517 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 08 22:29:52.093986 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.093625 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 08 22:29:52.093986 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.093650 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-hdfdx\"" Jul 08 22:29:52.093986 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.093858 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 08 22:29:52.094174 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.094063 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.096214 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.096196 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 08 22:29:52.096992 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.096969 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-bxv6m\"" Jul 08 22:29:52.097116 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.097099 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.097257 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.097240 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 08 22:29:52.097502 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.097484 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 08 22:29:52.097602 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.097514 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 08 22:29:52.100036 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.100013 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-bjp8c\"" Jul 08 22:29:52.100270 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.100254 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 08 22:29:52.100662 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.100646 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 08 22:29:52.104464 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.104446 2573 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-tzr48" Jul 08 22:29:52.112298 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.111812 2573 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-tzr48" Jul 08 22:29:52.175380 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.175355 2573 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 08 22:29:52.183766 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.183711 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal" event={"ID":"20a2b64c52acbf1e12a73711c6a93783","Type":"ContainerStarted","Data":"b439284a9f4a19ff92f96a34de637da2f22b8902741c68d9dea9433a8b4dff04"} Jul 08 22:29:52.183985 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.183966 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-etc-sysctl-d\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.184065 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184000 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-host-cni-bin\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.184065 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184058 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-system-cni-dir\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.184161 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184080 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7ec2b7c-a8c1-402e-9166-6cfc487a0115-konnectivity-ca\") pod \"konnectivity-agent-j9nc8\" (UID: \"f7ec2b7c-a8c1-402e-9166-6cfc487a0115\") " pod="kube-system/konnectivity-agent-j9nc8" Jul 08 22:29:52.184161 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184102 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3157419c-e9ba-48ef-a9f9-302b0aa3cc1a-etc-selinux\") pod \"aws-ebs-csi-driver-node-6dhlq\" (UID: \"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.184260 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184150 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3157419c-e9ba-48ef-a9f9-302b0aa3cc1a-sys-fs\") pod \"aws-ebs-csi-driver-node-6dhlq\" (UID: \"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.184260 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184191 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-cnibin\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.184260 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184217 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-os-release\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.184260 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184242 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mxvqr\" (UniqueName: \"kubernetes.io/projected/87424d7c-287f-40f1-8708-bc4a8c81f996-kube-api-access-mxvqr\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.184444 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184270 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3157419c-e9ba-48ef-a9f9-302b0aa3cc1a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6dhlq\" (UID: \"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.184444 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184296 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs\") pod \"network-metrics-daemon-2t2gl\" (UID: \"83988472-fc5e-4e4a-a7ab-248bd26e4a48\") " pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:29:52.184444 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184321 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-etc-systemd\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.184444 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184339 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/3157419c-e9ba-48ef-a9f9-302b0aa3cc1a-kubelet-dir\") pod \"aws-ebs-csi-driver-node-6dhlq\" (UID: \"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.184444 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184344 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-host-kubelet\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.184444 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184367 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-node-log\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.184444 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184392 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-run-openvswitch\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.184444 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184407 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/3157419c-e9ba-48ef-a9f9-302b0aa3cc1a-sys-fs\") pod \"aws-ebs-csi-driver-node-6dhlq\" (UID: \"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.184444 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184417 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7ec2b7c-a8c1-402e-9166-6cfc487a0115-agent-certs\") pod \"konnectivity-agent-j9nc8\" (UID: \"f7ec2b7c-a8c1-402e-9166-6cfc487a0115\") " pod="kube-system/konnectivity-agent-j9nc8" Jul 08 22:29:52.184899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184474 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5aaf8eb4-8a4e-43e1-a844-2226f1ca100b-host\") pod \"node-ca-rm7kj\" (UID: \"5aaf8eb4-8a4e-43e1-a844-2226f1ca100b\") " pod="openshift-image-registry/node-ca-rm7kj" Jul 08 22:29:52.184899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184507 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kwmbc\" (UniqueName: \"kubernetes.io/projected/5aaf8eb4-8a4e-43e1-a844-2226f1ca100b-kube-api-access-kwmbc\") pod \"node-ca-rm7kj\" (UID: \"5aaf8eb4-8a4e-43e1-a844-2226f1ca100b\") " pod="openshift-image-registry/node-ca-rm7kj" Jul 08 22:29:52.184899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184534 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qjfpz\" (UniqueName: \"kubernetes.io/projected/83988472-fc5e-4e4a-a7ab-248bd26e4a48-kube-api-access-qjfpz\") pod \"network-metrics-daemon-2t2gl\" (UID: \"83988472-fc5e-4e4a-a7ab-248bd26e4a48\") " pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:29:52.184899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184602 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-lib-modules\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.184899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184626 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-host-run-netns\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.184899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184651 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-multus-socket-dir-parent\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.184899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184725 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/901cfe25-d655-4c55-8eda-68305dc9b179-iptables-alerter-script\") pod \"iptables-alerter-kfjcx\" (UID: \"901cfe25-d655-4c55-8eda-68305dc9b179\") " pod="openshift-network-operator/iptables-alerter-kfjcx" Jul 08 22:29:52.184899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184752 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f7ec2b7c-a8c1-402e-9166-6cfc487a0115-konnectivity-ca\") pod \"konnectivity-agent-j9nc8\" (UID: \"f7ec2b7c-a8c1-402e-9166-6cfc487a0115\") " pod="kube-system/konnectivity-agent-j9nc8" Jul 08 22:29:52.184899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184764 2573 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 08 22:29:52.184899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184788 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/901cfe25-d655-4c55-8eda-68305dc9b179-host-slash\") pod \"iptables-alerter-kfjcx\" (UID: \"901cfe25-d655-4c55-8eda-68305dc9b179\") " pod="openshift-network-operator/iptables-alerter-kfjcx" Jul 08 22:29:52.184899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184819 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whbhf\" (UniqueName: \"kubernetes.io/projected/f716242a-d9bc-415f-9e3f-18f96b24cced-kube-api-access-whbhf\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.184899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184858 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-systemd-units\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.184899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184876 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/3157419c-e9ba-48ef-a9f9-302b0aa3cc1a-etc-selinux\") pod \"aws-ebs-csi-driver-node-6dhlq\" (UID: \"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.184899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184883 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-log-socket\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.185615 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184918 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-ovn-node-metrics-cert\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.185615 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184949 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/901cfe25-d655-4c55-8eda-68305dc9b179-host-slash\") pod \"iptables-alerter-kfjcx\" (UID: \"901cfe25-d655-4c55-8eda-68305dc9b179\") " pod="openshift-network-operator/iptables-alerter-kfjcx" Jul 08 22:29:52.185615 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.184949 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g9hd5\" (UniqueName: \"kubernetes.io/projected/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-kube-api-access-g9hd5\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.185615 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185024 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-etc-kubernetes\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.185615 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185069 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5wrc\" (UniqueName: \"kubernetes.io/projected/3157419c-e9ba-48ef-a9f9-302b0aa3cc1a-kube-api-access-l5wrc\") pod \"aws-ebs-csi-driver-node-6dhlq\" (UID: \"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.185615 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185095 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-sys\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.185615 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185120 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f716242a-d9bc-415f-9e3f-18f96b24cced-tmp\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.185615 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185143 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p4jv4\" (UniqueName: \"kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4\") pod \"network-check-target-pts6q\" (UID: \"e46b9a2f-6200-4556-9b64-ddc55dc0be5e\") " pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:29:52.185615 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185169 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-env-overrides\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.185615 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185192 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-ovnkube-script-lib\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.185615 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185260 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-host-var-lib-cni-bin\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.185615 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185322 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-cnibin\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.185615 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185348 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3157419c-e9ba-48ef-a9f9-302b0aa3cc1a-socket-dir\") pod \"aws-ebs-csi-driver-node-6dhlq\" (UID: \"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.185615 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185373 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6863dfc5-3c16-42a7-93a6-dc36e4722c27-hosts-file\") pod \"node-resolver-pn7b8\" (UID: \"6863dfc5-3c16-42a7-93a6-dc36e4722c27\") " pod="openshift-dns/node-resolver-pn7b8" Jul 08 22:29:52.185615 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185381 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/901cfe25-d655-4c55-8eda-68305dc9b179-iptables-alerter-script\") pod \"iptables-alerter-kfjcx\" (UID: \"901cfe25-d655-4c55-8eda-68305dc9b179\") " pod="openshift-network-operator/iptables-alerter-kfjcx" Jul 08 22:29:52.185615 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185397 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/98d1079e-ad90-4a60-bcaf-9005a7796b03-dbus\") pod \"global-pull-secret-syncer-58csw\" (UID: \"98d1079e-ad90-4a60-bcaf-9005a7796b03\") " pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:29:52.186362 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185421 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-system-cni-dir\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.186362 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185446 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-cni-binary-copy\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.186362 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185474 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4sx6l\" (UniqueName: \"kubernetes.io/projected/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-kube-api-access-4sx6l\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.186362 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185501 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3157419c-e9ba-48ef-a9f9-302b0aa3cc1a-registration-dir\") pod \"aws-ebs-csi-driver-node-6dhlq\" (UID: \"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.186362 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185601 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5aaf8eb4-8a4e-43e1-a844-2226f1ca100b-serviceca\") pod \"node-ca-rm7kj\" (UID: \"5aaf8eb4-8a4e-43e1-a844-2226f1ca100b\") " pod="openshift-image-registry/node-ca-rm7kj" Jul 08 22:29:52.186362 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185616 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/5aaf8eb4-8a4e-43e1-a844-2226f1ca100b-host\") pod \"node-ca-rm7kj\" (UID: \"5aaf8eb4-8a4e-43e1-a844-2226f1ca100b\") " pod="openshift-image-registry/node-ca-rm7kj" Jul 08 22:29:52.186362 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185624 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-etc-kubernetes\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.186362 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185740 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/3157419c-e9ba-48ef-a9f9-302b0aa3cc1a-socket-dir\") pod \"aws-ebs-csi-driver-node-6dhlq\" (UID: \"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.186362 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185828 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.186362 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185857 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-host-run-k8s-cni-cncf-io\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.186362 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185898 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-host-run-netns\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.186362 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185923 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.186362 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185968 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6863dfc5-3c16-42a7-93a6-dc36e4722c27-tmp-dir\") pod \"node-resolver-pn7b8\" (UID: \"6863dfc5-3c16-42a7-93a6-dc36e4722c27\") " pod="openshift-dns/node-resolver-pn7b8" Jul 08 22:29:52.186362 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.185974 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/6863dfc5-3c16-42a7-93a6-dc36e4722c27-hosts-file\") pod \"node-resolver-pn7b8\" (UID: \"6863dfc5-3c16-42a7-93a6-dc36e4722c27\") " pod="openshift-dns/node-resolver-pn7b8" Jul 08 22:29:52.186362 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.186039 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-host\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.186362 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.186067 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.187114 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.186094 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-host-cni-netd\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.187114 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.186117 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-etc-sysctl-conf\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.187114 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.186141 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-multus-cni-dir\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.187114 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.186166 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-os-release\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.187114 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.186186 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/5aaf8eb4-8a4e-43e1-a844-2226f1ca100b-serviceca\") pod \"node-ca-rm7kj\" (UID: \"5aaf8eb4-8a4e-43e1-a844-2226f1ca100b\") " pod="openshift-image-registry/node-ca-rm7kj" Jul 08 22:29:52.187114 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.186190 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-run-ovn\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.187114 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.186253 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/6863dfc5-3c16-42a7-93a6-dc36e4722c27-tmp-dir\") pod \"node-resolver-pn7b8\" (UID: \"6863dfc5-3c16-42a7-93a6-dc36e4722c27\") " pod="openshift-dns/node-resolver-pn7b8" Jul 08 22:29:52.187114 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.186278 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/3157419c-e9ba-48ef-a9f9-302b0aa3cc1a-registration-dir\") pod \"aws-ebs-csi-driver-node-6dhlq\" (UID: \"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.187114 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.186308 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3157419c-e9ba-48ef-a9f9-302b0aa3cc1a-device-dir\") pod \"aws-ebs-csi-driver-node-6dhlq\" (UID: \"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.187114 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.186343 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/98d1079e-ad90-4a60-bcaf-9005a7796b03-kubelet-config\") pod \"global-pull-secret-syncer-58csw\" (UID: \"98d1079e-ad90-4a60-bcaf-9005a7796b03\") " pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:29:52.187114 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.186397 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/3157419c-e9ba-48ef-a9f9-302b0aa3cc1a-device-dir\") pod \"aws-ebs-csi-driver-node-6dhlq\" (UID: \"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.187114 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.186419 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-etc-sysconfig\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.187114 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.186454 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f716242a-d9bc-415f-9e3f-18f96b24cced-etc-tuned\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.187114 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.186480 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-hostroot\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.187114 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.186510 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.187114 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.186540 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5pfpt\" (UniqueName: \"kubernetes.io/projected/6863dfc5-3c16-42a7-93a6-dc36e4722c27-kube-api-access-5pfpt\") pod \"node-resolver-pn7b8\" (UID: \"6863dfc5-3c16-42a7-93a6-dc36e4722c27\") " pod="openshift-dns/node-resolver-pn7b8" Jul 08 22:29:52.187114 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.186627 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-etc-openvswitch\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.187925 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.186667 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.187925 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.186707 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-host-slash\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.187925 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.187280 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-multus-conf-dir\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.187925 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.187311 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-host-run-multus-certs\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.187925 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.187339 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret\") pod \"global-pull-secret-syncer-58csw\" (UID: \"98d1079e-ad90-4a60-bcaf-9005a7796b03\") " pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:29:52.187925 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.187365 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-run\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.187925 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.187364 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-200.ec2.internal" event={"ID":"b88aa8db4d51f2f1daa8b6c561a11e94","Type":"ContainerStarted","Data":"ae1a3e8fcb84e67c65c7d798c360e5d6f8ec7c933fb25dbb2c35c2c7397be184"} Jul 08 22:29:52.187925 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.187390 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-var-lib-kubelet\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.187925 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.187415 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-run-systemd\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.187925 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.187440 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-var-lib-openvswitch\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.187925 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.187516 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-ovnkube-config\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.187925 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.187547 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87424d7c-287f-40f1-8708-bc4a8c81f996-multus-daemon-config\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.187925 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.187593 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jrm6n\" (UniqueName: \"kubernetes.io/projected/901cfe25-d655-4c55-8eda-68305dc9b179-kube-api-access-jrm6n\") pod \"iptables-alerter-kfjcx\" (UID: \"901cfe25-d655-4c55-8eda-68305dc9b179\") " pod="openshift-network-operator/iptables-alerter-kfjcx" Jul 08 22:29:52.187925 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.187619 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-etc-modprobe-d\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.187925 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.187645 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87424d7c-287f-40f1-8708-bc4a8c81f996-cni-binary-copy\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.187925 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.187671 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-host-var-lib-cni-multus\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.187925 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.187695 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-host-var-lib-kubelet\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.190258 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.189547 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f7ec2b7c-a8c1-402e-9166-6cfc487a0115-agent-certs\") pod \"konnectivity-agent-j9nc8\" (UID: \"f7ec2b7c-a8c1-402e-9166-6cfc487a0115\") " pod="kube-system/konnectivity-agent-j9nc8" Jul 08 22:29:52.197235 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.197209 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jrm6n\" (UniqueName: \"kubernetes.io/projected/901cfe25-d655-4c55-8eda-68305dc9b179-kube-api-access-jrm6n\") pod \"iptables-alerter-kfjcx\" (UID: \"901cfe25-d655-4c55-8eda-68305dc9b179\") " pod="openshift-network-operator/iptables-alerter-kfjcx" Jul 08 22:29:52.199827 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.199790 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5wrc\" (UniqueName: \"kubernetes.io/projected/3157419c-e9ba-48ef-a9f9-302b0aa3cc1a-kube-api-access-l5wrc\") pod \"aws-ebs-csi-driver-node-6dhlq\" (UID: \"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.200219 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.200199 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5pfpt\" (UniqueName: \"kubernetes.io/projected/6863dfc5-3c16-42a7-93a6-dc36e4722c27-kube-api-access-5pfpt\") pod \"node-resolver-pn7b8\" (UID: \"6863dfc5-3c16-42a7-93a6-dc36e4722c27\") " pod="openshift-dns/node-resolver-pn7b8" Jul 08 22:29:52.200522 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.200503 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kwmbc\" (UniqueName: \"kubernetes.io/projected/5aaf8eb4-8a4e-43e1-a844-2226f1ca100b-kube-api-access-kwmbc\") pod \"node-ca-rm7kj\" (UID: \"5aaf8eb4-8a4e-43e1-a844-2226f1ca100b\") " pod="openshift-image-registry/node-ca-rm7kj" Jul 08 22:29:52.288280 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288241 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-cni-binary-copy\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.288280 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288278 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4sx6l\" (UniqueName: \"kubernetes.io/projected/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-kube-api-access-4sx6l\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.288535 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288308 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-etc-kubernetes\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.288535 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288334 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.288535 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288351 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-host-run-k8s-cni-cncf-io\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.288535 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288367 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-host-run-netns\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.288535 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288385 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.288535 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288399 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-host\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.288535 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288415 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.288535 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288419 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-etc-kubernetes\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.288535 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288429 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-host-cni-netd\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.288535 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288462 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-host-cni-netd\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.288535 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288488 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-etc-sysctl-conf\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.288535 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288515 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-host-run-k8s-cni-cncf-io\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.288535 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288517 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-multus-cni-dir\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.288535 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288540 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-host-run-netns\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.288535 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288542 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-os-release\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.289316 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288595 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-run-ovn\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.289316 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288622 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/98d1079e-ad90-4a60-bcaf-9005a7796b03-kubelet-config\") pod \"global-pull-secret-syncer-58csw\" (UID: \"98d1079e-ad90-4a60-bcaf-9005a7796b03\") " pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:29:52.289316 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288635 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-host\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.289316 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288646 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-etc-sysconfig\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.289316 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288684 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f716242a-d9bc-415f-9e3f-18f96b24cced-etc-tuned\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.289316 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288701 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-etc-sysconfig\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.289316 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288719 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-hostroot\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.289316 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288748 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.289316 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288782 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-etc-openvswitch\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.289316 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288810 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.289316 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288833 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-etc-sysctl-conf\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.289316 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288840 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-host-slash\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.289316 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288494 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.289316 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288872 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-multus-conf-dir\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.289316 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288898 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-host-run-multus-certs\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.289316 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288901 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-multus-cni-dir\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.289316 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288920 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-cni-binary-copy\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.290176 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288928 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.290176 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288925 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret\") pod \"global-pull-secret-syncer-58csw\" (UID: \"98d1079e-ad90-4a60-bcaf-9005a7796b03\") " pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:29:52.290176 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288956 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-os-release\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.290176 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288967 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-run\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.290176 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288992 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-var-lib-kubelet\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.290176 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.288996 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-hostroot\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.290176 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289021 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-host-run-ovn-kubernetes\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.290176 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289021 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-run-systemd\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.290176 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289047 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-var-lib-openvswitch\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.290176 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289054 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-run-systemd\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.290176 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289062 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-ovnkube-config\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.290176 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289098 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-run\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.290176 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289124 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87424d7c-287f-40f1-8708-bc4a8c81f996-multus-daemon-config\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.290176 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289149 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-etc-modprobe-d\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.290176 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289154 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-tuning-conf-dir\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.290176 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289172 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87424d7c-287f-40f1-8708-bc4a8c81f996-cni-binary-copy\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.290176 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:52.288996 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 22:29:52.290176 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289195 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-host-var-lib-cni-multus\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.291077 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289206 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-etc-openvswitch\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.291077 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289218 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-host-var-lib-kubelet\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.291077 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289239 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-etc-sysctl-d\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.291077 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289264 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-host-cni-bin\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.291077 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289288 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-system-cni-dir\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.291077 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289297 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-run-ovn\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.291077 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289316 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-cnibin\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.291077 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289338 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-os-release\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.291077 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289354 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-multus-conf-dir\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.291077 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289353 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/98d1079e-ad90-4a60-bcaf-9005a7796b03-kubelet-config\") pod \"global-pull-secret-syncer-58csw\" (UID: \"98d1079e-ad90-4a60-bcaf-9005a7796b03\") " pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:29:52.291077 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289363 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mxvqr\" (UniqueName: \"kubernetes.io/projected/87424d7c-287f-40f1-8708-bc4a8c81f996-kube-api-access-mxvqr\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.291077 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:52.289404 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret podName:98d1079e-ad90-4a60-bcaf-9005a7796b03 nodeName:}" failed. No retries permitted until 2026-07-08 22:29:52.789383181 +0000 UTC m=+3.128090133 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret") pod "global-pull-secret-syncer-58csw" (UID: "98d1079e-ad90-4a60-bcaf-9005a7796b03") : object "kube-system"/"original-pull-secret" not registered Jul 08 22:29:52.291077 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289429 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-var-lib-kubelet\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.291077 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289433 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs\") pod \"network-metrics-daemon-2t2gl\" (UID: \"83988472-fc5e-4e4a-a7ab-248bd26e4a48\") " pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:29:52.291077 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289469 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-etc-systemd\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.291077 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289459 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-ovnkube-config\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.291077 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:52.289495 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:29:52.291918 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289493 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-host-kubelet\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.291918 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289520 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-etc-modprobe-d\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.291918 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289522 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-host-kubelet\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.291918 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289525 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-node-log\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.291918 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289547 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-host-slash\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.291918 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289583 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-node-log\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.291918 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289614 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-etc-systemd\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.291918 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289616 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-host-run-multus-certs\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.291918 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289627 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-host-cni-bin\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.291918 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289679 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-cnibin\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.291918 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289677 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-system-cni-dir\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.291918 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289704 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.291918 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:52.289729 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs podName:83988472-fc5e-4e4a-a7ab-248bd26e4a48 nodeName:}" failed. No retries permitted until 2026-07-08 22:29:52.789585296 +0000 UTC m=+3.128292247 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs") pod "network-metrics-daemon-2t2gl" (UID: "83988472-fc5e-4e4a-a7ab-248bd26e4a48") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:29:52.291918 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289712 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-host-var-lib-cni-multus\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.291918 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289741 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-var-lib-openvswitch\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.291918 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289755 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-run-openvswitch\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.291918 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289783 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-host-var-lib-kubelet\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.292740 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289789 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qjfpz\" (UniqueName: \"kubernetes.io/projected/83988472-fc5e-4e4a-a7ab-248bd26e4a48-kube-api-access-qjfpz\") pod \"network-metrics-daemon-2t2gl\" (UID: \"83988472-fc5e-4e4a-a7ab-248bd26e4a48\") " pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:29:52.292740 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289795 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-run-openvswitch\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.292740 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289826 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-lib-modules\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.292740 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289850 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-host-run-netns\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.292740 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289873 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-multus-socket-dir-parent\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.292740 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289900 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whbhf\" (UniqueName: \"kubernetes.io/projected/f716242a-d9bc-415f-9e3f-18f96b24cced-kube-api-access-whbhf\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.292740 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289915 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-etc-sysctl-d\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.292740 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289925 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-systemd-units\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.292740 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289928 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/87424d7c-287f-40f1-8708-bc4a8c81f996-multus-daemon-config\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.292740 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289950 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-log-socket\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.292740 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289962 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-systemd-units\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.292740 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289924 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-host-run-netns\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.292740 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289979 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-multus-socket-dir-parent\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.292740 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289975 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-ovn-node-metrics-cert\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.292740 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.289991 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-log-socket\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.292740 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.290020 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g9hd5\" (UniqueName: \"kubernetes.io/projected/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-kube-api-access-g9hd5\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.292740 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.290043 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/87424d7c-287f-40f1-8708-bc4a8c81f996-cni-binary-copy\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.292740 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.290048 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-etc-kubernetes\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.293299 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.290052 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-os-release\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.293299 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.290075 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-sys\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.293299 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.290101 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f716242a-d9bc-415f-9e3f-18f96b24cced-tmp\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.293299 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.290103 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-lib-modules\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.293299 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.290155 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4jv4\" (UniqueName: \"kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4\") pod \"network-check-target-pts6q\" (UID: \"e46b9a2f-6200-4556-9b64-ddc55dc0be5e\") " pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:29:52.293299 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.290158 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-etc-kubernetes\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.293299 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.290180 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f716242a-d9bc-415f-9e3f-18f96b24cced-sys\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.293299 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.290182 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-env-overrides\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.293299 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.290221 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-ovnkube-script-lib\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.293299 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.290264 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-host-var-lib-cni-bin\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.293299 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.290289 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-cnibin\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.293299 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.290316 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/98d1079e-ad90-4a60-bcaf-9005a7796b03-dbus\") pod \"global-pull-secret-syncer-58csw\" (UID: \"98d1079e-ad90-4a60-bcaf-9005a7796b03\") " pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:29:52.293299 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.290340 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-system-cni-dir\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.293299 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.290360 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/87424d7c-287f-40f1-8708-bc4a8c81f996-host-var-lib-cni-bin\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.293299 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.290406 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-cnibin\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.293299 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.290407 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-system-cni-dir\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.293299 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.290511 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/98d1079e-ad90-4a60-bcaf-9005a7796b03-dbus\") pod \"global-pull-secret-syncer-58csw\" (UID: \"98d1079e-ad90-4a60-bcaf-9005a7796b03\") " pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:29:52.293299 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.290631 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-env-overrides\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.294105 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.291297 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-ovnkube-script-lib\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.294105 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.293196 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/f716242a-d9bc-415f-9e3f-18f96b24cced-tmp\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.294105 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.293536 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-ovn-node-metrics-cert\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.294988 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.294968 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/f716242a-d9bc-415f-9e3f-18f96b24cced-etc-tuned\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.298391 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.298365 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4sx6l\" (UniqueName: \"kubernetes.io/projected/ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4-kube-api-access-4sx6l\") pod \"multus-additional-cni-plugins-mtwhq\" (UID: \"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4\") " pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.298919 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:52.298897 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 22:29:52.299045 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:52.299009 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 22:29:52.299106 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:52.299081 2573 projected.go:196] Error preparing data for projected volume kube-api-access-p4jv4 for pod openshift-network-diagnostics/network-check-target-pts6q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:29:52.299161 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:52.299154 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4 podName:e46b9a2f-6200-4556-9b64-ddc55dc0be5e nodeName:}" failed. No retries permitted until 2026-07-08 22:29:52.799138589 +0000 UTC m=+3.137845542 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-p4jv4" (UniqueName: "kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4") pod "network-check-target-pts6q" (UID: "e46b9a2f-6200-4556-9b64-ddc55dc0be5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:29:52.299739 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.299683 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qjfpz\" (UniqueName: \"kubernetes.io/projected/83988472-fc5e-4e4a-a7ab-248bd26e4a48-kube-api-access-qjfpz\") pod \"network-metrics-daemon-2t2gl\" (UID: \"83988472-fc5e-4e4a-a7ab-248bd26e4a48\") " pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:29:52.299900 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.299882 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-g9hd5\" (UniqueName: \"kubernetes.io/projected/71dfdf35-72dc-4e6d-8b65-516381e2e9a8-kube-api-access-g9hd5\") pod \"ovnkube-node-wsj6p\" (UID: \"71dfdf35-72dc-4e6d-8b65-516381e2e9a8\") " pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.301725 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.301673 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whbhf\" (UniqueName: \"kubernetes.io/projected/f716242a-d9bc-415f-9e3f-18f96b24cced-kube-api-access-whbhf\") pod \"tuned-qqltd\" (UID: \"f716242a-d9bc-415f-9e3f-18f96b24cced\") " pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.303021 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.302999 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mxvqr\" (UniqueName: \"kubernetes.io/projected/87424d7c-287f-40f1-8708-bc4a8c81f996-kube-api-access-mxvqr\") pod \"multus-8pfgv\" (UID: \"87424d7c-287f-40f1-8708-bc4a8c81f996\") " pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.314668 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.314641 2573 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 08 22:29:52.378149 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.378116 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-kfjcx" Jul 08 22:29:52.390951 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.390921 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-pn7b8" Jul 08 22:29:52.391413 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:52.391385 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod901cfe25_d655_4c55_8eda_68305dc9b179.slice/crio-baf7acba064bc5e47d78392a0cb6eeb50e2dfd1b9bec0d4207a5a2f79fdeadc5 WatchSource:0}: Error finding container baf7acba064bc5e47d78392a0cb6eeb50e2dfd1b9bec0d4207a5a2f79fdeadc5: Status 404 returned error can't find the container with id baf7acba064bc5e47d78392a0cb6eeb50e2dfd1b9bec0d4207a5a2f79fdeadc5 Jul 08 22:29:52.401883 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.401860 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-rm7kj" Jul 08 22:29:52.402785 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:52.402752 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6863dfc5_3c16_42a7_93a6_dc36e4722c27.slice/crio-02bf22ff2ea7c66625698520197a80563d4a7df30eea4c86b22a83a984c40776 WatchSource:0}: Error finding container 02bf22ff2ea7c66625698520197a80563d4a7df30eea4c86b22a83a984c40776: Status 404 returned error can't find the container with id 02bf22ff2ea7c66625698520197a80563d4a7df30eea4c86b22a83a984c40776 Jul 08 22:29:52.408792 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.408764 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-j9nc8" Jul 08 22:29:52.412220 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:52.412184 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5aaf8eb4_8a4e_43e1_a844_2226f1ca100b.slice/crio-6bc63aa60c3e8bf938029feb6a3c6ea32b8c2c0f02087e8fd6431457495ce5f6 WatchSource:0}: Error finding container 6bc63aa60c3e8bf938029feb6a3c6ea32b8c2c0f02087e8fd6431457495ce5f6: Status 404 returned error can't find the container with id 6bc63aa60c3e8bf938029feb6a3c6ea32b8c2c0f02087e8fd6431457495ce5f6 Jul 08 22:29:52.416583 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.416559 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" Jul 08 22:29:52.418960 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:52.418934 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf7ec2b7c_a8c1_402e_9166_6cfc487a0115.slice/crio-9c51a2347e2905ce01ea305600667c9a726c9392d6075a2c2edad577424e142a WatchSource:0}: Error finding container 9c51a2347e2905ce01ea305600667c9a726c9392d6075a2c2edad577424e142a: Status 404 returned error can't find the container with id 9c51a2347e2905ce01ea305600667c9a726c9392d6075a2c2edad577424e142a Jul 08 22:29:52.424772 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.424750 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:29:52.428104 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:52.428025 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3157419c_e9ba_48ef_a9f9_302b0aa3cc1a.slice/crio-0b555d64a705d1689bfce15e5f5f175d3a257b6dae3f3113b0e8bc249b8492a9 WatchSource:0}: Error finding container 0b555d64a705d1689bfce15e5f5f175d3a257b6dae3f3113b0e8bc249b8492a9: Status 404 returned error can't find the container with id 0b555d64a705d1689bfce15e5f5f175d3a257b6dae3f3113b0e8bc249b8492a9 Jul 08 22:29:52.433716 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.433696 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-qqltd" Jul 08 22:29:52.437576 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:52.437551 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod71dfdf35_72dc_4e6d_8b65_516381e2e9a8.slice/crio-a7b22d835963cdd1486257eeb7f0edece85102453f6b223a7e4b91e5a901ef2f WatchSource:0}: Error finding container a7b22d835963cdd1486257eeb7f0edece85102453f6b223a7e4b91e5a901ef2f: Status 404 returned error can't find the container with id a7b22d835963cdd1486257eeb7f0edece85102453f6b223a7e4b91e5a901ef2f Jul 08 22:29:52.443002 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.442780 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-8pfgv" Jul 08 22:29:52.448798 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.448743 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-mtwhq" Jul 08 22:29:52.456098 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:52.456074 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87424d7c_287f_40f1_8708_bc4a8c81f996.slice/crio-b158013d44b828073bc4d1134a8df0daf1f056c7f18d011dba8271070240de2d WatchSource:0}: Error finding container b158013d44b828073bc4d1134a8df0daf1f056c7f18d011dba8271070240de2d: Status 404 returned error can't find the container with id b158013d44b828073bc4d1134a8df0daf1f056c7f18d011dba8271070240de2d Jul 08 22:29:52.464700 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:29:52.464673 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffa96bf6_022d_4ee9_aa64_0c39c7e41ed4.slice/crio-aa12d323b08df0899992a4230b6d7cd8338dd5507f1335df49e6b8ec736bab33 WatchSource:0}: Error finding container aa12d323b08df0899992a4230b6d7cd8338dd5507f1335df49e6b8ec736bab33: Status 404 returned error can't find the container with id aa12d323b08df0899992a4230b6d7cd8338dd5507f1335df49e6b8ec736bab33 Jul 08 22:29:52.794422 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.794319 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs\") pod \"network-metrics-daemon-2t2gl\" (UID: \"83988472-fc5e-4e4a-a7ab-248bd26e4a48\") " pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:29:52.794422 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.794418 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret\") pod \"global-pull-secret-syncer-58csw\" (UID: \"98d1079e-ad90-4a60-bcaf-9005a7796b03\") " pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:29:52.794686 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:52.794505 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:29:52.794686 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:52.794539 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 22:29:52.794686 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:52.794606 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs podName:83988472-fc5e-4e4a-a7ab-248bd26e4a48 nodeName:}" failed. No retries permitted until 2026-07-08 22:29:53.794563262 +0000 UTC m=+4.133270220 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs") pod "network-metrics-daemon-2t2gl" (UID: "83988472-fc5e-4e4a-a7ab-248bd26e4a48") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:29:52.794686 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:52.794626 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret podName:98d1079e-ad90-4a60-bcaf-9005a7796b03 nodeName:}" failed. No retries permitted until 2026-07-08 22:29:53.794617207 +0000 UTC m=+4.133324160 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret") pod "global-pull-secret-syncer-58csw" (UID: "98d1079e-ad90-4a60-bcaf-9005a7796b03") : object "kube-system"/"original-pull-secret" not registered Jul 08 22:29:52.894934 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:52.894898 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4jv4\" (UniqueName: \"kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4\") pod \"network-check-target-pts6q\" (UID: \"e46b9a2f-6200-4556-9b64-ddc55dc0be5e\") " pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:29:52.895119 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:52.895055 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 22:29:52.895119 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:52.895086 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 22:29:52.895119 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:52.895104 2573 projected.go:196] Error preparing data for projected volume kube-api-access-p4jv4 for pod openshift-network-diagnostics/network-check-target-pts6q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:29:52.895238 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:52.895185 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4 podName:e46b9a2f-6200-4556-9b64-ddc55dc0be5e nodeName:}" failed. No retries permitted until 2026-07-08 22:29:53.89516329 +0000 UTC m=+4.233870265 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-p4jv4" (UniqueName: "kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4") pod "network-check-target-pts6q" (UID: "e46b9a2f-6200-4556-9b64-ddc55dc0be5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:29:53.115638 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:53.115487 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 22:24:52 +0000 UTC" deadline="2028-04-12 10:25:40.334803984 +0000 UTC" Jul 08 22:29:53.115638 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:53.115520 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15443h55m47.219289382s" Jul 08 22:29:53.199090 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:53.199048 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8pfgv" event={"ID":"87424d7c-287f-40f1-8708-bc4a8c81f996","Type":"ContainerStarted","Data":"b158013d44b828073bc4d1134a8df0daf1f056c7f18d011dba8271070240de2d"} Jul 08 22:29:53.200918 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:53.200885 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qqltd" event={"ID":"f716242a-d9bc-415f-9e3f-18f96b24cced","Type":"ContainerStarted","Data":"943b6ca1e1e2507067f7a74a9af13f3f38186ece005ec9986dc567825fee127c"} Jul 08 22:29:53.202673 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:53.202647 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" event={"ID":"71dfdf35-72dc-4e6d-8b65-516381e2e9a8","Type":"ContainerStarted","Data":"a7b22d835963cdd1486257eeb7f0edece85102453f6b223a7e4b91e5a901ef2f"} Jul 08 22:29:53.204058 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:53.204032 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" event={"ID":"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a","Type":"ContainerStarted","Data":"0b555d64a705d1689bfce15e5f5f175d3a257b6dae3f3113b0e8bc249b8492a9"} Jul 08 22:29:53.205619 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:53.205573 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtwhq" event={"ID":"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4","Type":"ContainerStarted","Data":"aa12d323b08df0899992a4230b6d7cd8338dd5507f1335df49e6b8ec736bab33"} Jul 08 22:29:53.207053 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:53.207029 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j9nc8" event={"ID":"f7ec2b7c-a8c1-402e-9166-6cfc487a0115","Type":"ContainerStarted","Data":"9c51a2347e2905ce01ea305600667c9a726c9392d6075a2c2edad577424e142a"} Jul 08 22:29:53.208324 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:53.208303 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rm7kj" event={"ID":"5aaf8eb4-8a4e-43e1-a844-2226f1ca100b","Type":"ContainerStarted","Data":"6bc63aa60c3e8bf938029feb6a3c6ea32b8c2c0f02087e8fd6431457495ce5f6"} Jul 08 22:29:53.209667 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:53.209642 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pn7b8" event={"ID":"6863dfc5-3c16-42a7-93a6-dc36e4722c27","Type":"ContainerStarted","Data":"02bf22ff2ea7c66625698520197a80563d4a7df30eea4c86b22a83a984c40776"} Jul 08 22:29:53.211824 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:53.211796 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kfjcx" event={"ID":"901cfe25-d655-4c55-8eda-68305dc9b179","Type":"ContainerStarted","Data":"baf7acba064bc5e47d78392a0cb6eeb50e2dfd1b9bec0d4207a5a2f79fdeadc5"} Jul 08 22:29:53.803767 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:53.803709 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs\") pod \"network-metrics-daemon-2t2gl\" (UID: \"83988472-fc5e-4e4a-a7ab-248bd26e4a48\") " pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:29:53.803971 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:53.803827 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret\") pod \"global-pull-secret-syncer-58csw\" (UID: \"98d1079e-ad90-4a60-bcaf-9005a7796b03\") " pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:29:53.804083 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:53.804065 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 22:29:53.804158 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:53.804144 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret podName:98d1079e-ad90-4a60-bcaf-9005a7796b03 nodeName:}" failed. No retries permitted until 2026-07-08 22:29:55.804121609 +0000 UTC m=+6.142828563 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret") pod "global-pull-secret-syncer-58csw" (UID: "98d1079e-ad90-4a60-bcaf-9005a7796b03") : object "kube-system"/"original-pull-secret" not registered Jul 08 22:29:53.804691 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:53.804667 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:29:53.804814 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:53.804734 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs podName:83988472-fc5e-4e4a-a7ab-248bd26e4a48 nodeName:}" failed. No retries permitted until 2026-07-08 22:29:55.804715651 +0000 UTC m=+6.143422607 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs") pod "network-metrics-daemon-2t2gl" (UID: "83988472-fc5e-4e4a-a7ab-248bd26e4a48") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:29:53.906217 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:53.905843 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4jv4\" (UniqueName: \"kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4\") pod \"network-check-target-pts6q\" (UID: \"e46b9a2f-6200-4556-9b64-ddc55dc0be5e\") " pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:29:53.906217 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:53.906105 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 22:29:53.906217 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:53.906136 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 22:29:53.906217 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:53.906151 2573 projected.go:196] Error preparing data for projected volume kube-api-access-p4jv4 for pod openshift-network-diagnostics/network-check-target-pts6q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:29:53.906543 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:53.906228 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4 podName:e46b9a2f-6200-4556-9b64-ddc55dc0be5e nodeName:}" failed. No retries permitted until 2026-07-08 22:29:55.906205846 +0000 UTC m=+6.244912800 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-p4jv4" (UniqueName: "kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4") pod "network-check-target-pts6q" (UID: "e46b9a2f-6200-4556-9b64-ddc55dc0be5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:29:54.116743 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:54.116576 2573 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-07 22:24:52 +0000 UTC" deadline="2028-04-15 20:03:51.930612786 +0000 UTC" Jul 08 22:29:54.116743 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:54.116647 2573 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15525h33m57.8139713s" Jul 08 22:29:54.179389 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:54.179354 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:29:54.179550 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:54.179513 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2gl" podUID="83988472-fc5e-4e4a-a7ab-248bd26e4a48" Jul 08 22:29:54.179804 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:54.179783 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:29:54.179913 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:54.179886 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pts6q" podUID="e46b9a2f-6200-4556-9b64-ddc55dc0be5e" Jul 08 22:29:54.179977 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:54.179961 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:29:54.180054 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:54.180036 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58csw" podUID="98d1079e-ad90-4a60-bcaf-9005a7796b03" Jul 08 22:29:55.824576 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:55.824536 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret\") pod \"global-pull-secret-syncer-58csw\" (UID: \"98d1079e-ad90-4a60-bcaf-9005a7796b03\") " pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:29:55.825090 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:55.824623 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs\") pod \"network-metrics-daemon-2t2gl\" (UID: \"83988472-fc5e-4e4a-a7ab-248bd26e4a48\") " pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:29:55.825090 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:55.824806 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:29:55.825090 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:55.824875 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs podName:83988472-fc5e-4e4a-a7ab-248bd26e4a48 nodeName:}" failed. No retries permitted until 2026-07-08 22:29:59.824854278 +0000 UTC m=+10.163561235 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs") pod "network-metrics-daemon-2t2gl" (UID: "83988472-fc5e-4e4a-a7ab-248bd26e4a48") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:29:55.825311 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:55.825293 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 22:29:55.825373 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:55.825350 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret podName:98d1079e-ad90-4a60-bcaf-9005a7796b03 nodeName:}" failed. No retries permitted until 2026-07-08 22:29:59.825333451 +0000 UTC m=+10.164040420 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret") pod "global-pull-secret-syncer-58csw" (UID: "98d1079e-ad90-4a60-bcaf-9005a7796b03") : object "kube-system"/"original-pull-secret" not registered Jul 08 22:29:55.926794 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:55.925997 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4jv4\" (UniqueName: \"kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4\") pod \"network-check-target-pts6q\" (UID: \"e46b9a2f-6200-4556-9b64-ddc55dc0be5e\") " pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:29:55.926794 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:55.926191 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 22:29:55.926794 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:55.926211 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 22:29:55.926794 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:55.926224 2573 projected.go:196] Error preparing data for projected volume kube-api-access-p4jv4 for pod openshift-network-diagnostics/network-check-target-pts6q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:29:55.926794 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:55.926289 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4 podName:e46b9a2f-6200-4556-9b64-ddc55dc0be5e nodeName:}" failed. No retries permitted until 2026-07-08 22:29:59.926269105 +0000 UTC m=+10.264976076 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-p4jv4" (UniqueName: "kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4") pod "network-check-target-pts6q" (UID: "e46b9a2f-6200-4556-9b64-ddc55dc0be5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:29:56.183121 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:56.182220 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:29:56.183121 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:56.182352 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58csw" podUID="98d1079e-ad90-4a60-bcaf-9005a7796b03" Jul 08 22:29:56.183121 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:56.182778 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:29:56.183121 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:56.182881 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pts6q" podUID="e46b9a2f-6200-4556-9b64-ddc55dc0be5e" Jul 08 22:29:56.183121 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:56.182930 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:29:56.183121 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:56.183013 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2gl" podUID="83988472-fc5e-4e4a-a7ab-248bd26e4a48" Jul 08 22:29:58.181190 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:58.181157 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:29:58.181662 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:58.181274 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pts6q" podUID="e46b9a2f-6200-4556-9b64-ddc55dc0be5e" Jul 08 22:29:58.181758 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:58.181680 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:29:58.181814 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:58.181766 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2gl" podUID="83988472-fc5e-4e4a-a7ab-248bd26e4a48" Jul 08 22:29:58.181867 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:58.181844 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:29:58.181922 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:58.181908 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58csw" podUID="98d1079e-ad90-4a60-bcaf-9005a7796b03" Jul 08 22:29:59.869987 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:59.869940 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs\") pod \"network-metrics-daemon-2t2gl\" (UID: \"83988472-fc5e-4e4a-a7ab-248bd26e4a48\") " pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:29:59.870529 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:59.870061 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret\") pod \"global-pull-secret-syncer-58csw\" (UID: \"98d1079e-ad90-4a60-bcaf-9005a7796b03\") " pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:29:59.870529 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:59.870213 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 22:29:59.870529 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:59.870286 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret podName:98d1079e-ad90-4a60-bcaf-9005a7796b03 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:07.870262284 +0000 UTC m=+18.208969258 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret") pod "global-pull-secret-syncer-58csw" (UID: "98d1079e-ad90-4a60-bcaf-9005a7796b03") : object "kube-system"/"original-pull-secret" not registered Jul 08 22:29:59.870805 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:59.870744 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:29:59.870805 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:59.870805 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs podName:83988472-fc5e-4e4a-a7ab-248bd26e4a48 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:07.870785874 +0000 UTC m=+18.209492884 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs") pod "network-metrics-daemon-2t2gl" (UID: "83988472-fc5e-4e4a-a7ab-248bd26e4a48") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:29:59.970810 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:29:59.970728 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4jv4\" (UniqueName: \"kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4\") pod \"network-check-target-pts6q\" (UID: \"e46b9a2f-6200-4556-9b64-ddc55dc0be5e\") " pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:29:59.971088 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:59.970933 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 22:29:59.971088 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:59.970959 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 22:29:59.971088 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:59.970973 2573 projected.go:196] Error preparing data for projected volume kube-api-access-p4jv4 for pod openshift-network-diagnostics/network-check-target-pts6q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:29:59.971088 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:29:59.971036 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4 podName:e46b9a2f-6200-4556-9b64-ddc55dc0be5e nodeName:}" failed. No retries permitted until 2026-07-08 22:30:07.971020203 +0000 UTC m=+18.309727171 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-p4jv4" (UniqueName: "kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4") pod "network-check-target-pts6q" (UID: "e46b9a2f-6200-4556-9b64-ddc55dc0be5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:30:00.181309 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:00.180756 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:30:00.181309 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:00.180907 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:30:00.181309 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:00.181021 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2gl" podUID="83988472-fc5e-4e4a-a7ab-248bd26e4a48" Jul 08 22:30:00.181309 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:00.180899 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pts6q" podUID="e46b9a2f-6200-4556-9b64-ddc55dc0be5e" Jul 08 22:30:00.181309 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:00.181070 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:30:00.181309 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:00.181116 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58csw" podUID="98d1079e-ad90-4a60-bcaf-9005a7796b03" Jul 08 22:30:02.176985 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:02.176865 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:30:02.177446 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:02.176997 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:30:02.177446 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:02.176868 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:30:02.177446 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:02.176992 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pts6q" podUID="e46b9a2f-6200-4556-9b64-ddc55dc0be5e" Jul 08 22:30:02.177446 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:02.177108 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58csw" podUID="98d1079e-ad90-4a60-bcaf-9005a7796b03" Jul 08 22:30:02.177446 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:02.177193 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2gl" podUID="83988472-fc5e-4e4a-a7ab-248bd26e4a48" Jul 08 22:30:04.179774 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:04.179473 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:30:04.179774 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:04.179640 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:30:04.179774 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:04.179659 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2gl" podUID="83988472-fc5e-4e4a-a7ab-248bd26e4a48" Jul 08 22:30:04.179774 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:04.179735 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58csw" podUID="98d1079e-ad90-4a60-bcaf-9005a7796b03" Jul 08 22:30:04.179774 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:04.179752 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:30:04.180350 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:04.179857 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pts6q" podUID="e46b9a2f-6200-4556-9b64-ddc55dc0be5e" Jul 08 22:30:04.246202 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:04.246163 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-200.ec2.internal" event={"ID":"b88aa8db4d51f2f1daa8b6c561a11e94","Type":"ContainerStarted","Data":"4071bf28c02c48c075d7c72e94fbd526dfdbe2cd6ee269c68c7060c883bd2901"} Jul 08 22:30:04.256638 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:04.256546 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-qqltd" event={"ID":"f716242a-d9bc-415f-9e3f-18f96b24cced","Type":"ContainerStarted","Data":"e1aed01cd240a2ffdf147371650130255ab49bf10cb2cec579ca6d38dd87eef6"} Jul 08 22:30:04.303885 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:04.303823 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-131-200.ec2.internal" podStartSLOduration=12.303805149 podStartE2EDuration="12.303805149s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:29:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:04.282026471 +0000 UTC m=+14.620733445" watchObservedRunningTime="2026-07-08 22:30:04.303805149 +0000 UTC m=+14.642512115" Jul 08 22:30:06.179707 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:06.179493 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:30:06.180277 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:06.179502 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:30:06.180277 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:06.179795 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58csw" podUID="98d1079e-ad90-4a60-bcaf-9005a7796b03" Jul 08 22:30:06.180277 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:06.179891 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2gl" podUID="83988472-fc5e-4e4a-a7ab-248bd26e4a48" Jul 08 22:30:06.180277 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:06.179584 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:30:06.180277 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:06.179971 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pts6q" podUID="e46b9a2f-6200-4556-9b64-ddc55dc0be5e" Jul 08 22:30:06.264505 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:06.264465 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-j9nc8" event={"ID":"f7ec2b7c-a8c1-402e-9166-6cfc487a0115","Type":"ContainerStarted","Data":"b62ebd654de05b03a632f3be6436ae726f2219bf40b988093027578304b73af9"} Jul 08 22:30:06.266330 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:06.266297 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-rm7kj" event={"ID":"5aaf8eb4-8a4e-43e1-a844-2226f1ca100b","Type":"ContainerStarted","Data":"a1d9f12c347deb0621ea4458dd3d4096d044db0b387f39945fab846f87574061"} Jul 08 22:30:06.267941 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:06.267910 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-pn7b8" event={"ID":"6863dfc5-3c16-42a7-93a6-dc36e4722c27","Type":"ContainerStarted","Data":"3ed94119496a775e0e29f7d829c2e4c55be1daff9e10aa533d1378d2c1630c8d"} Jul 08 22:30:06.269630 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:06.269603 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-kfjcx" event={"ID":"901cfe25-d655-4c55-8eda-68305dc9b179","Type":"ContainerStarted","Data":"d2fe2c0b28e97319892ee7da9a666247649b33590faf4ea1fc670f8c00932c94"} Jul 08 22:30:06.271235 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:06.271209 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal" event={"ID":"20a2b64c52acbf1e12a73711c6a93783","Type":"ContainerStarted","Data":"2233bbb59318e7efa8ec8d23c7be6d06fdb1b3104476d6f9fd7e51d4e003ca49"} Jul 08 22:30:06.273046 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:06.273020 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" event={"ID":"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a","Type":"ContainerStarted","Data":"6fd62aa3ed1c80fcb5f8fc79cf9df666fc1a0a083a11196718c938310a0b1da3"} Jul 08 22:30:06.274631 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:06.274611 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtwhq" event={"ID":"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4","Type":"ContainerStarted","Data":"447b4039faa3eb9c054f8f025d121e0f4988d930a1d2520d12967315d8ecc6a3"} Jul 08 22:30:06.279818 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:06.279780 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-j9nc8" podStartSLOduration=3.715431599 podStartE2EDuration="15.279767822s" totalImagesPullingTime="11.564336223s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:06.279709446 +0000 UTC m=+16.618416420" watchObservedRunningTime="2026-07-08 22:30:06.279767822 +0000 UTC m=+16.618474795" Jul 08 22:30:06.280218 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:06.280190 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-qqltd" podStartSLOduration=3.743021372 podStartE2EDuration="15.28018024s" totalImagesPullingTime="11.537158868s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:04.303910692 +0000 UTC m=+14.642617684" watchObservedRunningTime="2026-07-08 22:30:06.28018024 +0000 UTC m=+16.618887217" Jul 08 22:30:06.294359 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:06.294312 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-pn7b8" podStartSLOduration=4.704955511 podStartE2EDuration="16.294295336s" totalImagesPullingTime="11.589339825s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:29:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:06.293889768 +0000 UTC m=+16.632596743" watchObservedRunningTime="2026-07-08 22:30:06.294295336 +0000 UTC m=+16.633002308" Jul 08 22:30:06.321778 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:06.321717 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-kfjcx" podStartSLOduration=4.728933282 podStartE2EDuration="16.321698448s" totalImagesPullingTime="11.592765166s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:29:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:06.321331674 +0000 UTC m=+16.660038647" watchObservedRunningTime="2026-07-08 22:30:06.321698448 +0000 UTC m=+16.660405423" Jul 08 22:30:06.334755 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:06.334697 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-rm7kj" podStartSLOduration=3.763586014 podStartE2EDuration="15.334674852s" totalImagesPullingTime="11.571088838s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:06.334593295 +0000 UTC m=+16.673300295" watchObservedRunningTime="2026-07-08 22:30:06.334674852 +0000 UTC m=+16.673381825" Jul 08 22:30:07.936187 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:07.936141 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs\") pod \"network-metrics-daemon-2t2gl\" (UID: \"83988472-fc5e-4e4a-a7ab-248bd26e4a48\") " pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:30:07.937004 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:07.936235 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret\") pod \"global-pull-secret-syncer-58csw\" (UID: \"98d1079e-ad90-4a60-bcaf-9005a7796b03\") " pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:30:07.937004 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:07.936329 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 22:30:07.937004 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:07.936325 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:30:07.937004 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:07.936391 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret podName:98d1079e-ad90-4a60-bcaf-9005a7796b03 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:23.936375145 +0000 UTC m=+34.275082109 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret") pod "global-pull-secret-syncer-58csw" (UID: "98d1079e-ad90-4a60-bcaf-9005a7796b03") : object "kube-system"/"original-pull-secret" not registered Jul 08 22:30:07.937004 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:07.936409 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs podName:83988472-fc5e-4e4a-a7ab-248bd26e4a48 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:23.936399772 +0000 UTC m=+34.275106724 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs") pod "network-metrics-daemon-2t2gl" (UID: "83988472-fc5e-4e4a-a7ab-248bd26e4a48") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:30:08.037066 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:08.037027 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4jv4\" (UniqueName: \"kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4\") pod \"network-check-target-pts6q\" (UID: \"e46b9a2f-6200-4556-9b64-ddc55dc0be5e\") " pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:30:08.037263 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:08.037238 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 22:30:08.037362 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:08.037272 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 22:30:08.037362 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:08.037285 2573 projected.go:196] Error preparing data for projected volume kube-api-access-p4jv4 for pod openshift-network-diagnostics/network-check-target-pts6q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:30:08.037362 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:08.037356 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4 podName:e46b9a2f-6200-4556-9b64-ddc55dc0be5e nodeName:}" failed. No retries permitted until 2026-07-08 22:30:24.037339536 +0000 UTC m=+34.376046506 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-p4jv4" (UniqueName: "kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4") pod "network-check-target-pts6q" (UID: "e46b9a2f-6200-4556-9b64-ddc55dc0be5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:30:08.176431 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:08.176399 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:30:08.176639 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:08.176450 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:30:08.176639 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:08.176399 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:30:08.176639 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:08.176517 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pts6q" podUID="e46b9a2f-6200-4556-9b64-ddc55dc0be5e" Jul 08 22:30:08.176639 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:08.176609 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58csw" podUID="98d1079e-ad90-4a60-bcaf-9005a7796b03" Jul 08 22:30:08.176824 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:08.176698 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2gl" podUID="83988472-fc5e-4e4a-a7ab-248bd26e4a48" Jul 08 22:30:09.238491 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:09.238450 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-j9nc8" Jul 08 22:30:09.239345 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:09.239317 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-j9nc8" Jul 08 22:30:10.180231 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:10.180025 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:30:10.180387 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:10.180105 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:30:10.180387 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:10.180315 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58csw" podUID="98d1079e-ad90-4a60-bcaf-9005a7796b03" Jul 08 22:30:10.180496 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:10.180117 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:30:10.180496 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:10.180408 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pts6q" podUID="e46b9a2f-6200-4556-9b64-ddc55dc0be5e" Jul 08 22:30:10.180631 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:10.180527 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2gl" podUID="83988472-fc5e-4e4a-a7ab-248bd26e4a48" Jul 08 22:30:12.177013 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:12.176524 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:30:12.177013 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:12.176575 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:30:12.177013 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:12.176678 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58csw" podUID="98d1079e-ad90-4a60-bcaf-9005a7796b03" Jul 08 22:30:12.177013 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:12.176781 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:30:12.177013 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:12.176898 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2gl" podUID="83988472-fc5e-4e4a-a7ab-248bd26e4a48" Jul 08 22:30:12.177013 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:12.176973 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pts6q" podUID="e46b9a2f-6200-4556-9b64-ddc55dc0be5e" Jul 08 22:30:13.293672 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:13.293624 2573 generic.go:356] "Generic (PLEG): container finished" podID="ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4" containerID="447b4039faa3eb9c054f8f025d121e0f4988d930a1d2520d12967315d8ecc6a3" exitCode=0 Jul 08 22:30:13.294069 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:13.293700 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtwhq" event={"ID":"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4","Type":"ContainerDied","Data":"447b4039faa3eb9c054f8f025d121e0f4988d930a1d2520d12967315d8ecc6a3"} Jul 08 22:30:13.298694 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:13.296215 2573 generic.go:356] "Generic (PLEG): container finished" podID="20a2b64c52acbf1e12a73711c6a93783" containerID="2233bbb59318e7efa8ec8d23c7be6d06fdb1b3104476d6f9fd7e51d4e003ca49" exitCode=0 Jul 08 22:30:13.298694 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:13.296298 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal" event={"ID":"20a2b64c52acbf1e12a73711c6a93783","Type":"ContainerDied","Data":"2233bbb59318e7efa8ec8d23c7be6d06fdb1b3104476d6f9fd7e51d4e003ca49"} Jul 08 22:30:13.302708 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:13.302082 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-8pfgv" event={"ID":"87424d7c-287f-40f1-8708-bc4a8c81f996","Type":"ContainerStarted","Data":"e79bfb2ed72baaa39b9c83e043cb0a5bccdd3a33409fdac30f278fe27543459e"} Jul 08 22:30:13.304680 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:13.304582 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" event={"ID":"71dfdf35-72dc-4e6d-8b65-516381e2e9a8","Type":"ContainerStarted","Data":"5b966ce9c07b2c765535d34bccc6be6471d6df2c829d0220b218bcde23ecb114"} Jul 08 22:30:13.338353 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:13.338095 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-8pfgv" podStartSLOduration=1.6093395579999998 podStartE2EDuration="22.338072182s" totalImagesPullingTime="20.728732624s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:13.337130398 +0000 UTC m=+23.675837372" watchObservedRunningTime="2026-07-08 22:30:13.338072182 +0000 UTC m=+23.676779152" Jul 08 22:30:13.703927 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:13.703840 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-j9nc8" Jul 08 22:30:13.704100 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:13.703977 2573 prober_manager.go:312] "Failed to trigger a manual run" probe="Readiness" Jul 08 22:30:13.704547 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:13.704523 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-j9nc8" Jul 08 22:30:14.176716 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:14.176688 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:30:14.176872 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:14.176690 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:30:14.176872 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:14.176827 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2gl" podUID="83988472-fc5e-4e4a-a7ab-248bd26e4a48" Jul 08 22:30:14.176872 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:14.176698 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:30:14.177014 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:14.176883 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58csw" podUID="98d1079e-ad90-4a60-bcaf-9005a7796b03" Jul 08 22:30:14.177014 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:14.176940 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pts6q" podUID="e46b9a2f-6200-4556-9b64-ddc55dc0be5e" Jul 08 22:30:14.276259 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:14.276230 2573 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 08 22:30:14.311384 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:14.311344 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal" event={"ID":"20a2b64c52acbf1e12a73711c6a93783","Type":"ContainerStarted","Data":"4cad5023e87e364b29de0ec83fd97946a691c7e029185018d80aca35a069e37f"} Jul 08 22:30:14.314748 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:14.314719 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" event={"ID":"71dfdf35-72dc-4e6d-8b65-516381e2e9a8","Type":"ContainerStarted","Data":"b305b8cfecf1748e8ab6fa07eca1ae55056840ebc9a847ec7a18b4cab914018b"} Jul 08 22:30:14.314873 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:14.314814 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" event={"ID":"71dfdf35-72dc-4e6d-8b65-516381e2e9a8","Type":"ContainerStarted","Data":"2498a54b5ee942a43513aa4bde107ad7a27aea528ec21a194b5204e304bac63b"} Jul 08 22:30:14.314873 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:14.314870 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" event={"ID":"71dfdf35-72dc-4e6d-8b65-516381e2e9a8","Type":"ContainerStarted","Data":"63a5118ad38861d5628d49f250ca4c30d34a5539681f6399efe043ec1d8573e4"} Jul 08 22:30:14.314955 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:14.314914 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" event={"ID":"71dfdf35-72dc-4e6d-8b65-516381e2e9a8","Type":"ContainerStarted","Data":"4ab53e019a5911e453993448bf0d14412dd97da32d429e28560601d7854a5eb4"} Jul 08 22:30:14.315007 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:14.314959 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" event={"ID":"71dfdf35-72dc-4e6d-8b65-516381e2e9a8","Type":"ContainerStarted","Data":"28621db546fb4c5a0bc94e06543832602a9518ac52a7729d2ddc916b98b9e271"} Jul 08 22:30:14.316966 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:14.316939 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" event={"ID":"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a","Type":"ContainerStarted","Data":"54216ccd3f724bbc01363c0e00c6290e96e48dfcae0f5d823490f57f02e3d842"} Jul 08 22:30:15.159482 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:15.159355 2573 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-08T22:30:14.276251788Z","UUID":"1d2b5727-13c4-411e-ba94-f756f9e54e30","Handler":null,"Name":"","Endpoint":""} Jul 08 22:30:15.161437 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:15.161410 2573 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 08 22:30:15.161602 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:15.161456 2573 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 08 22:30:16.176577 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:16.176528 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:30:16.176577 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:16.176545 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:30:16.177227 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:16.176528 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:30:16.177227 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:16.176669 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58csw" podUID="98d1079e-ad90-4a60-bcaf-9005a7796b03" Jul 08 22:30:16.177227 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:16.176756 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pts6q" podUID="e46b9a2f-6200-4556-9b64-ddc55dc0be5e" Jul 08 22:30:16.177227 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:16.176827 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2gl" podUID="83988472-fc5e-4e4a-a7ab-248bd26e4a48" Jul 08 22:30:16.324569 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:16.324463 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" event={"ID":"71dfdf35-72dc-4e6d-8b65-516381e2e9a8","Type":"ContainerStarted","Data":"9022f0bd4bb273230faf941bd248935002aa3367e8b99fe0f2d7c68efa8afa1c"} Jul 08 22:30:16.326420 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:16.326396 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" event={"ID":"3157419c-e9ba-48ef-a9f9-302b0aa3cc1a","Type":"ContainerStarted","Data":"e99635bb5972b06cc14089e08f8bf81712e85f5d9018822e14478eb8a962eafa"} Jul 08 22:30:16.343564 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:16.343518 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-6dhlq" podStartSLOduration=3.685701654 podStartE2EDuration="25.343503082s" totalImagesPullingTime="21.657801428s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:29:51 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:16.343140708 +0000 UTC m=+26.681847682" watchObservedRunningTime="2026-07-08 22:30:16.343503082 +0000 UTC m=+26.682210055" Jul 08 22:30:16.343705 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:16.343680 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-131-200.ec2.internal" podStartSLOduration=24.343669753 podStartE2EDuration="24.343669753s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:29:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:14.340790162 +0000 UTC m=+24.679497136" watchObservedRunningTime="2026-07-08 22:30:16.343669753 +0000 UTC m=+26.682376726" Jul 08 22:30:18.177254 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:18.177224 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:30:18.177687 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:18.177224 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:30:18.177687 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:18.177336 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pts6q" podUID="e46b9a2f-6200-4556-9b64-ddc55dc0be5e" Jul 08 22:30:18.177687 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:18.177224 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:30:18.177687 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:18.177456 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2gl" podUID="83988472-fc5e-4e4a-a7ab-248bd26e4a48" Jul 08 22:30:18.177687 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:18.177544 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58csw" podUID="98d1079e-ad90-4a60-bcaf-9005a7796b03" Jul 08 22:30:18.335801 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:18.335520 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" event={"ID":"71dfdf35-72dc-4e6d-8b65-516381e2e9a8","Type":"ContainerStarted","Data":"a32a3d5e392d6507bf2dee940e5a04e72dd56aa0d1dd54d3d99d8272cc1962da"} Jul 08 22:30:18.335953 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:18.335893 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:30:18.335996 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:18.335968 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:30:18.336101 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:18.336081 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:30:18.355471 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:18.355428 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:30:18.355644 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:18.355535 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:30:18.363635 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:18.363592 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" podStartSLOduration=6.606370638 podStartE2EDuration="27.363577513s" totalImagesPullingTime="20.757206875s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:18.363354282 +0000 UTC m=+28.702061267" watchObservedRunningTime="2026-07-08 22:30:18.363577513 +0000 UTC m=+28.702284486" Jul 08 22:30:20.191031 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:20.190996 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-58csw"] Jul 08 22:30:20.191478 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:20.191162 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:30:20.191478 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:20.191271 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2gl" podUID="83988472-fc5e-4e4a-a7ab-248bd26e4a48" Jul 08 22:30:20.191656 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:20.191636 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:30:20.191748 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:20.191730 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58csw" podUID="98d1079e-ad90-4a60-bcaf-9005a7796b03" Jul 08 22:30:20.191835 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:20.191781 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:30:20.191910 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:20.191837 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pts6q" podUID="e46b9a2f-6200-4556-9b64-ddc55dc0be5e" Jul 08 22:30:20.191910 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:20.191860 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pts6q"] Jul 08 22:30:20.192940 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:20.192917 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2t2gl"] Jul 08 22:30:20.340234 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:20.340198 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:30:20.340234 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:20.340224 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:30:20.340451 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:20.340343 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pts6q" podUID="e46b9a2f-6200-4556-9b64-ddc55dc0be5e" Jul 08 22:30:20.340825 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:20.340799 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2gl" podUID="83988472-fc5e-4e4a-a7ab-248bd26e4a48" Jul 08 22:30:21.344341 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:21.344308 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtwhq" event={"ID":"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4","Type":"ContainerStarted","Data":"21ed9e5b08e0f11013c5de5c44bd7897d76b29f73e0fcec007655f72b7bd96e7"} Jul 08 22:30:22.176605 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:22.176570 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:30:22.176796 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:22.176548 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:30:22.176796 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:22.176687 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58csw" podUID="98d1079e-ad90-4a60-bcaf-9005a7796b03" Jul 08 22:30:22.176796 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:22.176570 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:30:22.176796 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:22.176759 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pts6q" podUID="e46b9a2f-6200-4556-9b64-ddc55dc0be5e" Jul 08 22:30:22.176965 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:22.176829 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2gl" podUID="83988472-fc5e-4e4a-a7ab-248bd26e4a48" Jul 08 22:30:22.348226 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:22.348195 2573 generic.go:356] "Generic (PLEG): container finished" podID="ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4" containerID="21ed9e5b08e0f11013c5de5c44bd7897d76b29f73e0fcec007655f72b7bd96e7" exitCode=0 Jul 08 22:30:22.348591 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:22.348249 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtwhq" event={"ID":"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4","Type":"ContainerDied","Data":"21ed9e5b08e0f11013c5de5c44bd7897d76b29f73e0fcec007655f72b7bd96e7"} Jul 08 22:30:23.956817 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:23.956587 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret\") pod \"global-pull-secret-syncer-58csw\" (UID: \"98d1079e-ad90-4a60-bcaf-9005a7796b03\") " pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:30:23.956817 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:23.956795 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs\") pod \"network-metrics-daemon-2t2gl\" (UID: \"83988472-fc5e-4e4a-a7ab-248bd26e4a48\") " pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:30:23.957242 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:23.956717 2573 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 08 22:30:23.957242 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:23.956879 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret podName:98d1079e-ad90-4a60-bcaf-9005a7796b03 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:55.956864277 +0000 UTC m=+66.295571227 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret") pod "global-pull-secret-syncer-58csw" (UID: "98d1079e-ad90-4a60-bcaf-9005a7796b03") : object "kube-system"/"original-pull-secret" not registered Jul 08 22:30:23.957242 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:23.956911 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:30:23.957242 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:23.956961 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs podName:83988472-fc5e-4e4a-a7ab-248bd26e4a48 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:55.956943897 +0000 UTC m=+66.295650848 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs") pod "network-metrics-daemon-2t2gl" (UID: "83988472-fc5e-4e4a-a7ab-248bd26e4a48") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 08 22:30:24.057136 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:24.057108 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4jv4\" (UniqueName: \"kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4\") pod \"network-check-target-pts6q\" (UID: \"e46b9a2f-6200-4556-9b64-ddc55dc0be5e\") " pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:30:24.057306 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:24.057271 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 08 22:30:24.057306 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:24.057295 2573 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 08 22:30:24.057422 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:24.057311 2573 projected.go:196] Error preparing data for projected volume kube-api-access-p4jv4 for pod openshift-network-diagnostics/network-check-target-pts6q: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:30:24.057422 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:24.057384 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4 podName:e46b9a2f-6200-4556-9b64-ddc55dc0be5e nodeName:}" failed. No retries permitted until 2026-07-08 22:30:56.057356823 +0000 UTC m=+66.396063794 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-p4jv4" (UniqueName: "kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4") pod "network-check-target-pts6q" (UID: "e46b9a2f-6200-4556-9b64-ddc55dc0be5e") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 08 22:30:24.176467 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:24.176428 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:30:24.176725 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:24.176432 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:30:24.176725 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:24.176575 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-2t2gl" podUID="83988472-fc5e-4e4a-a7ab-248bd26e4a48" Jul 08 22:30:24.176725 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:24.176434 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:30:24.176725 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:24.176624 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-58csw" podUID="98d1079e-ad90-4a60-bcaf-9005a7796b03" Jul 08 22:30:24.176725 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:24.176672 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-pts6q" podUID="e46b9a2f-6200-4556-9b64-ddc55dc0be5e" Jul 08 22:30:24.354944 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:24.354861 2573 generic.go:356] "Generic (PLEG): container finished" podID="ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4" containerID="f50a9b908aca1cd04efa9b9812444fee287685625f21c900b60cec79f40bead6" exitCode=0 Jul 08 22:30:24.354944 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:24.354921 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtwhq" event={"ID":"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4","Type":"ContainerDied","Data":"f50a9b908aca1cd04efa9b9812444fee287685625f21c900b60cec79f40bead6"} Jul 08 22:30:25.987429 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:25.987403 2573 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-131-200.ec2.internal" event="NodeReady" Jul 08 22:30:25.988041 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:25.987929 2573 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 08 22:30:26.022393 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.022358 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h"] Jul 08 22:30:26.031469 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.031445 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-668b798ff7-pdmpm"] Jul 08 22:30:26.031758 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.031593 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" Jul 08 22:30:26.034374 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.034351 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 08 22:30:26.034495 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.034353 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lrqf9\"" Jul 08 22:30:26.034601 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.034581 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 08 22:30:26.043758 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.043730 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h"] Jul 08 22:30:26.043873 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.043769 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-ldnsr"] Jul 08 22:30:26.043929 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.043897 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.046239 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.046214 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 08 22:30:26.046355 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.046323 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8mxl8\"" Jul 08 22:30:26.046421 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.046363 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 08 22:30:26.046474 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.046437 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 08 22:30:26.051036 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.051011 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 08 22:30:26.057971 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.057950 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-2g9hb"] Jul 08 22:30:26.058072 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.058037 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ldnsr" Jul 08 22:30:26.060668 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.060651 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5pzmj\"" Jul 08 22:30:26.060750 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.060672 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 08 22:30:26.060957 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.060937 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 08 22:30:26.068286 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.068268 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-668b798ff7-pdmpm"] Jul 08 22:30:26.068406 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.068303 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ldnsr"] Jul 08 22:30:26.068406 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.068321 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2g9hb"] Jul 08 22:30:26.068406 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.068396 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2g9hb" Jul 08 22:30:26.070815 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.070797 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 08 22:30:26.070915 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.070822 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 08 22:30:26.070915 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.070859 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-v84dk\"" Jul 08 22:30:26.070996 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.070917 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 08 22:30:26.173677 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.173642 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls\") pod \"dns-default-ldnsr\" (UID: \"67bdd4c4-38d8-4f50-92bd-73055c10f401\") " pod="openshift-dns/dns-default-ldnsr" Jul 08 22:30:26.173677 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.173679 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/484b5bc8-bcca-47de-ad41-453f35efec77-image-registry-private-configuration\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.173961 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.173698 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t66kh\" (UniqueName: \"kubernetes.io/projected/ff30c41b-0ed8-4b43-a28c-75834602f728-kube-api-access-t66kh\") pod \"ingress-canary-2g9hb\" (UID: \"ff30c41b-0ed8-4b43-a28c-75834602f728\") " pod="openshift-ingress-canary/ingress-canary-2g9hb" Jul 08 22:30:26.173961 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.173759 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.173961 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.173796 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/484b5bc8-bcca-47de-ad41-453f35efec77-registry-certificates\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.173961 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.173811 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wf867\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-kube-api-access-wf867\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.173961 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.173850 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/484b5bc8-bcca-47de-ad41-453f35efec77-installation-pull-secrets\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.173961 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.173878 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff30c41b-0ed8-4b43-a28c-75834602f728-cert\") pod \"ingress-canary-2g9hb\" (UID: \"ff30c41b-0ed8-4b43-a28c-75834602f728\") " pod="openshift-ingress-canary/ingress-canary-2g9hb" Jul 08 22:30:26.173961 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.173897 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67bdd4c4-38d8-4f50-92bd-73055c10f401-tmp-dir\") pod \"dns-default-ldnsr\" (UID: \"67bdd4c4-38d8-4f50-92bd-73055c10f401\") " pod="openshift-dns/dns-default-ldnsr" Jul 08 22:30:26.173961 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.173960 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2025a9dd-3c77-4432-a494-4da125abf86f-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-x8r8h\" (UID: \"2025a9dd-3c77-4432-a494-4da125abf86f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" Jul 08 22:30:26.174199 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.173980 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-bound-sa-token\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.174199 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.174000 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/67bdd4c4-38d8-4f50-92bd-73055c10f401-config-volume\") pod \"dns-default-ldnsr\" (UID: \"67bdd4c4-38d8-4f50-92bd-73055c10f401\") " pod="openshift-dns/dns-default-ldnsr" Jul 08 22:30:26.174199 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.174024 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pjs9d\" (UniqueName: \"kubernetes.io/projected/67bdd4c4-38d8-4f50-92bd-73055c10f401-kube-api-access-pjs9d\") pod \"dns-default-ldnsr\" (UID: \"67bdd4c4-38d8-4f50-92bd-73055c10f401\") " pod="openshift-dns/dns-default-ldnsr" Jul 08 22:30:26.174199 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.174043 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-x8r8h\" (UID: \"2025a9dd-3c77-4432-a494-4da125abf86f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" Jul 08 22:30:26.174199 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.174074 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/484b5bc8-bcca-47de-ad41-453f35efec77-ca-trust-extracted\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.174199 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.174093 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/484b5bc8-bcca-47de-ad41-453f35efec77-trusted-ca\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.176739 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.176725 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:30:26.176824 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.176727 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:30:26.176859 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.176832 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:30:26.179289 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.179268 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 22:30:26.179738 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.179573 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 22:30:26.179738 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.179617 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tm4h7\"" Jul 08 22:30:26.179738 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.179641 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 22:30:26.179738 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.179698 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lrv86\"" Jul 08 22:30:26.179924 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.179894 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 22:30:26.200400 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.200372 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9nc8_f7ec2b7c-a8c1-402e-9166-6cfc487a0115/konnectivity-agent/0.log" limit=1024 Jul 08 22:30:26.274646 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.274541 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls\") pod \"dns-default-ldnsr\" (UID: \"67bdd4c4-38d8-4f50-92bd-73055c10f401\") " pod="openshift-dns/dns-default-ldnsr" Jul 08 22:30:26.274646 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.274604 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/484b5bc8-bcca-47de-ad41-453f35efec77-image-registry-private-configuration\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.274646 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.274628 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t66kh\" (UniqueName: \"kubernetes.io/projected/ff30c41b-0ed8-4b43-a28c-75834602f728-kube-api-access-t66kh\") pod \"ingress-canary-2g9hb\" (UID: \"ff30c41b-0ed8-4b43-a28c-75834602f728\") " pod="openshift-ingress-canary/ingress-canary-2g9hb" Jul 08 22:30:26.274646 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.274647 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.274968 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.274663 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/484b5bc8-bcca-47de-ad41-453f35efec77-registry-certificates\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.274968 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.274678 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wf867\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-kube-api-access-wf867\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.274968 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:26.274694 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 22:30:26.274968 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:26.274808 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls podName:67bdd4c4-38d8-4f50-92bd-73055c10f401 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:26.774786046 +0000 UTC m=+37.113492999 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls") pod "dns-default-ldnsr" (UID: "67bdd4c4-38d8-4f50-92bd-73055c10f401") : secret "dns-default-metrics-tls" not found Jul 08 22:30:26.274968 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:26.274871 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 22:30:26.274968 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:26.274892 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-668b798ff7-pdmpm: secret "image-registry-tls" not found Jul 08 22:30:26.274968 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.274701 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/484b5bc8-bcca-47de-ad41-453f35efec77-installation-pull-secrets\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.274968 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:26.274964 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls podName:484b5bc8-bcca-47de-ad41-453f35efec77 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:26.774946565 +0000 UTC m=+37.113653530 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls") pod "image-registry-668b798ff7-pdmpm" (UID: "484b5bc8-bcca-47de-ad41-453f35efec77") : secret "image-registry-tls" not found Jul 08 22:30:26.275366 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.274983 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff30c41b-0ed8-4b43-a28c-75834602f728-cert\") pod \"ingress-canary-2g9hb\" (UID: \"ff30c41b-0ed8-4b43-a28c-75834602f728\") " pod="openshift-ingress-canary/ingress-canary-2g9hb" Jul 08 22:30:26.275366 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.275006 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67bdd4c4-38d8-4f50-92bd-73055c10f401-tmp-dir\") pod \"dns-default-ldnsr\" (UID: \"67bdd4c4-38d8-4f50-92bd-73055c10f401\") " pod="openshift-dns/dns-default-ldnsr" Jul 08 22:30:26.275366 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.275045 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2025a9dd-3c77-4432-a494-4da125abf86f-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-x8r8h\" (UID: \"2025a9dd-3c77-4432-a494-4da125abf86f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" Jul 08 22:30:26.275366 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.275061 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-bound-sa-token\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.275366 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.275083 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/67bdd4c4-38d8-4f50-92bd-73055c10f401-config-volume\") pod \"dns-default-ldnsr\" (UID: \"67bdd4c4-38d8-4f50-92bd-73055c10f401\") " pod="openshift-dns/dns-default-ldnsr" Jul 08 22:30:26.275366 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.275125 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pjs9d\" (UniqueName: \"kubernetes.io/projected/67bdd4c4-38d8-4f50-92bd-73055c10f401-kube-api-access-pjs9d\") pod \"dns-default-ldnsr\" (UID: \"67bdd4c4-38d8-4f50-92bd-73055c10f401\") " pod="openshift-dns/dns-default-ldnsr" Jul 08 22:30:26.275693 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.275397 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/484b5bc8-bcca-47de-ad41-453f35efec77-registry-certificates\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.275693 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.275425 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/67bdd4c4-38d8-4f50-92bd-73055c10f401-tmp-dir\") pod \"dns-default-ldnsr\" (UID: \"67bdd4c4-38d8-4f50-92bd-73055c10f401\") " pod="openshift-dns/dns-default-ldnsr" Jul 08 22:30:26.275693 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:26.275459 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 22:30:26.275693 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:26.275525 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert podName:2025a9dd-3c77-4432-a494-4da125abf86f nodeName:}" failed. No retries permitted until 2026-07-08 22:30:26.775508869 +0000 UTC m=+37.114215833 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-x8r8h" (UID: "2025a9dd-3c77-4432-a494-4da125abf86f") : secret "networking-console-plugin-cert" not found Jul 08 22:30:26.275693 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.275579 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-x8r8h\" (UID: \"2025a9dd-3c77-4432-a494-4da125abf86f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" Jul 08 22:30:26.275693 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.275647 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/484b5bc8-bcca-47de-ad41-453f35efec77-ca-trust-extracted\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.275693 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.275677 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/484b5bc8-bcca-47de-ad41-453f35efec77-trusted-ca\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.275693 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.275685 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/67bdd4c4-38d8-4f50-92bd-73055c10f401-config-volume\") pod \"dns-default-ldnsr\" (UID: \"67bdd4c4-38d8-4f50-92bd-73055c10f401\") " pod="openshift-dns/dns-default-ldnsr" Jul 08 22:30:26.276051 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.275910 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2025a9dd-3c77-4432-a494-4da125abf86f-nginx-conf\") pod \"networking-console-plugin-6bffdf9778-x8r8h\" (UID: \"2025a9dd-3c77-4432-a494-4da125abf86f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" Jul 08 22:30:26.276051 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.275935 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/484b5bc8-bcca-47de-ad41-453f35efec77-ca-trust-extracted\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.276520 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.276501 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/484b5bc8-bcca-47de-ad41-453f35efec77-trusted-ca\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.279324 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.279306 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/ff30c41b-0ed8-4b43-a28c-75834602f728-cert\") pod \"ingress-canary-2g9hb\" (UID: \"ff30c41b-0ed8-4b43-a28c-75834602f728\") " pod="openshift-ingress-canary/ingress-canary-2g9hb" Jul 08 22:30:26.282729 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.282704 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/484b5bc8-bcca-47de-ad41-453f35efec77-image-registry-private-configuration\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.282849 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.282726 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/484b5bc8-bcca-47de-ad41-453f35efec77-installation-pull-secrets\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.285972 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.285944 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pjs9d\" (UniqueName: \"kubernetes.io/projected/67bdd4c4-38d8-4f50-92bd-73055c10f401-kube-api-access-pjs9d\") pod \"dns-default-ldnsr\" (UID: \"67bdd4c4-38d8-4f50-92bd-73055c10f401\") " pod="openshift-dns/dns-default-ldnsr" Jul 08 22:30:26.286591 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.286547 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-bound-sa-token\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.286705 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.286656 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9nc8_f7ec2b7c-a8c1-402e-9166-6cfc487a0115/konnectivity-agent/0.log" limit=1024 Jul 08 22:30:26.286705 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.286662 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t66kh\" (UniqueName: \"kubernetes.io/projected/ff30c41b-0ed8-4b43-a28c-75834602f728-kube-api-access-t66kh\") pod \"ingress-canary-2g9hb\" (UID: \"ff30c41b-0ed8-4b43-a28c-75834602f728\") " pod="openshift-ingress-canary/ingress-canary-2g9hb" Jul 08 22:30:26.286817 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.286735 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wf867\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-kube-api-access-wf867\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.361879 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.361843 2573 generic.go:356] "Generic (PLEG): container finished" podID="ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4" containerID="dc203592f3289ff30b3d018876ad3e4d44ddb92044cdd2b96bef1b9a3bb32dcb" exitCode=0 Jul 08 22:30:26.362042 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.361893 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtwhq" event={"ID":"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4","Type":"ContainerDied","Data":"dc203592f3289ff30b3d018876ad3e4d44ddb92044cdd2b96bef1b9a3bb32dcb"} Jul 08 22:30:26.376358 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.376331 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-2g9hb" Jul 08 22:30:26.540957 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.540717 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-2g9hb"] Jul 08 22:30:26.544377 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:30:26.544348 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podff30c41b_0ed8_4b43_a28c_75834602f728.slice/crio-59d3a599bdad1a94bd42a3268d41cf67e337404606bd1554a4da1b828e328b52 WatchSource:0}: Error finding container 59d3a599bdad1a94bd42a3268d41cf67e337404606bd1554a4da1b828e328b52: Status 404 returned error can't find the container with id 59d3a599bdad1a94bd42a3268d41cf67e337404606bd1554a4da1b828e328b52 Jul 08 22:30:26.755905 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.755864 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9nc8_f7ec2b7c-a8c1-402e-9166-6cfc487a0115/konnectivity-agent/0.log" limit=1024 Jul 08 22:30:26.780302 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.780268 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-x8r8h\" (UID: \"2025a9dd-3c77-4432-a494-4da125abf86f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" Jul 08 22:30:26.780454 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.780355 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls\") pod \"dns-default-ldnsr\" (UID: \"67bdd4c4-38d8-4f50-92bd-73055c10f401\") " pod="openshift-dns/dns-default-ldnsr" Jul 08 22:30:26.780454 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:26.780391 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 22:30:26.780454 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:26.780452 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 22:30:26.780595 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:26.780462 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-668b798ff7-pdmpm: secret "image-registry-tls" not found Jul 08 22:30:26.780595 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:26.780466 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert podName:2025a9dd-3c77-4432-a494-4da125abf86f nodeName:}" failed. No retries permitted until 2026-07-08 22:30:27.780447504 +0000 UTC m=+38.119154459 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-x8r8h" (UID: "2025a9dd-3c77-4432-a494-4da125abf86f") : secret "networking-console-plugin-cert" not found Jul 08 22:30:26.780595 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:26.780495 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls podName:484b5bc8-bcca-47de-ad41-453f35efec77 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:27.780484683 +0000 UTC m=+38.119191635 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls") pod "image-registry-668b798ff7-pdmpm" (UID: "484b5bc8-bcca-47de-ad41-453f35efec77") : secret "image-registry-tls" not found Jul 08 22:30:26.780595 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:26.780502 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 22:30:26.780595 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:26.780572 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls podName:67bdd4c4-38d8-4f50-92bd-73055c10f401 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:27.780546088 +0000 UTC m=+38.119253043 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls") pod "dns-default-ldnsr" (UID: "67bdd4c4-38d8-4f50-92bd-73055c10f401") : secret "dns-default-metrics-tls" not found Jul 08 22:30:26.780595 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.780391 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:26.856713 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:26.856610 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9nc8_f7ec2b7c-a8c1-402e-9166-6cfc487a0115/konnectivity-agent/0.log" limit=1024 Jul 08 22:30:27.365687 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:27.365651 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2g9hb" event={"ID":"ff30c41b-0ed8-4b43-a28c-75834602f728","Type":"ContainerStarted","Data":"59d3a599bdad1a94bd42a3268d41cf67e337404606bd1554a4da1b828e328b52"} Jul 08 22:30:27.790067 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:27.790035 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-x8r8h\" (UID: \"2025a9dd-3c77-4432-a494-4da125abf86f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" Jul 08 22:30:27.790259 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:27.790128 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls\") pod \"dns-default-ldnsr\" (UID: \"67bdd4c4-38d8-4f50-92bd-73055c10f401\") " pod="openshift-dns/dns-default-ldnsr" Jul 08 22:30:27.790259 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:27.790168 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:27.790259 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:27.790219 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 22:30:27.790370 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:27.790291 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 22:30:27.790370 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:27.790307 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-668b798ff7-pdmpm: secret "image-registry-tls" not found Jul 08 22:30:27.790458 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:27.790391 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 22:30:27.790458 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:27.790294 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert podName:2025a9dd-3c77-4432-a494-4da125abf86f nodeName:}" failed. No retries permitted until 2026-07-08 22:30:29.790274329 +0000 UTC m=+40.128981293 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-x8r8h" (UID: "2025a9dd-3c77-4432-a494-4da125abf86f") : secret "networking-console-plugin-cert" not found Jul 08 22:30:27.790458 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:27.790435 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls podName:484b5bc8-bcca-47de-ad41-453f35efec77 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:29.790419167 +0000 UTC m=+40.129126120 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls") pod "image-registry-668b798ff7-pdmpm" (UID: "484b5bc8-bcca-47de-ad41-453f35efec77") : secret "image-registry-tls" not found Jul 08 22:30:27.790458 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:27.790450 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls podName:67bdd4c4-38d8-4f50-92bd-73055c10f401 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:29.790441239 +0000 UTC m=+40.129148190 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls") pod "dns-default-ldnsr" (UID: "67bdd4c4-38d8-4f50-92bd-73055c10f401") : secret "dns-default-metrics-tls" not found Jul 08 22:30:29.806814 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:29.806771 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-x8r8h\" (UID: \"2025a9dd-3c77-4432-a494-4da125abf86f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" Jul 08 22:30:29.807275 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:29.806871 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls\") pod \"dns-default-ldnsr\" (UID: \"67bdd4c4-38d8-4f50-92bd-73055c10f401\") " pod="openshift-dns/dns-default-ldnsr" Jul 08 22:30:29.807275 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:29.806898 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:29.807275 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:29.806952 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 22:30:29.807275 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:29.806972 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 22:30:29.807275 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:29.806987 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 22:30:29.807275 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:29.806997 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-668b798ff7-pdmpm: secret "image-registry-tls" not found Jul 08 22:30:29.807275 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:29.807029 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert podName:2025a9dd-3c77-4432-a494-4da125abf86f nodeName:}" failed. No retries permitted until 2026-07-08 22:30:33.807008256 +0000 UTC m=+44.145715222 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-x8r8h" (UID: "2025a9dd-3c77-4432-a494-4da125abf86f") : secret "networking-console-plugin-cert" not found Jul 08 22:30:29.807275 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:29.807049 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls podName:67bdd4c4-38d8-4f50-92bd-73055c10f401 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:33.807040082 +0000 UTC m=+44.145747035 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls") pod "dns-default-ldnsr" (UID: "67bdd4c4-38d8-4f50-92bd-73055c10f401") : secret "dns-default-metrics-tls" not found Jul 08 22:30:29.807275 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:29.807064 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls podName:484b5bc8-bcca-47de-ad41-453f35efec77 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:33.807055051 +0000 UTC m=+44.145762009 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls") pod "image-registry-668b798ff7-pdmpm" (UID: "484b5bc8-bcca-47de-ad41-453f35efec77") : secret "image-registry-tls" not found Jul 08 22:30:31.378033 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:31.377983 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-2g9hb" event={"ID":"ff30c41b-0ed8-4b43-a28c-75834602f728","Type":"ContainerStarted","Data":"39dcfe990c8668b57534dd88e3f7f04f8462f5b2c614266b9d9e00e942e03a4c"} Jul 08 22:30:31.395077 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:31.395011 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-2g9hb" podStartSLOduration=1.550464321 podStartE2EDuration="5.394994622s" totalImagesPullingTime="3.844530301s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:31.394802803 +0000 UTC m=+41.733509780" watchObservedRunningTime="2026-07-08 22:30:31.394994622 +0000 UTC m=+41.733701589" Jul 08 22:30:33.219827 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:33.219639 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9nc8_f7ec2b7c-a8c1-402e-9166-6cfc487a0115/konnectivity-agent/0.log" limit=1024 Jul 08 22:30:33.320440 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:33.320410 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9nc8_f7ec2b7c-a8c1-402e-9166-6cfc487a0115/konnectivity-agent/0.log" limit=1024 Jul 08 22:30:33.385081 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:33.385050 2573 generic.go:356] "Generic (PLEG): container finished" podID="ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4" containerID="06b50619910c3592a8d469ec8c5723b645024567e011272b9e862d4f04e6a0c7" exitCode=0 Jul 08 22:30:33.385217 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:33.385101 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtwhq" event={"ID":"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4","Type":"ContainerDied","Data":"06b50619910c3592a8d469ec8c5723b645024567e011272b9e862d4f04e6a0c7"} Jul 08 22:30:33.844725 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:33.844630 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-x8r8h\" (UID: \"2025a9dd-3c77-4432-a494-4da125abf86f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" Jul 08 22:30:33.844725 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:33.844694 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls\") pod \"dns-default-ldnsr\" (UID: \"67bdd4c4-38d8-4f50-92bd-73055c10f401\") " pod="openshift-dns/dns-default-ldnsr" Jul 08 22:30:33.844725 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:33.844731 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:33.844971 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:33.844801 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 22:30:33.844971 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:33.844823 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 22:30:33.844971 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:33.844836 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-668b798ff7-pdmpm: secret "image-registry-tls" not found Jul 08 22:30:33.844971 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:33.844862 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 22:30:33.844971 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:33.844884 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls podName:484b5bc8-bcca-47de-ad41-453f35efec77 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:41.844867119 +0000 UTC m=+52.183574084 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls") pod "image-registry-668b798ff7-pdmpm" (UID: "484b5bc8-bcca-47de-ad41-453f35efec77") : secret "image-registry-tls" not found Jul 08 22:30:33.844971 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:33.844899 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert podName:2025a9dd-3c77-4432-a494-4da125abf86f nodeName:}" failed. No retries permitted until 2026-07-08 22:30:41.844891922 +0000 UTC m=+52.183598873 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-x8r8h" (UID: "2025a9dd-3c77-4432-a494-4da125abf86f") : secret "networking-console-plugin-cert" not found Jul 08 22:30:33.844971 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:33.844913 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls podName:67bdd4c4-38d8-4f50-92bd-73055c10f401 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:41.844906281 +0000 UTC m=+52.183613231 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls") pod "dns-default-ldnsr" (UID: "67bdd4c4-38d8-4f50-92bd-73055c10f401") : secret "dns-default-metrics-tls" not found Jul 08 22:30:34.390123 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:34.390088 2573 generic.go:356] "Generic (PLEG): container finished" podID="ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4" containerID="f29c5674ee3c604b88d7c7a8c0ef24977d15a1cb9ee64a065c6b95c27dd5e0c4" exitCode=0 Jul 08 22:30:34.390490 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:34.390162 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtwhq" event={"ID":"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4","Type":"ContainerDied","Data":"f29c5674ee3c604b88d7c7a8c0ef24977d15a1cb9ee64a065c6b95c27dd5e0c4"} Jul 08 22:30:35.395724 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:35.395688 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-mtwhq" event={"ID":"ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4","Type":"ContainerStarted","Data":"54a2d9081f4e0138bb3ebeb41fe2a464c500058de2a5b021d2aa0a4933140c55"} Jul 08 22:30:35.420345 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:35.420179 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-mtwhq" podStartSLOduration=16.274906156 podStartE2EDuration="44.420162809s" totalImagesPullingTime="28.145256653s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:29:51 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:30:35.418474185 +0000 UTC m=+45.757181158" watchObservedRunningTime="2026-07-08 22:30:35.420162809 +0000 UTC m=+45.758869781" Jul 08 22:30:35.639716 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:35.639682 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9nc8_f7ec2b7c-a8c1-402e-9166-6cfc487a0115/konnectivity-agent/0.log" limit=1024 Jul 08 22:30:35.740420 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:35.740387 2573 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-j9nc8_f7ec2b7c-a8c1-402e-9166-6cfc487a0115/konnectivity-agent/0.log" limit=1024 Jul 08 22:30:41.910852 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:41.910806 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls\") pod \"dns-default-ldnsr\" (UID: \"67bdd4c4-38d8-4f50-92bd-73055c10f401\") " pod="openshift-dns/dns-default-ldnsr" Jul 08 22:30:41.910852 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:41.910855 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:41.911400 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:41.910900 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-x8r8h\" (UID: \"2025a9dd-3c77-4432-a494-4da125abf86f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" Jul 08 22:30:41.911400 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:41.910993 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 22:30:41.911400 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:41.910992 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 22:30:41.911400 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:41.911015 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 22:30:41.911400 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:41.911034 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-668b798ff7-pdmpm: secret "image-registry-tls" not found Jul 08 22:30:41.911400 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:41.911055 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert podName:2025a9dd-3c77-4432-a494-4da125abf86f nodeName:}" failed. No retries permitted until 2026-07-08 22:30:57.911042117 +0000 UTC m=+68.249749068 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-x8r8h" (UID: "2025a9dd-3c77-4432-a494-4da125abf86f") : secret "networking-console-plugin-cert" not found Jul 08 22:30:41.911400 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:41.911074 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls podName:484b5bc8-bcca-47de-ad41-453f35efec77 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:57.911060932 +0000 UTC m=+68.249767882 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls") pod "image-registry-668b798ff7-pdmpm" (UID: "484b5bc8-bcca-47de-ad41-453f35efec77") : secret "image-registry-tls" not found Jul 08 22:30:41.911400 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:41.911088 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls podName:67bdd4c4-38d8-4f50-92bd-73055c10f401 nodeName:}" failed. No retries permitted until 2026-07-08 22:30:57.91108176 +0000 UTC m=+68.249788711 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls") pod "dns-default-ldnsr" (UID: "67bdd4c4-38d8-4f50-92bd-73055c10f401") : secret "dns-default-metrics-tls" not found Jul 08 22:30:50.350895 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:50.350864 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-wsj6p" Jul 08 22:30:56.023108 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:56.023053 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs\") pod \"network-metrics-daemon-2t2gl\" (UID: \"83988472-fc5e-4e4a-a7ab-248bd26e4a48\") " pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:30:56.023593 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:56.023161 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret\") pod \"global-pull-secret-syncer-58csw\" (UID: \"98d1079e-ad90-4a60-bcaf-9005a7796b03\") " pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:30:56.025684 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:56.025663 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 08 22:30:56.025855 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:56.025839 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 08 22:30:56.033846 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:56.033829 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 22:30:56.033935 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:56.033887 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs podName:83988472-fc5e-4e4a-a7ab-248bd26e4a48 nodeName:}" failed. No retries permitted until 2026-07-08 22:32:00.033870088 +0000 UTC m=+130.372577039 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs") pod "network-metrics-daemon-2t2gl" (UID: "83988472-fc5e-4e4a-a7ab-248bd26e4a48") : secret "metrics-daemon-secret" not found Jul 08 22:30:56.037594 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:56.037571 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/98d1079e-ad90-4a60-bcaf-9005a7796b03-original-pull-secret\") pod \"global-pull-secret-syncer-58csw\" (UID: \"98d1079e-ad90-4a60-bcaf-9005a7796b03\") " pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:30:56.123475 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:56.123429 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p4jv4\" (UniqueName: \"kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4\") pod \"network-check-target-pts6q\" (UID: \"e46b9a2f-6200-4556-9b64-ddc55dc0be5e\") " pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:30:56.126140 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:56.126123 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 08 22:30:56.136850 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:56.136828 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 08 22:30:56.147405 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:56.147386 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-p4jv4\" (UniqueName: \"kubernetes.io/projected/e46b9a2f-6200-4556-9b64-ddc55dc0be5e-kube-api-access-p4jv4\") pod \"network-check-target-pts6q\" (UID: \"e46b9a2f-6200-4556-9b64-ddc55dc0be5e\") " pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:30:56.190429 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:56.190399 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-58csw" Jul 08 22:30:56.202762 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:56.202735 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-lrv86\"" Jul 08 22:30:56.211008 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:56.210987 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:30:56.325495 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:56.325465 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-58csw"] Jul 08 22:30:56.340382 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:56.340348 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-pts6q"] Jul 08 22:30:56.343508 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:30:56.343486 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode46b9a2f_6200_4556_9b64_ddc55dc0be5e.slice/crio-12af77a14ce403f0cd3f63053ca53ce35b8984060df7989674d33596eff32b0e WatchSource:0}: Error finding container 12af77a14ce403f0cd3f63053ca53ce35b8984060df7989674d33596eff32b0e: Status 404 returned error can't find the container with id 12af77a14ce403f0cd3f63053ca53ce35b8984060df7989674d33596eff32b0e Jul 08 22:30:56.445795 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:56.445757 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pts6q" event={"ID":"e46b9a2f-6200-4556-9b64-ddc55dc0be5e","Type":"ContainerStarted","Data":"12af77a14ce403f0cd3f63053ca53ce35b8984060df7989674d33596eff32b0e"} Jul 08 22:30:56.446820 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:56.446799 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-58csw" event={"ID":"98d1079e-ad90-4a60-bcaf-9005a7796b03","Type":"ContainerStarted","Data":"76c2e0c2e153d53775172f9c307dffaf750ab1027dc10cfeebcc4c2818f89ff4"} Jul 08 22:30:57.935829 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:57.935781 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-x8r8h\" (UID: \"2025a9dd-3c77-4432-a494-4da125abf86f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" Jul 08 22:30:57.936257 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:57.935859 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls\") pod \"dns-default-ldnsr\" (UID: \"67bdd4c4-38d8-4f50-92bd-73055c10f401\") " pod="openshift-dns/dns-default-ldnsr" Jul 08 22:30:57.936257 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:30:57.935902 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:30:57.936257 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:57.935968 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 22:30:57.936257 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:57.936024 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 22:30:57.936257 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:57.936062 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert podName:2025a9dd-3c77-4432-a494-4da125abf86f nodeName:}" failed. No retries permitted until 2026-07-08 22:31:29.936038269 +0000 UTC m=+100.274745237 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-x8r8h" (UID: "2025a9dd-3c77-4432-a494-4da125abf86f") : secret "networking-console-plugin-cert" not found Jul 08 22:30:57.936257 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:57.936026 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 22:30:57.936257 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:57.936084 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-668b798ff7-pdmpm: secret "image-registry-tls" not found Jul 08 22:30:57.936257 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:57.936085 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls podName:67bdd4c4-38d8-4f50-92bd-73055c10f401 nodeName:}" failed. No retries permitted until 2026-07-08 22:31:29.936074776 +0000 UTC m=+100.274781742 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls") pod "dns-default-ldnsr" (UID: "67bdd4c4-38d8-4f50-92bd-73055c10f401") : secret "dns-default-metrics-tls" not found Jul 08 22:30:57.936257 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:30:57.936157 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls podName:484b5bc8-bcca-47de-ad41-453f35efec77 nodeName:}" failed. No retries permitted until 2026-07-08 22:31:29.936130176 +0000 UTC m=+100.274837141 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls") pod "image-registry-668b798ff7-pdmpm" (UID: "484b5bc8-bcca-47de-ad41-453f35efec77") : secret "image-registry-tls" not found Jul 08 22:31:00.459128 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:31:00.459083 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-pts6q" event={"ID":"e46b9a2f-6200-4556-9b64-ddc55dc0be5e","Type":"ContainerStarted","Data":"3ca184039b69698dff2fbb2174cdb14a8f309f5d2ad053238ca0fd32c7714e5d"} Jul 08 22:31:00.459578 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:31:00.459216 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:31:00.476274 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:31:00.476222 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-pts6q" podStartSLOduration=65.893325762 podStartE2EDuration="1m9.476207074s" totalImagesPullingTime="3.582881312s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:31:00.475838713 +0000 UTC m=+70.814545706" watchObservedRunningTime="2026-07-08 22:31:00.476207074 +0000 UTC m=+70.814914046" Jul 08 22:31:02.465922 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:31:02.465825 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-58csw" event={"ID":"98d1079e-ad90-4a60-bcaf-9005a7796b03","Type":"ContainerStarted","Data":"47bbd8cb967198e785191bb98ccd4fa2d97e385ec44e0c85212cd22fcaa26ca3"} Jul 08 22:31:02.482037 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:31:02.481986 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-58csw" podStartSLOduration=65.796002899 podStartE2EDuration="1m11.481970406s" totalImagesPullingTime="5.685967507s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:31:02.480820594 +0000 UTC m=+72.819527563" watchObservedRunningTime="2026-07-08 22:31:02.481970406 +0000 UTC m=+72.820677379" Jul 08 22:31:29.964715 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:31:29.964612 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-x8r8h\" (UID: \"2025a9dd-3c77-4432-a494-4da125abf86f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" Jul 08 22:31:29.964715 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:31:29.964683 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls\") pod \"dns-default-ldnsr\" (UID: \"67bdd4c4-38d8-4f50-92bd-73055c10f401\") " pod="openshift-dns/dns-default-ldnsr" Jul 08 22:31:29.964715 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:31:29.964708 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:31:29.965237 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:31:29.964770 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 22:31:29.965237 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:31:29.964799 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 22:31:29.965237 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:31:29.964809 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-668b798ff7-pdmpm: secret "image-registry-tls" not found Jul 08 22:31:29.965237 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:31:29.964850 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert podName:2025a9dd-3c77-4432-a494-4da125abf86f nodeName:}" failed. No retries permitted until 2026-07-08 22:32:33.964834557 +0000 UTC m=+164.303541511 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-x8r8h" (UID: "2025a9dd-3c77-4432-a494-4da125abf86f") : secret "networking-console-plugin-cert" not found Jul 08 22:31:29.965237 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:31:29.964847 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 22:31:29.965237 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:31:29.964865 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls podName:484b5bc8-bcca-47de-ad41-453f35efec77 nodeName:}" failed. No retries permitted until 2026-07-08 22:32:33.964858374 +0000 UTC m=+164.303565328 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls") pod "image-registry-668b798ff7-pdmpm" (UID: "484b5bc8-bcca-47de-ad41-453f35efec77") : secret "image-registry-tls" not found Jul 08 22:31:29.965237 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:31:29.964922 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls podName:67bdd4c4-38d8-4f50-92bd-73055c10f401 nodeName:}" failed. No retries permitted until 2026-07-08 22:32:33.964902233 +0000 UTC m=+164.303609183 (durationBeforeRetry 1m4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls") pod "dns-default-ldnsr" (UID: "67bdd4c4-38d8-4f50-92bd-73055c10f401") : secret "dns-default-metrics-tls" not found Jul 08 22:31:31.465180 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:31:31.465143 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-pts6q" Jul 08 22:32:00.086918 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:32:00.086864 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs\") pod \"network-metrics-daemon-2t2gl\" (UID: \"83988472-fc5e-4e4a-a7ab-248bd26e4a48\") " pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:32:00.087347 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:32:00.087033 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 22:32:00.087347 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:32:00.087114 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs podName:83988472-fc5e-4e4a-a7ab-248bd26e4a48 nodeName:}" failed. No retries permitted until 2026-07-08 22:34:02.087096679 +0000 UTC m=+252.425803629 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs") pod "network-metrics-daemon-2t2gl" (UID: "83988472-fc5e-4e4a-a7ab-248bd26e4a48") : secret "metrics-daemon-secret" not found Jul 08 22:32:29.041707 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:32:29.041654 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" podUID="2025a9dd-3c77-4432-a494-4da125abf86f" Jul 08 22:32:29.054987 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:32:29.054948 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" podUID="484b5bc8-bcca-47de-ad41-453f35efec77" Jul 08 22:32:29.066114 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:32:29.066083 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ldnsr" podUID="67bdd4c4-38d8-4f50-92bd-73055c10f401" Jul 08 22:32:29.194865 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:32:29.194822 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2t2gl" podUID="83988472-fc5e-4e4a-a7ab-248bd26e4a48" Jul 08 22:32:29.675646 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:32:29.675610 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" Jul 08 22:32:29.675646 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:32:29.675636 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ldnsr" Jul 08 22:32:29.675850 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:32:29.675831 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:32:34.040240 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:32:34.040192 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:32:34.040684 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:32:34.040256 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-x8r8h\" (UID: \"2025a9dd-3c77-4432-a494-4da125abf86f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" Jul 08 22:32:34.040684 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:32:34.040323 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls\") pod \"dns-default-ldnsr\" (UID: \"67bdd4c4-38d8-4f50-92bd-73055c10f401\") " pod="openshift-dns/dns-default-ldnsr" Jul 08 22:32:34.040684 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:32:34.040359 2573 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 08 22:32:34.040684 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:32:34.040371 2573 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 08 22:32:34.040684 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:32:34.040377 2573 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-668b798ff7-pdmpm: secret "image-registry-tls" not found Jul 08 22:32:34.040684 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:32:34.040403 2573 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 08 22:32:34.040684 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:32:34.040452 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls podName:67bdd4c4-38d8-4f50-92bd-73055c10f401 nodeName:}" failed. No retries permitted until 2026-07-08 22:34:36.040435582 +0000 UTC m=+286.379142548 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls") pod "dns-default-ldnsr" (UID: "67bdd4c4-38d8-4f50-92bd-73055c10f401") : secret "dns-default-metrics-tls" not found Jul 08 22:32:34.040684 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:32:34.040469 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert podName:2025a9dd-3c77-4432-a494-4da125abf86f nodeName:}" failed. No retries permitted until 2026-07-08 22:34:36.040460544 +0000 UTC m=+286.379167501 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert") pod "networking-console-plugin-6bffdf9778-x8r8h" (UID: "2025a9dd-3c77-4432-a494-4da125abf86f") : secret "networking-console-plugin-cert" not found Jul 08 22:32:34.040684 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:32:34.040481 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls podName:484b5bc8-bcca-47de-ad41-453f35efec77 nodeName:}" failed. No retries permitted until 2026-07-08 22:34:36.040474684 +0000 UTC m=+286.379181642 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls") pod "image-registry-668b798ff7-pdmpm" (UID: "484b5bc8-bcca-47de-ad41-453f35efec77") : secret "image-registry-tls" not found Jul 08 22:32:41.176798 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:32:41.176740 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:34:02.170316 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:02.170264 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs\") pod \"network-metrics-daemon-2t2gl\" (UID: \"83988472-fc5e-4e4a-a7ab-248bd26e4a48\") " pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:34:02.170842 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:02.170395 2573 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: secret "metrics-daemon-secret" not found Jul 08 22:34:02.170842 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:02.170460 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs podName:83988472-fc5e-4e4a-a7ab-248bd26e4a48 nodeName:}" failed. No retries permitted until 2026-07-08 22:36:04.170443912 +0000 UTC m=+374.509150863 (durationBeforeRetry 2m2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs") pod "network-metrics-daemon-2t2gl" (UID: "83988472-fc5e-4e4a-a7ab-248bd26e4a48") : secret "metrics-daemon-secret" not found Jul 08 22:34:17.773396 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.773300 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-nc496"] Jul 08 22:34:17.775036 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.775017 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-27fkb"] Jul 08 22:34:17.775160 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.775142 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-nc496" Jul 08 22:34:17.776626 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.776610 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-27fkb" Jul 08 22:34:17.777507 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.777458 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-dz25n\"" Jul 08 22:34:17.779491 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.779470 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 08 22:34:17.779623 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.779474 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-mk5g9"] Jul 08 22:34:17.779841 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.779824 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 08 22:34:17.780078 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.780055 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 08 22:34:17.780229 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.780113 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 08 22:34:17.780229 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.780173 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-w92jw\"" Jul 08 22:34:17.781191 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.781172 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5gdxt"] Jul 08 22:34:17.781293 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.781264 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-mk5g9" Jul 08 22:34:17.782913 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.782891 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5gdxt" Jul 08 22:34:17.784074 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.784056 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 08 22:34:17.784209 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.784195 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 08 22:34:17.784308 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.784291 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-wzkkm\"" Jul 08 22:34:17.786330 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.786312 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 08 22:34:17.786399 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.786331 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 08 22:34:17.786399 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.786312 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 08 22:34:17.787379 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.787361 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 08 22:34:17.788300 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.788284 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-nc496"] Jul 08 22:34:17.789864 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.789848 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-bprrp\"" Jul 08 22:34:17.800011 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.799979 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-27fkb"] Jul 08 22:34:17.801167 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.801143 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5gdxt"] Jul 08 22:34:17.802036 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.802014 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-mk5g9"] Jul 08 22:34:17.874019 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.873977 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-tscmz"] Jul 08 22:34:17.876756 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.876732 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-tscmz" Jul 08 22:34:17.880088 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.880065 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 08 22:34:17.880243 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.880106 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 08 22:34:17.880243 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.880182 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 08 22:34:17.880415 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.880398 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-6sff9\"" Jul 08 22:34:17.880481 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.880398 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 08 22:34:17.882034 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.882014 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whgzf\" (UniqueName: \"kubernetes.io/projected/7b934b33-508c-43c0-8105-e3e7789bf8d1-kube-api-access-whgzf\") pod \"network-check-source-989f8b8dc-nc496\" (UID: \"7b934b33-508c-43c0-8105-e3e7789bf8d1\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-nc496" Jul 08 22:34:17.882139 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.882044 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e-config\") pod \"service-ca-operator-5d46d9ffd4-27fkb\" (UID: \"c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-27fkb" Jul 08 22:34:17.882139 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.882064 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sbr6x\" (UniqueName: \"kubernetes.io/projected/b7e9ab54-1734-465c-9c1c-85315d415441-kube-api-access-sbr6x\") pod \"volume-data-source-validator-5d456fdbcd-mk5g9\" (UID: \"b7e9ab54-1734-465c-9c1c-85315d415441\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-mk5g9" Jul 08 22:34:17.882270 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.882154 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgvm6\" (UniqueName: \"kubernetes.io/projected/c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e-kube-api-access-hgvm6\") pod \"service-ca-operator-5d46d9ffd4-27fkb\" (UID: \"c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-27fkb" Jul 08 22:34:17.882270 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.882251 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-27fkb\" (UID: \"c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-27fkb" Jul 08 22:34:17.882358 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.882289 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db970960-4fdf-45e5-b4fb-b5028b2c05c0-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-5gdxt\" (UID: \"db970960-4fdf-45e5-b4fb-b5028b2c05c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5gdxt" Jul 08 22:34:17.882358 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.882327 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db970960-4fdf-45e5-b4fb-b5028b2c05c0-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-5gdxt\" (UID: \"db970960-4fdf-45e5-b4fb-b5028b2c05c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5gdxt" Jul 08 22:34:17.882358 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.882351 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h4r7g\" (UniqueName: \"kubernetes.io/projected/db970960-4fdf-45e5-b4fb-b5028b2c05c0-kube-api-access-h4r7g\") pod \"kube-storage-version-migrator-operator-846bf668f7-5gdxt\" (UID: \"db970960-4fdf-45e5-b4fb-b5028b2c05c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5gdxt" Jul 08 22:34:17.886899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.886880 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 08 22:34:17.891891 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.891870 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-tscmz"] Jul 08 22:34:17.982777 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.982730 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/77abbd4d-d10d-47f8-8f2f-6fddd5bb1657-serving-cert\") pod \"console-operator-68b757fb67-tscmz\" (UID: \"77abbd4d-d10d-47f8-8f2f-6fddd5bb1657\") " pod="openshift-console-operator/console-operator-68b757fb67-tscmz" Jul 08 22:34:17.982963 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.982802 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db970960-4fdf-45e5-b4fb-b5028b2c05c0-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-5gdxt\" (UID: \"db970960-4fdf-45e5-b4fb-b5028b2c05c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5gdxt" Jul 08 22:34:17.982963 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.982831 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whgzf\" (UniqueName: \"kubernetes.io/projected/7b934b33-508c-43c0-8105-e3e7789bf8d1-kube-api-access-whgzf\") pod \"network-check-source-989f8b8dc-nc496\" (UID: \"7b934b33-508c-43c0-8105-e3e7789bf8d1\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-nc496" Jul 08 22:34:17.982963 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.982854 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e-config\") pod \"service-ca-operator-5d46d9ffd4-27fkb\" (UID: \"c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-27fkb" Jul 08 22:34:17.982963 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.982899 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgvm6\" (UniqueName: \"kubernetes.io/projected/c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e-kube-api-access-hgvm6\") pod \"service-ca-operator-5d46d9ffd4-27fkb\" (UID: \"c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-27fkb" Jul 08 22:34:17.982963 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.982940 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-27fkb\" (UID: \"c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-27fkb" Jul 08 22:34:17.983183 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.983067 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/77abbd4d-d10d-47f8-8f2f-6fddd5bb1657-config\") pod \"console-operator-68b757fb67-tscmz\" (UID: \"77abbd4d-d10d-47f8-8f2f-6fddd5bb1657\") " pod="openshift-console-operator/console-operator-68b757fb67-tscmz" Jul 08 22:34:17.983183 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.983114 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db970960-4fdf-45e5-b4fb-b5028b2c05c0-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-5gdxt\" (UID: \"db970960-4fdf-45e5-b4fb-b5028b2c05c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5gdxt" Jul 08 22:34:17.983281 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.983199 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sbr6x\" (UniqueName: \"kubernetes.io/projected/b7e9ab54-1734-465c-9c1c-85315d415441-kube-api-access-sbr6x\") pod \"volume-data-source-validator-5d456fdbcd-mk5g9\" (UID: \"b7e9ab54-1734-465c-9c1c-85315d415441\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-mk5g9" Jul 08 22:34:17.983281 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.983250 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77abbd4d-d10d-47f8-8f2f-6fddd5bb1657-trusted-ca\") pod \"console-operator-68b757fb67-tscmz\" (UID: \"77abbd4d-d10d-47f8-8f2f-6fddd5bb1657\") " pod="openshift-console-operator/console-operator-68b757fb67-tscmz" Jul 08 22:34:17.983490 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.983468 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/db970960-4fdf-45e5-b4fb-b5028b2c05c0-config\") pod \"kube-storage-version-migrator-operator-846bf668f7-5gdxt\" (UID: \"db970960-4fdf-45e5-b4fb-b5028b2c05c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5gdxt" Jul 08 22:34:17.983580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.983464 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lv9lg\" (UniqueName: \"kubernetes.io/projected/77abbd4d-d10d-47f8-8f2f-6fddd5bb1657-kube-api-access-lv9lg\") pod \"console-operator-68b757fb67-tscmz\" (UID: \"77abbd4d-d10d-47f8-8f2f-6fddd5bb1657\") " pod="openshift-console-operator/console-operator-68b757fb67-tscmz" Jul 08 22:34:17.983644 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.983591 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e-config\") pod \"service-ca-operator-5d46d9ffd4-27fkb\" (UID: \"c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-27fkb" Jul 08 22:34:17.983644 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.983589 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h4r7g\" (UniqueName: \"kubernetes.io/projected/db970960-4fdf-45e5-b4fb-b5028b2c05c0-kube-api-access-h4r7g\") pod \"kube-storage-version-migrator-operator-846bf668f7-5gdxt\" (UID: \"db970960-4fdf-45e5-b4fb-b5028b2c05c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5gdxt" Jul 08 22:34:17.985420 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.985398 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e-serving-cert\") pod \"service-ca-operator-5d46d9ffd4-27fkb\" (UID: \"c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-27fkb" Jul 08 22:34:17.985537 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.985427 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/db970960-4fdf-45e5-b4fb-b5028b2c05c0-serving-cert\") pod \"kube-storage-version-migrator-operator-846bf668f7-5gdxt\" (UID: \"db970960-4fdf-45e5-b4fb-b5028b2c05c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5gdxt" Jul 08 22:34:17.992283 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.992260 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-h4r7g\" (UniqueName: \"kubernetes.io/projected/db970960-4fdf-45e5-b4fb-b5028b2c05c0-kube-api-access-h4r7g\") pod \"kube-storage-version-migrator-operator-846bf668f7-5gdxt\" (UID: \"db970960-4fdf-45e5-b4fb-b5028b2c05c0\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5gdxt" Jul 08 22:34:17.992283 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.992268 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgvm6\" (UniqueName: \"kubernetes.io/projected/c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e-kube-api-access-hgvm6\") pod \"service-ca-operator-5d46d9ffd4-27fkb\" (UID: \"c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e\") " pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-27fkb" Jul 08 22:34:17.992425 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.992385 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-sbr6x\" (UniqueName: \"kubernetes.io/projected/b7e9ab54-1734-465c-9c1c-85315d415441-kube-api-access-sbr6x\") pod \"volume-data-source-validator-5d456fdbcd-mk5g9\" (UID: \"b7e9ab54-1734-465c-9c1c-85315d415441\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-mk5g9" Jul 08 22:34:17.992517 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:17.992502 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whgzf\" (UniqueName: \"kubernetes.io/projected/7b934b33-508c-43c0-8105-e3e7789bf8d1-kube-api-access-whgzf\") pod \"network-check-source-989f8b8dc-nc496\" (UID: \"7b934b33-508c-43c0-8105-e3e7789bf8d1\") " pod="openshift-network-diagnostics/network-check-source-989f8b8dc-nc496" Jul 08 22:34:18.083989 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.083888 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/77abbd4d-d10d-47f8-8f2f-6fddd5bb1657-config\") pod \"console-operator-68b757fb67-tscmz\" (UID: \"77abbd4d-d10d-47f8-8f2f-6fddd5bb1657\") " pod="openshift-console-operator/console-operator-68b757fb67-tscmz" Jul 08 22:34:18.083989 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.083953 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77abbd4d-d10d-47f8-8f2f-6fddd5bb1657-trusted-ca\") pod \"console-operator-68b757fb67-tscmz\" (UID: \"77abbd4d-d10d-47f8-8f2f-6fddd5bb1657\") " pod="openshift-console-operator/console-operator-68b757fb67-tscmz" Jul 08 22:34:18.083989 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.083984 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lv9lg\" (UniqueName: \"kubernetes.io/projected/77abbd4d-d10d-47f8-8f2f-6fddd5bb1657-kube-api-access-lv9lg\") pod \"console-operator-68b757fb67-tscmz\" (UID: \"77abbd4d-d10d-47f8-8f2f-6fddd5bb1657\") " pod="openshift-console-operator/console-operator-68b757fb67-tscmz" Jul 08 22:34:18.084188 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.084034 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/77abbd4d-d10d-47f8-8f2f-6fddd5bb1657-serving-cert\") pod \"console-operator-68b757fb67-tscmz\" (UID: \"77abbd4d-d10d-47f8-8f2f-6fddd5bb1657\") " pod="openshift-console-operator/console-operator-68b757fb67-tscmz" Jul 08 22:34:18.084689 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.084664 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/77abbd4d-d10d-47f8-8f2f-6fddd5bb1657-config\") pod \"console-operator-68b757fb67-tscmz\" (UID: \"77abbd4d-d10d-47f8-8f2f-6fddd5bb1657\") " pod="openshift-console-operator/console-operator-68b757fb67-tscmz" Jul 08 22:34:18.085229 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.085210 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/77abbd4d-d10d-47f8-8f2f-6fddd5bb1657-trusted-ca\") pod \"console-operator-68b757fb67-tscmz\" (UID: \"77abbd4d-d10d-47f8-8f2f-6fddd5bb1657\") " pod="openshift-console-operator/console-operator-68b757fb67-tscmz" Jul 08 22:34:18.085500 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.085485 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-nc496" Jul 08 22:34:18.086462 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.086427 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/77abbd4d-d10d-47f8-8f2f-6fddd5bb1657-serving-cert\") pod \"console-operator-68b757fb67-tscmz\" (UID: \"77abbd4d-d10d-47f8-8f2f-6fddd5bb1657\") " pod="openshift-console-operator/console-operator-68b757fb67-tscmz" Jul 08 22:34:18.092781 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.092763 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-27fkb" Jul 08 22:34:18.093331 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.093308 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-lv9lg\" (UniqueName: \"kubernetes.io/projected/77abbd4d-d10d-47f8-8f2f-6fddd5bb1657-kube-api-access-lv9lg\") pod \"console-operator-68b757fb67-tscmz\" (UID: \"77abbd4d-d10d-47f8-8f2f-6fddd5bb1657\") " pod="openshift-console-operator/console-operator-68b757fb67-tscmz" Jul 08 22:34:18.099709 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.099667 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-mk5g9" Jul 08 22:34:18.105358 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.105338 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5gdxt" Jul 08 22:34:18.189251 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.186762 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-68b757fb67-tscmz" Jul 08 22:34:18.244031 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.243944 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-989f8b8dc-nc496"] Jul 08 22:34:18.250262 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:34:18.250237 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7b934b33_508c_43c0_8105_e3e7789bf8d1.slice/crio-85c7bd4c030d447bd5a313c6df4c3c099d558febbcdd7c13284e706f16da38b4 WatchSource:0}: Error finding container 85c7bd4c030d447bd5a313c6df4c3c099d558febbcdd7c13284e706f16da38b4: Status 404 returned error can't find the container with id 85c7bd4c030d447bd5a313c6df4c3c099d558febbcdd7c13284e706f16da38b4 Jul 08 22:34:18.256890 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.256861 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-27fkb"] Jul 08 22:34:18.279722 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.279659 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-mk5g9"] Jul 08 22:34:18.282683 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:34:18.282530 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb7e9ab54_1734_465c_9c1c_85315d415441.slice/crio-5abe38f5b5050dd91b5936b39857a23f7dde04bd573493ad94f524d76b44abdc WatchSource:0}: Error finding container 5abe38f5b5050dd91b5936b39857a23f7dde04bd573493ad94f524d76b44abdc: Status 404 returned error can't find the container with id 5abe38f5b5050dd91b5936b39857a23f7dde04bd573493ad94f524d76b44abdc Jul 08 22:34:18.296819 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.296661 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5gdxt"] Jul 08 22:34:18.300818 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:34:18.300783 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb970960_4fdf_45e5_b4fb_b5028b2c05c0.slice/crio-cec79e7eec44554f866b2118b037464c32d5a21352e6046fd2307ac8b8021ef3 WatchSource:0}: Error finding container cec79e7eec44554f866b2118b037464c32d5a21352e6046fd2307ac8b8021ef3: Status 404 returned error can't find the container with id cec79e7eec44554f866b2118b037464c32d5a21352e6046fd2307ac8b8021ef3 Jul 08 22:34:18.348868 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.348793 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-68b757fb67-tscmz"] Jul 08 22:34:18.352847 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:34:18.352824 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod77abbd4d_d10d_47f8_8f2f_6fddd5bb1657.slice/crio-3b752fe1312bd92ced97d80bd62506eecc1ea960f0a2c73dbb40dbcd5a9d219b WatchSource:0}: Error finding container 3b752fe1312bd92ced97d80bd62506eecc1ea960f0a2c73dbb40dbcd5a9d219b: Status 404 returned error can't find the container with id 3b752fe1312bd92ced97d80bd62506eecc1ea960f0a2c73dbb40dbcd5a9d219b Jul 08 22:34:18.930243 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.930205 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-mk5g9" event={"ID":"b7e9ab54-1734-465c-9c1c-85315d415441","Type":"ContainerStarted","Data":"5abe38f5b5050dd91b5936b39857a23f7dde04bd573493ad94f524d76b44abdc"} Jul 08 22:34:18.931263 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.931235 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-27fkb" event={"ID":"c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e","Type":"ContainerStarted","Data":"f257a190b0ff5718299ec2312a534db1f50a066898e32cb03584c45779cb9326"} Jul 08 22:34:18.932223 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.932202 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tscmz" event={"ID":"77abbd4d-d10d-47f8-8f2f-6fddd5bb1657","Type":"ContainerStarted","Data":"3b752fe1312bd92ced97d80bd62506eecc1ea960f0a2c73dbb40dbcd5a9d219b"} Jul 08 22:34:18.933311 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.933288 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5gdxt" event={"ID":"db970960-4fdf-45e5-b4fb-b5028b2c05c0","Type":"ContainerStarted","Data":"cec79e7eec44554f866b2118b037464c32d5a21352e6046fd2307ac8b8021ef3"} Jul 08 22:34:18.934611 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.934582 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-nc496" event={"ID":"7b934b33-508c-43c0-8105-e3e7789bf8d1","Type":"ContainerStarted","Data":"8eb9776e5ee389e827f0985a91409f7cf5b48bffc3baccfcb5848564646bbdb4"} Jul 08 22:34:18.934696 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.934615 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-nc496" event={"ID":"7b934b33-508c-43c0-8105-e3e7789bf8d1","Type":"ContainerStarted","Data":"85c7bd4c030d447bd5a313c6df4c3c099d558febbcdd7c13284e706f16da38b4"} Jul 08 22:34:18.950166 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:18.950115 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-989f8b8dc-nc496" podStartSLOduration=1.950098121 podStartE2EDuration="1.950098121s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:34:17 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:34:18.950037925 +0000 UTC m=+269.288744895" watchObservedRunningTime="2026-07-08 22:34:18.950098121 +0000 UTC m=+269.288805095" Jul 08 22:34:20.945570 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:20.945514 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-mk5g9" event={"ID":"b7e9ab54-1734-465c-9c1c-85315d415441","Type":"ContainerStarted","Data":"10baedabab911be02fc83a6528c69c5a7364a6fdc11e7f90e555201583e5250a"} Jul 08 22:34:20.961442 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:20.961317 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-5d456fdbcd-mk5g9" podStartSLOduration=2.377143514 podStartE2EDuration="3.961299099s" totalImagesPullingTime="1.584155585s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:34:20.960610037 +0000 UTC m=+271.299317021" watchObservedRunningTime="2026-07-08 22:34:20.961299099 +0000 UTC m=+271.300006073" Jul 08 22:34:21.951833 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:21.951772 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-27fkb" event={"ID":"c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e","Type":"ContainerStarted","Data":"f9d143a7ab512d2e7dd699f594e22b24ac9fa098424f0b4f9b2faede83cb114c"} Jul 08 22:34:21.954285 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:21.954221 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tscmz" event={"ID":"77abbd4d-d10d-47f8-8f2f-6fddd5bb1657","Type":"ContainerStarted","Data":"c347e8ba6635410cf740786aeca50f4b3db0fa640aa7814d3ab5cc7972a8c7d3"} Jul 08 22:34:21.954705 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:21.954587 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-tscmz" Jul 08 22:34:21.955993 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:21.955917 2573 patch_prober.go:28] interesting pod/console-operator-68b757fb67-tscmz container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.14:8443/readyz\": dial tcp 10.132.0.14:8443: connect: connection refused" start-of-body= Jul 08 22:34:21.955993 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:21.955964 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-68b757fb67-tscmz" podUID="77abbd4d-d10d-47f8-8f2f-6fddd5bb1657" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.14:8443/readyz\": dial tcp 10.132.0.14:8443: connect: connection refused" Jul 08 22:34:21.956800 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:21.956431 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5gdxt" event={"ID":"db970960-4fdf-45e5-b4fb-b5028b2c05c0","Type":"ContainerStarted","Data":"32a8b252fcb8e82afefb38d5bbd6ca8c7355e49d71a134140cdaf7c01b76509d"} Jul 08 22:34:21.969013 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:21.968949 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-27fkb" podStartSLOduration=1.361886726 podStartE2EDuration="4.968927585s" totalImagesPullingTime="3.607040859s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:34:21.96780374 +0000 UTC m=+272.306510713" watchObservedRunningTime="2026-07-08 22:34:21.968927585 +0000 UTC m=+272.307634559" Jul 08 22:34:21.986383 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:21.986316 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-68b757fb67-tscmz" podStartSLOduration=1.463201664 podStartE2EDuration="4.986294058s" totalImagesPullingTime="3.523092394s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:34:21.985064569 +0000 UTC m=+272.323771542" watchObservedRunningTime="2026-07-08 22:34:21.986294058 +0000 UTC m=+272.325001034" Jul 08 22:34:22.192358 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.192241 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5gdxt" podStartSLOduration=1.62651222 podStartE2EDuration="5.192213039s" totalImagesPullingTime="3.565700819s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:34:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:34:22.004661838 +0000 UTC m=+272.343368803" watchObservedRunningTime="2026-07-08 22:34:22.192213039 +0000 UTC m=+272.530920013" Jul 08 22:34:22.193423 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.193400 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-45r85"] Jul 08 22:34:22.195377 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.195362 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:22.198524 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.198427 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 08 22:34:22.198524 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.198489 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 08 22:34:22.198715 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.198610 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 08 22:34:22.198777 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.198714 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 08 22:34:22.198777 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.198728 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-v54n6\"" Jul 08 22:34:22.211087 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.211063 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-45r85"] Jul 08 22:34:22.317517 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.317471 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52435621-b805-464a-84e1-ed7cf0ebc95b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:22.317517 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.317518 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/52435621-b805-464a-84e1-ed7cf0ebc95b-crio-socket\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:22.317743 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.317540 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/52435621-b805-464a-84e1-ed7cf0ebc95b-data-volume\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:22.317743 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.317645 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfxw6\" (UniqueName: \"kubernetes.io/projected/52435621-b805-464a-84e1-ed7cf0ebc95b-kube-api-access-mfxw6\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:22.317743 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.317699 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52435621-b805-464a-84e1-ed7cf0ebc95b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:22.418987 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.418938 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfxw6\" (UniqueName: \"kubernetes.io/projected/52435621-b805-464a-84e1-ed7cf0ebc95b-kube-api-access-mfxw6\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:22.419191 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.418998 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52435621-b805-464a-84e1-ed7cf0ebc95b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:22.419191 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.419094 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52435621-b805-464a-84e1-ed7cf0ebc95b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:22.419191 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.419123 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/52435621-b805-464a-84e1-ed7cf0ebc95b-crio-socket\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:22.419191 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.419152 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/52435621-b805-464a-84e1-ed7cf0ebc95b-data-volume\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:22.419191 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:22.419150 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 22:34:22.419420 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:22.419222 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 22:34:22.419420 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.419238 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/52435621-b805-464a-84e1-ed7cf0ebc95b-crio-socket\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:22.419420 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:22.419258 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52435621-b805-464a-84e1-ed7cf0ebc95b-kube-rbac-proxy-cm podName:52435621-b805-464a-84e1-ed7cf0ebc95b nodeName:}" failed. No retries permitted until 2026-07-08 22:34:22.919236726 +0000 UTC m=+273.257943682 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/52435621-b805-464a-84e1-ed7cf0ebc95b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-45r85" (UID: "52435621-b805-464a-84e1-ed7cf0ebc95b") : configmap "kube-rbac-proxy" not found Jul 08 22:34:22.419420 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:22.419281 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52435621-b805-464a-84e1-ed7cf0ebc95b-insights-runtime-extractor-tls podName:52435621-b805-464a-84e1-ed7cf0ebc95b nodeName:}" failed. No retries permitted until 2026-07-08 22:34:22.919263805 +0000 UTC m=+273.257970759 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52435621-b805-464a-84e1-ed7cf0ebc95b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-45r85" (UID: "52435621-b805-464a-84e1-ed7cf0ebc95b") : secret "insights-runtime-extractor-tls" not found Jul 08 22:34:22.419549 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.419520 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/52435621-b805-464a-84e1-ed7cf0ebc95b-data-volume\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:22.427539 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.427513 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfxw6\" (UniqueName: \"kubernetes.io/projected/52435621-b805-464a-84e1-ed7cf0ebc95b-kube-api-access-mfxw6\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:22.921643 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.921581 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52435621-b805-464a-84e1-ed7cf0ebc95b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:22.921807 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.921693 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52435621-b805-464a-84e1-ed7cf0ebc95b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:22.921807 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:22.921719 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 22:34:22.921807 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:22.921784 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 22:34:22.921807 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:22.921791 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52435621-b805-464a-84e1-ed7cf0ebc95b-insights-runtime-extractor-tls podName:52435621-b805-464a-84e1-ed7cf0ebc95b nodeName:}" failed. No retries permitted until 2026-07-08 22:34:23.921773314 +0000 UTC m=+274.260480264 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52435621-b805-464a-84e1-ed7cf0ebc95b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-45r85" (UID: "52435621-b805-464a-84e1-ed7cf0ebc95b") : secret "insights-runtime-extractor-tls" not found Jul 08 22:34:22.921956 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:22.921829 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52435621-b805-464a-84e1-ed7cf0ebc95b-kube-rbac-proxy-cm podName:52435621-b805-464a-84e1-ed7cf0ebc95b nodeName:}" failed. No retries permitted until 2026-07-08 22:34:23.921815735 +0000 UTC m=+274.260522687 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/52435621-b805-464a-84e1-ed7cf0ebc95b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-45r85" (UID: "52435621-b805-464a-84e1-ed7cf0ebc95b") : configmap "kube-rbac-proxy" not found Jul 08 22:34:22.961595 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.961547 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/0.log" Jul 08 22:34:22.961973 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.961603 2573 generic.go:356] "Generic (PLEG): container finished" podID="77abbd4d-d10d-47f8-8f2f-6fddd5bb1657" containerID="c347e8ba6635410cf740786aeca50f4b3db0fa640aa7814d3ab5cc7972a8c7d3" exitCode=255 Jul 08 22:34:22.961973 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.961703 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tscmz" event={"ID":"77abbd4d-d10d-47f8-8f2f-6fddd5bb1657","Type":"ContainerDied","Data":"c347e8ba6635410cf740786aeca50f4b3db0fa640aa7814d3ab5cc7972a8c7d3"} Jul 08 22:34:22.961973 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:22.961877 2573 scope.go:117] "RemoveContainer" containerID="c347e8ba6635410cf740786aeca50f4b3db0fa640aa7814d3ab5cc7972a8c7d3" Jul 08 22:34:23.153617 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:23.153585 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-n5xrb"] Jul 08 22:34:23.155659 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:23.155638 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-n5xrb" Jul 08 22:34:23.158054 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:23.158035 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-4pprv\"" Jul 08 22:34:23.158300 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:23.158285 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 08 22:34:23.158577 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:23.158542 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 08 22:34:23.166776 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:23.166746 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-n5xrb"] Jul 08 22:34:23.225133 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:23.225102 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zzs74\" (UniqueName: \"kubernetes.io/projected/b96bff0e-6f67-4ce8-ac4e-053a5ce4d27d-kube-api-access-zzs74\") pod \"migrator-d57d58cc9-n5xrb\" (UID: \"b96bff0e-6f67-4ce8-ac4e-053a5ce4d27d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-n5xrb" Jul 08 22:34:23.325762 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:23.325729 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zzs74\" (UniqueName: \"kubernetes.io/projected/b96bff0e-6f67-4ce8-ac4e-053a5ce4d27d-kube-api-access-zzs74\") pod \"migrator-d57d58cc9-n5xrb\" (UID: \"b96bff0e-6f67-4ce8-ac4e-053a5ce4d27d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-n5xrb" Jul 08 22:34:23.333127 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:23.333101 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-zzs74\" (UniqueName: \"kubernetes.io/projected/b96bff0e-6f67-4ce8-ac4e-053a5ce4d27d-kube-api-access-zzs74\") pod \"migrator-d57d58cc9-n5xrb\" (UID: \"b96bff0e-6f67-4ce8-ac4e-053a5ce4d27d\") " pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-n5xrb" Jul 08 22:34:23.472066 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:23.472015 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-n5xrb" Jul 08 22:34:23.595156 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:23.595124 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-d57d58cc9-n5xrb"] Jul 08 22:34:23.598879 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:34:23.598856 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb96bff0e_6f67_4ce8_ac4e_053a5ce4d27d.slice/crio-f268527f07db5bd8540e2a3c55a3d4a6f3617fa553ae1091e1310dd1c6fcef3f WatchSource:0}: Error finding container f268527f07db5bd8540e2a3c55a3d4a6f3617fa553ae1091e1310dd1c6fcef3f: Status 404 returned error can't find the container with id f268527f07db5bd8540e2a3c55a3d4a6f3617fa553ae1091e1310dd1c6fcef3f Jul 08 22:34:23.930984 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:23.930886 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52435621-b805-464a-84e1-ed7cf0ebc95b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:23.930984 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:23.930950 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52435621-b805-464a-84e1-ed7cf0ebc95b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:23.931212 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:23.931016 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 22:34:23.931212 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:23.931028 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 22:34:23.931212 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:23.931072 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52435621-b805-464a-84e1-ed7cf0ebc95b-kube-rbac-proxy-cm podName:52435621-b805-464a-84e1-ed7cf0ebc95b nodeName:}" failed. No retries permitted until 2026-07-08 22:34:25.931056839 +0000 UTC m=+276.269763790 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/52435621-b805-464a-84e1-ed7cf0ebc95b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-45r85" (UID: "52435621-b805-464a-84e1-ed7cf0ebc95b") : configmap "kube-rbac-proxy" not found Jul 08 22:34:23.931212 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:23.931086 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52435621-b805-464a-84e1-ed7cf0ebc95b-insights-runtime-extractor-tls podName:52435621-b805-464a-84e1-ed7cf0ebc95b nodeName:}" failed. No retries permitted until 2026-07-08 22:34:25.93107994 +0000 UTC m=+276.269786890 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52435621-b805-464a-84e1-ed7cf0ebc95b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-45r85" (UID: "52435621-b805-464a-84e1-ed7cf0ebc95b") : secret "insights-runtime-extractor-tls" not found Jul 08 22:34:23.966754 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:23.966726 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/1.log" Jul 08 22:34:23.967193 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:23.967179 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/0.log" Jul 08 22:34:23.967242 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:23.967216 2573 generic.go:356] "Generic (PLEG): container finished" podID="77abbd4d-d10d-47f8-8f2f-6fddd5bb1657" containerID="00de051064ddf6dd904d0dd194a1378602a4b5d64ce59f230327a2288fe06498" exitCode=255 Jul 08 22:34:23.967319 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:23.967299 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tscmz" event={"ID":"77abbd4d-d10d-47f8-8f2f-6fddd5bb1657","Type":"ContainerDied","Data":"00de051064ddf6dd904d0dd194a1378602a4b5d64ce59f230327a2288fe06498"} Jul 08 22:34:23.967384 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:23.967370 2573 scope.go:117] "RemoveContainer" containerID="c347e8ba6635410cf740786aeca50f4b3db0fa640aa7814d3ab5cc7972a8c7d3" Jul 08 22:34:23.967592 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:23.967575 2573 scope.go:117] "RemoveContainer" containerID="00de051064ddf6dd904d0dd194a1378602a4b5d64ce59f230327a2288fe06498" Jul 08 22:34:23.967796 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:23.967774 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-tscmz_openshift-console-operator(77abbd4d-d10d-47f8-8f2f-6fddd5bb1657)\"" pod="openshift-console-operator/console-operator-68b757fb67-tscmz" podUID="77abbd4d-d10d-47f8-8f2f-6fddd5bb1657" Jul 08 22:34:23.968797 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:23.968499 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-n5xrb" event={"ID":"b96bff0e-6f67-4ce8-ac4e-053a5ce4d27d","Type":"ContainerStarted","Data":"f268527f07db5bd8540e2a3c55a3d4a6f3617fa553ae1091e1310dd1c6fcef3f"} Jul 08 22:34:24.375536 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:24.375500 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pn7b8_6863dfc5-3c16-42a7-93a6-dc36e4722c27/dns-node-resolver/0.log" Jul 08 22:34:24.931796 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:24.931766 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-758f599c5-x7b54"] Jul 08 22:34:24.933736 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:24.933715 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-x7b54" Jul 08 22:34:24.936110 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:24.936080 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 08 22:34:24.936220 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:24.936150 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-zdgjl\"" Jul 08 22:34:24.937036 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:24.937018 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 08 22:34:24.937141 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:24.937048 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 08 22:34:24.937141 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:24.937120 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 08 22:34:24.942399 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:24.942205 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-x7b54"] Jul 08 22:34:24.977095 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:24.977064 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/1.log" Jul 08 22:34:24.977585 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:24.977500 2573 scope.go:117] "RemoveContainer" containerID="00de051064ddf6dd904d0dd194a1378602a4b5d64ce59f230327a2288fe06498" Jul 08 22:34:24.977735 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:24.977712 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-tscmz_openshift-console-operator(77abbd4d-d10d-47f8-8f2f-6fddd5bb1657)\"" pod="openshift-console-operator/console-operator-68b757fb67-tscmz" podUID="77abbd4d-d10d-47f8-8f2f-6fddd5bb1657" Jul 08 22:34:25.038802 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:25.038768 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dd8cea8e-4ada-4e21-9b93-a081a4eec6de-signing-key\") pod \"service-ca-758f599c5-x7b54\" (UID: \"dd8cea8e-4ada-4e21-9b93-a081a4eec6de\") " pod="openshift-service-ca/service-ca-758f599c5-x7b54" Jul 08 22:34:25.039086 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:25.039041 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jg2q\" (UniqueName: \"kubernetes.io/projected/dd8cea8e-4ada-4e21-9b93-a081a4eec6de-kube-api-access-8jg2q\") pod \"service-ca-758f599c5-x7b54\" (UID: \"dd8cea8e-4ada-4e21-9b93-a081a4eec6de\") " pod="openshift-service-ca/service-ca-758f599c5-x7b54" Jul 08 22:34:25.039197 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:25.039102 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dd8cea8e-4ada-4e21-9b93-a081a4eec6de-signing-cabundle\") pod \"service-ca-758f599c5-x7b54\" (UID: \"dd8cea8e-4ada-4e21-9b93-a081a4eec6de\") " pod="openshift-service-ca/service-ca-758f599c5-x7b54" Jul 08 22:34:25.140228 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:25.140179 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jg2q\" (UniqueName: \"kubernetes.io/projected/dd8cea8e-4ada-4e21-9b93-a081a4eec6de-kube-api-access-8jg2q\") pod \"service-ca-758f599c5-x7b54\" (UID: \"dd8cea8e-4ada-4e21-9b93-a081a4eec6de\") " pod="openshift-service-ca/service-ca-758f599c5-x7b54" Jul 08 22:34:25.140424 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:25.140237 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dd8cea8e-4ada-4e21-9b93-a081a4eec6de-signing-cabundle\") pod \"service-ca-758f599c5-x7b54\" (UID: \"dd8cea8e-4ada-4e21-9b93-a081a4eec6de\") " pod="openshift-service-ca/service-ca-758f599c5-x7b54" Jul 08 22:34:25.140424 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:25.140360 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dd8cea8e-4ada-4e21-9b93-a081a4eec6de-signing-key\") pod \"service-ca-758f599c5-x7b54\" (UID: \"dd8cea8e-4ada-4e21-9b93-a081a4eec6de\") " pod="openshift-service-ca/service-ca-758f599c5-x7b54" Jul 08 22:34:25.141081 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:25.141051 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/dd8cea8e-4ada-4e21-9b93-a081a4eec6de-signing-cabundle\") pod \"service-ca-758f599c5-x7b54\" (UID: \"dd8cea8e-4ada-4e21-9b93-a081a4eec6de\") " pod="openshift-service-ca/service-ca-758f599c5-x7b54" Jul 08 22:34:25.143043 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:25.143019 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/dd8cea8e-4ada-4e21-9b93-a081a4eec6de-signing-key\") pod \"service-ca-758f599c5-x7b54\" (UID: \"dd8cea8e-4ada-4e21-9b93-a081a4eec6de\") " pod="openshift-service-ca/service-ca-758f599c5-x7b54" Jul 08 22:34:25.149134 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:25.149113 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jg2q\" (UniqueName: \"kubernetes.io/projected/dd8cea8e-4ada-4e21-9b93-a081a4eec6de-kube-api-access-8jg2q\") pod \"service-ca-758f599c5-x7b54\" (UID: \"dd8cea8e-4ada-4e21-9b93-a081a4eec6de\") " pod="openshift-service-ca/service-ca-758f599c5-x7b54" Jul 08 22:34:25.245072 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:25.245043 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-758f599c5-x7b54" Jul 08 22:34:25.376312 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:25.376134 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rm7kj_5aaf8eb4-8a4e-43e1-a844-2226f1ca100b/node-ca/0.log" Jul 08 22:34:25.376580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:25.376541 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-758f599c5-x7b54"] Jul 08 22:34:25.379038 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:34:25.379016 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd8cea8e_4ada_4e21_9b93_a081a4eec6de.slice/crio-52eea7a22f4db4de0a122c994928f8c685b46e267a328f19d7e95e65576e4057 WatchSource:0}: Error finding container 52eea7a22f4db4de0a122c994928f8c685b46e267a328f19d7e95e65576e4057: Status 404 returned error can't find the container with id 52eea7a22f4db4de0a122c994928f8c685b46e267a328f19d7e95e65576e4057 Jul 08 22:34:25.774861 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:25.774828 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2g9hb_ff30c41b-0ed8-4b43-a28c-75834602f728/serve-healthcheck-canary/0.log" Jul 08 22:34:25.947519 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:25.947476 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52435621-b805-464a-84e1-ed7cf0ebc95b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:25.947731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:25.947616 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52435621-b805-464a-84e1-ed7cf0ebc95b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:25.947731 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:25.947631 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 22:34:25.947731 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:25.947704 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52435621-b805-464a-84e1-ed7cf0ebc95b-kube-rbac-proxy-cm podName:52435621-b805-464a-84e1-ed7cf0ebc95b nodeName:}" failed. No retries permitted until 2026-07-08 22:34:29.947688287 +0000 UTC m=+280.286395237 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/52435621-b805-464a-84e1-ed7cf0ebc95b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-45r85" (UID: "52435621-b805-464a-84e1-ed7cf0ebc95b") : configmap "kube-rbac-proxy" not found Jul 08 22:34:25.947856 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:25.947789 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 22:34:25.947856 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:25.947849 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52435621-b805-464a-84e1-ed7cf0ebc95b-insights-runtime-extractor-tls podName:52435621-b805-464a-84e1-ed7cf0ebc95b nodeName:}" failed. No retries permitted until 2026-07-08 22:34:29.947832574 +0000 UTC m=+280.286539544 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52435621-b805-464a-84e1-ed7cf0ebc95b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-45r85" (UID: "52435621-b805-464a-84e1-ed7cf0ebc95b") : secret "insights-runtime-extractor-tls" not found Jul 08 22:34:25.982193 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:25.982156 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-x7b54" event={"ID":"dd8cea8e-4ada-4e21-9b93-a081a4eec6de","Type":"ContainerStarted","Data":"9b77685803cc64cab10ab832d58918c520b30253b676a4fccc23aa940f8f3aea"} Jul 08 22:34:25.982664 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:25.982253 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-758f599c5-x7b54" event={"ID":"dd8cea8e-4ada-4e21-9b93-a081a4eec6de","Type":"ContainerStarted","Data":"52eea7a22f4db4de0a122c994928f8c685b46e267a328f19d7e95e65576e4057"} Jul 08 22:34:25.983977 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:25.983942 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-n5xrb" event={"ID":"b96bff0e-6f67-4ce8-ac4e-053a5ce4d27d","Type":"ContainerStarted","Data":"569c25489816a483a716e633b3e95c7ca236caae36e15ad3f746f3ffaa2301e8"} Jul 08 22:34:25.984082 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:25.983993 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-n5xrb" event={"ID":"b96bff0e-6f67-4ce8-ac4e-053a5ce4d27d","Type":"ContainerStarted","Data":"2b4978613e5d9bc33507e00ee673a429d7affe8c00fb6d5a174597f8ec7d542d"} Jul 08 22:34:26.002960 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:26.002914 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-758f599c5-x7b54" podStartSLOduration=2.002900341 podStartE2EDuration="2.002900341s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:34:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:34:26.002087302 +0000 UTC m=+276.340794296" watchObservedRunningTime="2026-07-08 22:34:26.002900341 +0000 UTC m=+276.341607314" Jul 08 22:34:26.022221 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:26.022161 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-d57d58cc9-n5xrb" podStartSLOduration=1.452545836 podStartE2EDuration="3.022148315s" totalImagesPullingTime="1.569602479s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:34:26.022026297 +0000 UTC m=+276.360733271" watchObservedRunningTime="2026-07-08 22:34:26.022148315 +0000 UTC m=+276.360855284" Jul 08 22:34:28.187576 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:28.187477 2573 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-68b757fb67-tscmz" Jul 08 22:34:28.187926 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:28.187839 2573 scope.go:117] "RemoveContainer" containerID="00de051064ddf6dd904d0dd194a1378602a4b5d64ce59f230327a2288fe06498" Jul 08 22:34:28.188012 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:28.187991 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-tscmz_openshift-console-operator(77abbd4d-d10d-47f8-8f2f-6fddd5bb1657)\"" pod="openshift-console-operator/console-operator-68b757fb67-tscmz" podUID="77abbd4d-d10d-47f8-8f2f-6fddd5bb1657" Jul 08 22:34:29.989053 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:29.989011 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52435621-b805-464a-84e1-ed7cf0ebc95b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:29.989490 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:29.989099 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52435621-b805-464a-84e1-ed7cf0ebc95b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:29.989490 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:29.989163 2573 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 08 22:34:29.989490 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:29.989213 2573 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 08 22:34:29.989490 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:29.989242 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/52435621-b805-464a-84e1-ed7cf0ebc95b-insights-runtime-extractor-tls podName:52435621-b805-464a-84e1-ed7cf0ebc95b nodeName:}" failed. No retries permitted until 2026-07-08 22:34:37.989221322 +0000 UTC m=+288.327928290 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/52435621-b805-464a-84e1-ed7cf0ebc95b-insights-runtime-extractor-tls") pod "insights-runtime-extractor-45r85" (UID: "52435621-b805-464a-84e1-ed7cf0ebc95b") : secret "insights-runtime-extractor-tls" not found Jul 08 22:34:29.989490 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:29.989262 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/52435621-b805-464a-84e1-ed7cf0ebc95b-kube-rbac-proxy-cm podName:52435621-b805-464a-84e1-ed7cf0ebc95b nodeName:}" failed. No retries permitted until 2026-07-08 22:34:37.989249732 +0000 UTC m=+288.327956683 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/52435621-b805-464a-84e1-ed7cf0ebc95b-kube-rbac-proxy-cm") pod "insights-runtime-extractor-45r85" (UID: "52435621-b805-464a-84e1-ed7cf0ebc95b") : configmap "kube-rbac-proxy" not found Jul 08 22:34:31.954844 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:31.954805 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-tscmz" Jul 08 22:34:31.955241 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:31.955225 2573 scope.go:117] "RemoveContainer" containerID="00de051064ddf6dd904d0dd194a1378602a4b5d64ce59f230327a2288fe06498" Jul 08 22:34:31.955394 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:31.955373 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-68b757fb67-tscmz_openshift-console-operator(77abbd4d-d10d-47f8-8f2f-6fddd5bb1657)\"" pod="openshift-console-operator/console-operator-68b757fb67-tscmz" podUID="77abbd4d-d10d-47f8-8f2f-6fddd5bb1657" Jul 08 22:34:32.676729 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:32.676683 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-dns/dns-default-ldnsr" podUID="67bdd4c4-38d8-4f50-92bd-73055c10f401" Jul 08 22:34:32.676729 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:32.676682 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[registry-tls], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" podUID="484b5bc8-bcca-47de-ad41-453f35efec77" Jul 08 22:34:32.676729 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:32.676683 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[networking-console-plugin-cert], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" podUID="2025a9dd-3c77-4432-a494-4da125abf86f" Jul 08 22:34:33.008569 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:33.008522 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" Jul 08 22:34:33.008569 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:33.008535 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:34:33.008569 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:33.008533 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ldnsr" Jul 08 22:34:36.139911 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:36.139878 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-x8r8h\" (UID: \"2025a9dd-3c77-4432-a494-4da125abf86f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" Jul 08 22:34:36.140395 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:36.139964 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls\") pod \"dns-default-ldnsr\" (UID: \"67bdd4c4-38d8-4f50-92bd-73055c10f401\") " pod="openshift-dns/dns-default-ldnsr" Jul 08 22:34:36.140395 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:36.140019 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:34:36.142768 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:36.142734 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2025a9dd-3c77-4432-a494-4da125abf86f-networking-console-plugin-cert\") pod \"networking-console-plugin-6bffdf9778-x8r8h\" (UID: \"2025a9dd-3c77-4432-a494-4da125abf86f\") " pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" Jul 08 22:34:36.142913 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:36.142888 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/67bdd4c4-38d8-4f50-92bd-73055c10f401-metrics-tls\") pod \"dns-default-ldnsr\" (UID: \"67bdd4c4-38d8-4f50-92bd-73055c10f401\") " pod="openshift-dns/dns-default-ldnsr" Jul 08 22:34:36.142981 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:36.142961 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls\") pod \"image-registry-668b798ff7-pdmpm\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:34:36.312803 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:36.312774 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-lrqf9\"" Jul 08 22:34:36.312803 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:36.312801 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-8mxl8\"" Jul 08 22:34:36.313044 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:36.312840 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-5pzmj\"" Jul 08 22:34:36.320094 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:36.320072 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" Jul 08 22:34:36.320212 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:36.320097 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-ldnsr" Jul 08 22:34:36.320212 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:36.320120 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:34:36.476048 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:36.475848 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-668b798ff7-pdmpm"] Jul 08 22:34:36.478762 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:34:36.478736 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod484b5bc8_bcca_47de_ad41_453f35efec77.slice/crio-004dca7458c3a0aa00c379ac1f3fefcb978bde1158b112c6cb221586cdd80700 WatchSource:0}: Error finding container 004dca7458c3a0aa00c379ac1f3fefcb978bde1158b112c6cb221586cdd80700: Status 404 returned error can't find the container with id 004dca7458c3a0aa00c379ac1f3fefcb978bde1158b112c6cb221586cdd80700 Jul 08 22:34:36.694946 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:36.694869 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h"] Jul 08 22:34:36.697753 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:36.697730 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-ldnsr"] Jul 08 22:34:36.699724 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:34:36.699697 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2025a9dd_3c77_4432_a494_4da125abf86f.slice/crio-f044f661c8990b23d6d61c10b430997ed6dca998d7ad493612c55b2f60794343 WatchSource:0}: Error finding container f044f661c8990b23d6d61c10b430997ed6dca998d7ad493612c55b2f60794343: Status 404 returned error can't find the container with id f044f661c8990b23d6d61c10b430997ed6dca998d7ad493612c55b2f60794343 Jul 08 22:34:36.700728 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:34:36.700709 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod67bdd4c4_38d8_4f50_92bd_73055c10f401.slice/crio-890fc471477bc1898b05a2392a18513cbc9a30fb61c0c30094d68e63fee4b20e WatchSource:0}: Error finding container 890fc471477bc1898b05a2392a18513cbc9a30fb61c0c30094d68e63fee4b20e: Status 404 returned error can't find the container with id 890fc471477bc1898b05a2392a18513cbc9a30fb61c0c30094d68e63fee4b20e Jul 08 22:34:37.022379 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:37.022343 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ldnsr" event={"ID":"67bdd4c4-38d8-4f50-92bd-73055c10f401","Type":"ContainerStarted","Data":"890fc471477bc1898b05a2392a18513cbc9a30fb61c0c30094d68e63fee4b20e"} Jul 08 22:34:37.023846 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:37.023815 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" event={"ID":"484b5bc8-bcca-47de-ad41-453f35efec77","Type":"ContainerStarted","Data":"55c201f75e14a5f5d7c7db2636835f8f5a455db8ca71a556a221663b6394d58a"} Jul 08 22:34:37.023980 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:37.023854 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" event={"ID":"484b5bc8-bcca-47de-ad41-453f35efec77","Type":"ContainerStarted","Data":"004dca7458c3a0aa00c379ac1f3fefcb978bde1158b112c6cb221586cdd80700"} Jul 08 22:34:37.023980 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:37.023924 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:34:37.024965 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:37.024933 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" event={"ID":"2025a9dd-3c77-4432-a494-4da125abf86f","Type":"ContainerStarted","Data":"f044f661c8990b23d6d61c10b430997ed6dca998d7ad493612c55b2f60794343"} Jul 08 22:34:37.043381 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:37.043337 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" podStartSLOduration=271.043320169 podStartE2EDuration="4m31.043320169s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:30:06 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:34:37.042195857 +0000 UTC m=+287.380902829" watchObservedRunningTime="2026-07-08 22:34:37.043320169 +0000 UTC m=+287.382027174" Jul 08 22:34:38.059584 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:38.059532 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52435621-b805-464a-84e1-ed7cf0ebc95b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:38.060027 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:38.059623 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52435621-b805-464a-84e1-ed7cf0ebc95b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:38.060194 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:38.060169 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/52435621-b805-464a-84e1-ed7cf0ebc95b-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:38.062336 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:38.062313 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/52435621-b805-464a-84e1-ed7cf0ebc95b-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-45r85\" (UID: \"52435621-b805-464a-84e1-ed7cf0ebc95b\") " pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:38.105281 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:38.105246 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-45r85" Jul 08 22:34:38.369667 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:38.369639 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-45r85"] Jul 08 22:34:38.372819 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:34:38.372791 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod52435621_b805_464a_84e1_ed7cf0ebc95b.slice/crio-cb1d23a36ffc726a337ef69d595a35f9a8c2b4756dd3d97507351274916432ff WatchSource:0}: Error finding container cb1d23a36ffc726a337ef69d595a35f9a8c2b4756dd3d97507351274916432ff: Status 404 returned error can't find the container with id cb1d23a36ffc726a337ef69d595a35f9a8c2b4756dd3d97507351274916432ff Jul 08 22:34:39.034192 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:39.034156 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" event={"ID":"2025a9dd-3c77-4432-a494-4da125abf86f","Type":"ContainerStarted","Data":"53407f06ca2d8bac8485a12b2d15cc959a7617073c562516799ef0b7268d4456"} Jul 08 22:34:39.035482 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:39.035447 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-45r85" event={"ID":"52435621-b805-464a-84e1-ed7cf0ebc95b","Type":"ContainerStarted","Data":"cb1d23a36ffc726a337ef69d595a35f9a8c2b4756dd3d97507351274916432ff"} Jul 08 22:34:39.051094 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:39.051031 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-6bffdf9778-x8r8h" podStartSLOduration=278.503084034 podStartE2EDuration="4m40.051008051s" totalImagesPullingTime="1.547924017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:29:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:34:39.050461687 +0000 UTC m=+289.389168683" watchObservedRunningTime="2026-07-08 22:34:39.051008051 +0000 UTC m=+289.389715025" Jul 08 22:34:40.041962 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:40.041924 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ldnsr" event={"ID":"67bdd4c4-38d8-4f50-92bd-73055c10f401","Type":"ContainerStarted","Data":"1ca0707580bc8db74e26f306ea842600dda908b008af7499c223a6ce68362acf"} Jul 08 22:34:40.042436 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:40.042014 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-ldnsr" event={"ID":"67bdd4c4-38d8-4f50-92bd-73055c10f401","Type":"ContainerStarted","Data":"1fd3fcc84a25a76abbdf242f1c355231323b91d36b356d50d9a133c6b28d27b5"} Jul 08 22:34:40.058750 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:40.058703 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-ldnsr" podStartSLOduration=251.643413973 podStartE2EDuration="4m14.05868587s" totalImagesPullingTime="2.415271897s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:30:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:34:40.057932498 +0000 UTC m=+290.396639496" watchObservedRunningTime="2026-07-08 22:34:40.05868587 +0000 UTC m=+290.397392843" Jul 08 22:34:41.045959 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:41.045925 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-ldnsr" Jul 08 22:34:43.053869 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:43.053831 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-45r85" event={"ID":"52435621-b805-464a-84e1-ed7cf0ebc95b","Type":"ContainerStarted","Data":"cd3896b7fac30df7e5f8fd8d52b3d857a53b1a49fa77ec333da433c76e390e99"} Jul 08 22:34:43.176498 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:43.176466 2573 scope.go:117] "RemoveContainer" containerID="00de051064ddf6dd904d0dd194a1378602a4b5d64ce59f230327a2288fe06498" Jul 08 22:34:44.059951 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:44.059918 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/1.log" Jul 08 22:34:44.060430 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:44.060025 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-68b757fb67-tscmz" event={"ID":"77abbd4d-d10d-47f8-8f2f-6fddd5bb1657","Type":"ContainerStarted","Data":"788cf28d37a34238118dc56be96c9acc52fbeaa8bb0ef8bb0f5f691398a9a35a"} Jul 08 22:34:44.060430 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:44.060362 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-68b757fb67-tscmz" Jul 08 22:34:44.062403 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:44.062350 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-45r85" event={"ID":"52435621-b805-464a-84e1-ed7cf0ebc95b","Type":"ContainerStarted","Data":"d78a7c4aa5f426da8876e48bfbbbfe588fb4df54f618a1e3cd6e78491cde7951"} Jul 08 22:34:44.065835 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:44.065819 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-68b757fb67-tscmz" Jul 08 22:34:44.177241 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:34:44.177199 2573 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[metrics-certs], unattached volumes=[], failed to process volumes=[]: context deadline exceeded" pod="openshift-multus/network-metrics-daemon-2t2gl" podUID="83988472-fc5e-4e4a-a7ab-248bd26e4a48" Jul 08 22:34:46.071364 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:46.071324 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-45r85" event={"ID":"52435621-b805-464a-84e1-ed7cf0ebc95b","Type":"ContainerStarted","Data":"9caf1e9d97567b46319bcdbd8ae6033104ce287b60d4a135bf3cd687e8233b54"} Jul 08 22:34:46.089158 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:46.089104 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-45r85" podStartSLOduration=16.999619065 podStartE2EDuration="24.08908769s" totalImagesPullingTime="7.089468625s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 22:34:22 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:34:46.087964862 +0000 UTC m=+296.426671858" watchObservedRunningTime="2026-07-08 22:34:46.08908769 +0000 UTC m=+296.427794663" Jul 08 22:34:50.087173 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:50.087141 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/1.log" Jul 08 22:34:50.087699 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:50.087681 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/1.log" Jul 08 22:34:50.098584 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:50.098543 2573 kubelet.go:1648] "Image garbage collection succeeded" Jul 08 22:34:51.051904 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:51.051867 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-ldnsr" Jul 08 22:34:52.185030 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.185003 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-7bbf989bcc-fswb8"] Jul 08 22:34:52.187902 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.187883 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:34:52.190192 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.190169 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 08 22:34:52.190192 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.190168 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 08 22:34:52.191239 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.191212 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 08 22:34:52.191340 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.191250 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 08 22:34:52.191340 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.191298 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 08 22:34:52.191451 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.191354 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 08 22:34:52.191451 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.191365 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 08 22:34:52.191937 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.191914 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-l87c9\"" Jul 08 22:34:52.198186 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.198166 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bbf989bcc-fswb8"] Jul 08 22:34:52.377856 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.377809 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-console-config\") pod \"console-7bbf989bcc-fswb8\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:34:52.377856 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.377856 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-console-serving-cert\") pod \"console-7bbf989bcc-fswb8\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:34:52.378085 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.377959 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-console-oauth-config\") pod \"console-7bbf989bcc-fswb8\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:34:52.378085 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.378001 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-service-ca\") pod \"console-7bbf989bcc-fswb8\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:34:52.378085 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.378017 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-oauth-serving-cert\") pod \"console-7bbf989bcc-fswb8\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:34:52.378085 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.378077 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-njnsw\" (UniqueName: \"kubernetes.io/projected/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-kube-api-access-njnsw\") pod \"console-7bbf989bcc-fswb8\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:34:52.479311 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.479277 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-console-oauth-config\") pod \"console-7bbf989bcc-fswb8\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:34:52.479500 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.479323 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-service-ca\") pod \"console-7bbf989bcc-fswb8\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:34:52.479500 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.479345 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-oauth-serving-cert\") pod \"console-7bbf989bcc-fswb8\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:34:52.479500 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.479369 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-njnsw\" (UniqueName: \"kubernetes.io/projected/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-kube-api-access-njnsw\") pod \"console-7bbf989bcc-fswb8\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:34:52.479703 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.479524 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-console-config\") pod \"console-7bbf989bcc-fswb8\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:34:52.479703 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.479583 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-console-serving-cert\") pod \"console-7bbf989bcc-fswb8\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:34:52.480164 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.480081 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-service-ca\") pod \"console-7bbf989bcc-fswb8\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:34:52.480164 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.480095 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-oauth-serving-cert\") pod \"console-7bbf989bcc-fswb8\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:34:52.480164 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.480168 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-console-config\") pod \"console-7bbf989bcc-fswb8\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:34:52.481961 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.481934 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-console-oauth-config\") pod \"console-7bbf989bcc-fswb8\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:34:52.482102 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.482082 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-console-serving-cert\") pod \"console-7bbf989bcc-fswb8\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:34:52.487424 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.487404 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-njnsw\" (UniqueName: \"kubernetes.io/projected/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-kube-api-access-njnsw\") pod \"console-7bbf989bcc-fswb8\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:34:52.497210 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.497185 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:34:52.631142 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.631108 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-7bbf989bcc-fswb8"] Jul 08 22:34:52.634055 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:34:52.634032 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8be99ce0_8ab0_460b_bbcd_e7036780fb8b.slice/crio-67ab9993dfd226b335081eaba4879d647b995c21d3dcfa6abe62c506e9d55344 WatchSource:0}: Error finding container 67ab9993dfd226b335081eaba4879d647b995c21d3dcfa6abe62c506e9d55344: Status 404 returned error can't find the container with id 67ab9993dfd226b335081eaba4879d647b995c21d3dcfa6abe62c506e9d55344 Jul 08 22:34:52.636320 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:52.636299 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 22:34:53.093810 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:53.093777 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bbf989bcc-fswb8" event={"ID":"8be99ce0-8ab0-460b-bbcd-e7036780fb8b","Type":"ContainerStarted","Data":"67ab9993dfd226b335081eaba4879d647b995c21d3dcfa6abe62c506e9d55344"} Jul 08 22:34:55.176832 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:55.176793 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:34:56.326063 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:56.326027 2573 patch_prober.go:28] interesting pod/image-registry-668b798ff7-pdmpm container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 08 22:34:56.326380 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:56.326103 2573 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" podUID="484b5bc8-bcca-47de-ad41-453f35efec77" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 22:34:57.110434 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:57.110396 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bbf989bcc-fswb8" event={"ID":"8be99ce0-8ab0-460b-bbcd-e7036780fb8b","Type":"ContainerStarted","Data":"160a28c06a627be71713d016a0968cd735ee22177e48b5fd8d8463b4ddc375a7"} Jul 08 22:34:57.129598 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:57.129524 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-7bbf989bcc-fswb8" podStartSLOduration=1.47811435 podStartE2EDuration="5.129510383s" totalImagesPullingTime="3.651396033s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:34:52 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:34:57.128057915 +0000 UTC m=+307.466764888" watchObservedRunningTime="2026-07-08 22:34:57.129510383 +0000 UTC m=+307.468217353" Jul 08 22:34:58.033844 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:58.033817 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:34:59.167488 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.167458 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-54844dbd47-lfb8j"] Jul 08 22:34:59.169580 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.169542 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.177343 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.177322 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 08 22:34:59.179530 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.179508 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54844dbd47-lfb8j"] Jul 08 22:34:59.228584 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.228542 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-service-ca\") pod \"console-54844dbd47-lfb8j\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.228736 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.228591 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-trusted-ca-bundle\") pod \"console-54844dbd47-lfb8j\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.228736 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.228616 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-oauth-serving-cert\") pod \"console-54844dbd47-lfb8j\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.228736 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.228651 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7df6a0e-df96-42af-a834-6297ee94fd6c-console-oauth-config\") pod \"console-54844dbd47-lfb8j\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.228736 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.228685 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz29l\" (UniqueName: \"kubernetes.io/projected/d7df6a0e-df96-42af-a834-6297ee94fd6c-kube-api-access-hz29l\") pod \"console-54844dbd47-lfb8j\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.228736 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.228710 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-console-config\") pod \"console-54844dbd47-lfb8j\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.228916 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.228759 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7df6a0e-df96-42af-a834-6297ee94fd6c-console-serving-cert\") pod \"console-54844dbd47-lfb8j\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.329701 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.329668 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-trusted-ca-bundle\") pod \"console-54844dbd47-lfb8j\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.329883 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.329710 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-oauth-serving-cert\") pod \"console-54844dbd47-lfb8j\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.329883 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.329741 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7df6a0e-df96-42af-a834-6297ee94fd6c-console-oauth-config\") pod \"console-54844dbd47-lfb8j\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.329883 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.329800 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz29l\" (UniqueName: \"kubernetes.io/projected/d7df6a0e-df96-42af-a834-6297ee94fd6c-kube-api-access-hz29l\") pod \"console-54844dbd47-lfb8j\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.329883 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.329852 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-console-config\") pod \"console-54844dbd47-lfb8j\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.330175 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.329897 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7df6a0e-df96-42af-a834-6297ee94fd6c-console-serving-cert\") pod \"console-54844dbd47-lfb8j\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.330175 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.329935 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-service-ca\") pod \"console-54844dbd47-lfb8j\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.330509 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.330456 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-oauth-serving-cert\") pod \"console-54844dbd47-lfb8j\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.330744 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.330672 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-service-ca\") pod \"console-54844dbd47-lfb8j\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.330804 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.330766 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-trusted-ca-bundle\") pod \"console-54844dbd47-lfb8j\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.330804 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.330726 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-console-config\") pod \"console-54844dbd47-lfb8j\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.332381 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.332354 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7df6a0e-df96-42af-a834-6297ee94fd6c-console-oauth-config\") pod \"console-54844dbd47-lfb8j\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.332473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.332443 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7df6a0e-df96-42af-a834-6297ee94fd6c-console-serving-cert\") pod \"console-54844dbd47-lfb8j\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.339037 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.339012 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz29l\" (UniqueName: \"kubernetes.io/projected/d7df6a0e-df96-42af-a834-6297ee94fd6c-kube-api-access-hz29l\") pod \"console-54844dbd47-lfb8j\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.478198 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.478151 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:34:59.615615 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:34:59.615431 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-54844dbd47-lfb8j"] Jul 08 22:34:59.618164 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:34:59.618131 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd7df6a0e_df96_42af_a834_6297ee94fd6c.slice/crio-bec2cdcc925724ca47bc197535db0975ec7b37756cd9984b3aebf2fdc9c89128 WatchSource:0}: Error finding container bec2cdcc925724ca47bc197535db0975ec7b37756cd9984b3aebf2fdc9c89128: Status 404 returned error can't find the container with id bec2cdcc925724ca47bc197535db0975ec7b37756cd9984b3aebf2fdc9c89128 Jul 08 22:35:00.125871 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:00.125838 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54844dbd47-lfb8j" event={"ID":"d7df6a0e-df96-42af-a834-6297ee94fd6c","Type":"ContainerStarted","Data":"26fe226c579d6cc6b05bfdbddfb9491c0b28f92e202dfbba1aa9027009cdd80c"} Jul 08 22:35:00.126065 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:00.125910 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54844dbd47-lfb8j" event={"ID":"d7df6a0e-df96-42af-a834-6297ee94fd6c","Type":"ContainerStarted","Data":"bec2cdcc925724ca47bc197535db0975ec7b37756cd9984b3aebf2fdc9c89128"} Jul 08 22:35:00.147755 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:00.147702 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-54844dbd47-lfb8j" podStartSLOduration=1.147686585 podStartE2EDuration="1.147686585s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:34:59 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:35:00.146453581 +0000 UTC m=+310.485160553" watchObservedRunningTime="2026-07-08 22:35:00.147686585 +0000 UTC m=+310.486393558" Jul 08 22:35:02.498226 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:02.498184 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:35:02.498695 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:02.498275 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:35:02.503224 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:02.503195 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:35:03.140487 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:03.140458 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:35:07.848770 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:07.848731 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-668b798ff7-pdmpm"] Jul 08 22:35:09.478654 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:09.478616 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:35:09.479109 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:09.478682 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:35:09.483806 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:09.483783 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:35:10.165280 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.165255 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:35:10.224839 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.224808 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bbf989bcc-fswb8"] Jul 08 22:35:10.326435 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.326394 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-z2fn2"] Jul 08 22:35:10.337231 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.337194 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q"] Jul 08 22:35:10.337405 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.337333 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.340821 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.340794 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 08 22:35:10.341077 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.341050 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-dvq2w\"" Jul 08 22:35:10.341205 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.341103 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 08 22:35:10.341205 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.341123 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 08 22:35:10.341205 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.341180 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 08 22:35:10.341381 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.341355 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 08 22:35:10.341662 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.341644 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 08 22:35:10.342899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.342881 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" Jul 08 22:35:10.346988 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.346477 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 08 22:35:10.346988 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.346607 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 08 22:35:10.346988 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.346824 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 08 22:35:10.347203 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.347107 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-k4nq9\"" Jul 08 22:35:10.349630 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.349588 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q"] Jul 08 22:35:10.414472 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.414437 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a267882-3b16-4c31-9b32-49995f135456-node-exporter-textfile\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.414692 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.414491 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a267882-3b16-4c31-9b32-49995f135456-node-exporter-wtmp\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.414692 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.414617 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a267882-3b16-4c31-9b32-49995f135456-node-exporter-tls\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.414692 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.414650 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a267882-3b16-4c31-9b32-49995f135456-metrics-client-ca\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.414692 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.414677 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a267882-3b16-4c31-9b32-49995f135456-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.414903 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.414722 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e1863738-5f7e-492c-939e-b9b748e4f658-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-n425q\" (UID: \"e1863738-5f7e-492c-939e-b9b748e4f658\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" Jul 08 22:35:10.414903 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.414768 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a267882-3b16-4c31-9b32-49995f135456-sys\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.414903 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.414791 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1863738-5f7e-492c-939e-b9b748e4f658-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-n425q\" (UID: \"e1863738-5f7e-492c-939e-b9b748e4f658\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" Jul 08 22:35:10.414903 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.414824 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e1863738-5f7e-492c-939e-b9b748e4f658-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-n425q\" (UID: \"e1863738-5f7e-492c-939e-b9b748e4f658\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" Jul 08 22:35:10.414903 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.414865 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4r22t\" (UniqueName: \"kubernetes.io/projected/e1863738-5f7e-492c-939e-b9b748e4f658-kube-api-access-4r22t\") pod \"kube-state-metrics-7c9dbb8b7d-n425q\" (UID: \"e1863738-5f7e-492c-939e-b9b748e4f658\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" Jul 08 22:35:10.415085 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.414907 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1863738-5f7e-492c-939e-b9b748e4f658-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-n425q\" (UID: \"e1863738-5f7e-492c-939e-b9b748e4f658\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" Jul 08 22:35:10.415085 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.414935 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a267882-3b16-4c31-9b32-49995f135456-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.415085 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.414953 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4mx46\" (UniqueName: \"kubernetes.io/projected/4a267882-3b16-4c31-9b32-49995f135456-kube-api-access-4mx46\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.415085 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.414976 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1863738-5f7e-492c-939e-b9b748e4f658-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-n425q\" (UID: \"e1863738-5f7e-492c-939e-b9b748e4f658\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" Jul 08 22:35:10.415085 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.415004 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a267882-3b16-4c31-9b32-49995f135456-root\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.516126 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.516090 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a267882-3b16-4c31-9b32-49995f135456-node-exporter-tls\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.516126 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.516136 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a267882-3b16-4c31-9b32-49995f135456-metrics-client-ca\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.516705 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.516170 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a267882-3b16-4c31-9b32-49995f135456-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.516705 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.516213 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e1863738-5f7e-492c-939e-b9b748e4f658-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-n425q\" (UID: \"e1863738-5f7e-492c-939e-b9b748e4f658\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" Jul 08 22:35:10.516705 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.516262 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a267882-3b16-4c31-9b32-49995f135456-sys\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.516705 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.516288 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1863738-5f7e-492c-939e-b9b748e4f658-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-n425q\" (UID: \"e1863738-5f7e-492c-939e-b9b748e4f658\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" Jul 08 22:35:10.516705 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:35:10.516289 2573 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 08 22:35:10.516705 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.516321 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e1863738-5f7e-492c-939e-b9b748e4f658-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-n425q\" (UID: \"e1863738-5f7e-492c-939e-b9b748e4f658\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" Jul 08 22:35:10.516705 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.516352 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4r22t\" (UniqueName: \"kubernetes.io/projected/e1863738-5f7e-492c-939e-b9b748e4f658-kube-api-access-4r22t\") pod \"kube-state-metrics-7c9dbb8b7d-n425q\" (UID: \"e1863738-5f7e-492c-939e-b9b748e4f658\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" Jul 08 22:35:10.516705 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:35:10.516387 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/4a267882-3b16-4c31-9b32-49995f135456-node-exporter-tls podName:4a267882-3b16-4c31-9b32-49995f135456 nodeName:}" failed. No retries permitted until 2026-07-08 22:35:11.016364389 +0000 UTC m=+321.355071357 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/4a267882-3b16-4c31-9b32-49995f135456-node-exporter-tls") pod "node-exporter-z2fn2" (UID: "4a267882-3b16-4c31-9b32-49995f135456") : secret "node-exporter-tls" not found Jul 08 22:35:10.516705 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.516425 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1863738-5f7e-492c-939e-b9b748e4f658-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-n425q\" (UID: \"e1863738-5f7e-492c-939e-b9b748e4f658\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" Jul 08 22:35:10.516705 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.516459 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a267882-3b16-4c31-9b32-49995f135456-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.516705 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.516484 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4mx46\" (UniqueName: \"kubernetes.io/projected/4a267882-3b16-4c31-9b32-49995f135456-kube-api-access-4mx46\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.516705 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.516511 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1863738-5f7e-492c-939e-b9b748e4f658-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-n425q\" (UID: \"e1863738-5f7e-492c-939e-b9b748e4f658\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" Jul 08 22:35:10.516705 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.516543 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a267882-3b16-4c31-9b32-49995f135456-root\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.516705 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.516621 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a267882-3b16-4c31-9b32-49995f135456-node-exporter-textfile\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.516705 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.516653 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a267882-3b16-4c31-9b32-49995f135456-node-exporter-wtmp\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.517629 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.516844 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/4a267882-3b16-4c31-9b32-49995f135456-node-exporter-wtmp\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.517629 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.517508 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4a267882-3b16-4c31-9b32-49995f135456-metrics-client-ca\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.519644 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.518034 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e1863738-5f7e-492c-939e-b9b748e4f658-metrics-client-ca\") pod \"kube-state-metrics-7c9dbb8b7d-n425q\" (UID: \"e1863738-5f7e-492c-939e-b9b748e4f658\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" Jul 08 22:35:10.519644 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.518529 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/4a267882-3b16-4c31-9b32-49995f135456-node-exporter-accelerators-collector-config\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.519644 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.518820 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/4a267882-3b16-4c31-9b32-49995f135456-sys\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.519644 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.519091 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/e1863738-5f7e-492c-939e-b9b748e4f658-volume-directive-shadow\") pod \"kube-state-metrics-7c9dbb8b7d-n425q\" (UID: \"e1863738-5f7e-492c-939e-b9b748e4f658\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" Jul 08 22:35:10.519644 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.519296 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/4a267882-3b16-4c31-9b32-49995f135456-node-exporter-textfile\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.519644 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.519350 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/4a267882-3b16-4c31-9b32-49995f135456-root\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.520637 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.520614 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/e1863738-5f7e-492c-939e-b9b748e4f658-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-7c9dbb8b7d-n425q\" (UID: \"e1863738-5f7e-492c-939e-b9b748e4f658\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" Jul 08 22:35:10.520936 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.520912 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4a267882-3b16-4c31-9b32-49995f135456-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.523864 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.523837 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/e1863738-5f7e-492c-939e-b9b748e4f658-kube-state-metrics-tls\") pod \"kube-state-metrics-7c9dbb8b7d-n425q\" (UID: \"e1863738-5f7e-492c-939e-b9b748e4f658\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" Jul 08 22:35:10.523998 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.523923 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/e1863738-5f7e-492c-939e-b9b748e4f658-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-7c9dbb8b7d-n425q\" (UID: \"e1863738-5f7e-492c-939e-b9b748e4f658\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" Jul 08 22:35:10.525594 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.525545 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4r22t\" (UniqueName: \"kubernetes.io/projected/e1863738-5f7e-492c-939e-b9b748e4f658-kube-api-access-4r22t\") pod \"kube-state-metrics-7c9dbb8b7d-n425q\" (UID: \"e1863738-5f7e-492c-939e-b9b748e4f658\") " pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" Jul 08 22:35:10.527094 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.527072 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4mx46\" (UniqueName: \"kubernetes.io/projected/4a267882-3b16-4c31-9b32-49995f135456-kube-api-access-4mx46\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:10.657593 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.657540 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" Jul 08 22:35:10.800627 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:10.800515 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q"] Jul 08 22:35:10.804659 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:35:10.804629 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1863738_5f7e_492c_939e_b9b748e4f658.slice/crio-8d6c96e2b7f0c1633aef864a636a97418f3e4308fe4d238fa72dfb246a030989 WatchSource:0}: Error finding container 8d6c96e2b7f0c1633aef864a636a97418f3e4308fe4d238fa72dfb246a030989: Status 404 returned error can't find the container with id 8d6c96e2b7f0c1633aef864a636a97418f3e4308fe4d238fa72dfb246a030989 Jul 08 22:35:11.021637 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:11.021598 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a267882-3b16-4c31-9b32-49995f135456-node-exporter-tls\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:11.024025 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:11.024004 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/4a267882-3b16-4c31-9b32-49995f135456-node-exporter-tls\") pod \"node-exporter-z2fn2\" (UID: \"4a267882-3b16-4c31-9b32-49995f135456\") " pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:11.165663 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:11.165577 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" event={"ID":"e1863738-5f7e-492c-939e-b9b748e4f658","Type":"ContainerStarted","Data":"8d6c96e2b7f0c1633aef864a636a97418f3e4308fe4d238fa72dfb246a030989"} Jul 08 22:35:11.250618 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:11.250586 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-z2fn2" Jul 08 22:35:11.262529 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:35:11.262498 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4a267882_3b16_4c31_9b32_49995f135456.slice/crio-68de861272254ff9d4a869d087700d4db40e88434d1fe70caa2cf89b1d68f52b WatchSource:0}: Error finding container 68de861272254ff9d4a869d087700d4db40e88434d1fe70caa2cf89b1d68f52b: Status 404 returned error can't find the container with id 68de861272254ff9d4a869d087700d4db40e88434d1fe70caa2cf89b1d68f52b Jul 08 22:35:12.171383 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:12.171340 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2fn2" event={"ID":"4a267882-3b16-4c31-9b32-49995f135456","Type":"ContainerStarted","Data":"68de861272254ff9d4a869d087700d4db40e88434d1fe70caa2cf89b1d68f52b"} Jul 08 22:35:13.179230 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.179196 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2fn2" event={"ID":"4a267882-3b16-4c31-9b32-49995f135456","Type":"ContainerStarted","Data":"8f6d916bc9f97bc66d23c559b8096eb72901213fec1f54c6b8d04ce93ae3f81f"} Jul 08 22:35:13.181279 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.181253 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" event={"ID":"e1863738-5f7e-492c-939e-b9b748e4f658","Type":"ContainerStarted","Data":"f8cb75d1b5e4fcdaff1dc7f373fe08ec8d9732ea375f4d9d847b9acb7ab62b66"} Jul 08 22:35:13.181394 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.181313 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" event={"ID":"e1863738-5f7e-492c-939e-b9b748e4f658","Type":"ContainerStarted","Data":"1c181dff83dc3ad0dc3e83c453801e10272e0991b1178a67e64cf763213800bb"} Jul 08 22:35:13.280989 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.280956 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc"] Jul 08 22:35:13.306168 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.306094 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc"] Jul 08 22:35:13.306271 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.306221 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.309447 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.308732 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 08 22:35:13.309447 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.308934 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 08 22:35:13.309447 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.309237 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 08 22:35:13.309447 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.309308 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 08 22:35:13.309750 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.309487 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-kd1jss3u43jm\"" Jul 08 22:35:13.309750 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.309710 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-r5k4b\"" Jul 08 22:35:13.310086 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.309894 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 08 22:35:13.345456 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.345430 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/18593320-7883-47f8-84fa-0a4d95dd1eaa-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.345610 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.345584 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18593320-7883-47f8-84fa-0a4d95dd1eaa-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.345698 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.345635 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18593320-7883-47f8-84fa-0a4d95dd1eaa-metrics-client-ca\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.345698 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.345672 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/18593320-7883-47f8-84fa-0a4d95dd1eaa-secret-thanos-querier-tls\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.345803 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.345709 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18593320-7883-47f8-84fa-0a4d95dd1eaa-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.345803 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.345738 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/18593320-7883-47f8-84fa-0a4d95dd1eaa-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.345803 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.345766 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18593320-7883-47f8-84fa-0a4d95dd1eaa-secret-grpc-tls\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.345803 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.345789 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6qnhf\" (UniqueName: \"kubernetes.io/projected/18593320-7883-47f8-84fa-0a4d95dd1eaa-kube-api-access-6qnhf\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.446955 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.446922 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18593320-7883-47f8-84fa-0a4d95dd1eaa-metrics-client-ca\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.447060 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.446985 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/18593320-7883-47f8-84fa-0a4d95dd1eaa-secret-thanos-querier-tls\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.447060 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.447025 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18593320-7883-47f8-84fa-0a4d95dd1eaa-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.447178 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.447059 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/18593320-7883-47f8-84fa-0a4d95dd1eaa-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.447178 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.447089 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18593320-7883-47f8-84fa-0a4d95dd1eaa-secret-grpc-tls\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.447178 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.447114 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6qnhf\" (UniqueName: \"kubernetes.io/projected/18593320-7883-47f8-84fa-0a4d95dd1eaa-kube-api-access-6qnhf\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.447316 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.447203 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/18593320-7883-47f8-84fa-0a4d95dd1eaa-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.447316 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.447241 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18593320-7883-47f8-84fa-0a4d95dd1eaa-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.448302 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.447923 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/18593320-7883-47f8-84fa-0a4d95dd1eaa-metrics-client-ca\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.450316 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.450266 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/18593320-7883-47f8-84fa-0a4d95dd1eaa-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.450792 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.450763 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/18593320-7883-47f8-84fa-0a4d95dd1eaa-secret-thanos-querier-tls\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.451199 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.451176 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/18593320-7883-47f8-84fa-0a4d95dd1eaa-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.452213 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.452181 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/18593320-7883-47f8-84fa-0a4d95dd1eaa-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.452306 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.452265 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/18593320-7883-47f8-84fa-0a4d95dd1eaa-secret-grpc-tls\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.452385 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.452362 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/18593320-7883-47f8-84fa-0a4d95dd1eaa-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.455024 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.455001 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-6qnhf\" (UniqueName: \"kubernetes.io/projected/18593320-7883-47f8-84fa-0a4d95dd1eaa-kube-api-access-6qnhf\") pod \"thanos-querier-7d7568cd6c-dk8sc\" (UID: \"18593320-7883-47f8-84fa-0a4d95dd1eaa\") " pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.618995 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.618954 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:13.792795 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:13.792761 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc"] Jul 08 22:35:13.796388 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:35:13.796358 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod18593320_7883_47f8_84fa_0a4d95dd1eaa.slice/crio-e900c9ec55249218386791594591af9643499d78e6671cdbcddaf634442ff884 WatchSource:0}: Error finding container e900c9ec55249218386791594591af9643499d78e6671cdbcddaf634442ff884: Status 404 returned error can't find the container with id e900c9ec55249218386791594591af9643499d78e6671cdbcddaf634442ff884 Jul 08 22:35:14.186335 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:14.186290 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" event={"ID":"18593320-7883-47f8-84fa-0a4d95dd1eaa","Type":"ContainerStarted","Data":"e900c9ec55249218386791594591af9643499d78e6671cdbcddaf634442ff884"} Jul 08 22:35:14.188439 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:14.188412 2573 generic.go:356] "Generic (PLEG): container finished" podID="4a267882-3b16-4c31-9b32-49995f135456" containerID="8f6d916bc9f97bc66d23c559b8096eb72901213fec1f54c6b8d04ce93ae3f81f" exitCode=0 Jul 08 22:35:14.188571 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:14.188503 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2fn2" event={"ID":"4a267882-3b16-4c31-9b32-49995f135456","Type":"ContainerDied","Data":"8f6d916bc9f97bc66d23c559b8096eb72901213fec1f54c6b8d04ce93ae3f81f"} Jul 08 22:35:14.188620 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:14.188583 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2fn2" event={"ID":"4a267882-3b16-4c31-9b32-49995f135456","Type":"ContainerStarted","Data":"421264fa97e1bcdebbf37e5384d39fcd4ca63bb872a791f3f94ec0165484c142"} Jul 08 22:35:14.188620 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:14.188611 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-z2fn2" event={"ID":"4a267882-3b16-4c31-9b32-49995f135456","Type":"ContainerStarted","Data":"f30e723e4eddf053fdcccffc5b7864c61b80ad77e9554666b0862191efb6e8cc"} Jul 08 22:35:14.190604 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:14.190581 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" event={"ID":"e1863738-5f7e-492c-939e-b9b748e4f658","Type":"ContainerStarted","Data":"a52f4f4f83a5e8d442babafd4ac6822514664f3396247b781e780d5f78ae9454"} Jul 08 22:35:14.207825 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:14.207773 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-z2fn2" podStartSLOduration=2.444875874 podStartE2EDuration="4.207758026s" totalImagesPullingTime="1.642555295s" totalInitContainerRuntime="120.326857ms" isStatefulPod=true podCreationTimestamp="2026-07-08 22:35:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:35:14.207506899 +0000 UTC m=+324.546213891" watchObservedRunningTime="2026-07-08 22:35:14.207758026 +0000 UTC m=+324.546464998" Jul 08 22:35:14.225731 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:14.225681 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-7c9dbb8b7d-n425q" podStartSLOduration=2.128344828 podStartE2EDuration="4.225664037s" totalImagesPullingTime="2.097319209s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:35:10 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:35:14.225269115 +0000 UTC m=+324.563976088" watchObservedRunningTime="2026-07-08 22:35:14.225664037 +0000 UTC m=+324.564371009" Jul 08 22:35:15.110358 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:15.110316 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-fksxf"] Jul 08 22:35:15.129960 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:15.129929 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-fksxf"] Jul 08 22:35:15.130104 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:15.130026 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fksxf" Jul 08 22:35:15.132658 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:15.132620 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 08 22:35:15.132795 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:15.132765 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-dmxcq\"" Jul 08 22:35:15.164751 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:15.164712 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd4087f8-0815-45a0-a17a-f67b29cca667-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-fksxf\" (UID: \"cd4087f8-0815-45a0-a17a-f67b29cca667\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fksxf" Jul 08 22:35:15.164950 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:15.164772 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7kk9w\" (UniqueName: \"kubernetes.io/projected/cd4087f8-0815-45a0-a17a-f67b29cca667-kube-api-access-7kk9w\") pod \"monitoring-plugin-d5dcff7cf-fksxf\" (UID: \"cd4087f8-0815-45a0-a17a-f67b29cca667\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fksxf" Jul 08 22:35:15.265643 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:15.265599 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd4087f8-0815-45a0-a17a-f67b29cca667-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-fksxf\" (UID: \"cd4087f8-0815-45a0-a17a-f67b29cca667\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fksxf" Jul 08 22:35:15.266147 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:15.265706 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7kk9w\" (UniqueName: \"kubernetes.io/projected/cd4087f8-0815-45a0-a17a-f67b29cca667-kube-api-access-7kk9w\") pod \"monitoring-plugin-d5dcff7cf-fksxf\" (UID: \"cd4087f8-0815-45a0-a17a-f67b29cca667\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fksxf" Jul 08 22:35:15.266147 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:35:15.265705 2573 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 08 22:35:15.266260 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:35:15.266188 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd4087f8-0815-45a0-a17a-f67b29cca667-monitoring-plugin-cert podName:cd4087f8-0815-45a0-a17a-f67b29cca667 nodeName:}" failed. No retries permitted until 2026-07-08 22:35:15.76616677 +0000 UTC m=+326.104873738 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/cd4087f8-0815-45a0-a17a-f67b29cca667-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-fksxf" (UID: "cd4087f8-0815-45a0-a17a-f67b29cca667") : secret "monitoring-plugin-cert" not found Jul 08 22:35:15.277986 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:15.277938 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7kk9w\" (UniqueName: \"kubernetes.io/projected/cd4087f8-0815-45a0-a17a-f67b29cca667-kube-api-access-7kk9w\") pod \"monitoring-plugin-d5dcff7cf-fksxf\" (UID: \"cd4087f8-0815-45a0-a17a-f67b29cca667\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fksxf" Jul 08 22:35:15.770002 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:15.769959 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd4087f8-0815-45a0-a17a-f67b29cca667-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-fksxf\" (UID: \"cd4087f8-0815-45a0-a17a-f67b29cca667\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fksxf" Jul 08 22:35:15.770308 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:35:15.770100 2573 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 08 22:35:15.770308 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:35:15.770172 2573 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/cd4087f8-0815-45a0-a17a-f67b29cca667-monitoring-plugin-cert podName:cd4087f8-0815-45a0-a17a-f67b29cca667 nodeName:}" failed. No retries permitted until 2026-07-08 22:35:16.770154364 +0000 UTC m=+327.108861318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/cd4087f8-0815-45a0-a17a-f67b29cca667-monitoring-plugin-cert") pod "monitoring-plugin-d5dcff7cf-fksxf" (UID: "cd4087f8-0815-45a0-a17a-f67b29cca667") : secret "monitoring-plugin-cert" not found Jul 08 22:35:16.781897 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:16.781847 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd4087f8-0815-45a0-a17a-f67b29cca667-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-fksxf\" (UID: \"cd4087f8-0815-45a0-a17a-f67b29cca667\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fksxf" Jul 08 22:35:16.784430 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:16.784405 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/cd4087f8-0815-45a0-a17a-f67b29cca667-monitoring-plugin-cert\") pod \"monitoring-plugin-d5dcff7cf-fksxf\" (UID: \"cd4087f8-0815-45a0-a17a-f67b29cca667\") " pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fksxf" Jul 08 22:35:16.941834 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:16.941796 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fksxf" Jul 08 22:35:17.086064 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:17.085976 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-d5dcff7cf-fksxf"] Jul 08 22:35:17.089593 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:35:17.089542 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcd4087f8_0815_45a0_a17a_f67b29cca667.slice/crio-94cdf1db9e18877b655d9bd6c6aa700c8f8eb4dcbd65242eb5e913ff1c4b8b20 WatchSource:0}: Error finding container 94cdf1db9e18877b655d9bd6c6aa700c8f8eb4dcbd65242eb5e913ff1c4b8b20: Status 404 returned error can't find the container with id 94cdf1db9e18877b655d9bd6c6aa700c8f8eb4dcbd65242eb5e913ff1c4b8b20 Jul 08 22:35:17.206778 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:17.206742 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" event={"ID":"18593320-7883-47f8-84fa-0a4d95dd1eaa","Type":"ContainerStarted","Data":"2940f5a6e1b83dd387b943fe6bc2ffd50a5230f1a9b36bc7959a224382fd2419"} Jul 08 22:35:17.206955 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:17.206826 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" event={"ID":"18593320-7883-47f8-84fa-0a4d95dd1eaa","Type":"ContainerStarted","Data":"7335c3b9c115329886f0893fef1ea9ce2fd758699cb65b3362dcf3af01351ef8"} Jul 08 22:35:17.206955 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:17.206862 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" event={"ID":"18593320-7883-47f8-84fa-0a4d95dd1eaa","Type":"ContainerStarted","Data":"6f2abf93d99d6af1eaf3f42c805d218976180e4a8569aaed28f265022342eb7b"} Jul 08 22:35:17.208182 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:17.208141 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fksxf" event={"ID":"cd4087f8-0815-45a0-a17a-f67b29cca667","Type":"ContainerStarted","Data":"94cdf1db9e18877b655d9bd6c6aa700c8f8eb4dcbd65242eb5e913ff1c4b8b20"} Jul 08 22:35:18.217365 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:18.217309 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" event={"ID":"18593320-7883-47f8-84fa-0a4d95dd1eaa","Type":"ContainerStarted","Data":"1c95441c6d7134cf5a57b6cd1742c094e7f3d358ba5e42e38ba9eda5aeb12b63"} Jul 08 22:35:18.217865 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:18.217387 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" event={"ID":"18593320-7883-47f8-84fa-0a4d95dd1eaa","Type":"ContainerStarted","Data":"9c5305e9261e38b3f95a1a20d68426e3bd7017a5df303b103539e67f0a99591e"} Jul 08 22:35:18.217865 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:18.217426 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" event={"ID":"18593320-7883-47f8-84fa-0a4d95dd1eaa","Type":"ContainerStarted","Data":"feb248c577e4c363998919fdd0ba5dd36576c90b777b838cf7684bcb9e2b0635"} Jul 08 22:35:18.217865 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:18.217462 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:18.241796 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:18.241747 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" podStartSLOduration=1.908534887 podStartE2EDuration="5.241730849s" totalImagesPullingTime="3.333195962s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:35:13 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:35:18.240400695 +0000 UTC m=+328.579107705" watchObservedRunningTime="2026-07-08 22:35:18.241730849 +0000 UTC m=+328.580437822" Jul 08 22:35:19.222583 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:19.222532 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fksxf" event={"ID":"cd4087f8-0815-45a0-a17a-f67b29cca667","Type":"ContainerStarted","Data":"01ac59e825273f36334b81c0057125c34cbfc480dc1ce379711ebf59b25080d3"} Jul 08 22:35:19.223034 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:19.223019 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fksxf" Jul 08 22:35:19.228104 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:19.228078 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fksxf" Jul 08 22:35:19.238609 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:19.238548 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-d5dcff7cf-fksxf" podStartSLOduration=2.809266201 podStartE2EDuration="4.238533705s" totalImagesPullingTime="1.429267504s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:35:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:35:19.237058218 +0000 UTC m=+329.575765205" watchObservedRunningTime="2026-07-08 22:35:19.238533705 +0000 UTC m=+329.577240679" Jul 08 22:35:20.625972 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.625922 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-69c4657c76-dh9bd"] Jul 08 22:35:20.629753 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.629700 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:20.639698 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.639670 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69c4657c76-dh9bd"] Jul 08 22:35:20.719331 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.719300 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e05b4378-d42f-47e1-9ed4-0a7864891abb-console-serving-cert\") pod \"console-69c4657c76-dh9bd\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:20.719331 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.719334 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zjhb\" (UniqueName: \"kubernetes.io/projected/e05b4378-d42f-47e1-9ed4-0a7864891abb-kube-api-access-2zjhb\") pod \"console-69c4657c76-dh9bd\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:20.719540 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.719368 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-console-config\") pod \"console-69c4657c76-dh9bd\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:20.719540 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.719434 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-oauth-serving-cert\") pod \"console-69c4657c76-dh9bd\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:20.719540 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.719496 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-trusted-ca-bundle\") pod \"console-69c4657c76-dh9bd\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:20.719540 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.719521 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e05b4378-d42f-47e1-9ed4-0a7864891abb-console-oauth-config\") pod \"console-69c4657c76-dh9bd\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:20.719540 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.719537 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-service-ca\") pod \"console-69c4657c76-dh9bd\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:20.820677 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.820629 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e05b4378-d42f-47e1-9ed4-0a7864891abb-console-serving-cert\") pod \"console-69c4657c76-dh9bd\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:20.820677 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.820675 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zjhb\" (UniqueName: \"kubernetes.io/projected/e05b4378-d42f-47e1-9ed4-0a7864891abb-kube-api-access-2zjhb\") pod \"console-69c4657c76-dh9bd\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:20.820907 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.820700 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-console-config\") pod \"console-69c4657c76-dh9bd\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:20.820907 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.820715 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-oauth-serving-cert\") pod \"console-69c4657c76-dh9bd\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:20.820907 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.820759 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-trusted-ca-bundle\") pod \"console-69c4657c76-dh9bd\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:20.820907 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.820784 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e05b4378-d42f-47e1-9ed4-0a7864891abb-console-oauth-config\") pod \"console-69c4657c76-dh9bd\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:20.820907 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.820798 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-service-ca\") pod \"console-69c4657c76-dh9bd\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:20.821463 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.821437 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-console-config\") pod \"console-69c4657c76-dh9bd\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:20.821617 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.821596 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-service-ca\") pod \"console-69c4657c76-dh9bd\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:20.821681 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.821666 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-trusted-ca-bundle\") pod \"console-69c4657c76-dh9bd\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:20.821913 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.821888 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-oauth-serving-cert\") pod \"console-69c4657c76-dh9bd\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:20.823333 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.823310 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e05b4378-d42f-47e1-9ed4-0a7864891abb-console-oauth-config\") pod \"console-69c4657c76-dh9bd\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:20.823434 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.823413 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e05b4378-d42f-47e1-9ed4-0a7864891abb-console-serving-cert\") pod \"console-69c4657c76-dh9bd\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:20.829365 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.829339 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zjhb\" (UniqueName: \"kubernetes.io/projected/e05b4378-d42f-47e1-9ed4-0a7864891abb-kube-api-access-2zjhb\") pod \"console-69c4657c76-dh9bd\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:20.939321 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:20.939231 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:21.072504 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:21.072471 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-69c4657c76-dh9bd"] Jul 08 22:35:21.077027 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:35:21.077002 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode05b4378_d42f_47e1_9ed4_0a7864891abb.slice/crio-632199b0c9212c1f300a2f09849c3f133bbd6a99da7d937cf858f4d3f74956c2 WatchSource:0}: Error finding container 632199b0c9212c1f300a2f09849c3f133bbd6a99da7d937cf858f4d3f74956c2: Status 404 returned error can't find the container with id 632199b0c9212c1f300a2f09849c3f133bbd6a99da7d937cf858f4d3f74956c2 Jul 08 22:35:21.231483 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:21.231444 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69c4657c76-dh9bd" event={"ID":"e05b4378-d42f-47e1-9ed4-0a7864891abb","Type":"ContainerStarted","Data":"ad94efed2987add2b8615688f050842f5f1f1b2b48f6d79139b8552806c429cf"} Jul 08 22:35:21.231666 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:21.231509 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69c4657c76-dh9bd" event={"ID":"e05b4378-d42f-47e1-9ed4-0a7864891abb","Type":"ContainerStarted","Data":"632199b0c9212c1f300a2f09849c3f133bbd6a99da7d937cf858f4d3f74956c2"} Jul 08 22:35:21.248348 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:21.248291 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-69c4657c76-dh9bd" podStartSLOduration=1.248275394 podStartE2EDuration="1.248275394s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:35:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:35:21.246732651 +0000 UTC m=+331.585439648" watchObservedRunningTime="2026-07-08 22:35:21.248275394 +0000 UTC m=+331.586982366" Jul 08 22:35:24.229912 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:24.229882 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-7d7568cd6c-dk8sc" Jul 08 22:35:27.844968 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:27.844918 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2g9hb_ff30c41b-0ed8-4b43-a28c-75834602f728/serve-healthcheck-canary/0.log" Jul 08 22:35:30.940109 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:30.940077 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:30.940488 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:30.940150 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:30.945210 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:30.945185 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:31.273113 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:31.273082 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:35:31.315584 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:31.315526 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54844dbd47-lfb8j"] Jul 08 22:35:32.869481 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:32.869431 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" podUID="484b5bc8-bcca-47de-ad41-453f35efec77" containerName="registry" containerID="cri-o://55c201f75e14a5f5d7c7db2636835f8f5a455db8ca71a556a221663b6394d58a" gracePeriod=30 Jul 08 22:35:33.111322 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.111288 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:35:33.228792 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.228762 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/484b5bc8-bcca-47de-ad41-453f35efec77-registry-certificates\") pod \"484b5bc8-bcca-47de-ad41-453f35efec77\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " Jul 08 22:35:33.229002 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.228798 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/484b5bc8-bcca-47de-ad41-453f35efec77-ca-trust-extracted\") pod \"484b5bc8-bcca-47de-ad41-453f35efec77\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " Jul 08 22:35:33.229002 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.228837 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/484b5bc8-bcca-47de-ad41-453f35efec77-installation-pull-secrets\") pod \"484b5bc8-bcca-47de-ad41-453f35efec77\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " Jul 08 22:35:33.229002 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.228869 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls\") pod \"484b5bc8-bcca-47de-ad41-453f35efec77\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " Jul 08 22:35:33.229002 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.228895 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/484b5bc8-bcca-47de-ad41-453f35efec77-trusted-ca\") pod \"484b5bc8-bcca-47de-ad41-453f35efec77\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " Jul 08 22:35:33.229002 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.228919 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-bound-sa-token\") pod \"484b5bc8-bcca-47de-ad41-453f35efec77\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " Jul 08 22:35:33.229002 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.228950 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/484b5bc8-bcca-47de-ad41-453f35efec77-image-registry-private-configuration\") pod \"484b5bc8-bcca-47de-ad41-453f35efec77\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " Jul 08 22:35:33.229286 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.229008 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wf867\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-kube-api-access-wf867\") pod \"484b5bc8-bcca-47de-ad41-453f35efec77\" (UID: \"484b5bc8-bcca-47de-ad41-453f35efec77\") " Jul 08 22:35:33.229348 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.229271 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/484b5bc8-bcca-47de-ad41-453f35efec77-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "484b5bc8-bcca-47de-ad41-453f35efec77" (UID: "484b5bc8-bcca-47de-ad41-453f35efec77"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:35:33.229407 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.229384 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/484b5bc8-bcca-47de-ad41-453f35efec77-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "484b5bc8-bcca-47de-ad41-453f35efec77" (UID: "484b5bc8-bcca-47de-ad41-453f35efec77"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:35:33.231962 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.231907 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/484b5bc8-bcca-47de-ad41-453f35efec77-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "484b5bc8-bcca-47de-ad41-453f35efec77" (UID: "484b5bc8-bcca-47de-ad41-453f35efec77"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:35:33.231962 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.231942 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "484b5bc8-bcca-47de-ad41-453f35efec77" (UID: "484b5bc8-bcca-47de-ad41-453f35efec77"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:35:33.232176 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.232035 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/484b5bc8-bcca-47de-ad41-453f35efec77-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "484b5bc8-bcca-47de-ad41-453f35efec77" (UID: "484b5bc8-bcca-47de-ad41-453f35efec77"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:35:33.232176 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.232059 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "484b5bc8-bcca-47de-ad41-453f35efec77" (UID: "484b5bc8-bcca-47de-ad41-453f35efec77"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:35:33.232176 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.232087 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-kube-api-access-wf867" (OuterVolumeSpecName: "kube-api-access-wf867") pod "484b5bc8-bcca-47de-ad41-453f35efec77" (UID: "484b5bc8-bcca-47de-ad41-453f35efec77"). InnerVolumeSpecName "kube-api-access-wf867". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:35:33.238182 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.238153 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/484b5bc8-bcca-47de-ad41-453f35efec77-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "484b5bc8-bcca-47de-ad41-453f35efec77" (UID: "484b5bc8-bcca-47de-ad41-453f35efec77"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:35:33.277835 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.277800 2573 generic.go:356] "Generic (PLEG): container finished" podID="484b5bc8-bcca-47de-ad41-453f35efec77" containerID="55c201f75e14a5f5d7c7db2636835f8f5a455db8ca71a556a221663b6394d58a" exitCode=0 Jul 08 22:35:33.277978 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.277844 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" event={"ID":"484b5bc8-bcca-47de-ad41-453f35efec77","Type":"ContainerDied","Data":"55c201f75e14a5f5d7c7db2636835f8f5a455db8ca71a556a221663b6394d58a"} Jul 08 22:35:33.277978 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.277857 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" Jul 08 22:35:33.277978 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.277883 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-668b798ff7-pdmpm" event={"ID":"484b5bc8-bcca-47de-ad41-453f35efec77","Type":"ContainerDied","Data":"004dca7458c3a0aa00c379ac1f3fefcb978bde1158b112c6cb221586cdd80700"} Jul 08 22:35:33.277978 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.277902 2573 scope.go:117] "RemoveContainer" containerID="55c201f75e14a5f5d7c7db2636835f8f5a455db8ca71a556a221663b6394d58a" Jul 08 22:35:33.287011 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.286988 2573 scope.go:117] "RemoveContainer" containerID="55c201f75e14a5f5d7c7db2636835f8f5a455db8ca71a556a221663b6394d58a" Jul 08 22:35:33.287293 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:35:33.287273 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"55c201f75e14a5f5d7c7db2636835f8f5a455db8ca71a556a221663b6394d58a\": container with ID starting with 55c201f75e14a5f5d7c7db2636835f8f5a455db8ca71a556a221663b6394d58a not found: ID does not exist" containerID="55c201f75e14a5f5d7c7db2636835f8f5a455db8ca71a556a221663b6394d58a" Jul 08 22:35:33.287343 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.287303 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"55c201f75e14a5f5d7c7db2636835f8f5a455db8ca71a556a221663b6394d58a"} err="failed to get container status \"55c201f75e14a5f5d7c7db2636835f8f5a455db8ca71a556a221663b6394d58a\": rpc error: code = NotFound desc = could not find container \"55c201f75e14a5f5d7c7db2636835f8f5a455db8ca71a556a221663b6394d58a\": container with ID starting with 55c201f75e14a5f5d7c7db2636835f8f5a455db8ca71a556a221663b6394d58a not found: ID does not exist" Jul 08 22:35:33.298830 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.298804 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-668b798ff7-pdmpm"] Jul 08 22:35:33.302549 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.302529 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-668b798ff7-pdmpm"] Jul 08 22:35:33.330708 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.330677 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wf867\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-kube-api-access-wf867\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:35:33.330708 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.330704 2573 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/484b5bc8-bcca-47de-ad41-453f35efec77-registry-certificates\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:35:33.330917 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.330716 2573 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/484b5bc8-bcca-47de-ad41-453f35efec77-ca-trust-extracted\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:35:33.330917 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.330729 2573 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/484b5bc8-bcca-47de-ad41-453f35efec77-installation-pull-secrets\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:35:33.330917 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.330738 2573 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-registry-tls\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:35:33.330917 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.330747 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/484b5bc8-bcca-47de-ad41-453f35efec77-trusted-ca\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:35:33.330917 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.330755 2573 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/484b5bc8-bcca-47de-ad41-453f35efec77-bound-sa-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:35:33.330917 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:33.330762 2573 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/484b5bc8-bcca-47de-ad41-453f35efec77-image-registry-private-configuration\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:35:34.182284 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:34.182249 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="484b5bc8-bcca-47de-ad41-453f35efec77" path="/var/lib/kubelet/pods/484b5bc8-bcca-47de-ad41-453f35efec77/volumes" Jul 08 22:35:35.253238 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:35.253191 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-7bbf989bcc-fswb8" podUID="8be99ce0-8ab0-460b-bbcd-e7036780fb8b" containerName="console" containerID="cri-o://160a28c06a627be71713d016a0968cd735ee22177e48b5fd8d8463b4ddc375a7" gracePeriod=15 Jul 08 22:35:35.498091 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:35.498070 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:35:35.650674 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:35.650583 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-console-oauth-config\") pod \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " Jul 08 22:35:35.650674 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:35.650638 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-console-config\") pod \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " Jul 08 22:35:35.650674 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:35.650662 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-service-ca\") pod \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " Jul 08 22:35:35.650938 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:35.650684 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-njnsw\" (UniqueName: \"kubernetes.io/projected/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-kube-api-access-njnsw\") pod \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " Jul 08 22:35:35.650938 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:35.650705 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-console-serving-cert\") pod \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " Jul 08 22:35:35.650938 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:35.650743 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-oauth-serving-cert\") pod \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\" (UID: \"8be99ce0-8ab0-460b-bbcd-e7036780fb8b\") " Jul 08 22:35:35.651155 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:35.651128 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-console-config" (OuterVolumeSpecName: "console-config") pod "8be99ce0-8ab0-460b-bbcd-e7036780fb8b" (UID: "8be99ce0-8ab0-460b-bbcd-e7036780fb8b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:35:35.651219 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:35.651125 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-service-ca" (OuterVolumeSpecName: "service-ca") pod "8be99ce0-8ab0-460b-bbcd-e7036780fb8b" (UID: "8be99ce0-8ab0-460b-bbcd-e7036780fb8b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:35:35.651219 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:35.651185 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "8be99ce0-8ab0-460b-bbcd-e7036780fb8b" (UID: "8be99ce0-8ab0-460b-bbcd-e7036780fb8b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:35:35.653130 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:35.653102 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "8be99ce0-8ab0-460b-bbcd-e7036780fb8b" (UID: "8be99ce0-8ab0-460b-bbcd-e7036780fb8b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:35:35.653130 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:35.653118 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-kube-api-access-njnsw" (OuterVolumeSpecName: "kube-api-access-njnsw") pod "8be99ce0-8ab0-460b-bbcd-e7036780fb8b" (UID: "8be99ce0-8ab0-460b-bbcd-e7036780fb8b"). InnerVolumeSpecName "kube-api-access-njnsw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:35:35.653293 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:35.653121 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "8be99ce0-8ab0-460b-bbcd-e7036780fb8b" (UID: "8be99ce0-8ab0-460b-bbcd-e7036780fb8b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:35:35.751521 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:35.751480 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-console-oauth-config\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:35:35.751521 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:35.751513 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-console-config\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:35:35.751521 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:35.751523 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-service-ca\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:35:35.751521 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:35.751531 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-njnsw\" (UniqueName: \"kubernetes.io/projected/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-kube-api-access-njnsw\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:35:35.751805 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:35.751540 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-console-serving-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:35:35.751805 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:35.751549 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8be99ce0-8ab0-460b-bbcd-e7036780fb8b-oauth-serving-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:35:36.291596 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:36.291533 2573 generic.go:356] "Generic (PLEG): container finished" podID="8be99ce0-8ab0-460b-bbcd-e7036780fb8b" containerID="160a28c06a627be71713d016a0968cd735ee22177e48b5fd8d8463b4ddc375a7" exitCode=0 Jul 08 22:35:36.292068 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:36.291604 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-7bbf989bcc-fswb8" Jul 08 22:35:36.292068 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:36.291628 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bbf989bcc-fswb8" event={"ID":"8be99ce0-8ab0-460b-bbcd-e7036780fb8b","Type":"ContainerDied","Data":"160a28c06a627be71713d016a0968cd735ee22177e48b5fd8d8463b4ddc375a7"} Jul 08 22:35:36.292068 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:36.291690 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-7bbf989bcc-fswb8" event={"ID":"8be99ce0-8ab0-460b-bbcd-e7036780fb8b","Type":"ContainerDied","Data":"67ab9993dfd226b335081eaba4879d647b995c21d3dcfa6abe62c506e9d55344"} Jul 08 22:35:36.292068 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:36.291718 2573 scope.go:117] "RemoveContainer" containerID="160a28c06a627be71713d016a0968cd735ee22177e48b5fd8d8463b4ddc375a7" Jul 08 22:35:36.299961 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:36.299942 2573 scope.go:117] "RemoveContainer" containerID="160a28c06a627be71713d016a0968cd735ee22177e48b5fd8d8463b4ddc375a7" Jul 08 22:35:36.300251 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:35:36.300225 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"160a28c06a627be71713d016a0968cd735ee22177e48b5fd8d8463b4ddc375a7\": container with ID starting with 160a28c06a627be71713d016a0968cd735ee22177e48b5fd8d8463b4ddc375a7 not found: ID does not exist" containerID="160a28c06a627be71713d016a0968cd735ee22177e48b5fd8d8463b4ddc375a7" Jul 08 22:35:36.300303 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:36.300252 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"160a28c06a627be71713d016a0968cd735ee22177e48b5fd8d8463b4ddc375a7"} err="failed to get container status \"160a28c06a627be71713d016a0968cd735ee22177e48b5fd8d8463b4ddc375a7\": rpc error: code = NotFound desc = could not find container \"160a28c06a627be71713d016a0968cd735ee22177e48b5fd8d8463b4ddc375a7\": container with ID starting with 160a28c06a627be71713d016a0968cd735ee22177e48b5fd8d8463b4ddc375a7 not found: ID does not exist" Jul 08 22:35:36.307638 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:36.307619 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-7bbf989bcc-fswb8"] Jul 08 22:35:36.310527 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:36.310501 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-7bbf989bcc-fswb8"] Jul 08 22:35:38.182628 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:38.182601 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8be99ce0-8ab0-460b-bbcd-e7036780fb8b" path="/var/lib/kubelet/pods/8be99ce0-8ab0-460b-bbcd-e7036780fb8b/volumes" Jul 08 22:35:38.302915 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:38.302875 2573 generic.go:356] "Generic (PLEG): container finished" podID="db970960-4fdf-45e5-b4fb-b5028b2c05c0" containerID="32a8b252fcb8e82afefb38d5bbd6ca8c7355e49d71a134140cdaf7c01b76509d" exitCode=0 Jul 08 22:35:38.303098 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:38.302920 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5gdxt" event={"ID":"db970960-4fdf-45e5-b4fb-b5028b2c05c0","Type":"ContainerDied","Data":"32a8b252fcb8e82afefb38d5bbd6ca8c7355e49d71a134140cdaf7c01b76509d"} Jul 08 22:35:38.303336 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:38.303317 2573 scope.go:117] "RemoveContainer" containerID="32a8b252fcb8e82afefb38d5bbd6ca8c7355e49d71a134140cdaf7c01b76509d" Jul 08 22:35:39.311607 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:39.311371 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-846bf668f7-5gdxt" event={"ID":"db970960-4fdf-45e5-b4fb-b5028b2c05c0","Type":"ContainerStarted","Data":"3bc90caf1c67a8f6f70cbddb711a5ab86b077444c5ce8a5d8c36878793283171"} Jul 08 22:35:52.365778 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:52.365691 2573 generic.go:356] "Generic (PLEG): container finished" podID="c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e" containerID="f9d143a7ab512d2e7dd699f594e22b24ac9fa098424f0b4f9b2faede83cb114c" exitCode=0 Jul 08 22:35:52.366125 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:52.365772 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-27fkb" event={"ID":"c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e","Type":"ContainerDied","Data":"f9d143a7ab512d2e7dd699f594e22b24ac9fa098424f0b4f9b2faede83cb114c"} Jul 08 22:35:52.366125 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:52.366108 2573 scope.go:117] "RemoveContainer" containerID="f9d143a7ab512d2e7dd699f594e22b24ac9fa098424f0b4f9b2faede83cb114c" Jul 08 22:35:53.371611 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:53.371546 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d46d9ffd4-27fkb" event={"ID":"c4ecfdb6-b737-4564-a273-7f1e5f1a2b7e","Type":"ContainerStarted","Data":"51edf671eea5c756d25638299160542916e309e2ca10fc90809478ed88589163"} Jul 08 22:35:56.340034 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.339988 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-54844dbd47-lfb8j" podUID="d7df6a0e-df96-42af-a834-6297ee94fd6c" containerName="console" containerID="cri-o://26fe226c579d6cc6b05bfdbddfb9491c0b28f92e202dfbba1aa9027009cdd80c" gracePeriod=15 Jul 08 22:35:56.581859 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.581829 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:35:56.628703 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.628630 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7df6a0e-df96-42af-a834-6297ee94fd6c-console-oauth-config\") pod \"d7df6a0e-df96-42af-a834-6297ee94fd6c\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " Jul 08 22:35:56.628703 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.628663 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-trusted-ca-bundle\") pod \"d7df6a0e-df96-42af-a834-6297ee94fd6c\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " Jul 08 22:35:56.628703 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.628683 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hz29l\" (UniqueName: \"kubernetes.io/projected/d7df6a0e-df96-42af-a834-6297ee94fd6c-kube-api-access-hz29l\") pod \"d7df6a0e-df96-42af-a834-6297ee94fd6c\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " Jul 08 22:35:56.628904 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.628710 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-oauth-serving-cert\") pod \"d7df6a0e-df96-42af-a834-6297ee94fd6c\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " Jul 08 22:35:56.628904 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.628828 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-service-ca\") pod \"d7df6a0e-df96-42af-a834-6297ee94fd6c\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " Jul 08 22:35:56.628904 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.628886 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-console-config\") pod \"d7df6a0e-df96-42af-a834-6297ee94fd6c\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " Jul 08 22:35:56.629057 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.628921 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7df6a0e-df96-42af-a834-6297ee94fd6c-console-serving-cert\") pod \"d7df6a0e-df96-42af-a834-6297ee94fd6c\" (UID: \"d7df6a0e-df96-42af-a834-6297ee94fd6c\") " Jul 08 22:35:56.629057 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.629022 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "d7df6a0e-df96-42af-a834-6297ee94fd6c" (UID: "d7df6a0e-df96-42af-a834-6297ee94fd6c"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:35:56.629275 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.629146 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "d7df6a0e-df96-42af-a834-6297ee94fd6c" (UID: "d7df6a0e-df96-42af-a834-6297ee94fd6c"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:35:56.629275 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.629259 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-service-ca" (OuterVolumeSpecName: "service-ca") pod "d7df6a0e-df96-42af-a834-6297ee94fd6c" (UID: "d7df6a0e-df96-42af-a834-6297ee94fd6c"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:35:56.629666 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.629318 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-oauth-serving-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:35:56.629666 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.629316 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-console-config" (OuterVolumeSpecName: "console-config") pod "d7df6a0e-df96-42af-a834-6297ee94fd6c" (UID: "d7df6a0e-df96-42af-a834-6297ee94fd6c"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:35:56.631164 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.631137 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d7df6a0e-df96-42af-a834-6297ee94fd6c-kube-api-access-hz29l" (OuterVolumeSpecName: "kube-api-access-hz29l") pod "d7df6a0e-df96-42af-a834-6297ee94fd6c" (UID: "d7df6a0e-df96-42af-a834-6297ee94fd6c"). InnerVolumeSpecName "kube-api-access-hz29l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:35:56.631260 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.631168 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7df6a0e-df96-42af-a834-6297ee94fd6c-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "d7df6a0e-df96-42af-a834-6297ee94fd6c" (UID: "d7df6a0e-df96-42af-a834-6297ee94fd6c"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:35:56.631260 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.631183 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/d7df6a0e-df96-42af-a834-6297ee94fd6c-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "d7df6a0e-df96-42af-a834-6297ee94fd6c" (UID: "d7df6a0e-df96-42af-a834-6297ee94fd6c"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:35:56.730599 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.730541 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-service-ca\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:35:56.730599 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.730589 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-console-config\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:35:56.730599 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.730599 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/d7df6a0e-df96-42af-a834-6297ee94fd6c-console-serving-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:35:56.730599 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.730607 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/d7df6a0e-df96-42af-a834-6297ee94fd6c-console-oauth-config\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:35:56.730849 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.730616 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/d7df6a0e-df96-42af-a834-6297ee94fd6c-trusted-ca-bundle\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:35:56.730849 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:56.730624 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hz29l\" (UniqueName: \"kubernetes.io/projected/d7df6a0e-df96-42af-a834-6297ee94fd6c-kube-api-access-hz29l\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:35:57.388183 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:57.388143 2573 generic.go:356] "Generic (PLEG): container finished" podID="d7df6a0e-df96-42af-a834-6297ee94fd6c" containerID="26fe226c579d6cc6b05bfdbddfb9491c0b28f92e202dfbba1aa9027009cdd80c" exitCode=0 Jul 08 22:35:57.388689 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:57.388195 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-54844dbd47-lfb8j" Jul 08 22:35:57.388689 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:57.388237 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54844dbd47-lfb8j" event={"ID":"d7df6a0e-df96-42af-a834-6297ee94fd6c","Type":"ContainerDied","Data":"26fe226c579d6cc6b05bfdbddfb9491c0b28f92e202dfbba1aa9027009cdd80c"} Jul 08 22:35:57.388689 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:57.388309 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-54844dbd47-lfb8j" event={"ID":"d7df6a0e-df96-42af-a834-6297ee94fd6c","Type":"ContainerDied","Data":"bec2cdcc925724ca47bc197535db0975ec7b37756cd9984b3aebf2fdc9c89128"} Jul 08 22:35:57.388689 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:57.388342 2573 scope.go:117] "RemoveContainer" containerID="26fe226c579d6cc6b05bfdbddfb9491c0b28f92e202dfbba1aa9027009cdd80c" Jul 08 22:35:57.397120 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:57.397103 2573 scope.go:117] "RemoveContainer" containerID="26fe226c579d6cc6b05bfdbddfb9491c0b28f92e202dfbba1aa9027009cdd80c" Jul 08 22:35:57.397386 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:35:57.397368 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26fe226c579d6cc6b05bfdbddfb9491c0b28f92e202dfbba1aa9027009cdd80c\": container with ID starting with 26fe226c579d6cc6b05bfdbddfb9491c0b28f92e202dfbba1aa9027009cdd80c not found: ID does not exist" containerID="26fe226c579d6cc6b05bfdbddfb9491c0b28f92e202dfbba1aa9027009cdd80c" Jul 08 22:35:57.397441 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:57.397394 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26fe226c579d6cc6b05bfdbddfb9491c0b28f92e202dfbba1aa9027009cdd80c"} err="failed to get container status \"26fe226c579d6cc6b05bfdbddfb9491c0b28f92e202dfbba1aa9027009cdd80c\": rpc error: code = NotFound desc = could not find container \"26fe226c579d6cc6b05bfdbddfb9491c0b28f92e202dfbba1aa9027009cdd80c\": container with ID starting with 26fe226c579d6cc6b05bfdbddfb9491c0b28f92e202dfbba1aa9027009cdd80c not found: ID does not exist" Jul 08 22:35:57.408925 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:57.408899 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-54844dbd47-lfb8j"] Jul 08 22:35:57.413680 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:57.413658 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-54844dbd47-lfb8j"] Jul 08 22:35:58.181296 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:35:58.181254 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d7df6a0e-df96-42af-a834-6297ee94fd6c" path="/var/lib/kubelet/pods/d7df6a0e-df96-42af-a834-6297ee94fd6c/volumes" Jul 08 22:36:04.194258 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:04.194226 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs\") pod \"network-metrics-daemon-2t2gl\" (UID: \"83988472-fc5e-4e4a-a7ab-248bd26e4a48\") " pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:36:04.196681 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:04.196658 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/83988472-fc5e-4e4a-a7ab-248bd26e4a48-metrics-certs\") pod \"network-metrics-daemon-2t2gl\" (UID: \"83988472-fc5e-4e4a-a7ab-248bd26e4a48\") " pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:36:04.480540 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:04.480516 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-tm4h7\"" Jul 08 22:36:04.487819 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:04.487796 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-2t2gl" Jul 08 22:36:04.619624 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:04.619446 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-2t2gl"] Jul 08 22:36:04.622160 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:36:04.622130 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83988472_fc5e_4e4a_a7ab_248bd26e4a48.slice/crio-9aa71806d62bcb2ddc40d6b2b247c3ffee5f9393c1efa60c6cbe9d1663031ed2 WatchSource:0}: Error finding container 9aa71806d62bcb2ddc40d6b2b247c3ffee5f9393c1efa60c6cbe9d1663031ed2: Status 404 returned error can't find the container with id 9aa71806d62bcb2ddc40d6b2b247c3ffee5f9393c1efa60c6cbe9d1663031ed2 Jul 08 22:36:05.421138 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:05.421089 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2t2gl" event={"ID":"83988472-fc5e-4e4a-a7ab-248bd26e4a48","Type":"ContainerStarted","Data":"9aa71806d62bcb2ddc40d6b2b247c3ffee5f9393c1efa60c6cbe9d1663031ed2"} Jul 08 22:36:06.427335 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:06.427305 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2t2gl" event={"ID":"83988472-fc5e-4e4a-a7ab-248bd26e4a48","Type":"ContainerStarted","Data":"99db75ca6648422558035e4a0c8eb94d4edce487ca4dc7923db9498c279628aa"} Jul 08 22:36:06.427746 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:06.427355 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-2t2gl" event={"ID":"83988472-fc5e-4e4a-a7ab-248bd26e4a48","Type":"ContainerStarted","Data":"2d13345f1cca2e70b3682459359a9b0ba554ac1f2241f97438fb0d360a1d1433"} Jul 08 22:36:06.443829 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:06.443777 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-2t2gl" podStartSLOduration=374.54537077 podStartE2EDuration="6m15.443762403s" totalImagesPullingTime="898.391633ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:29:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:36:06.442720147 +0000 UTC m=+376.781427121" watchObservedRunningTime="2026-07-08 22:36:06.443762403 +0000 UTC m=+376.782469376" Jul 08 22:36:27.933165 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:27.933132 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6d6768c7cf-kwpcz"] Jul 08 22:36:27.933534 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:27.933502 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="484b5bc8-bcca-47de-ad41-453f35efec77" containerName="registry" Jul 08 22:36:27.933534 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:27.933524 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="484b5bc8-bcca-47de-ad41-453f35efec77" containerName="registry" Jul 08 22:36:27.933534 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:27.933532 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d7df6a0e-df96-42af-a834-6297ee94fd6c" containerName="console" Jul 08 22:36:27.933688 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:27.933538 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="d7df6a0e-df96-42af-a834-6297ee94fd6c" containerName="console" Jul 08 22:36:27.933688 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:27.933546 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8be99ce0-8ab0-460b-bbcd-e7036780fb8b" containerName="console" Jul 08 22:36:27.933688 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:27.933577 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="8be99ce0-8ab0-460b-bbcd-e7036780fb8b" containerName="console" Jul 08 22:36:27.933688 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:27.933634 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="484b5bc8-bcca-47de-ad41-453f35efec77" containerName="registry" Jul 08 22:36:27.933688 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:27.933645 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="8be99ce0-8ab0-460b-bbcd-e7036780fb8b" containerName="console" Jul 08 22:36:27.933688 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:27.933659 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="d7df6a0e-df96-42af-a834-6297ee94fd6c" containerName="console" Jul 08 22:36:27.936160 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:27.936140 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:27.950054 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:27.950030 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d6768c7cf-kwpcz"] Jul 08 22:36:28.081540 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.081440 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe0074ac-0c56-4c93-917e-2fd2f31106c7-console-serving-cert\") pod \"console-6d6768c7cf-kwpcz\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:28.081540 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.081486 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-service-ca\") pod \"console-6d6768c7cf-kwpcz\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:28.081540 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.081508 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qgqv4\" (UniqueName: \"kubernetes.io/projected/fe0074ac-0c56-4c93-917e-2fd2f31106c7-kube-api-access-qgqv4\") pod \"console-6d6768c7cf-kwpcz\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:28.081782 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.081662 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe0074ac-0c56-4c93-917e-2fd2f31106c7-console-oauth-config\") pod \"console-6d6768c7cf-kwpcz\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:28.081782 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.081687 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-console-config\") pod \"console-6d6768c7cf-kwpcz\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:28.081782 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.081705 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-oauth-serving-cert\") pod \"console-6d6768c7cf-kwpcz\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:28.081782 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.081744 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-trusted-ca-bundle\") pod \"console-6d6768c7cf-kwpcz\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:28.182861 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.182827 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe0074ac-0c56-4c93-917e-2fd2f31106c7-console-serving-cert\") pod \"console-6d6768c7cf-kwpcz\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:28.182861 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.182861 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-service-ca\") pod \"console-6d6768c7cf-kwpcz\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:28.183106 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.182887 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qgqv4\" (UniqueName: \"kubernetes.io/projected/fe0074ac-0c56-4c93-917e-2fd2f31106c7-kube-api-access-qgqv4\") pod \"console-6d6768c7cf-kwpcz\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:28.183106 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.182957 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe0074ac-0c56-4c93-917e-2fd2f31106c7-console-oauth-config\") pod \"console-6d6768c7cf-kwpcz\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:28.183106 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.182979 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-console-config\") pod \"console-6d6768c7cf-kwpcz\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:28.183106 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.182999 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-oauth-serving-cert\") pod \"console-6d6768c7cf-kwpcz\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:28.183106 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.183028 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-trusted-ca-bundle\") pod \"console-6d6768c7cf-kwpcz\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:28.183627 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.183601 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-service-ca\") pod \"console-6d6768c7cf-kwpcz\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:28.183751 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.183717 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-console-config\") pod \"console-6d6768c7cf-kwpcz\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:28.183888 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.183871 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-trusted-ca-bundle\") pod \"console-6d6768c7cf-kwpcz\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:28.184008 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.183985 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-oauth-serving-cert\") pod \"console-6d6768c7cf-kwpcz\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:28.185504 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.185482 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe0074ac-0c56-4c93-917e-2fd2f31106c7-console-serving-cert\") pod \"console-6d6768c7cf-kwpcz\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:28.185627 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.185526 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe0074ac-0c56-4c93-917e-2fd2f31106c7-console-oauth-config\") pod \"console-6d6768c7cf-kwpcz\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:28.191376 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.191339 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qgqv4\" (UniqueName: \"kubernetes.io/projected/fe0074ac-0c56-4c93-917e-2fd2f31106c7-kube-api-access-qgqv4\") pod \"console-6d6768c7cf-kwpcz\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:28.245924 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.245896 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:28.394291 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.394266 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6d6768c7cf-kwpcz"] Jul 08 22:36:28.396941 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:36:28.396913 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfe0074ac_0c56_4c93_917e_2fd2f31106c7.slice/crio-4ca0caffd515ea7f46a802d6e7133f6b0081d2d21aefe5f16db89b5db711798d WatchSource:0}: Error finding container 4ca0caffd515ea7f46a802d6e7133f6b0081d2d21aefe5f16db89b5db711798d: Status 404 returned error can't find the container with id 4ca0caffd515ea7f46a802d6e7133f6b0081d2d21aefe5f16db89b5db711798d Jul 08 22:36:28.515339 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.515297 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6768c7cf-kwpcz" event={"ID":"fe0074ac-0c56-4c93-917e-2fd2f31106c7","Type":"ContainerStarted","Data":"5fa3cd9c8388462b191cf1cbff460915cf8d78a7731ce70cce1a8903c799cb4b"} Jul 08 22:36:28.515519 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.515359 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6768c7cf-kwpcz" event={"ID":"fe0074ac-0c56-4c93-917e-2fd2f31106c7","Type":"ContainerStarted","Data":"4ca0caffd515ea7f46a802d6e7133f6b0081d2d21aefe5f16db89b5db711798d"} Jul 08 22:36:28.533852 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:28.533804 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6d6768c7cf-kwpcz" podStartSLOduration=1.5337872099999998 podStartE2EDuration="1.53378721s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:36:27 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:36:28.531980278 +0000 UTC m=+398.870687263" watchObservedRunningTime="2026-07-08 22:36:28.53378721 +0000 UTC m=+398.872494183" Jul 08 22:36:38.246545 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:38.246466 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:38.247052 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:38.246596 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:38.252246 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:38.252223 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:38.560319 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:38.560240 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:36:38.607570 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:36:38.607512 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69c4657c76-dh9bd"] Jul 08 22:37:03.633146 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:03.633102 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-69c4657c76-dh9bd" podUID="e05b4378-d42f-47e1-9ed4-0a7864891abb" containerName="console" containerID="cri-o://ad94efed2987add2b8615688f050842f5f1f1b2b48f6d79139b8552806c429cf" gracePeriod=15 Jul 08 22:37:03.870439 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:03.870413 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:37:03.958819 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:03.958721 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-oauth-serving-cert\") pod \"e05b4378-d42f-47e1-9ed4-0a7864891abb\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " Jul 08 22:37:03.958819 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:03.958775 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e05b4378-d42f-47e1-9ed4-0a7864891abb-console-serving-cert\") pod \"e05b4378-d42f-47e1-9ed4-0a7864891abb\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " Jul 08 22:37:03.958819 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:03.958797 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-trusted-ca-bundle\") pod \"e05b4378-d42f-47e1-9ed4-0a7864891abb\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " Jul 08 22:37:03.959107 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:03.958910 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2zjhb\" (UniqueName: \"kubernetes.io/projected/e05b4378-d42f-47e1-9ed4-0a7864891abb-kube-api-access-2zjhb\") pod \"e05b4378-d42f-47e1-9ed4-0a7864891abb\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " Jul 08 22:37:03.959107 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:03.958957 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-service-ca\") pod \"e05b4378-d42f-47e1-9ed4-0a7864891abb\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " Jul 08 22:37:03.959107 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:03.959006 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e05b4378-d42f-47e1-9ed4-0a7864891abb-console-oauth-config\") pod \"e05b4378-d42f-47e1-9ed4-0a7864891abb\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " Jul 08 22:37:03.959107 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:03.959054 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-console-config\") pod \"e05b4378-d42f-47e1-9ed4-0a7864891abb\" (UID: \"e05b4378-d42f-47e1-9ed4-0a7864891abb\") " Jul 08 22:37:03.959289 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:03.959158 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e05b4378-d42f-47e1-9ed4-0a7864891abb" (UID: "e05b4378-d42f-47e1-9ed4-0a7864891abb"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:37:03.959341 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:03.959196 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e05b4378-d42f-47e1-9ed4-0a7864891abb" (UID: "e05b4378-d42f-47e1-9ed4-0a7864891abb"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:37:03.959341 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:03.959306 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-oauth-serving-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:37:03.959482 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:03.959385 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-service-ca" (OuterVolumeSpecName: "service-ca") pod "e05b4378-d42f-47e1-9ed4-0a7864891abb" (UID: "e05b4378-d42f-47e1-9ed4-0a7864891abb"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:37:03.959549 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:03.959518 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-console-config" (OuterVolumeSpecName: "console-config") pod "e05b4378-d42f-47e1-9ed4-0a7864891abb" (UID: "e05b4378-d42f-47e1-9ed4-0a7864891abb"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:37:03.961144 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:03.961119 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e05b4378-d42f-47e1-9ed4-0a7864891abb-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e05b4378-d42f-47e1-9ed4-0a7864891abb" (UID: "e05b4378-d42f-47e1-9ed4-0a7864891abb"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:37:03.961144 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:03.961126 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e05b4378-d42f-47e1-9ed4-0a7864891abb-kube-api-access-2zjhb" (OuterVolumeSpecName: "kube-api-access-2zjhb") pod "e05b4378-d42f-47e1-9ed4-0a7864891abb" (UID: "e05b4378-d42f-47e1-9ed4-0a7864891abb"). InnerVolumeSpecName "kube-api-access-2zjhb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:37:03.961282 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:03.961181 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e05b4378-d42f-47e1-9ed4-0a7864891abb-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e05b4378-d42f-47e1-9ed4-0a7864891abb" (UID: "e05b4378-d42f-47e1-9ed4-0a7864891abb"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:37:04.060111 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:04.060073 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2zjhb\" (UniqueName: \"kubernetes.io/projected/e05b4378-d42f-47e1-9ed4-0a7864891abb-kube-api-access-2zjhb\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:37:04.060111 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:04.060103 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-service-ca\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:37:04.060111 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:04.060112 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e05b4378-d42f-47e1-9ed4-0a7864891abb-console-oauth-config\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:37:04.060111 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:04.060121 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-console-config\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:37:04.060375 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:04.060131 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e05b4378-d42f-47e1-9ed4-0a7864891abb-console-serving-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:37:04.060375 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:04.060139 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e05b4378-d42f-47e1-9ed4-0a7864891abb-trusted-ca-bundle\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:37:04.665811 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:04.665778 2573 generic.go:356] "Generic (PLEG): container finished" podID="e05b4378-d42f-47e1-9ed4-0a7864891abb" containerID="ad94efed2987add2b8615688f050842f5f1f1b2b48f6d79139b8552806c429cf" exitCode=0 Jul 08 22:37:04.666202 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:04.665830 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-69c4657c76-dh9bd" Jul 08 22:37:04.666202 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:04.665830 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69c4657c76-dh9bd" event={"ID":"e05b4378-d42f-47e1-9ed4-0a7864891abb","Type":"ContainerDied","Data":"ad94efed2987add2b8615688f050842f5f1f1b2b48f6d79139b8552806c429cf"} Jul 08 22:37:04.666202 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:04.665951 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-69c4657c76-dh9bd" event={"ID":"e05b4378-d42f-47e1-9ed4-0a7864891abb","Type":"ContainerDied","Data":"632199b0c9212c1f300a2f09849c3f133bbd6a99da7d937cf858f4d3f74956c2"} Jul 08 22:37:04.666202 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:04.665985 2573 scope.go:117] "RemoveContainer" containerID="ad94efed2987add2b8615688f050842f5f1f1b2b48f6d79139b8552806c429cf" Jul 08 22:37:04.676258 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:04.676235 2573 scope.go:117] "RemoveContainer" containerID="ad94efed2987add2b8615688f050842f5f1f1b2b48f6d79139b8552806c429cf" Jul 08 22:37:04.676644 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:37:04.676619 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ad94efed2987add2b8615688f050842f5f1f1b2b48f6d79139b8552806c429cf\": container with ID starting with ad94efed2987add2b8615688f050842f5f1f1b2b48f6d79139b8552806c429cf not found: ID does not exist" containerID="ad94efed2987add2b8615688f050842f5f1f1b2b48f6d79139b8552806c429cf" Jul 08 22:37:04.676718 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:04.676651 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ad94efed2987add2b8615688f050842f5f1f1b2b48f6d79139b8552806c429cf"} err="failed to get container status \"ad94efed2987add2b8615688f050842f5f1f1b2b48f6d79139b8552806c429cf\": rpc error: code = NotFound desc = could not find container \"ad94efed2987add2b8615688f050842f5f1f1b2b48f6d79139b8552806c429cf\": container with ID starting with ad94efed2987add2b8615688f050842f5f1f1b2b48f6d79139b8552806c429cf not found: ID does not exist" Jul 08 22:37:04.682384 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:04.682360 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-69c4657c76-dh9bd"] Jul 08 22:37:04.686151 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:04.686129 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-69c4657c76-dh9bd"] Jul 08 22:37:06.180956 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:06.180920 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e05b4378-d42f-47e1-9ed4-0a7864891abb" path="/var/lib/kubelet/pods/e05b4378-d42f-47e1-9ed4-0a7864891abb/volumes" Jul 08 22:37:17.192225 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:17.192136 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k"] Jul 08 22:37:17.192821 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:17.192595 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e05b4378-d42f-47e1-9ed4-0a7864891abb" containerName="console" Jul 08 22:37:17.192821 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:17.192614 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="e05b4378-d42f-47e1-9ed4-0a7864891abb" containerName="console" Jul 08 22:37:17.192821 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:17.192720 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="e05b4378-d42f-47e1-9ed4-0a7864891abb" containerName="console" Jul 08 22:37:17.194806 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:17.194783 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k" Jul 08 22:37:17.197532 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:17.197506 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 22:37:17.198591 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:17.198575 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 22:37:17.198658 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:17.198577 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tl2r9\"" Jul 08 22:37:17.204451 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:17.204426 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k"] Jul 08 22:37:17.249136 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:17.249101 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-277jq\" (UniqueName: \"kubernetes.io/projected/6df15006-eba3-452a-914c-ca3fe069b4f6-kube-api-access-277jq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k\" (UID: \"6df15006-eba3-452a-914c-ca3fe069b4f6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k" Jul 08 22:37:17.249136 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:17.249137 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6df15006-eba3-452a-914c-ca3fe069b4f6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k\" (UID: \"6df15006-eba3-452a-914c-ca3fe069b4f6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k" Jul 08 22:37:17.249338 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:17.249198 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6df15006-eba3-452a-914c-ca3fe069b4f6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k\" (UID: \"6df15006-eba3-452a-914c-ca3fe069b4f6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k" Jul 08 22:37:17.349614 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:17.349576 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-277jq\" (UniqueName: \"kubernetes.io/projected/6df15006-eba3-452a-914c-ca3fe069b4f6-kube-api-access-277jq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k\" (UID: \"6df15006-eba3-452a-914c-ca3fe069b4f6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k" Jul 08 22:37:17.349614 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:17.349620 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6df15006-eba3-452a-914c-ca3fe069b4f6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k\" (UID: \"6df15006-eba3-452a-914c-ca3fe069b4f6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k" Jul 08 22:37:17.349821 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:17.349668 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6df15006-eba3-452a-914c-ca3fe069b4f6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k\" (UID: \"6df15006-eba3-452a-914c-ca3fe069b4f6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k" Jul 08 22:37:17.350023 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:17.350003 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6df15006-eba3-452a-914c-ca3fe069b4f6-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k\" (UID: \"6df15006-eba3-452a-914c-ca3fe069b4f6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k" Jul 08 22:37:17.350070 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:17.350028 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6df15006-eba3-452a-914c-ca3fe069b4f6-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k\" (UID: \"6df15006-eba3-452a-914c-ca3fe069b4f6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k" Jul 08 22:37:17.360447 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:17.360416 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-277jq\" (UniqueName: \"kubernetes.io/projected/6df15006-eba3-452a-914c-ca3fe069b4f6-kube-api-access-277jq\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k\" (UID: \"6df15006-eba3-452a-914c-ca3fe069b4f6\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k" Jul 08 22:37:17.504022 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:17.503987 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k" Jul 08 22:37:17.636362 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:17.636324 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k"] Jul 08 22:37:17.639622 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:37:17.639586 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6df15006_eba3_452a_914c_ca3fe069b4f6.slice/crio-64bff1615a31b8def1bd1e95e91dfd860f5f359c78d3874003e03f45d1aace6c WatchSource:0}: Error finding container 64bff1615a31b8def1bd1e95e91dfd860f5f359c78d3874003e03f45d1aace6c: Status 404 returned error can't find the container with id 64bff1615a31b8def1bd1e95e91dfd860f5f359c78d3874003e03f45d1aace6c Jul 08 22:37:17.722093 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:17.722055 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k" event={"ID":"6df15006-eba3-452a-914c-ca3fe069b4f6","Type":"ContainerStarted","Data":"64bff1615a31b8def1bd1e95e91dfd860f5f359c78d3874003e03f45d1aace6c"} Jul 08 22:37:23.748863 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:23.748826 2573 generic.go:356] "Generic (PLEG): container finished" podID="6df15006-eba3-452a-914c-ca3fe069b4f6" containerID="50fe753ff4c0a1c49ebb53268ec65d5d25efbfcf9f66def6486b8bfd6ff61951" exitCode=0 Jul 08 22:37:23.749248 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:23.748869 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k" event={"ID":"6df15006-eba3-452a-914c-ca3fe069b4f6","Type":"ContainerDied","Data":"50fe753ff4c0a1c49ebb53268ec65d5d25efbfcf9f66def6486b8bfd6ff61951"} Jul 08 22:37:26.765462 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:26.765422 2573 generic.go:356] "Generic (PLEG): container finished" podID="6df15006-eba3-452a-914c-ca3fe069b4f6" containerID="76becdbbb9bc9e87ee3fbefb766abf1917610539808194a3ed0bd2ddd883e3e3" exitCode=0 Jul 08 22:37:26.765854 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:26.765473 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k" event={"ID":"6df15006-eba3-452a-914c-ca3fe069b4f6","Type":"ContainerDied","Data":"76becdbbb9bc9e87ee3fbefb766abf1917610539808194a3ed0bd2ddd883e3e3"} Jul 08 22:37:34.802868 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:34.802774 2573 generic.go:356] "Generic (PLEG): container finished" podID="6df15006-eba3-452a-914c-ca3fe069b4f6" containerID="89f3c4f4ec55179e29e5e7386fd92964305a8950a8566b97446228033f186161" exitCode=0 Jul 08 22:37:34.802868 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:34.802823 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k" event={"ID":"6df15006-eba3-452a-914c-ca3fe069b4f6","Type":"ContainerDied","Data":"89f3c4f4ec55179e29e5e7386fd92964305a8950a8566b97446228033f186161"} Jul 08 22:37:35.933805 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:35.933782 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k" Jul 08 22:37:35.973386 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:35.973356 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6df15006-eba3-452a-914c-ca3fe069b4f6-util\") pod \"6df15006-eba3-452a-914c-ca3fe069b4f6\" (UID: \"6df15006-eba3-452a-914c-ca3fe069b4f6\") " Jul 08 22:37:35.973546 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:35.973412 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-277jq\" (UniqueName: \"kubernetes.io/projected/6df15006-eba3-452a-914c-ca3fe069b4f6-kube-api-access-277jq\") pod \"6df15006-eba3-452a-914c-ca3fe069b4f6\" (UID: \"6df15006-eba3-452a-914c-ca3fe069b4f6\") " Jul 08 22:37:35.973546 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:35.973495 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6df15006-eba3-452a-914c-ca3fe069b4f6-bundle\") pod \"6df15006-eba3-452a-914c-ca3fe069b4f6\" (UID: \"6df15006-eba3-452a-914c-ca3fe069b4f6\") " Jul 08 22:37:35.974126 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:35.974094 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6df15006-eba3-452a-914c-ca3fe069b4f6-bundle" (OuterVolumeSpecName: "bundle") pod "6df15006-eba3-452a-914c-ca3fe069b4f6" (UID: "6df15006-eba3-452a-914c-ca3fe069b4f6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:37:35.975724 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:35.975693 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6df15006-eba3-452a-914c-ca3fe069b4f6-kube-api-access-277jq" (OuterVolumeSpecName: "kube-api-access-277jq") pod "6df15006-eba3-452a-914c-ca3fe069b4f6" (UID: "6df15006-eba3-452a-914c-ca3fe069b4f6"). InnerVolumeSpecName "kube-api-access-277jq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:37:35.977489 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:35.977471 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6df15006-eba3-452a-914c-ca3fe069b4f6-util" (OuterVolumeSpecName: "util") pod "6df15006-eba3-452a-914c-ca3fe069b4f6" (UID: "6df15006-eba3-452a-914c-ca3fe069b4f6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:37:36.074704 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:36.074617 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6df15006-eba3-452a-914c-ca3fe069b4f6-bundle\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:37:36.074704 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:36.074646 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6df15006-eba3-452a-914c-ca3fe069b4f6-util\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:37:36.074704 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:36.074655 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-277jq\" (UniqueName: \"kubernetes.io/projected/6df15006-eba3-452a-914c-ca3fe069b4f6-kube-api-access-277jq\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:37:36.813398 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:36.813367 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k" Jul 08 22:37:36.813577 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:36.813365 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ph58k" event={"ID":"6df15006-eba3-452a-914c-ca3fe069b4f6","Type":"ContainerDied","Data":"64bff1615a31b8def1bd1e95e91dfd860f5f359c78d3874003e03f45d1aace6c"} Jul 08 22:37:36.813577 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:36.813484 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64bff1615a31b8def1bd1e95e91dfd860f5f359c78d3874003e03f45d1aace6c" Jul 08 22:37:40.518512 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:40.518482 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4jqpt"] Jul 08 22:37:40.518886 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:40.518779 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6df15006-eba3-452a-914c-ca3fe069b4f6" containerName="util" Jul 08 22:37:40.518886 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:40.518791 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6df15006-eba3-452a-914c-ca3fe069b4f6" containerName="util" Jul 08 22:37:40.518886 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:40.518798 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6df15006-eba3-452a-914c-ca3fe069b4f6" containerName="pull" Jul 08 22:37:40.518886 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:40.518803 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6df15006-eba3-452a-914c-ca3fe069b4f6" containerName="pull" Jul 08 22:37:40.518886 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:40.518813 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6df15006-eba3-452a-914c-ca3fe069b4f6" containerName="extract" Jul 08 22:37:40.518886 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:40.518819 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6df15006-eba3-452a-914c-ca3fe069b4f6" containerName="extract" Jul 08 22:37:40.518886 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:40.518878 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6df15006-eba3-452a-914c-ca3fe069b4f6" containerName="extract" Jul 08 22:37:40.562688 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:40.562644 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4jqpt"] Jul 08 22:37:40.562848 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:40.562751 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4jqpt" Jul 08 22:37:40.565883 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:40.565853 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 08 22:37:40.566024 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:40.565943 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 08 22:37:40.566024 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:40.565995 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-ml62t\"" Jul 08 22:37:40.608679 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:40.608645 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-76tmt\" (UniqueName: \"kubernetes.io/projected/5e0cc88e-59e1-4dbe-be16-95919fa336f1-kube-api-access-76tmt\") pod \"cert-manager-operator-controller-manager-55c444bf86-4jqpt\" (UID: \"5e0cc88e-59e1-4dbe-be16-95919fa336f1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4jqpt" Jul 08 22:37:40.608813 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:40.608682 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e0cc88e-59e1-4dbe-be16-95919fa336f1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4jqpt\" (UID: \"5e0cc88e-59e1-4dbe-be16-95919fa336f1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4jqpt" Jul 08 22:37:40.709418 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:40.709378 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-76tmt\" (UniqueName: \"kubernetes.io/projected/5e0cc88e-59e1-4dbe-be16-95919fa336f1-kube-api-access-76tmt\") pod \"cert-manager-operator-controller-manager-55c444bf86-4jqpt\" (UID: \"5e0cc88e-59e1-4dbe-be16-95919fa336f1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4jqpt" Jul 08 22:37:40.709418 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:40.709422 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e0cc88e-59e1-4dbe-be16-95919fa336f1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4jqpt\" (UID: \"5e0cc88e-59e1-4dbe-be16-95919fa336f1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4jqpt" Jul 08 22:37:40.709868 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:40.709847 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/5e0cc88e-59e1-4dbe-be16-95919fa336f1-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-4jqpt\" (UID: \"5e0cc88e-59e1-4dbe-be16-95919fa336f1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4jqpt" Jul 08 22:37:40.722059 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:40.722034 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-76tmt\" (UniqueName: \"kubernetes.io/projected/5e0cc88e-59e1-4dbe-be16-95919fa336f1-kube-api-access-76tmt\") pod \"cert-manager-operator-controller-manager-55c444bf86-4jqpt\" (UID: \"5e0cc88e-59e1-4dbe-be16-95919fa336f1\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4jqpt" Jul 08 22:37:40.872351 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:40.872271 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4jqpt" Jul 08 22:37:41.024891 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:41.024824 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4jqpt"] Jul 08 22:37:41.028511 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:37:41.028485 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e0cc88e_59e1_4dbe_be16_95919fa336f1.slice/crio-d05512531c04bb4480d52404bd4b3e9054317374d08c9fbf456535e110478d24 WatchSource:0}: Error finding container d05512531c04bb4480d52404bd4b3e9054317374d08c9fbf456535e110478d24: Status 404 returned error can't find the container with id d05512531c04bb4480d52404bd4b3e9054317374d08c9fbf456535e110478d24 Jul 08 22:37:41.835184 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:41.835139 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4jqpt" event={"ID":"5e0cc88e-59e1-4dbe-be16-95919fa336f1","Type":"ContainerStarted","Data":"d05512531c04bb4480d52404bd4b3e9054317374d08c9fbf456535e110478d24"} Jul 08 22:37:43.846339 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:43.846294 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4jqpt" event={"ID":"5e0cc88e-59e1-4dbe-be16-95919fa336f1","Type":"ContainerStarted","Data":"d3a3235b6e51a23835a267f5529a08ee02bd3dd45cf55c958af399d1946fc70c"} Jul 08 22:37:43.869991 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:43.869941 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-4jqpt" podStartSLOduration=1.9647632019999999 podStartE2EDuration="3.86992768s" totalImagesPullingTime="1.905164478s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:37:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:37:43.868124766 +0000 UTC m=+474.206831738" watchObservedRunningTime="2026-07-08 22:37:43.86992768 +0000 UTC m=+474.208634653" Jul 08 22:37:44.737398 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:44.737365 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2"] Jul 08 22:37:44.760086 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:44.760055 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2"] Jul 08 22:37:44.760257 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:44.760207 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2" Jul 08 22:37:44.763084 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:44.763065 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 22:37:44.763238 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:44.763110 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 22:37:44.763983 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:44.763962 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tl2r9\"" Jul 08 22:37:44.837761 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:44.837728 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a420036-bf67-47c9-b425-fd984c576a82-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2\" (UID: \"0a420036-bf67-47c9-b425-fd984c576a82\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2" Jul 08 22:37:44.837761 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:44.837768 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kkfpq\" (UniqueName: \"kubernetes.io/projected/0a420036-bf67-47c9-b425-fd984c576a82-kube-api-access-kkfpq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2\" (UID: \"0a420036-bf67-47c9-b425-fd984c576a82\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2" Jul 08 22:37:44.837989 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:44.837801 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a420036-bf67-47c9-b425-fd984c576a82-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2\" (UID: \"0a420036-bf67-47c9-b425-fd984c576a82\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2" Jul 08 22:37:44.938371 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:44.938335 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a420036-bf67-47c9-b425-fd984c576a82-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2\" (UID: \"0a420036-bf67-47c9-b425-fd984c576a82\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2" Jul 08 22:37:44.938799 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:44.938378 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kkfpq\" (UniqueName: \"kubernetes.io/projected/0a420036-bf67-47c9-b425-fd984c576a82-kube-api-access-kkfpq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2\" (UID: \"0a420036-bf67-47c9-b425-fd984c576a82\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2" Jul 08 22:37:44.938799 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:44.938408 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a420036-bf67-47c9-b425-fd984c576a82-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2\" (UID: \"0a420036-bf67-47c9-b425-fd984c576a82\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2" Jul 08 22:37:44.938873 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:44.938826 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a420036-bf67-47c9-b425-fd984c576a82-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2\" (UID: \"0a420036-bf67-47c9-b425-fd984c576a82\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2" Jul 08 22:37:44.938873 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:44.938835 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a420036-bf67-47c9-b425-fd984c576a82-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2\" (UID: \"0a420036-bf67-47c9-b425-fd984c576a82\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2" Jul 08 22:37:44.949267 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:44.949235 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-kkfpq\" (UniqueName: \"kubernetes.io/projected/0a420036-bf67-47c9-b425-fd984c576a82-kube-api-access-kkfpq\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2\" (UID: \"0a420036-bf67-47c9-b425-fd984c576a82\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2" Jul 08 22:37:45.070194 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:45.070111 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2" Jul 08 22:37:45.224117 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:45.224093 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2"] Jul 08 22:37:45.226759 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:37:45.226732 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a420036_bf67_47c9_b425_fd984c576a82.slice/crio-214bb3030e45777f496161a1e54525534ef83a13b90a75de66d5c9b52748b0d1 WatchSource:0}: Error finding container 214bb3030e45777f496161a1e54525534ef83a13b90a75de66d5c9b52748b0d1: Status 404 returned error can't find the container with id 214bb3030e45777f496161a1e54525534ef83a13b90a75de66d5c9b52748b0d1 Jul 08 22:37:45.856410 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:45.856373 2573 generic.go:356] "Generic (PLEG): container finished" podID="0a420036-bf67-47c9-b425-fd984c576a82" containerID="284d4a0212446c84042e4711f2ebf4d74768f0e31b7a8e7276a8a98c97fe58a5" exitCode=0 Jul 08 22:37:45.856593 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:45.856439 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2" event={"ID":"0a420036-bf67-47c9-b425-fd984c576a82","Type":"ContainerDied","Data":"284d4a0212446c84042e4711f2ebf4d74768f0e31b7a8e7276a8a98c97fe58a5"} Jul 08 22:37:45.856593 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:45.856473 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2" event={"ID":"0a420036-bf67-47c9-b425-fd984c576a82","Type":"ContainerStarted","Data":"214bb3030e45777f496161a1e54525534ef83a13b90a75de66d5c9b52748b0d1"} Jul 08 22:37:46.869973 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:46.869891 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pgds6"] Jul 08 22:37:46.871948 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:46.871931 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pgds6" Jul 08 22:37:46.874265 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:46.874242 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 08 22:37:46.874387 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:46.874334 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 08 22:37:46.874458 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:46.874442 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-z765f\"" Jul 08 22:37:46.880820 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:46.880800 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pgds6"] Jul 08 22:37:46.954599 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:46.954531 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4w2w\" (UniqueName: \"kubernetes.io/projected/cc8b351b-424b-4620-83ac-ad6aef2b84ac-kube-api-access-d4w2w\") pod \"cert-manager-cainjector-559cdd8c87-pgds6\" (UID: \"cc8b351b-424b-4620-83ac-ad6aef2b84ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pgds6" Jul 08 22:37:46.954805 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:46.954668 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc8b351b-424b-4620-83ac-ad6aef2b84ac-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pgds6\" (UID: \"cc8b351b-424b-4620-83ac-ad6aef2b84ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pgds6" Jul 08 22:37:47.055786 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:47.055745 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4w2w\" (UniqueName: \"kubernetes.io/projected/cc8b351b-424b-4620-83ac-ad6aef2b84ac-kube-api-access-d4w2w\") pod \"cert-manager-cainjector-559cdd8c87-pgds6\" (UID: \"cc8b351b-424b-4620-83ac-ad6aef2b84ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pgds6" Jul 08 22:37:47.055963 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:47.055801 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc8b351b-424b-4620-83ac-ad6aef2b84ac-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pgds6\" (UID: \"cc8b351b-424b-4620-83ac-ad6aef2b84ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pgds6" Jul 08 22:37:47.065475 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:47.065442 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4w2w\" (UniqueName: \"kubernetes.io/projected/cc8b351b-424b-4620-83ac-ad6aef2b84ac-kube-api-access-d4w2w\") pod \"cert-manager-cainjector-559cdd8c87-pgds6\" (UID: \"cc8b351b-424b-4620-83ac-ad6aef2b84ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pgds6" Jul 08 22:37:47.065654 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:47.065442 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/cc8b351b-424b-4620-83ac-ad6aef2b84ac-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-pgds6\" (UID: \"cc8b351b-424b-4620-83ac-ad6aef2b84ac\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-pgds6" Jul 08 22:37:47.194190 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:47.194108 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pgds6" Jul 08 22:37:47.325966 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:47.325939 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-pgds6"] Jul 08 22:37:47.328195 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:37:47.328164 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podcc8b351b_424b_4620_83ac_ad6aef2b84ac.slice/crio-9824898d7117804732460acdb6e4c1c45be486f4797e8cba4da980f7c5b6fc01 WatchSource:0}: Error finding container 9824898d7117804732460acdb6e4c1c45be486f4797e8cba4da980f7c5b6fc01: Status 404 returned error can't find the container with id 9824898d7117804732460acdb6e4c1c45be486f4797e8cba4da980f7c5b6fc01 Jul 08 22:37:47.868800 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:47.868752 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pgds6" event={"ID":"cc8b351b-424b-4620-83ac-ad6aef2b84ac","Type":"ContainerStarted","Data":"9824898d7117804732460acdb6e4c1c45be486f4797e8cba4da980f7c5b6fc01"} Jul 08 22:37:49.882656 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:49.882608 2573 generic.go:356] "Generic (PLEG): container finished" podID="0a420036-bf67-47c9-b425-fd984c576a82" containerID="9040e4026a848ad6e1f6188ba2df670deefebfbe08e78e66bccd11718955578f" exitCode=0 Jul 08 22:37:49.883139 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:49.882692 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2" event={"ID":"0a420036-bf67-47c9-b425-fd984c576a82","Type":"ContainerDied","Data":"9040e4026a848ad6e1f6188ba2df670deefebfbe08e78e66bccd11718955578f"} Jul 08 22:37:50.590817 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:50.590775 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6jqzr"] Jul 08 22:37:50.594366 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:50.594338 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-6jqzr" Jul 08 22:37:50.596883 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:50.596862 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-4qpvj\"" Jul 08 22:37:50.601108 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:50.601082 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6jqzr"] Jul 08 22:37:50.688089 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:50.688049 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jj5ps\" (UniqueName: \"kubernetes.io/projected/8d8897ee-e67b-4ecf-8e9f-fa816b1da166-kube-api-access-jj5ps\") pod \"cert-manager-webhook-6486ffd997-6jqzr\" (UID: \"8d8897ee-e67b-4ecf-8e9f-fa816b1da166\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6jqzr" Jul 08 22:37:50.688291 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:50.688156 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d8897ee-e67b-4ecf-8e9f-fa816b1da166-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6jqzr\" (UID: \"8d8897ee-e67b-4ecf-8e9f-fa816b1da166\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6jqzr" Jul 08 22:37:50.789466 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:50.789423 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d8897ee-e67b-4ecf-8e9f-fa816b1da166-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6jqzr\" (UID: \"8d8897ee-e67b-4ecf-8e9f-fa816b1da166\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6jqzr" Jul 08 22:37:50.789715 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:50.789491 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jj5ps\" (UniqueName: \"kubernetes.io/projected/8d8897ee-e67b-4ecf-8e9f-fa816b1da166-kube-api-access-jj5ps\") pod \"cert-manager-webhook-6486ffd997-6jqzr\" (UID: \"8d8897ee-e67b-4ecf-8e9f-fa816b1da166\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6jqzr" Jul 08 22:37:50.798250 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:50.798216 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/8d8897ee-e67b-4ecf-8e9f-fa816b1da166-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-6jqzr\" (UID: \"8d8897ee-e67b-4ecf-8e9f-fa816b1da166\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6jqzr" Jul 08 22:37:50.798359 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:50.798270 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-jj5ps\" (UniqueName: \"kubernetes.io/projected/8d8897ee-e67b-4ecf-8e9f-fa816b1da166-kube-api-access-jj5ps\") pod \"cert-manager-webhook-6486ffd997-6jqzr\" (UID: \"8d8897ee-e67b-4ecf-8e9f-fa816b1da166\") " pod="cert-manager/cert-manager-webhook-6486ffd997-6jqzr" Jul 08 22:37:50.890201 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:50.890121 2573 generic.go:356] "Generic (PLEG): container finished" podID="0a420036-bf67-47c9-b425-fd984c576a82" containerID="f7a547692795703cd35fa36670385018f95d7d7fb95c7d39adae214c62eb22e4" exitCode=0 Jul 08 22:37:50.890621 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:50.890206 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2" event={"ID":"0a420036-bf67-47c9-b425-fd984c576a82","Type":"ContainerDied","Data":"f7a547692795703cd35fa36670385018f95d7d7fb95c7d39adae214c62eb22e4"} Jul 08 22:37:50.891957 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:50.891933 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pgds6" event={"ID":"cc8b351b-424b-4620-83ac-ad6aef2b84ac","Type":"ContainerStarted","Data":"e65ff3ed489cbe221683c4c2fc5ededabeed48239529f5facd7eb10474ba83df"} Jul 08 22:37:50.904271 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:50.904248 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-6jqzr" Jul 08 22:37:50.922394 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:50.922353 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-pgds6" podStartSLOduration=2.109073859 podStartE2EDuration="4.922337528s" totalImagesPullingTime="2.813263669s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:37:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:37:50.921006475 +0000 UTC m=+481.259713484" watchObservedRunningTime="2026-07-08 22:37:50.922337528 +0000 UTC m=+481.261044500" Jul 08 22:37:51.043904 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:51.043869 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-6jqzr"] Jul 08 22:37:51.046931 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:37:51.046908 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod8d8897ee_e67b_4ecf_8e9f_fa816b1da166.slice/crio-fad7084e0d845fd09f9b1e62219fd1aacfb722829731fdc76940cacde7bd84d6 WatchSource:0}: Error finding container fad7084e0d845fd09f9b1e62219fd1aacfb722829731fdc76940cacde7bd84d6: Status 404 returned error can't find the container with id fad7084e0d845fd09f9b1e62219fd1aacfb722829731fdc76940cacde7bd84d6 Jul 08 22:37:51.897477 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:51.897437 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-6jqzr" event={"ID":"8d8897ee-e67b-4ecf-8e9f-fa816b1da166","Type":"ContainerStarted","Data":"1b8b226fd4abddfb149c6f27910b6ef9d37dbf2681752481f632fff6cb026559"} Jul 08 22:37:51.897894 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:51.897486 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-6jqzr" event={"ID":"8d8897ee-e67b-4ecf-8e9f-fa816b1da166","Type":"ContainerStarted","Data":"fad7084e0d845fd09f9b1e62219fd1aacfb722829731fdc76940cacde7bd84d6"} Jul 08 22:37:51.916177 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:51.916129 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-6jqzr" podStartSLOduration=1.9161132090000002 podStartE2EDuration="1.916113209s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:37:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:37:51.914465977 +0000 UTC m=+482.253172950" watchObservedRunningTime="2026-07-08 22:37:51.916113209 +0000 UTC m=+482.254820182" Jul 08 22:37:52.029619 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:52.029595 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2" Jul 08 22:37:52.101803 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:52.101776 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kkfpq\" (UniqueName: \"kubernetes.io/projected/0a420036-bf67-47c9-b425-fd984c576a82-kube-api-access-kkfpq\") pod \"0a420036-bf67-47c9-b425-fd984c576a82\" (UID: \"0a420036-bf67-47c9-b425-fd984c576a82\") " Jul 08 22:37:52.101964 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:52.101829 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a420036-bf67-47c9-b425-fd984c576a82-bundle\") pod \"0a420036-bf67-47c9-b425-fd984c576a82\" (UID: \"0a420036-bf67-47c9-b425-fd984c576a82\") " Jul 08 22:37:52.101964 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:52.101863 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a420036-bf67-47c9-b425-fd984c576a82-util\") pod \"0a420036-bf67-47c9-b425-fd984c576a82\" (UID: \"0a420036-bf67-47c9-b425-fd984c576a82\") " Jul 08 22:37:52.102252 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:52.102228 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a420036-bf67-47c9-b425-fd984c576a82-bundle" (OuterVolumeSpecName: "bundle") pod "0a420036-bf67-47c9-b425-fd984c576a82" (UID: "0a420036-bf67-47c9-b425-fd984c576a82"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:37:52.104064 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:52.104031 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0a420036-bf67-47c9-b425-fd984c576a82-kube-api-access-kkfpq" (OuterVolumeSpecName: "kube-api-access-kkfpq") pod "0a420036-bf67-47c9-b425-fd984c576a82" (UID: "0a420036-bf67-47c9-b425-fd984c576a82"). InnerVolumeSpecName "kube-api-access-kkfpq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:37:52.106496 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:52.106466 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0a420036-bf67-47c9-b425-fd984c576a82-util" (OuterVolumeSpecName: "util") pod "0a420036-bf67-47c9-b425-fd984c576a82" (UID: "0a420036-bf67-47c9-b425-fd984c576a82"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:37:52.203062 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:52.203037 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kkfpq\" (UniqueName: \"kubernetes.io/projected/0a420036-bf67-47c9-b425-fd984c576a82-kube-api-access-kkfpq\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:37:52.203062 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:52.203060 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0a420036-bf67-47c9-b425-fd984c576a82-bundle\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:37:52.203221 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:52.203069 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0a420036-bf67-47c9-b425-fd984c576a82-util\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:37:52.903632 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:52.903590 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2" event={"ID":"0a420036-bf67-47c9-b425-fd984c576a82","Type":"ContainerDied","Data":"214bb3030e45777f496161a1e54525534ef83a13b90a75de66d5c9b52748b0d1"} Jul 08 22:37:52.904018 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:52.903674 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="214bb3030e45777f496161a1e54525534ef83a13b90a75de66d5c9b52748b0d1" Jul 08 22:37:52.904018 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:52.903604 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fnfvs2" Jul 08 22:37:52.904018 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:52.903914 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-6jqzr" Jul 08 22:37:57.922394 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:57.922355 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xrv46"] Jul 08 22:37:57.922834 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:57.922676 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a420036-bf67-47c9-b425-fd984c576a82" containerName="util" Jul 08 22:37:57.922834 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:57.922689 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a420036-bf67-47c9-b425-fd984c576a82" containerName="util" Jul 08 22:37:57.922834 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:57.922704 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a420036-bf67-47c9-b425-fd984c576a82" containerName="pull" Jul 08 22:37:57.922834 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:57.922710 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a420036-bf67-47c9-b425-fd984c576a82" containerName="pull" Jul 08 22:37:57.922834 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:57.922716 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0a420036-bf67-47c9-b425-fd984c576a82" containerName="extract" Jul 08 22:37:57.922834 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:57.922722 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0a420036-bf67-47c9-b425-fd984c576a82" containerName="extract" Jul 08 22:37:57.922834 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:57.922779 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0a420036-bf67-47c9-b425-fd984c576a82" containerName="extract" Jul 08 22:37:57.924697 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:57.924682 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xrv46" Jul 08 22:37:57.927337 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:57.927317 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 08 22:37:57.928341 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:57.928315 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-s74np\"" Jul 08 22:37:57.928486 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:57.928319 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 08 22:37:57.933609 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:57.933587 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xrv46"] Jul 08 22:37:57.946372 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:57.946352 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c4njf\" (UniqueName: \"kubernetes.io/projected/e3e3bb21-646b-4cab-8051-95380702b6fe-kube-api-access-c4njf\") pod \"openshift-lws-operator-fd8ccff4c-xrv46\" (UID: \"e3e3bb21-646b-4cab-8051-95380702b6fe\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xrv46" Jul 08 22:37:57.946468 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:57.946447 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3e3bb21-646b-4cab-8051-95380702b6fe-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xrv46\" (UID: \"e3e3bb21-646b-4cab-8051-95380702b6fe\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xrv46" Jul 08 22:37:58.046946 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:58.046912 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3e3bb21-646b-4cab-8051-95380702b6fe-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xrv46\" (UID: \"e3e3bb21-646b-4cab-8051-95380702b6fe\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xrv46" Jul 08 22:37:58.047126 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:58.046958 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c4njf\" (UniqueName: \"kubernetes.io/projected/e3e3bb21-646b-4cab-8051-95380702b6fe-kube-api-access-c4njf\") pod \"openshift-lws-operator-fd8ccff4c-xrv46\" (UID: \"e3e3bb21-646b-4cab-8051-95380702b6fe\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xrv46" Jul 08 22:37:58.047313 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:58.047293 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/e3e3bb21-646b-4cab-8051-95380702b6fe-tmp\") pod \"openshift-lws-operator-fd8ccff4c-xrv46\" (UID: \"e3e3bb21-646b-4cab-8051-95380702b6fe\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xrv46" Jul 08 22:37:58.059842 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:58.059810 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c4njf\" (UniqueName: \"kubernetes.io/projected/e3e3bb21-646b-4cab-8051-95380702b6fe-kube-api-access-c4njf\") pod \"openshift-lws-operator-fd8ccff4c-xrv46\" (UID: \"e3e3bb21-646b-4cab-8051-95380702b6fe\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xrv46" Jul 08 22:37:58.235219 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:58.235186 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xrv46" Jul 08 22:37:58.382479 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:58.382449 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xrv46"] Jul 08 22:37:58.384479 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:37:58.384453 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode3e3bb21_646b_4cab_8051_95380702b6fe.slice/crio-4d3b43b09b2ec82822ca839edc669e7925f583f8712718c6b040d0520c0f5f18 WatchSource:0}: Error finding container 4d3b43b09b2ec82822ca839edc669e7925f583f8712718c6b040d0520c0f5f18: Status 404 returned error can't find the container with id 4d3b43b09b2ec82822ca839edc669e7925f583f8712718c6b040d0520c0f5f18 Jul 08 22:37:58.910393 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:58.910357 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-6jqzr" Jul 08 22:37:58.935542 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:58.935506 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xrv46" event={"ID":"e3e3bb21-646b-4cab-8051-95380702b6fe","Type":"ContainerStarted","Data":"4d3b43b09b2ec82822ca839edc669e7925f583f8712718c6b040d0520c0f5f18"} Jul 08 22:37:59.942044 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:37:59.942009 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xrv46" event={"ID":"e3e3bb21-646b-4cab-8051-95380702b6fe","Type":"ContainerStarted","Data":"21a7d98b6238cbdde0c0bc06360a1a0d03c26ef86154d7c72f9ee4ac0c38b483"} Jul 08 22:38:02.383119 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:02.383059 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-xrv46" podStartSLOduration=4.049316744 podStartE2EDuration="5.383043069s" totalImagesPullingTime="1.333726325s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:37:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:37:59.970740379 +0000 UTC m=+490.309447351" watchObservedRunningTime="2026-07-08 22:38:02.383043069 +0000 UTC m=+492.721750042" Jul 08 22:38:02.383518 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:02.383226 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8"] Jul 08 22:38:02.385371 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:02.385355 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8" Jul 08 22:38:02.387808 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:02.387785 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 08 22:38:02.388838 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:02.388821 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-tl2r9\"" Jul 08 22:38:02.388956 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:02.388853 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 08 22:38:02.394852 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:02.394818 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8"] Jul 08 22:38:02.485681 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:02.485637 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b45b6aa2-6416-4437-b693-dfd63a3cf93d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8\" (UID: \"b45b6aa2-6416-4437-b693-dfd63a3cf93d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8" Jul 08 22:38:02.485681 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:02.485686 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b45b6aa2-6416-4437-b693-dfd63a3cf93d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8\" (UID: \"b45b6aa2-6416-4437-b693-dfd63a3cf93d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8" Jul 08 22:38:02.485921 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:02.485798 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hxfdm\" (UniqueName: \"kubernetes.io/projected/b45b6aa2-6416-4437-b693-dfd63a3cf93d-kube-api-access-hxfdm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8\" (UID: \"b45b6aa2-6416-4437-b693-dfd63a3cf93d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8" Jul 08 22:38:02.587023 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:02.586984 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b45b6aa2-6416-4437-b693-dfd63a3cf93d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8\" (UID: \"b45b6aa2-6416-4437-b693-dfd63a3cf93d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8" Jul 08 22:38:02.587023 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:02.587025 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b45b6aa2-6416-4437-b693-dfd63a3cf93d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8\" (UID: \"b45b6aa2-6416-4437-b693-dfd63a3cf93d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8" Jul 08 22:38:02.587286 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:02.587086 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hxfdm\" (UniqueName: \"kubernetes.io/projected/b45b6aa2-6416-4437-b693-dfd63a3cf93d-kube-api-access-hxfdm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8\" (UID: \"b45b6aa2-6416-4437-b693-dfd63a3cf93d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8" Jul 08 22:38:02.587452 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:02.587428 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b45b6aa2-6416-4437-b693-dfd63a3cf93d-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8\" (UID: \"b45b6aa2-6416-4437-b693-dfd63a3cf93d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8" Jul 08 22:38:02.587512 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:02.587449 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b45b6aa2-6416-4437-b693-dfd63a3cf93d-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8\" (UID: \"b45b6aa2-6416-4437-b693-dfd63a3cf93d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8" Jul 08 22:38:02.595603 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:02.595549 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-hxfdm\" (UniqueName: \"kubernetes.io/projected/b45b6aa2-6416-4437-b693-dfd63a3cf93d-kube-api-access-hxfdm\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8\" (UID: \"b45b6aa2-6416-4437-b693-dfd63a3cf93d\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8" Jul 08 22:38:02.702129 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:02.702039 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8" Jul 08 22:38:02.842082 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:02.842049 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8"] Jul 08 22:38:02.845036 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:38:02.845003 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb45b6aa2_6416_4437_b693_dfd63a3cf93d.slice/crio-3a7eb5d58189b53baa6e64f3b6ebd2775135aba36a63b1566b6c3bab9b758b03 WatchSource:0}: Error finding container 3a7eb5d58189b53baa6e64f3b6ebd2775135aba36a63b1566b6c3bab9b758b03: Status 404 returned error can't find the container with id 3a7eb5d58189b53baa6e64f3b6ebd2775135aba36a63b1566b6c3bab9b758b03 Jul 08 22:38:02.958827 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:02.958787 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8" event={"ID":"b45b6aa2-6416-4437-b693-dfd63a3cf93d","Type":"ContainerStarted","Data":"bfbfa728996eab9aeea6978598d904c3f42224214c96dfe2f317c9f7117e245a"} Jul 08 22:38:02.958950 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:02.958856 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8" event={"ID":"b45b6aa2-6416-4437-b693-dfd63a3cf93d","Type":"ContainerStarted","Data":"3a7eb5d58189b53baa6e64f3b6ebd2775135aba36a63b1566b6c3bab9b758b03"} Jul 08 22:38:03.964826 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:03.964733 2573 generic.go:356] "Generic (PLEG): container finished" podID="b45b6aa2-6416-4437-b693-dfd63a3cf93d" containerID="bfbfa728996eab9aeea6978598d904c3f42224214c96dfe2f317c9f7117e245a" exitCode=0 Jul 08 22:38:03.965204 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:03.964824 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8" event={"ID":"b45b6aa2-6416-4437-b693-dfd63a3cf93d","Type":"ContainerDied","Data":"bfbfa728996eab9aeea6978598d904c3f42224214c96dfe2f317c9f7117e245a"} Jul 08 22:38:04.374371 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:04.374338 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lsmd8"] Jul 08 22:38:04.376402 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:04.376384 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-lsmd8" Jul 08 22:38:04.379690 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:04.379667 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-htpg4\"" Jul 08 22:38:04.390093 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:04.390074 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lsmd8"] Jul 08 22:38:04.502907 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:04.502878 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tpk8x\" (UniqueName: \"kubernetes.io/projected/893f363d-bb81-4ded-bbaa-ffa5a0f93f55-kube-api-access-tpk8x\") pod \"cert-manager-55b4d954d5-lsmd8\" (UID: \"893f363d-bb81-4ded-bbaa-ffa5a0f93f55\") " pod="cert-manager/cert-manager-55b4d954d5-lsmd8" Jul 08 22:38:04.503094 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:04.502931 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/893f363d-bb81-4ded-bbaa-ffa5a0f93f55-bound-sa-token\") pod \"cert-manager-55b4d954d5-lsmd8\" (UID: \"893f363d-bb81-4ded-bbaa-ffa5a0f93f55\") " pod="cert-manager/cert-manager-55b4d954d5-lsmd8" Jul 08 22:38:04.603432 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:04.603397 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/893f363d-bb81-4ded-bbaa-ffa5a0f93f55-bound-sa-token\") pod \"cert-manager-55b4d954d5-lsmd8\" (UID: \"893f363d-bb81-4ded-bbaa-ffa5a0f93f55\") " pod="cert-manager/cert-manager-55b4d954d5-lsmd8" Jul 08 22:38:04.603597 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:04.603515 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tpk8x\" (UniqueName: \"kubernetes.io/projected/893f363d-bb81-4ded-bbaa-ffa5a0f93f55-kube-api-access-tpk8x\") pod \"cert-manager-55b4d954d5-lsmd8\" (UID: \"893f363d-bb81-4ded-bbaa-ffa5a0f93f55\") " pod="cert-manager/cert-manager-55b4d954d5-lsmd8" Jul 08 22:38:04.613024 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:04.613004 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/893f363d-bb81-4ded-bbaa-ffa5a0f93f55-bound-sa-token\") pod \"cert-manager-55b4d954d5-lsmd8\" (UID: \"893f363d-bb81-4ded-bbaa-ffa5a0f93f55\") " pod="cert-manager/cert-manager-55b4d954d5-lsmd8" Jul 08 22:38:04.613201 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:04.613179 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tpk8x\" (UniqueName: \"kubernetes.io/projected/893f363d-bb81-4ded-bbaa-ffa5a0f93f55-kube-api-access-tpk8x\") pod \"cert-manager-55b4d954d5-lsmd8\" (UID: \"893f363d-bb81-4ded-bbaa-ffa5a0f93f55\") " pod="cert-manager/cert-manager-55b4d954d5-lsmd8" Jul 08 22:38:04.685066 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:04.685032 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-lsmd8" Jul 08 22:38:04.817087 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:04.817060 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-lsmd8"] Jul 08 22:38:04.820423 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:38:04.820394 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod893f363d_bb81_4ded_bbaa_ffa5a0f93f55.slice/crio-58b3b6db3319ba018ff5482a3535cc33101a3942fee217aa0fd5bbf9090bceb1 WatchSource:0}: Error finding container 58b3b6db3319ba018ff5482a3535cc33101a3942fee217aa0fd5bbf9090bceb1: Status 404 returned error can't find the container with id 58b3b6db3319ba018ff5482a3535cc33101a3942fee217aa0fd5bbf9090bceb1 Jul 08 22:38:04.971009 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:04.970978 2573 generic.go:356] "Generic (PLEG): container finished" podID="b45b6aa2-6416-4437-b693-dfd63a3cf93d" containerID="c1ed1a4b611a02e612b62b83ee52fc39c6449b8c839bd614f5924282405ae330" exitCode=0 Jul 08 22:38:04.971446 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:04.971025 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8" event={"ID":"b45b6aa2-6416-4437-b693-dfd63a3cf93d","Type":"ContainerDied","Data":"c1ed1a4b611a02e612b62b83ee52fc39c6449b8c839bd614f5924282405ae330"} Jul 08 22:38:04.972752 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:04.972730 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-lsmd8" event={"ID":"893f363d-bb81-4ded-bbaa-ffa5a0f93f55","Type":"ContainerStarted","Data":"05f404c1c5a4120d4799b083881dab6dc72a86f45e3cfdad7ce2a8de0e107401"} Jul 08 22:38:04.972847 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:04.972766 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-lsmd8" event={"ID":"893f363d-bb81-4ded-bbaa-ffa5a0f93f55","Type":"ContainerStarted","Data":"58b3b6db3319ba018ff5482a3535cc33101a3942fee217aa0fd5bbf9090bceb1"} Jul 08 22:38:05.011225 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:05.011181 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-lsmd8" podStartSLOduration=1.011161212 podStartE2EDuration="1.011161212s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:38:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:38:05.010965494 +0000 UTC m=+495.349672485" watchObservedRunningTime="2026-07-08 22:38:05.011161212 +0000 UTC m=+495.349868187" Jul 08 22:38:05.979275 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:05.979243 2573 generic.go:356] "Generic (PLEG): container finished" podID="b45b6aa2-6416-4437-b693-dfd63a3cf93d" containerID="1fbf055bbcd9137373f9192d4b69aaac4caab4d9461918bd368c7bb78e54a93a" exitCode=0 Jul 08 22:38:05.979661 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:05.979328 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8" event={"ID":"b45b6aa2-6416-4437-b693-dfd63a3cf93d","Type":"ContainerDied","Data":"1fbf055bbcd9137373f9192d4b69aaac4caab4d9461918bd368c7bb78e54a93a"} Jul 08 22:38:07.109242 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:07.109217 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8" Jul 08 22:38:07.226198 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:07.226164 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-hxfdm\" (UniqueName: \"kubernetes.io/projected/b45b6aa2-6416-4437-b693-dfd63a3cf93d-kube-api-access-hxfdm\") pod \"b45b6aa2-6416-4437-b693-dfd63a3cf93d\" (UID: \"b45b6aa2-6416-4437-b693-dfd63a3cf93d\") " Jul 08 22:38:07.226375 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:07.226242 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b45b6aa2-6416-4437-b693-dfd63a3cf93d-bundle\") pod \"b45b6aa2-6416-4437-b693-dfd63a3cf93d\" (UID: \"b45b6aa2-6416-4437-b693-dfd63a3cf93d\") " Jul 08 22:38:07.226375 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:07.226272 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b45b6aa2-6416-4437-b693-dfd63a3cf93d-util\") pod \"b45b6aa2-6416-4437-b693-dfd63a3cf93d\" (UID: \"b45b6aa2-6416-4437-b693-dfd63a3cf93d\") " Jul 08 22:38:07.226997 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:07.226967 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45b6aa2-6416-4437-b693-dfd63a3cf93d-bundle" (OuterVolumeSpecName: "bundle") pod "b45b6aa2-6416-4437-b693-dfd63a3cf93d" (UID: "b45b6aa2-6416-4437-b693-dfd63a3cf93d"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:38:07.228466 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:07.228439 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b45b6aa2-6416-4437-b693-dfd63a3cf93d-kube-api-access-hxfdm" (OuterVolumeSpecName: "kube-api-access-hxfdm") pod "b45b6aa2-6416-4437-b693-dfd63a3cf93d" (UID: "b45b6aa2-6416-4437-b693-dfd63a3cf93d"). InnerVolumeSpecName "kube-api-access-hxfdm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:38:07.231502 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:07.231476 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b45b6aa2-6416-4437-b693-dfd63a3cf93d-util" (OuterVolumeSpecName: "util") pod "b45b6aa2-6416-4437-b693-dfd63a3cf93d" (UID: "b45b6aa2-6416-4437-b693-dfd63a3cf93d"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:38:07.327547 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:07.327459 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b45b6aa2-6416-4437-b693-dfd63a3cf93d-bundle\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:38:07.327547 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:07.327488 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b45b6aa2-6416-4437-b693-dfd63a3cf93d-util\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:38:07.327547 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:07.327498 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-hxfdm\" (UniqueName: \"kubernetes.io/projected/b45b6aa2-6416-4437-b693-dfd63a3cf93d-kube-api-access-hxfdm\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:38:07.991151 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:07.991121 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8" Jul 08 22:38:07.991151 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:07.991137 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afwktp8" event={"ID":"b45b6aa2-6416-4437-b693-dfd63a3cf93d","Type":"ContainerDied","Data":"3a7eb5d58189b53baa6e64f3b6ebd2775135aba36a63b1566b6c3bab9b758b03"} Jul 08 22:38:07.991363 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:07.991176 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3a7eb5d58189b53baa6e64f3b6ebd2775135aba36a63b1566b6c3bab9b758b03" Jul 08 22:38:20.692475 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.692438 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr"] Jul 08 22:38:20.693045 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.692829 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b45b6aa2-6416-4437-b693-dfd63a3cf93d" containerName="extract" Jul 08 22:38:20.693045 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.692847 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b45b6aa2-6416-4437-b693-dfd63a3cf93d" containerName="extract" Jul 08 22:38:20.693045 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.692866 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b45b6aa2-6416-4437-b693-dfd63a3cf93d" containerName="util" Jul 08 22:38:20.693045 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.692874 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b45b6aa2-6416-4437-b693-dfd63a3cf93d" containerName="util" Jul 08 22:38:20.693045 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.692903 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b45b6aa2-6416-4437-b693-dfd63a3cf93d" containerName="pull" Jul 08 22:38:20.693045 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.692913 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="b45b6aa2-6416-4437-b693-dfd63a3cf93d" containerName="pull" Jul 08 22:38:20.693045 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.692983 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="b45b6aa2-6416-4437-b693-dfd63a3cf93d" containerName="extract" Jul 08 22:38:20.697384 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.697360 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" Jul 08 22:38:20.700229 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.700205 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 08 22:38:20.700371 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.700210 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 08 22:38:20.700371 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.700210 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 08 22:38:20.700371 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.700278 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-nk2k8\"" Jul 08 22:38:20.700547 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.700379 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 08 22:38:20.715515 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.715488 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr"] Jul 08 22:38:20.846341 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.846305 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c3f38fa-2f25-49d9-9868-acd602cf0eb0-webhook-cert\") pod \"opendatahub-operator-controller-manager-67f464889d-vfkhr\" (UID: \"0c3f38fa-2f25-49d9-9868-acd602cf0eb0\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" Jul 08 22:38:20.846341 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.846340 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0c3f38fa-2f25-49d9-9868-acd602cf0eb0-manifests\") pod \"opendatahub-operator-controller-manager-67f464889d-vfkhr\" (UID: \"0c3f38fa-2f25-49d9-9868-acd602cf0eb0\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" Jul 08 22:38:20.846798 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.846369 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0c3f38fa-2f25-49d9-9868-acd602cf0eb0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67f464889d-vfkhr\" (UID: \"0c3f38fa-2f25-49d9-9868-acd602cf0eb0\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" Jul 08 22:38:20.846798 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.846428 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9rbqs\" (UniqueName: \"kubernetes.io/projected/0c3f38fa-2f25-49d9-9868-acd602cf0eb0-kube-api-access-9rbqs\") pod \"opendatahub-operator-controller-manager-67f464889d-vfkhr\" (UID: \"0c3f38fa-2f25-49d9-9868-acd602cf0eb0\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" Jul 08 22:38:20.846798 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.846478 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c3f38fa-2f25-49d9-9868-acd602cf0eb0-tmp\") pod \"opendatahub-operator-controller-manager-67f464889d-vfkhr\" (UID: \"0c3f38fa-2f25-49d9-9868-acd602cf0eb0\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" Jul 08 22:38:20.947419 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.947327 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c3f38fa-2f25-49d9-9868-acd602cf0eb0-webhook-cert\") pod \"opendatahub-operator-controller-manager-67f464889d-vfkhr\" (UID: \"0c3f38fa-2f25-49d9-9868-acd602cf0eb0\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" Jul 08 22:38:20.947419 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.947363 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0c3f38fa-2f25-49d9-9868-acd602cf0eb0-manifests\") pod \"opendatahub-operator-controller-manager-67f464889d-vfkhr\" (UID: \"0c3f38fa-2f25-49d9-9868-acd602cf0eb0\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" Jul 08 22:38:20.947419 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.947386 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0c3f38fa-2f25-49d9-9868-acd602cf0eb0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67f464889d-vfkhr\" (UID: \"0c3f38fa-2f25-49d9-9868-acd602cf0eb0\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" Jul 08 22:38:20.947419 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.947419 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9rbqs\" (UniqueName: \"kubernetes.io/projected/0c3f38fa-2f25-49d9-9868-acd602cf0eb0-kube-api-access-9rbqs\") pod \"opendatahub-operator-controller-manager-67f464889d-vfkhr\" (UID: \"0c3f38fa-2f25-49d9-9868-acd602cf0eb0\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" Jul 08 22:38:20.947801 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.947466 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c3f38fa-2f25-49d9-9868-acd602cf0eb0-tmp\") pod \"opendatahub-operator-controller-manager-67f464889d-vfkhr\" (UID: \"0c3f38fa-2f25-49d9-9868-acd602cf0eb0\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" Jul 08 22:38:20.947876 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.947858 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/0c3f38fa-2f25-49d9-9868-acd602cf0eb0-manifests\") pod \"opendatahub-operator-controller-manager-67f464889d-vfkhr\" (UID: \"0c3f38fa-2f25-49d9-9868-acd602cf0eb0\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" Jul 08 22:38:20.950059 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.950028 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0c3f38fa-2f25-49d9-9868-acd602cf0eb0-tmp\") pod \"opendatahub-operator-controller-manager-67f464889d-vfkhr\" (UID: \"0c3f38fa-2f25-49d9-9868-acd602cf0eb0\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" Jul 08 22:38:20.950169 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.950098 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/0c3f38fa-2f25-49d9-9868-acd602cf0eb0-apiservice-cert\") pod \"opendatahub-operator-controller-manager-67f464889d-vfkhr\" (UID: \"0c3f38fa-2f25-49d9-9868-acd602cf0eb0\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" Jul 08 22:38:20.950213 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.950166 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/0c3f38fa-2f25-49d9-9868-acd602cf0eb0-webhook-cert\") pod \"opendatahub-operator-controller-manager-67f464889d-vfkhr\" (UID: \"0c3f38fa-2f25-49d9-9868-acd602cf0eb0\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" Jul 08 22:38:20.955125 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:20.955107 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-9rbqs\" (UniqueName: \"kubernetes.io/projected/0c3f38fa-2f25-49d9-9868-acd602cf0eb0-kube-api-access-9rbqs\") pod \"opendatahub-operator-controller-manager-67f464889d-vfkhr\" (UID: \"0c3f38fa-2f25-49d9-9868-acd602cf0eb0\") " pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" Jul 08 22:38:21.007986 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:21.007948 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" Jul 08 22:38:21.153434 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:21.153386 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr"] Jul 08 22:38:21.156271 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:38:21.156242 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0c3f38fa_2f25_49d9_9868_acd602cf0eb0.slice/crio-6ce9355b95debeb01d913beba7470f59acda0e5874aefafe8969acd4ff224f13 WatchSource:0}: Error finding container 6ce9355b95debeb01d913beba7470f59acda0e5874aefafe8969acd4ff224f13: Status 404 returned error can't find the container with id 6ce9355b95debeb01d913beba7470f59acda0e5874aefafe8969acd4ff224f13 Jul 08 22:38:22.059102 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:22.059055 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" event={"ID":"0c3f38fa-2f25-49d9-9868-acd602cf0eb0","Type":"ContainerStarted","Data":"6ce9355b95debeb01d913beba7470f59acda0e5874aefafe8969acd4ff224f13"} Jul 08 22:38:25.076718 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:25.076682 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" event={"ID":"0c3f38fa-2f25-49d9-9868-acd602cf0eb0","Type":"ContainerStarted","Data":"0719f3ec512dc53d424e186ac3810857f9a2ef3bba7d6a5680d976c76ed06361"} Jul 08 22:38:26.082525 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:26.082486 2573 generic.go:356] "Generic (PLEG): container finished" podID="0c3f38fa-2f25-49d9-9868-acd602cf0eb0" containerID="0719f3ec512dc53d424e186ac3810857f9a2ef3bba7d6a5680d976c76ed06361" exitCode=0 Jul 08 22:38:26.082925 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:26.082568 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" event={"ID":"0c3f38fa-2f25-49d9-9868-acd602cf0eb0","Type":"ContainerDied","Data":"0719f3ec512dc53d424e186ac3810857f9a2ef3bba7d6a5680d976c76ed06361"} Jul 08 22:38:27.089437 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:27.089400 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" event={"ID":"0c3f38fa-2f25-49d9-9868-acd602cf0eb0","Type":"ContainerStarted","Data":"f32981bcf059b6dac705348d98b5bce71489acbea249eb181374e728f146be84"} Jul 08 22:38:27.089862 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:27.089529 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" Jul 08 22:38:27.115664 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:27.115605 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" podStartSLOduration=2.646207537 podStartE2EDuration="7.115587702s" totalImagesPullingTime="3.334815437s" totalInitContainerRuntime="1.134564728s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:38:20 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:38:27.112770531 +0000 UTC m=+517.451477508" watchObservedRunningTime="2026-07-08 22:38:27.115587702 +0000 UTC m=+517.454294675" Jul 08 22:38:38.098407 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:38.098375 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-67f464889d-vfkhr" Jul 08 22:38:47.716402 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.716325 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf"] Jul 08 22:38:47.719650 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.719630 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.722863 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.722843 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-6z8xm\"" Jul 08 22:38:47.722977 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.722872 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 22:38:47.723463 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.723445 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 22:38:47.723606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.723587 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 22:38:47.735603 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.735582 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf"] Jul 08 22:38:47.763331 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.763298 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.763497 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.763361 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.763497 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.763387 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.763653 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.763502 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.763653 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.763580 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.763653 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.763604 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.763653 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.763622 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wc4tv\" (UniqueName: \"kubernetes.io/projected/537863bd-0511-4d48-b4c9-6805e4f33ed5-kube-api-access-wc4tv\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.763803 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.763680 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/537863bd-0511-4d48-b4c9-6805e4f33ed5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.763803 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.763703 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.864235 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.864194 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.864235 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.864238 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.864482 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.864268 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.864482 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.864319 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.864482 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.864348 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.864482 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.864447 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wc4tv\" (UniqueName: \"kubernetes.io/projected/537863bd-0511-4d48-b4c9-6805e4f33ed5-kube-api-access-wc4tv\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.864744 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.864521 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/537863bd-0511-4d48-b4c9-6805e4f33ed5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.864744 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.864576 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.864744 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.864599 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.864744 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.864661 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.865086 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.865064 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.865253 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.865214 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/537863bd-0511-4d48-b4c9-6805e4f33ed5-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.865253 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.865167 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.865253 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.865247 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-data\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.867149 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.867124 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.867246 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.867204 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.873858 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.873832 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-token\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:47.876221 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:47.876200 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-wc4tv\" (UniqueName: \"kubernetes.io/projected/537863bd-0511-4d48-b4c9-6805e4f33ed5-kube-api-access-wc4tv\") pod \"data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:48.031934 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:48.031897 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:48.184194 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:48.184169 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf"] Jul 08 22:38:48.186488 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:38:48.186463 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod537863bd_0511_4d48_b4c9_6805e4f33ed5.slice/crio-5ef010f51161358e3df2ad8077093b399158b17c91990eba4a254406addd4572 WatchSource:0}: Error finding container 5ef010f51161358e3df2ad8077093b399158b17c91990eba4a254406addd4572: Status 404 returned error can't find the container with id 5ef010f51161358e3df2ad8077093b399158b17c91990eba4a254406addd4572 Jul 08 22:38:48.193000 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:48.192971 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" event={"ID":"537863bd-0511-4d48-b4c9-6805e4f33ed5","Type":"ContainerStarted","Data":"5ef010f51161358e3df2ad8077093b399158b17c91990eba4a254406addd4572"} Jul 08 22:38:50.171261 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:50.171225 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c47f9b476-zbnfb"] Jul 08 22:38:50.181475 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:50.181376 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c47f9b476-zbnfb" Jul 08 22:38:50.183777 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:50.183751 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfe33462-9c0e-4e5a-8c96-e4b87a3443a5-cert\") pod \"lws-controller-manager-7c47f9b476-zbnfb\" (UID: \"cfe33462-9c0e-4e5a-8c96-e4b87a3443a5\") " pod="openshift-lws-operator/lws-controller-manager-7c47f9b476-zbnfb" Jul 08 22:38:50.183928 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:50.183793 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cfe33462-9c0e-4e5a-8c96-e4b87a3443a5-metrics-cert\") pod \"lws-controller-manager-7c47f9b476-zbnfb\" (UID: \"cfe33462-9c0e-4e5a-8c96-e4b87a3443a5\") " pod="openshift-lws-operator/lws-controller-manager-7c47f9b476-zbnfb" Jul 08 22:38:50.183928 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:50.183838 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cfe33462-9c0e-4e5a-8c96-e4b87a3443a5-manager-config\") pod \"lws-controller-manager-7c47f9b476-zbnfb\" (UID: \"cfe33462-9c0e-4e5a-8c96-e4b87a3443a5\") " pod="openshift-lws-operator/lws-controller-manager-7c47f9b476-zbnfb" Jul 08 22:38:50.183928 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:50.183865 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pcswt\" (UniqueName: \"kubernetes.io/projected/cfe33462-9c0e-4e5a-8c96-e4b87a3443a5-kube-api-access-pcswt\") pod \"lws-controller-manager-7c47f9b476-zbnfb\" (UID: \"cfe33462-9c0e-4e5a-8c96-e4b87a3443a5\") " pod="openshift-lws-operator/lws-controller-manager-7c47f9b476-zbnfb" Jul 08 22:38:50.186010 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:50.185771 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 08 22:38:50.186010 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:50.185772 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-nqffg\"" Jul 08 22:38:50.186010 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:50.185923 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 08 22:38:50.186327 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:50.186041 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 08 22:38:50.191953 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:50.191897 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c47f9b476-zbnfb"] Jul 08 22:38:50.284840 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:50.284807 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfe33462-9c0e-4e5a-8c96-e4b87a3443a5-cert\") pod \"lws-controller-manager-7c47f9b476-zbnfb\" (UID: \"cfe33462-9c0e-4e5a-8c96-e4b87a3443a5\") " pod="openshift-lws-operator/lws-controller-manager-7c47f9b476-zbnfb" Jul 08 22:38:50.284840 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:50.284852 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cfe33462-9c0e-4e5a-8c96-e4b87a3443a5-metrics-cert\") pod \"lws-controller-manager-7c47f9b476-zbnfb\" (UID: \"cfe33462-9c0e-4e5a-8c96-e4b87a3443a5\") " pod="openshift-lws-operator/lws-controller-manager-7c47f9b476-zbnfb" Jul 08 22:38:50.285167 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:50.285144 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cfe33462-9c0e-4e5a-8c96-e4b87a3443a5-manager-config\") pod \"lws-controller-manager-7c47f9b476-zbnfb\" (UID: \"cfe33462-9c0e-4e5a-8c96-e4b87a3443a5\") " pod="openshift-lws-operator/lws-controller-manager-7c47f9b476-zbnfb" Jul 08 22:38:50.285236 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:50.285187 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pcswt\" (UniqueName: \"kubernetes.io/projected/cfe33462-9c0e-4e5a-8c96-e4b87a3443a5-kube-api-access-pcswt\") pod \"lws-controller-manager-7c47f9b476-zbnfb\" (UID: \"cfe33462-9c0e-4e5a-8c96-e4b87a3443a5\") " pod="openshift-lws-operator/lws-controller-manager-7c47f9b476-zbnfb" Jul 08 22:38:50.286078 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:50.286057 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/cfe33462-9c0e-4e5a-8c96-e4b87a3443a5-manager-config\") pod \"lws-controller-manager-7c47f9b476-zbnfb\" (UID: \"cfe33462-9c0e-4e5a-8c96-e4b87a3443a5\") " pod="openshift-lws-operator/lws-controller-manager-7c47f9b476-zbnfb" Jul 08 22:38:50.287947 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:50.287924 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/cfe33462-9c0e-4e5a-8c96-e4b87a3443a5-cert\") pod \"lws-controller-manager-7c47f9b476-zbnfb\" (UID: \"cfe33462-9c0e-4e5a-8c96-e4b87a3443a5\") " pod="openshift-lws-operator/lws-controller-manager-7c47f9b476-zbnfb" Jul 08 22:38:50.288060 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:50.287946 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/cfe33462-9c0e-4e5a-8c96-e4b87a3443a5-metrics-cert\") pod \"lws-controller-manager-7c47f9b476-zbnfb\" (UID: \"cfe33462-9c0e-4e5a-8c96-e4b87a3443a5\") " pod="openshift-lws-operator/lws-controller-manager-7c47f9b476-zbnfb" Jul 08 22:38:50.294912 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:50.294876 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pcswt\" (UniqueName: \"kubernetes.io/projected/cfe33462-9c0e-4e5a-8c96-e4b87a3443a5-kube-api-access-pcswt\") pod \"lws-controller-manager-7c47f9b476-zbnfb\" (UID: \"cfe33462-9c0e-4e5a-8c96-e4b87a3443a5\") " pod="openshift-lws-operator/lws-controller-manager-7c47f9b476-zbnfb" Jul 08 22:38:50.498664 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:50.498620 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-7c47f9b476-zbnfb" Jul 08 22:38:51.040625 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:51.040582 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 22:38:51.040719 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:51.040681 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 22:38:51.040760 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:51.040722 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 22:38:51.125999 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:51.119346 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-7c47f9b476-zbnfb"] Jul 08 22:38:51.212950 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:51.212900 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c47f9b476-zbnfb" event={"ID":"cfe33462-9c0e-4e5a-8c96-e4b87a3443a5","Type":"ContainerStarted","Data":"b08089c0e19f9376b4d19c00a3400357d1f4a64904c425c243b2828bdfeb8ae8"} Jul 08 22:38:51.214734 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:51.214704 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" event={"ID":"537863bd-0511-4d48-b4c9-6805e4f33ed5","Type":"ContainerStarted","Data":"1af581a7c290b42e194c959b44243c1bfaa40de09c2d756a4762be16fca31e50"} Jul 08 22:38:51.238883 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:51.238768 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" podStartSLOduration=1.3868696489999999 podStartE2EDuration="4.238750943s" totalImagesPullingTime="2.851881294s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:38:47 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:38:51.236222557 +0000 UTC m=+541.574929548" watchObservedRunningTime="2026-07-08 22:38:51.238750943 +0000 UTC m=+541.577457961" Jul 08 22:38:51.560493 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:51.560404 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-tbr82"] Jul 08 22:38:51.564142 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:51.564118 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tbr82" Jul 08 22:38:51.567755 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:51.567730 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-mh7wd\"" Jul 08 22:38:51.568311 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:51.568294 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 08 22:38:51.581002 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:51.580972 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-tbr82"] Jul 08 22:38:51.596125 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:51.596095 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28f8b75a-156a-411c-b513-d2e8c0507e6c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-tbr82\" (UID: \"28f8b75a-156a-411c-b513-d2e8c0507e6c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tbr82" Jul 08 22:38:51.596335 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:51.596132 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-whb79\" (UniqueName: \"kubernetes.io/projected/28f8b75a-156a-411c-b513-d2e8c0507e6c-kube-api-access-whb79\") pod \"llmisvc-controller-manager-777c6bd7d5-tbr82\" (UID: \"28f8b75a-156a-411c-b513-d2e8c0507e6c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tbr82" Jul 08 22:38:51.696573 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:51.696518 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28f8b75a-156a-411c-b513-d2e8c0507e6c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-tbr82\" (UID: \"28f8b75a-156a-411c-b513-d2e8c0507e6c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tbr82" Jul 08 22:38:51.696752 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:51.696584 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-whb79\" (UniqueName: \"kubernetes.io/projected/28f8b75a-156a-411c-b513-d2e8c0507e6c-kube-api-access-whb79\") pod \"llmisvc-controller-manager-777c6bd7d5-tbr82\" (UID: \"28f8b75a-156a-411c-b513-d2e8c0507e6c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tbr82" Jul 08 22:38:51.699284 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:51.699254 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/28f8b75a-156a-411c-b513-d2e8c0507e6c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-tbr82\" (UID: \"28f8b75a-156a-411c-b513-d2e8c0507e6c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tbr82" Jul 08 22:38:51.705392 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:51.705369 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-whb79\" (UniqueName: \"kubernetes.io/projected/28f8b75a-156a-411c-b513-d2e8c0507e6c-kube-api-access-whb79\") pod \"llmisvc-controller-manager-777c6bd7d5-tbr82\" (UID: \"28f8b75a-156a-411c-b513-d2e8c0507e6c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tbr82" Jul 08 22:38:51.875783 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:51.875696 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tbr82" Jul 08 22:38:52.032807 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:52.032772 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:52.034310 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:52.034277 2573 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 08 22:38:52.034456 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:52.034334 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" podUID="537863bd-0511-4d48-b4c9-6805e4f33ed5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 08 22:38:52.050112 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:52.050085 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-tbr82"] Jul 08 22:38:52.052193 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:38:52.052151 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod28f8b75a_156a_411c_b513_d2e8c0507e6c.slice/crio-fab35a6ef22fe37aff3b1ff0097cca7dc53fa0a5b4b795d50fe5a660703a7878 WatchSource:0}: Error finding container fab35a6ef22fe37aff3b1ff0097cca7dc53fa0a5b4b795d50fe5a660703a7878: Status 404 returned error can't find the container with id fab35a6ef22fe37aff3b1ff0097cca7dc53fa0a5b4b795d50fe5a660703a7878 Jul 08 22:38:52.223272 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:52.223231 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tbr82" event={"ID":"28f8b75a-156a-411c-b513-d2e8c0507e6c","Type":"ContainerStarted","Data":"fab35a6ef22fe37aff3b1ff0097cca7dc53fa0a5b4b795d50fe5a660703a7878"} Jul 08 22:38:53.033229 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:53.033198 2573 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 08 22:38:53.033384 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:53.033254 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" podUID="537863bd-0511-4d48-b4c9-6805e4f33ed5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 08 22:38:53.118113 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:53.118036 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf"] Jul 08 22:38:53.230345 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:53.230305 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-7c47f9b476-zbnfb" event={"ID":"cfe33462-9c0e-4e5a-8c96-e4b87a3443a5","Type":"ContainerStarted","Data":"8992f8075b12195a4059672f16cae85e9bd84f6e7619257ea4cefcd3aa7aa404"} Jul 08 22:38:53.230760 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:53.230600 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-7c47f9b476-zbnfb" Jul 08 22:38:53.264850 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:53.264795 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-7c47f9b476-zbnfb" podStartSLOduration=1.575255486 podStartE2EDuration="3.2647757s" totalImagesPullingTime="1.689520214s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:38:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:38:53.262516598 +0000 UTC m=+543.601223584" watchObservedRunningTime="2026-07-08 22:38:53.2647757 +0000 UTC m=+543.603482673" Jul 08 22:38:54.032865 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:54.032826 2573 patch_prober.go:28] interesting pod/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" start-of-body= Jul 08 22:38:54.033050 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:54.032884 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" podUID="537863bd-0511-4d48-b4c9-6805e4f33ed5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.34:15021/healthz/ready\": dial tcp 10.132.0.34:15021: connect: connection refused" Jul 08 22:38:54.234816 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:54.234770 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" podUID="537863bd-0511-4d48-b4c9-6805e4f33ed5" containerName="istio-proxy" containerID="cri-o://1af581a7c290b42e194c959b44243c1bfaa40de09c2d756a4762be16fca31e50" gracePeriod=30 Jul 08 22:38:56.247021 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:56.246989 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tbr82" event={"ID":"28f8b75a-156a-411c-b513-d2e8c0507e6c","Type":"ContainerStarted","Data":"51a713c832e7b9cddbf8b9778668fb87a27fee38e5c6d3db1add94ecc84c34a0"} Jul 08 22:38:56.247469 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:56.247124 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tbr82" Jul 08 22:38:56.266156 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:56.266105 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tbr82" podStartSLOduration=1.865552975 podStartE2EDuration="5.266089988s" totalImagesPullingTime="3.400537013s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:38:51 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:38:56.26453051 +0000 UTC m=+546.603237484" watchObservedRunningTime="2026-07-08 22:38:56.266089988 +0000 UTC m=+546.604796961" Jul 08 22:38:59.481609 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.481586 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:38:59.560037 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.559947 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-workload-socket\") pod \"537863bd-0511-4d48-b4c9-6805e4f33ed5\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " Jul 08 22:38:59.560037 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.559989 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-credential-socket\") pod \"537863bd-0511-4d48-b4c9-6805e4f33ed5\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " Jul 08 22:38:59.560037 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.560014 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/537863bd-0511-4d48-b4c9-6805e4f33ed5-istiod-ca-cert\") pod \"537863bd-0511-4d48-b4c9-6805e4f33ed5\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " Jul 08 22:38:59.560290 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.560048 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-podinfo\") pod \"537863bd-0511-4d48-b4c9-6805e4f33ed5\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " Jul 08 22:38:59.560290 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.560235 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-token\") pod \"537863bd-0511-4d48-b4c9-6805e4f33ed5\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " Jul 08 22:38:59.560290 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.560280 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wc4tv\" (UniqueName: \"kubernetes.io/projected/537863bd-0511-4d48-b4c9-6805e4f33ed5-kube-api-access-wc4tv\") pod \"537863bd-0511-4d48-b4c9-6805e4f33ed5\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " Jul 08 22:38:59.560437 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.560324 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-data\") pod \"537863bd-0511-4d48-b4c9-6805e4f33ed5\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " Jul 08 22:38:59.560437 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.560354 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-envoy\") pod \"537863bd-0511-4d48-b4c9-6805e4f33ed5\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " Jul 08 22:38:59.560437 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.560418 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-workload-certs\") pod \"537863bd-0511-4d48-b4c9-6805e4f33ed5\" (UID: \"537863bd-0511-4d48-b4c9-6805e4f33ed5\") " Jul 08 22:38:59.560437 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.560320 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "537863bd-0511-4d48-b4c9-6805e4f33ed5" (UID: "537863bd-0511-4d48-b4c9-6805e4f33ed5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:38:59.560651 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.560341 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "537863bd-0511-4d48-b4c9-6805e4f33ed5" (UID: "537863bd-0511-4d48-b4c9-6805e4f33ed5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:38:59.560651 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.560351 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/537863bd-0511-4d48-b4c9-6805e4f33ed5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "537863bd-0511-4d48-b4c9-6805e4f33ed5" (UID: "537863bd-0511-4d48-b4c9-6805e4f33ed5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:38:59.560651 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.560599 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-data" (OuterVolumeSpecName: "istio-data") pod "537863bd-0511-4d48-b4c9-6805e4f33ed5" (UID: "537863bd-0511-4d48-b4c9-6805e4f33ed5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:38:59.560792 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.560706 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-workload-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:38:59.560792 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.560725 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-credential-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:38:59.560792 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.560742 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/537863bd-0511-4d48-b4c9-6805e4f33ed5-istiod-ca-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:38:59.560792 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.560755 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-data\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:38:59.560792 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.560757 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "537863bd-0511-4d48-b4c9-6805e4f33ed5" (UID: "537863bd-0511-4d48-b4c9-6805e4f33ed5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:38:59.562678 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.562647 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-token" (OuterVolumeSpecName: "istio-token") pod "537863bd-0511-4d48-b4c9-6805e4f33ed5" (UID: "537863bd-0511-4d48-b4c9-6805e4f33ed5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:38:59.562678 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.562654 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "537863bd-0511-4d48-b4c9-6805e4f33ed5" (UID: "537863bd-0511-4d48-b4c9-6805e4f33ed5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 22:38:59.562858 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.562675 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/537863bd-0511-4d48-b4c9-6805e4f33ed5-kube-api-access-wc4tv" (OuterVolumeSpecName: "kube-api-access-wc4tv") pod "537863bd-0511-4d48-b4c9-6805e4f33ed5" (UID: "537863bd-0511-4d48-b4c9-6805e4f33ed5"). InnerVolumeSpecName "kube-api-access-wc4tv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:38:59.562858 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.562676 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "537863bd-0511-4d48-b4c9-6805e4f33ed5" (UID: "537863bd-0511-4d48-b4c9-6805e4f33ed5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:38:59.661343 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.661303 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-envoy\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:38:59.661343 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.661334 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/537863bd-0511-4d48-b4c9-6805e4f33ed5-workload-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:38:59.661343 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.661344 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-podinfo\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:38:59.661343 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.661352 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/537863bd-0511-4d48-b4c9-6805e4f33ed5-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:38:59.661645 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:38:59.661360 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wc4tv\" (UniqueName: \"kubernetes.io/projected/537863bd-0511-4d48-b4c9-6805e4f33ed5-kube-api-access-wc4tv\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:39:00.266893 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:00.266858 2573 generic.go:356] "Generic (PLEG): container finished" podID="537863bd-0511-4d48-b4c9-6805e4f33ed5" containerID="1af581a7c290b42e194c959b44243c1bfaa40de09c2d756a4762be16fca31e50" exitCode=0 Jul 08 22:39:00.267099 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:00.266915 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" Jul 08 22:39:00.267099 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:00.266925 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" event={"ID":"537863bd-0511-4d48-b4c9-6805e4f33ed5","Type":"ContainerDied","Data":"1af581a7c290b42e194c959b44243c1bfaa40de09c2d756a4762be16fca31e50"} Jul 08 22:39:00.267099 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:00.266980 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf" event={"ID":"537863bd-0511-4d48-b4c9-6805e4f33ed5","Type":"ContainerDied","Data":"5ef010f51161358e3df2ad8077093b399158b17c91990eba4a254406addd4572"} Jul 08 22:39:00.267099 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:00.267009 2573 scope.go:117] "RemoveContainer" containerID="1af581a7c290b42e194c959b44243c1bfaa40de09c2d756a4762be16fca31e50" Jul 08 22:39:00.276639 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:00.276621 2573 scope.go:117] "RemoveContainer" containerID="1af581a7c290b42e194c959b44243c1bfaa40de09c2d756a4762be16fca31e50" Jul 08 22:39:00.276923 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:39:00.276899 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1af581a7c290b42e194c959b44243c1bfaa40de09c2d756a4762be16fca31e50\": container with ID starting with 1af581a7c290b42e194c959b44243c1bfaa40de09c2d756a4762be16fca31e50 not found: ID does not exist" containerID="1af581a7c290b42e194c959b44243c1bfaa40de09c2d756a4762be16fca31e50" Jul 08 22:39:00.277000 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:00.276931 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1af581a7c290b42e194c959b44243c1bfaa40de09c2d756a4762be16fca31e50"} err="failed to get container status \"1af581a7c290b42e194c959b44243c1bfaa40de09c2d756a4762be16fca31e50\": rpc error: code = NotFound desc = could not find container \"1af581a7c290b42e194c959b44243c1bfaa40de09c2d756a4762be16fca31e50\": container with ID starting with 1af581a7c290b42e194c959b44243c1bfaa40de09c2d756a4762be16fca31e50 not found: ID does not exist" Jul 08 22:39:00.285695 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:00.285666 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf"] Jul 08 22:39:00.294315 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:00.293902 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-f5b59fcbd-9h8nf"] Jul 08 22:39:02.182681 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:02.182641 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="537863bd-0511-4d48-b4c9-6805e4f33ed5" path="/var/lib/kubelet/pods/537863bd-0511-4d48-b4c9-6805e4f33ed5/volumes" Jul 08 22:39:04.237079 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:04.237048 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-7c47f9b476-zbnfb" Jul 08 22:39:27.253857 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:27.253820 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-tbr82" Jul 08 22:39:50.117782 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:50.117754 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/1.log" Jul 08 22:39:50.118805 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:50.118785 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/1.log" Jul 08 22:39:56.906452 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:56.906417 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk"] Jul 08 22:39:56.907696 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:56.906781 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="537863bd-0511-4d48-b4c9-6805e4f33ed5" containerName="istio-proxy" Jul 08 22:39:56.907696 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:56.906792 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="537863bd-0511-4d48-b4c9-6805e4f33ed5" containerName="istio-proxy" Jul 08 22:39:56.907696 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:56.906845 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="537863bd-0511-4d48-b4c9-6805e4f33ed5" containerName="istio-proxy" Jul 08 22:39:56.908862 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:56.908846 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk" Jul 08 22:39:56.911138 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:56.911115 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 22:39:56.912115 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:56.912085 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 22:39:56.912212 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:56.912186 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-rpbmg\"" Jul 08 22:39:56.922863 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:56.922829 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk"] Jul 08 22:39:56.951996 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:56.951963 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4edba4af-741a-4267-b2e5-541731048617-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk\" (UID: \"4edba4af-741a-4267-b2e5-541731048617\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk" Jul 08 22:39:56.952144 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:56.952037 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-d4hkb\" (UniqueName: \"kubernetes.io/projected/4edba4af-741a-4267-b2e5-541731048617-kube-api-access-d4hkb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk\" (UID: \"4edba4af-741a-4267-b2e5-541731048617\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk" Jul 08 22:39:56.952144 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:56.952064 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4edba4af-741a-4267-b2e5-541731048617-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk\" (UID: \"4edba4af-741a-4267-b2e5-541731048617\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk" Jul 08 22:39:57.052656 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.052618 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4edba4af-741a-4267-b2e5-541731048617-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk\" (UID: \"4edba4af-741a-4267-b2e5-541731048617\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk" Jul 08 22:39:57.052823 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.052700 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-d4hkb\" (UniqueName: \"kubernetes.io/projected/4edba4af-741a-4267-b2e5-541731048617-kube-api-access-d4hkb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk\" (UID: \"4edba4af-741a-4267-b2e5-541731048617\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk" Jul 08 22:39:57.052823 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.052720 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4edba4af-741a-4267-b2e5-541731048617-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk\" (UID: \"4edba4af-741a-4267-b2e5-541731048617\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk" Jul 08 22:39:57.053090 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.053075 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4edba4af-741a-4267-b2e5-541731048617-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk\" (UID: \"4edba4af-741a-4267-b2e5-541731048617\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk" Jul 08 22:39:57.053133 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.053073 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4edba4af-741a-4267-b2e5-541731048617-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk\" (UID: \"4edba4af-741a-4267-b2e5-541731048617\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk" Jul 08 22:39:57.061905 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.061868 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-d4hkb\" (UniqueName: \"kubernetes.io/projected/4edba4af-741a-4267-b2e5-541731048617-kube-api-access-d4hkb\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk\" (UID: \"4edba4af-741a-4267-b2e5-541731048617\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk" Jul 08 22:39:57.220222 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.220190 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk" Jul 08 22:39:57.354885 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.354858 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk"] Jul 08 22:39:57.357035 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:39:57.357002 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4edba4af_741a_4267_b2e5_541731048617.slice/crio-936a9b3849670a81e15f7275588a0b41a6c2973f141a4089051eb09aba3dc9f8 WatchSource:0}: Error finding container 936a9b3849670a81e15f7275588a0b41a6c2973f141a4089051eb09aba3dc9f8: Status 404 returned error can't find the container with id 936a9b3849670a81e15f7275588a0b41a6c2973f141a4089051eb09aba3dc9f8 Jul 08 22:39:57.515472 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.515387 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w"] Jul 08 22:39:57.518116 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.518098 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w" Jul 08 22:39:57.528293 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.528269 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w"] Jul 08 22:39:57.544897 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.544869 2573 generic.go:356] "Generic (PLEG): container finished" podID="4edba4af-741a-4267-b2e5-541731048617" containerID="109054b30c0adbaec09b07d4e301255ba4831d0b829cfe56e14ad1738ac5db8f" exitCode=0 Jul 08 22:39:57.545047 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.544951 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk" event={"ID":"4edba4af-741a-4267-b2e5-541731048617","Type":"ContainerDied","Data":"109054b30c0adbaec09b07d4e301255ba4831d0b829cfe56e14ad1738ac5db8f"} Jul 08 22:39:57.545047 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.544996 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk" event={"ID":"4edba4af-741a-4267-b2e5-541731048617","Type":"ContainerStarted","Data":"936a9b3849670a81e15f7275588a0b41a6c2973f141a4089051eb09aba3dc9f8"} Jul 08 22:39:57.545370 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.545357 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 22:39:57.556375 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.556353 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83d9d177-a817-4a7f-90ea-192dc9dbf3c1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w\" (UID: \"83d9d177-a817-4a7f-90ea-192dc9dbf3c1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w" Jul 08 22:39:57.556489 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.556387 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83d9d177-a817-4a7f-90ea-192dc9dbf3c1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w\" (UID: \"83d9d177-a817-4a7f-90ea-192dc9dbf3c1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w" Jul 08 22:39:57.556489 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.556416 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tgq5r\" (UniqueName: \"kubernetes.io/projected/83d9d177-a817-4a7f-90ea-192dc9dbf3c1-kube-api-access-tgq5r\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w\" (UID: \"83d9d177-a817-4a7f-90ea-192dc9dbf3c1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w" Jul 08 22:39:57.656944 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.656906 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83d9d177-a817-4a7f-90ea-192dc9dbf3c1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w\" (UID: \"83d9d177-a817-4a7f-90ea-192dc9dbf3c1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w" Jul 08 22:39:57.656944 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.656947 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83d9d177-a817-4a7f-90ea-192dc9dbf3c1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w\" (UID: \"83d9d177-a817-4a7f-90ea-192dc9dbf3c1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w" Jul 08 22:39:57.657185 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.657076 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tgq5r\" (UniqueName: \"kubernetes.io/projected/83d9d177-a817-4a7f-90ea-192dc9dbf3c1-kube-api-access-tgq5r\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w\" (UID: \"83d9d177-a817-4a7f-90ea-192dc9dbf3c1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w" Jul 08 22:39:57.657350 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.657329 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83d9d177-a817-4a7f-90ea-192dc9dbf3c1-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w\" (UID: \"83d9d177-a817-4a7f-90ea-192dc9dbf3c1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w" Jul 08 22:39:57.657414 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.657353 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83d9d177-a817-4a7f-90ea-192dc9dbf3c1-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w\" (UID: \"83d9d177-a817-4a7f-90ea-192dc9dbf3c1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w" Jul 08 22:39:57.665961 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.665932 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-tgq5r\" (UniqueName: \"kubernetes.io/projected/83d9d177-a817-4a7f-90ea-192dc9dbf3c1-kube-api-access-tgq5r\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w\" (UID: \"83d9d177-a817-4a7f-90ea-192dc9dbf3c1\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w" Jul 08 22:39:57.827766 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.827672 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w" Jul 08 22:39:57.910282 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.910256 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j"] Jul 08 22:39:57.914667 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.914640 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j" Jul 08 22:39:57.921596 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.921522 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j"] Jul 08 22:39:57.959996 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.959961 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gzbjv\" (UniqueName: \"kubernetes.io/projected/56aa51ca-f677-4767-bc30-57e3f1b6765f-kube-api-access-gzbjv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j\" (UID: \"56aa51ca-f677-4767-bc30-57e3f1b6765f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j" Jul 08 22:39:57.960154 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.960006 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56aa51ca-f677-4767-bc30-57e3f1b6765f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j\" (UID: \"56aa51ca-f677-4767-bc30-57e3f1b6765f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j" Jul 08 22:39:57.960154 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.960061 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56aa51ca-f677-4767-bc30-57e3f1b6765f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j\" (UID: \"56aa51ca-f677-4767-bc30-57e3f1b6765f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j" Jul 08 22:39:57.965595 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:57.965548 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w"] Jul 08 22:39:57.967295 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:39:57.967272 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod83d9d177_a817_4a7f_90ea_192dc9dbf3c1.slice/crio-e95ea2812e4dec0aaa195bffc522f4b2d48b2cdc002f49a2734c857c9b2d7393 WatchSource:0}: Error finding container e95ea2812e4dec0aaa195bffc522f4b2d48b2cdc002f49a2734c857c9b2d7393: Status 404 returned error can't find the container with id e95ea2812e4dec0aaa195bffc522f4b2d48b2cdc002f49a2734c857c9b2d7393 Jul 08 22:39:58.060569 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.060521 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gzbjv\" (UniqueName: \"kubernetes.io/projected/56aa51ca-f677-4767-bc30-57e3f1b6765f-kube-api-access-gzbjv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j\" (UID: \"56aa51ca-f677-4767-bc30-57e3f1b6765f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j" Jul 08 22:39:58.060661 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.060603 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56aa51ca-f677-4767-bc30-57e3f1b6765f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j\" (UID: \"56aa51ca-f677-4767-bc30-57e3f1b6765f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j" Jul 08 22:39:58.060661 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.060640 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56aa51ca-f677-4767-bc30-57e3f1b6765f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j\" (UID: \"56aa51ca-f677-4767-bc30-57e3f1b6765f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j" Jul 08 22:39:58.061036 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.061018 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56aa51ca-f677-4767-bc30-57e3f1b6765f-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j\" (UID: \"56aa51ca-f677-4767-bc30-57e3f1b6765f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j" Jul 08 22:39:58.061036 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.061031 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56aa51ca-f677-4767-bc30-57e3f1b6765f-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j\" (UID: \"56aa51ca-f677-4767-bc30-57e3f1b6765f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j" Jul 08 22:39:58.068363 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.068339 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gzbjv\" (UniqueName: \"kubernetes.io/projected/56aa51ca-f677-4767-bc30-57e3f1b6765f-kube-api-access-gzbjv\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j\" (UID: \"56aa51ca-f677-4767-bc30-57e3f1b6765f\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j" Jul 08 22:39:58.226377 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.226356 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j" Jul 08 22:39:58.312041 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.312003 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5"] Jul 08 22:39:58.314879 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.314854 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5" Jul 08 22:39:58.329490 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.329461 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5"] Jul 08 22:39:58.364663 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.364589 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pnrw9\" (UniqueName: \"kubernetes.io/projected/17e4d5d9-9948-457c-b6da-69617f0991fd-kube-api-access-pnrw9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5\" (UID: \"17e4d5d9-9948-457c-b6da-69617f0991fd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5" Jul 08 22:39:58.364797 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.364721 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17e4d5d9-9948-457c-b6da-69617f0991fd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5\" (UID: \"17e4d5d9-9948-457c-b6da-69617f0991fd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5" Jul 08 22:39:58.364797 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.364766 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17e4d5d9-9948-457c-b6da-69617f0991fd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5\" (UID: \"17e4d5d9-9948-457c-b6da-69617f0991fd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5" Jul 08 22:39:58.382984 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.382954 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j"] Jul 08 22:39:58.401476 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:39:58.401444 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod56aa51ca_f677_4767_bc30_57e3f1b6765f.slice/crio-4f26352537d9ea561f61d7ad44df31d0a6dbe8f1c132eb7b061f5e9408f5dafb WatchSource:0}: Error finding container 4f26352537d9ea561f61d7ad44df31d0a6dbe8f1c132eb7b061f5e9408f5dafb: Status 404 returned error can't find the container with id 4f26352537d9ea561f61d7ad44df31d0a6dbe8f1c132eb7b061f5e9408f5dafb Jul 08 22:39:58.465907 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.465872 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17e4d5d9-9948-457c-b6da-69617f0991fd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5\" (UID: \"17e4d5d9-9948-457c-b6da-69617f0991fd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5" Jul 08 22:39:58.466095 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.465923 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17e4d5d9-9948-457c-b6da-69617f0991fd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5\" (UID: \"17e4d5d9-9948-457c-b6da-69617f0991fd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5" Jul 08 22:39:58.466095 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.465959 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pnrw9\" (UniqueName: \"kubernetes.io/projected/17e4d5d9-9948-457c-b6da-69617f0991fd-kube-api-access-pnrw9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5\" (UID: \"17e4d5d9-9948-457c-b6da-69617f0991fd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5" Jul 08 22:39:58.466307 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.466285 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17e4d5d9-9948-457c-b6da-69617f0991fd-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5\" (UID: \"17e4d5d9-9948-457c-b6da-69617f0991fd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5" Jul 08 22:39:58.466393 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.466368 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17e4d5d9-9948-457c-b6da-69617f0991fd-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5\" (UID: \"17e4d5d9-9948-457c-b6da-69617f0991fd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5" Jul 08 22:39:58.474684 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.474658 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-pnrw9\" (UniqueName: \"kubernetes.io/projected/17e4d5d9-9948-457c-b6da-69617f0991fd-kube-api-access-pnrw9\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5\" (UID: \"17e4d5d9-9948-457c-b6da-69617f0991fd\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5" Jul 08 22:39:58.551905 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.551866 2573 generic.go:356] "Generic (PLEG): container finished" podID="4edba4af-741a-4267-b2e5-541731048617" containerID="2f1f7235d295cc3c2854c5cf5795f77729b1efe4fdd5a34c89ab4fa008428d6f" exitCode=0 Jul 08 22:39:58.552078 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.551929 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk" event={"ID":"4edba4af-741a-4267-b2e5-541731048617","Type":"ContainerDied","Data":"2f1f7235d295cc3c2854c5cf5795f77729b1efe4fdd5a34c89ab4fa008428d6f"} Jul 08 22:39:58.553631 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.553612 2573 generic.go:356] "Generic (PLEG): container finished" podID="56aa51ca-f677-4767-bc30-57e3f1b6765f" containerID="cdd5e26d6937cd9faa22c4604dd1dcbfe129b76036e543c901c6c7c693a54706" exitCode=0 Jul 08 22:39:58.553718 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.553696 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j" event={"ID":"56aa51ca-f677-4767-bc30-57e3f1b6765f","Type":"ContainerDied","Data":"cdd5e26d6937cd9faa22c4604dd1dcbfe129b76036e543c901c6c7c693a54706"} Jul 08 22:39:58.553777 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.553747 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j" event={"ID":"56aa51ca-f677-4767-bc30-57e3f1b6765f","Type":"ContainerStarted","Data":"4f26352537d9ea561f61d7ad44df31d0a6dbe8f1c132eb7b061f5e9408f5dafb"} Jul 08 22:39:58.555312 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.555290 2573 generic.go:356] "Generic (PLEG): container finished" podID="83d9d177-a817-4a7f-90ea-192dc9dbf3c1" containerID="42ea4742515ff5df21309adf0a7522a97ac67e029289d6778ad3ca2095a6636a" exitCode=0 Jul 08 22:39:58.555436 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.555356 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w" event={"ID":"83d9d177-a817-4a7f-90ea-192dc9dbf3c1","Type":"ContainerDied","Data":"42ea4742515ff5df21309adf0a7522a97ac67e029289d6778ad3ca2095a6636a"} Jul 08 22:39:58.555436 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.555394 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w" event={"ID":"83d9d177-a817-4a7f-90ea-192dc9dbf3c1","Type":"ContainerStarted","Data":"e95ea2812e4dec0aaa195bffc522f4b2d48b2cdc002f49a2734c857c9b2d7393"} Jul 08 22:39:58.631784 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.631697 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5" Jul 08 22:39:58.773724 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:58.773697 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5"] Jul 08 22:39:58.775345 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:39:58.775318 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod17e4d5d9_9948_457c_b6da_69617f0991fd.slice/crio-e3f9fc48607b57e15d4975b12cb552b50e36847a8c2a0dd28fa63d8d55594ce9 WatchSource:0}: Error finding container e3f9fc48607b57e15d4975b12cb552b50e36847a8c2a0dd28fa63d8d55594ce9: Status 404 returned error can't find the container with id e3f9fc48607b57e15d4975b12cb552b50e36847a8c2a0dd28fa63d8d55594ce9 Jul 08 22:39:59.562665 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:59.562632 2573 generic.go:356] "Generic (PLEG): container finished" podID="83d9d177-a817-4a7f-90ea-192dc9dbf3c1" containerID="879ef231b05dcf62d928cbe581c3f6144fe1c4f3cc15508df9275bbc7dfb3026" exitCode=0 Jul 08 22:39:59.563054 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:59.562736 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w" event={"ID":"83d9d177-a817-4a7f-90ea-192dc9dbf3c1","Type":"ContainerDied","Data":"879ef231b05dcf62d928cbe581c3f6144fe1c4f3cc15508df9275bbc7dfb3026"} Jul 08 22:39:59.564405 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:59.564297 2573 generic.go:356] "Generic (PLEG): container finished" podID="17e4d5d9-9948-457c-b6da-69617f0991fd" containerID="c02b74aa4569be4d32c8dd20577ed59a68d1e17b69f25876e16106ace5c011e5" exitCode=0 Jul 08 22:39:59.564475 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:59.564397 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5" event={"ID":"17e4d5d9-9948-457c-b6da-69617f0991fd","Type":"ContainerDied","Data":"c02b74aa4569be4d32c8dd20577ed59a68d1e17b69f25876e16106ace5c011e5"} Jul 08 22:39:59.564475 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:59.564438 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5" event={"ID":"17e4d5d9-9948-457c-b6da-69617f0991fd","Type":"ContainerStarted","Data":"e3f9fc48607b57e15d4975b12cb552b50e36847a8c2a0dd28fa63d8d55594ce9"} Jul 08 22:39:59.574488 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:59.572104 2573 generic.go:356] "Generic (PLEG): container finished" podID="4edba4af-741a-4267-b2e5-541731048617" containerID="3cc4d0f1bca660ecc4223880458e60c826ee7808a3108d9ab6b926da16327df7" exitCode=0 Jul 08 22:39:59.574488 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:39:59.572182 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk" event={"ID":"4edba4af-741a-4267-b2e5-541731048617","Type":"ContainerDied","Data":"3cc4d0f1bca660ecc4223880458e60c826ee7808a3108d9ab6b926da16327df7"} Jul 08 22:40:00.579378 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:00.579344 2573 generic.go:356] "Generic (PLEG): container finished" podID="56aa51ca-f677-4767-bc30-57e3f1b6765f" containerID="f50c2536f9a16c71cdf58577d93e4161c81df8eb7037900f9cba97a9f1fc56ee" exitCode=0 Jul 08 22:40:00.579873 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:00.579437 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j" event={"ID":"56aa51ca-f677-4767-bc30-57e3f1b6765f","Type":"ContainerDied","Data":"f50c2536f9a16c71cdf58577d93e4161c81df8eb7037900f9cba97a9f1fc56ee"} Jul 08 22:40:00.581696 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:00.581676 2573 generic.go:356] "Generic (PLEG): container finished" podID="83d9d177-a817-4a7f-90ea-192dc9dbf3c1" containerID="5eccdf71c36bc6314c3e84ace9a09467f150fe2f213144f6767ab4b2e61ed641" exitCode=0 Jul 08 22:40:00.581827 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:00.581740 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w" event={"ID":"83d9d177-a817-4a7f-90ea-192dc9dbf3c1","Type":"ContainerDied","Data":"5eccdf71c36bc6314c3e84ace9a09467f150fe2f213144f6767ab4b2e61ed641"} Jul 08 22:40:00.583712 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:00.583627 2573 generic.go:356] "Generic (PLEG): container finished" podID="17e4d5d9-9948-457c-b6da-69617f0991fd" containerID="28629f1d0e703dcf46d721beb418e7b8289e8ce6d8c64d6ef10471e531bad84c" exitCode=0 Jul 08 22:40:00.583775 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:00.583733 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5" event={"ID":"17e4d5d9-9948-457c-b6da-69617f0991fd","Type":"ContainerDied","Data":"28629f1d0e703dcf46d721beb418e7b8289e8ce6d8c64d6ef10471e531bad84c"} Jul 08 22:40:00.724215 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:00.724176 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk" Jul 08 22:40:00.785313 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:00.785279 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4edba4af-741a-4267-b2e5-541731048617-util\") pod \"4edba4af-741a-4267-b2e5-541731048617\" (UID: \"4edba4af-741a-4267-b2e5-541731048617\") " Jul 08 22:40:00.785498 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:00.785383 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-d4hkb\" (UniqueName: \"kubernetes.io/projected/4edba4af-741a-4267-b2e5-541731048617-kube-api-access-d4hkb\") pod \"4edba4af-741a-4267-b2e5-541731048617\" (UID: \"4edba4af-741a-4267-b2e5-541731048617\") " Jul 08 22:40:00.785498 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:00.785402 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4edba4af-741a-4267-b2e5-541731048617-bundle\") pod \"4edba4af-741a-4267-b2e5-541731048617\" (UID: \"4edba4af-741a-4267-b2e5-541731048617\") " Jul 08 22:40:00.786031 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:00.785997 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4edba4af-741a-4267-b2e5-541731048617-bundle" (OuterVolumeSpecName: "bundle") pod "4edba4af-741a-4267-b2e5-541731048617" (UID: "4edba4af-741a-4267-b2e5-541731048617"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:40:00.787789 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:00.787761 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4edba4af-741a-4267-b2e5-541731048617-kube-api-access-d4hkb" (OuterVolumeSpecName: "kube-api-access-d4hkb") pod "4edba4af-741a-4267-b2e5-541731048617" (UID: "4edba4af-741a-4267-b2e5-541731048617"). InnerVolumeSpecName "kube-api-access-d4hkb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:40:00.790742 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:00.790714 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4edba4af-741a-4267-b2e5-541731048617-util" (OuterVolumeSpecName: "util") pod "4edba4af-741a-4267-b2e5-541731048617" (UID: "4edba4af-741a-4267-b2e5-541731048617"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:40:00.886412 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:00.886323 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/4edba4af-741a-4267-b2e5-541731048617-util\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:40:00.886412 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:00.886352 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-d4hkb\" (UniqueName: \"kubernetes.io/projected/4edba4af-741a-4267-b2e5-541731048617-kube-api-access-d4hkb\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:40:00.886412 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:00.886361 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/4edba4af-741a-4267-b2e5-541731048617-bundle\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:40:01.592288 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:01.592256 2573 generic.go:356] "Generic (PLEG): container finished" podID="17e4d5d9-9948-457c-b6da-69617f0991fd" containerID="6cab924f76953f1d4fd15729e28446b5488d1eb4513e81aa8e2e31ef5a29accc" exitCode=0 Jul 08 22:40:01.592801 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:01.592322 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5" event={"ID":"17e4d5d9-9948-457c-b6da-69617f0991fd","Type":"ContainerDied","Data":"6cab924f76953f1d4fd15729e28446b5488d1eb4513e81aa8e2e31ef5a29accc"} Jul 08 22:40:01.594427 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:01.594404 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk" event={"ID":"4edba4af-741a-4267-b2e5-541731048617","Type":"ContainerDied","Data":"936a9b3849670a81e15f7275588a0b41a6c2973f141a4089051eb09aba3dc9f8"} Jul 08 22:40:01.594540 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:01.594440 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="936a9b3849670a81e15f7275588a0b41a6c2973f141a4089051eb09aba3dc9f8" Jul 08 22:40:01.594540 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:01.594412 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk" Jul 08 22:40:01.596641 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:01.596618 2573 generic.go:356] "Generic (PLEG): container finished" podID="56aa51ca-f677-4767-bc30-57e3f1b6765f" containerID="3847e379dd9b951b3fd2738fa94ed334eaded012541ec122e30831e89dd0b2c7" exitCode=0 Jul 08 22:40:01.596742 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:01.596664 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j" event={"ID":"56aa51ca-f677-4767-bc30-57e3f1b6765f","Type":"ContainerDied","Data":"3847e379dd9b951b3fd2738fa94ed334eaded012541ec122e30831e89dd0b2c7"} Jul 08 22:40:01.734420 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:01.734393 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w" Jul 08 22:40:01.794839 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:01.794800 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83d9d177-a817-4a7f-90ea-192dc9dbf3c1-util\") pod \"83d9d177-a817-4a7f-90ea-192dc9dbf3c1\" (UID: \"83d9d177-a817-4a7f-90ea-192dc9dbf3c1\") " Jul 08 22:40:01.794991 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:01.794898 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tgq5r\" (UniqueName: \"kubernetes.io/projected/83d9d177-a817-4a7f-90ea-192dc9dbf3c1-kube-api-access-tgq5r\") pod \"83d9d177-a817-4a7f-90ea-192dc9dbf3c1\" (UID: \"83d9d177-a817-4a7f-90ea-192dc9dbf3c1\") " Jul 08 22:40:01.794991 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:01.794944 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83d9d177-a817-4a7f-90ea-192dc9dbf3c1-bundle\") pod \"83d9d177-a817-4a7f-90ea-192dc9dbf3c1\" (UID: \"83d9d177-a817-4a7f-90ea-192dc9dbf3c1\") " Jul 08 22:40:01.795468 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:01.795428 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83d9d177-a817-4a7f-90ea-192dc9dbf3c1-bundle" (OuterVolumeSpecName: "bundle") pod "83d9d177-a817-4a7f-90ea-192dc9dbf3c1" (UID: "83d9d177-a817-4a7f-90ea-192dc9dbf3c1"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:40:01.797208 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:01.797178 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/83d9d177-a817-4a7f-90ea-192dc9dbf3c1-kube-api-access-tgq5r" (OuterVolumeSpecName: "kube-api-access-tgq5r") pod "83d9d177-a817-4a7f-90ea-192dc9dbf3c1" (UID: "83d9d177-a817-4a7f-90ea-192dc9dbf3c1"). InnerVolumeSpecName "kube-api-access-tgq5r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:40:01.799942 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:01.799919 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/83d9d177-a817-4a7f-90ea-192dc9dbf3c1-util" (OuterVolumeSpecName: "util") pod "83d9d177-a817-4a7f-90ea-192dc9dbf3c1" (UID: "83d9d177-a817-4a7f-90ea-192dc9dbf3c1"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:40:01.895709 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:01.895618 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/83d9d177-a817-4a7f-90ea-192dc9dbf3c1-util\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:40:01.895709 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:01.895651 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tgq5r\" (UniqueName: \"kubernetes.io/projected/83d9d177-a817-4a7f-90ea-192dc9dbf3c1-kube-api-access-tgq5r\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:40:01.895709 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:01.895662 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/83d9d177-a817-4a7f-90ea-192dc9dbf3c1-bundle\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:40:02.604040 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.604009 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w" Jul 08 22:40:02.604430 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.604049 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w" event={"ID":"83d9d177-a817-4a7f-90ea-192dc9dbf3c1","Type":"ContainerDied","Data":"e95ea2812e4dec0aaa195bffc522f4b2d48b2cdc002f49a2734c857c9b2d7393"} Jul 08 22:40:02.604430 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.604093 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e95ea2812e4dec0aaa195bffc522f4b2d48b2cdc002f49a2734c857c9b2d7393" Jul 08 22:40:02.740787 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.740757 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5" Jul 08 22:40:02.766945 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.766920 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j" Jul 08 22:40:02.804142 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.804102 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56aa51ca-f677-4767-bc30-57e3f1b6765f-util\") pod \"56aa51ca-f677-4767-bc30-57e3f1b6765f\" (UID: \"56aa51ca-f677-4767-bc30-57e3f1b6765f\") " Jul 08 22:40:02.804315 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.804166 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17e4d5d9-9948-457c-b6da-69617f0991fd-util\") pod \"17e4d5d9-9948-457c-b6da-69617f0991fd\" (UID: \"17e4d5d9-9948-457c-b6da-69617f0991fd\") " Jul 08 22:40:02.804315 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.804228 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56aa51ca-f677-4767-bc30-57e3f1b6765f-bundle\") pod \"56aa51ca-f677-4767-bc30-57e3f1b6765f\" (UID: \"56aa51ca-f677-4767-bc30-57e3f1b6765f\") " Jul 08 22:40:02.804315 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.804260 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pnrw9\" (UniqueName: \"kubernetes.io/projected/17e4d5d9-9948-457c-b6da-69617f0991fd-kube-api-access-pnrw9\") pod \"17e4d5d9-9948-457c-b6da-69617f0991fd\" (UID: \"17e4d5d9-9948-457c-b6da-69617f0991fd\") " Jul 08 22:40:02.804315 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.804288 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17e4d5d9-9948-457c-b6da-69617f0991fd-bundle\") pod \"17e4d5d9-9948-457c-b6da-69617f0991fd\" (UID: \"17e4d5d9-9948-457c-b6da-69617f0991fd\") " Jul 08 22:40:02.804547 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.804316 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gzbjv\" (UniqueName: \"kubernetes.io/projected/56aa51ca-f677-4767-bc30-57e3f1b6765f-kube-api-access-gzbjv\") pod \"56aa51ca-f677-4767-bc30-57e3f1b6765f\" (UID: \"56aa51ca-f677-4767-bc30-57e3f1b6765f\") " Jul 08 22:40:02.804761 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.804733 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56aa51ca-f677-4767-bc30-57e3f1b6765f-bundle" (OuterVolumeSpecName: "bundle") pod "56aa51ca-f677-4767-bc30-57e3f1b6765f" (UID: "56aa51ca-f677-4767-bc30-57e3f1b6765f"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:40:02.805191 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.805162 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17e4d5d9-9948-457c-b6da-69617f0991fd-bundle" (OuterVolumeSpecName: "bundle") pod "17e4d5d9-9948-457c-b6da-69617f0991fd" (UID: "17e4d5d9-9948-457c-b6da-69617f0991fd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:40:02.807028 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.806996 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/56aa51ca-f677-4767-bc30-57e3f1b6765f-kube-api-access-gzbjv" (OuterVolumeSpecName: "kube-api-access-gzbjv") pod "56aa51ca-f677-4767-bc30-57e3f1b6765f" (UID: "56aa51ca-f677-4767-bc30-57e3f1b6765f"). InnerVolumeSpecName "kube-api-access-gzbjv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:40:02.807189 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.807166 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/17e4d5d9-9948-457c-b6da-69617f0991fd-kube-api-access-pnrw9" (OuterVolumeSpecName: "kube-api-access-pnrw9") pod "17e4d5d9-9948-457c-b6da-69617f0991fd" (UID: "17e4d5d9-9948-457c-b6da-69617f0991fd"). InnerVolumeSpecName "kube-api-access-pnrw9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:40:02.810078 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.810039 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/56aa51ca-f677-4767-bc30-57e3f1b6765f-util" (OuterVolumeSpecName: "util") pod "56aa51ca-f677-4767-bc30-57e3f1b6765f" (UID: "56aa51ca-f677-4767-bc30-57e3f1b6765f"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:40:02.810242 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.810222 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/17e4d5d9-9948-457c-b6da-69617f0991fd-util" (OuterVolumeSpecName: "util") pod "17e4d5d9-9948-457c-b6da-69617f0991fd" (UID: "17e4d5d9-9948-457c-b6da-69617f0991fd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:40:02.905414 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.905325 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/17e4d5d9-9948-457c-b6da-69617f0991fd-util\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:40:02.905414 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.905356 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/56aa51ca-f677-4767-bc30-57e3f1b6765f-bundle\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:40:02.905414 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.905365 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pnrw9\" (UniqueName: \"kubernetes.io/projected/17e4d5d9-9948-457c-b6da-69617f0991fd-kube-api-access-pnrw9\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:40:02.905414 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.905374 2573 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/17e4d5d9-9948-457c-b6da-69617f0991fd-bundle\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:40:02.905414 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.905383 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gzbjv\" (UniqueName: \"kubernetes.io/projected/56aa51ca-f677-4767-bc30-57e3f1b6765f-kube-api-access-gzbjv\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:40:02.905414 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:02.905390 2573 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/56aa51ca-f677-4767-bc30-57e3f1b6765f-util\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:40:03.611856 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:03.611822 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j" event={"ID":"56aa51ca-f677-4767-bc30-57e3f1b6765f","Type":"ContainerDied","Data":"4f26352537d9ea561f61d7ad44df31d0a6dbe8f1c132eb7b061f5e9408f5dafb"} Jul 08 22:40:03.612253 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:03.611867 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="4f26352537d9ea561f61d7ad44df31d0a6dbe8f1c132eb7b061f5e9408f5dafb" Jul 08 22:40:03.612253 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:03.611827 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j" Jul 08 22:40:03.613788 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:03.613765 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5" event={"ID":"17e4d5d9-9948-457c-b6da-69617f0991fd","Type":"ContainerDied","Data":"e3f9fc48607b57e15d4975b12cb552b50e36847a8c2a0dd28fa63d8d55594ce9"} Jul 08 22:40:03.613788 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:03.613781 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5" Jul 08 22:40:03.613947 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:03.613805 2573 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="e3f9fc48607b57e15d4975b12cb552b50e36847a8c2a0dd28fa63d8d55594ce9" Jul 08 22:40:24.462965 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.462874 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-cbcc88b7d-kz7dz"] Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463266 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83d9d177-a817-4a7f-90ea-192dc9dbf3c1" containerName="extract" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463280 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="83d9d177-a817-4a7f-90ea-192dc9dbf3c1" containerName="extract" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463290 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17e4d5d9-9948-457c-b6da-69617f0991fd" containerName="util" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463300 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="17e4d5d9-9948-457c-b6da-69617f0991fd" containerName="util" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463310 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17e4d5d9-9948-457c-b6da-69617f0991fd" containerName="extract" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463315 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="17e4d5d9-9948-457c-b6da-69617f0991fd" containerName="extract" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463324 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83d9d177-a817-4a7f-90ea-192dc9dbf3c1" containerName="util" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463329 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="83d9d177-a817-4a7f-90ea-192dc9dbf3c1" containerName="util" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463339 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56aa51ca-f677-4767-bc30-57e3f1b6765f" containerName="util" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463344 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="56aa51ca-f677-4767-bc30-57e3f1b6765f" containerName="util" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463353 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4edba4af-741a-4267-b2e5-541731048617" containerName="pull" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463357 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4edba4af-741a-4267-b2e5-541731048617" containerName="pull" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463365 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56aa51ca-f677-4767-bc30-57e3f1b6765f" containerName="extract" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463373 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="56aa51ca-f677-4767-bc30-57e3f1b6765f" containerName="extract" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463386 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4edba4af-741a-4267-b2e5-541731048617" containerName="util" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463391 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4edba4af-741a-4267-b2e5-541731048617" containerName="util" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463395 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="83d9d177-a817-4a7f-90ea-192dc9dbf3c1" containerName="pull" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463400 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="83d9d177-a817-4a7f-90ea-192dc9dbf3c1" containerName="pull" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463407 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="56aa51ca-f677-4767-bc30-57e3f1b6765f" containerName="pull" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463411 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="56aa51ca-f677-4767-bc30-57e3f1b6765f" containerName="pull" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463417 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="17e4d5d9-9948-457c-b6da-69617f0991fd" containerName="pull" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463421 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="17e4d5d9-9948-457c-b6da-69617f0991fd" containerName="pull" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463426 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4edba4af-741a-4267-b2e5-541731048617" containerName="extract" Jul 08 22:40:24.463473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463431 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4edba4af-741a-4267-b2e5-541731048617" containerName="extract" Jul 08 22:40:24.464277 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463504 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4edba4af-741a-4267-b2e5-541731048617" containerName="extract" Jul 08 22:40:24.464277 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463511 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="17e4d5d9-9948-457c-b6da-69617f0991fd" containerName="extract" Jul 08 22:40:24.464277 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463520 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="83d9d177-a817-4a7f-90ea-192dc9dbf3c1" containerName="extract" Jul 08 22:40:24.464277 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.463529 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="56aa51ca-f677-4767-bc30-57e3f1b6765f" containerName="extract" Jul 08 22:40:24.467963 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.467938 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.479986 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.479963 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cbcc88b7d-kz7dz"] Jul 08 22:40:24.599983 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.599954 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e87b7ce-978e-4fd4-9c4c-68bd7b273953-console-oauth-config\") pod \"console-cbcc88b7d-kz7dz\" (UID: \"8e87b7ce-978e-4fd4-9c4c-68bd7b273953\") " pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.600235 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.600030 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b8mtp\" (UniqueName: \"kubernetes.io/projected/8e87b7ce-978e-4fd4-9c4c-68bd7b273953-kube-api-access-b8mtp\") pod \"console-cbcc88b7d-kz7dz\" (UID: \"8e87b7ce-978e-4fd4-9c4c-68bd7b273953\") " pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.600235 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.600053 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e87b7ce-978e-4fd4-9c4c-68bd7b273953-console-serving-cert\") pod \"console-cbcc88b7d-kz7dz\" (UID: \"8e87b7ce-978e-4fd4-9c4c-68bd7b273953\") " pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.600235 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.600079 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e87b7ce-978e-4fd4-9c4c-68bd7b273953-console-config\") pod \"console-cbcc88b7d-kz7dz\" (UID: \"8e87b7ce-978e-4fd4-9c4c-68bd7b273953\") " pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.600235 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.600149 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e87b7ce-978e-4fd4-9c4c-68bd7b273953-service-ca\") pod \"console-cbcc88b7d-kz7dz\" (UID: \"8e87b7ce-978e-4fd4-9c4c-68bd7b273953\") " pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.600235 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.600172 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e87b7ce-978e-4fd4-9c4c-68bd7b273953-trusted-ca-bundle\") pod \"console-cbcc88b7d-kz7dz\" (UID: \"8e87b7ce-978e-4fd4-9c4c-68bd7b273953\") " pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.600235 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.600192 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e87b7ce-978e-4fd4-9c4c-68bd7b273953-oauth-serving-cert\") pod \"console-cbcc88b7d-kz7dz\" (UID: \"8e87b7ce-978e-4fd4-9c4c-68bd7b273953\") " pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.701634 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.701600 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e87b7ce-978e-4fd4-9c4c-68bd7b273953-console-oauth-config\") pod \"console-cbcc88b7d-kz7dz\" (UID: \"8e87b7ce-978e-4fd4-9c4c-68bd7b273953\") " pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.701848 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.701687 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b8mtp\" (UniqueName: \"kubernetes.io/projected/8e87b7ce-978e-4fd4-9c4c-68bd7b273953-kube-api-access-b8mtp\") pod \"console-cbcc88b7d-kz7dz\" (UID: \"8e87b7ce-978e-4fd4-9c4c-68bd7b273953\") " pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.701848 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.701713 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e87b7ce-978e-4fd4-9c4c-68bd7b273953-console-serving-cert\") pod \"console-cbcc88b7d-kz7dz\" (UID: \"8e87b7ce-978e-4fd4-9c4c-68bd7b273953\") " pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.701848 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.701748 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e87b7ce-978e-4fd4-9c4c-68bd7b273953-console-config\") pod \"console-cbcc88b7d-kz7dz\" (UID: \"8e87b7ce-978e-4fd4-9c4c-68bd7b273953\") " pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.701848 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.701786 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e87b7ce-978e-4fd4-9c4c-68bd7b273953-service-ca\") pod \"console-cbcc88b7d-kz7dz\" (UID: \"8e87b7ce-978e-4fd4-9c4c-68bd7b273953\") " pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.701848 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.701811 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e87b7ce-978e-4fd4-9c4c-68bd7b273953-trusted-ca-bundle\") pod \"console-cbcc88b7d-kz7dz\" (UID: \"8e87b7ce-978e-4fd4-9c4c-68bd7b273953\") " pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.701848 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.701836 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e87b7ce-978e-4fd4-9c4c-68bd7b273953-oauth-serving-cert\") pod \"console-cbcc88b7d-kz7dz\" (UID: \"8e87b7ce-978e-4fd4-9c4c-68bd7b273953\") " pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.702583 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.702537 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/8e87b7ce-978e-4fd4-9c4c-68bd7b273953-oauth-serving-cert\") pod \"console-cbcc88b7d-kz7dz\" (UID: \"8e87b7ce-978e-4fd4-9c4c-68bd7b273953\") " pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.702583 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.702543 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/8e87b7ce-978e-4fd4-9c4c-68bd7b273953-console-config\") pod \"console-cbcc88b7d-kz7dz\" (UID: \"8e87b7ce-978e-4fd4-9c4c-68bd7b273953\") " pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.702807 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.702783 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/8e87b7ce-978e-4fd4-9c4c-68bd7b273953-service-ca\") pod \"console-cbcc88b7d-kz7dz\" (UID: \"8e87b7ce-978e-4fd4-9c4c-68bd7b273953\") " pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.702991 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.702968 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/8e87b7ce-978e-4fd4-9c4c-68bd7b273953-trusted-ca-bundle\") pod \"console-cbcc88b7d-kz7dz\" (UID: \"8e87b7ce-978e-4fd4-9c4c-68bd7b273953\") " pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.704374 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.704351 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/8e87b7ce-978e-4fd4-9c4c-68bd7b273953-console-oauth-config\") pod \"console-cbcc88b7d-kz7dz\" (UID: \"8e87b7ce-978e-4fd4-9c4c-68bd7b273953\") " pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.704532 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.704514 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/8e87b7ce-978e-4fd4-9c4c-68bd7b273953-console-serving-cert\") pod \"console-cbcc88b7d-kz7dz\" (UID: \"8e87b7ce-978e-4fd4-9c4c-68bd7b273953\") " pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.709634 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.709612 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b8mtp\" (UniqueName: \"kubernetes.io/projected/8e87b7ce-978e-4fd4-9c4c-68bd7b273953-kube-api-access-b8mtp\") pod \"console-cbcc88b7d-kz7dz\" (UID: \"8e87b7ce-978e-4fd4-9c4c-68bd7b273953\") " pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.778581 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.778513 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:24.917425 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:24.917391 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-cbcc88b7d-kz7dz"] Jul 08 22:40:24.919447 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:40:24.919418 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8e87b7ce_978e_4fd4_9c4c_68bd7b273953.slice/crio-4823488d13488e602a77af328a18b30535777a9053bc005323a10c947219280a WatchSource:0}: Error finding container 4823488d13488e602a77af328a18b30535777a9053bc005323a10c947219280a: Status 404 returned error can't find the container with id 4823488d13488e602a77af328a18b30535777a9053bc005323a10c947219280a Jul 08 22:40:25.732094 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:25.732052 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cbcc88b7d-kz7dz" event={"ID":"8e87b7ce-978e-4fd4-9c4c-68bd7b273953","Type":"ContainerStarted","Data":"1c42c9a67b472d27662e352629a481fef0a83ed0543676f9ad550321a49ef11d"} Jul 08 22:40:25.732483 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:25.732107 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-cbcc88b7d-kz7dz" event={"ID":"8e87b7ce-978e-4fd4-9c4c-68bd7b273953","Type":"ContainerStarted","Data":"4823488d13488e602a77af328a18b30535777a9053bc005323a10c947219280a"} Jul 08 22:40:25.751247 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:25.751190 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-cbcc88b7d-kz7dz" podStartSLOduration=1.7511717610000002 podStartE2EDuration="1.751171761s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:40:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:40:25.750428751 +0000 UTC m=+636.089135768" watchObservedRunningTime="2026-07-08 22:40:25.751171761 +0000 UTC m=+636.089878734" Jul 08 22:40:34.778946 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:34.778907 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:34.779443 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:34.778977 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:34.783744 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:34.783704 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:34.852921 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:34.852889 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z454c"] Jul 08 22:40:34.856707 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:34.856670 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z454c" Jul 08 22:40:34.859058 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:34.859038 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 08 22:40:34.859186 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:34.859071 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 08 22:40:34.859186 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:34.859097 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"limitador-operator-controller-manager-dockercfg-chtgj\"" Jul 08 22:40:34.869486 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:34.869459 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z454c"] Jul 08 22:40:34.891235 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:34.891200 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c6xlw\" (UniqueName: \"kubernetes.io/projected/585d2c5a-237e-4347-a9c1-ec1e869ec56c-kube-api-access-c6xlw\") pod \"limitador-operator-controller-manager-859d7b78bd-z454c\" (UID: \"585d2c5a-237e-4347-a9c1-ec1e869ec56c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z454c" Jul 08 22:40:34.991924 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:34.991887 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c6xlw\" (UniqueName: \"kubernetes.io/projected/585d2c5a-237e-4347-a9c1-ec1e869ec56c-kube-api-access-c6xlw\") pod \"limitador-operator-controller-manager-859d7b78bd-z454c\" (UID: \"585d2c5a-237e-4347-a9c1-ec1e869ec56c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z454c" Jul 08 22:40:35.000488 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:35.000453 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-c6xlw\" (UniqueName: \"kubernetes.io/projected/585d2c5a-237e-4347-a9c1-ec1e869ec56c-kube-api-access-c6xlw\") pod \"limitador-operator-controller-manager-859d7b78bd-z454c\" (UID: \"585d2c5a-237e-4347-a9c1-ec1e869ec56c\") " pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z454c" Jul 08 22:40:35.170173 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:35.170082 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z454c" Jul 08 22:40:35.308310 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:35.308277 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z454c"] Jul 08 22:40:35.312295 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:40:35.312216 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod585d2c5a_237e_4347_a9c1_ec1e869ec56c.slice/crio-cc65f18b6fc4c4cc49b1294193ce36bf07a6ab8c30e28271e8764bf6ffddb48a WatchSource:0}: Error finding container cc65f18b6fc4c4cc49b1294193ce36bf07a6ab8c30e28271e8764bf6ffddb48a: Status 404 returned error can't find the container with id cc65f18b6fc4c4cc49b1294193ce36bf07a6ab8c30e28271e8764bf6ffddb48a Jul 08 22:40:35.782465 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:35.782426 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z454c" event={"ID":"585d2c5a-237e-4347-a9c1-ec1e869ec56c","Type":"ContainerStarted","Data":"cc65f18b6fc4c4cc49b1294193ce36bf07a6ab8c30e28271e8764bf6ffddb48a"} Jul 08 22:40:35.786407 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:35.786385 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-cbcc88b7d-kz7dz" Jul 08 22:40:35.842933 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:35.842901 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d6768c7cf-kwpcz"] Jul 08 22:40:37.795519 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:37.795482 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z454c" event={"ID":"585d2c5a-237e-4347-a9c1-ec1e869ec56c","Type":"ContainerStarted","Data":"47b4a9b8b69ade61e91a2a9e3bc6bfebb946c33e8a7cfe39994ae01754d061fb"} Jul 08 22:40:37.795942 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:37.795590 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z454c" Jul 08 22:40:37.819075 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:37.819025 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z454c" podStartSLOduration=2.055067771 podStartE2EDuration="3.819008059s" totalImagesPullingTime="1.763940288s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:40:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:40:37.818469061 +0000 UTC m=+648.157176035" watchObservedRunningTime="2026-07-08 22:40:37.819008059 +0000 UTC m=+648.157715034" Jul 08 22:40:48.803462 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:40:48.803426 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-operator-controller-manager-859d7b78bd-z454c" Jul 08 22:41:00.866983 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:00.866924 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-console/console-6d6768c7cf-kwpcz" podUID="fe0074ac-0c56-4c93-917e-2fd2f31106c7" containerName="console" containerID="cri-o://5fa3cd9c8388462b191cf1cbff460915cf8d78a7731ce70cce1a8903c799cb4b" gracePeriod=15 Jul 08 22:41:01.114472 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.114440 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:41:01.242253 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.242217 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-trusted-ca-bundle\") pod \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " Jul 08 22:41:01.242253 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.242259 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-console-config\") pod \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " Jul 08 22:41:01.242518 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.242294 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-oauth-serving-cert\") pod \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " Jul 08 22:41:01.242518 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.242330 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe0074ac-0c56-4c93-917e-2fd2f31106c7-console-serving-cert\") pod \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " Jul 08 22:41:01.242518 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.242385 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe0074ac-0c56-4c93-917e-2fd2f31106c7-console-oauth-config\") pod \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " Jul 08 22:41:01.242518 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.242421 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-service-ca\") pod \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " Jul 08 22:41:01.242518 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.242454 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qgqv4\" (UniqueName: \"kubernetes.io/projected/fe0074ac-0c56-4c93-917e-2fd2f31106c7-kube-api-access-qgqv4\") pod \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\" (UID: \"fe0074ac-0c56-4c93-917e-2fd2f31106c7\") " Jul 08 22:41:01.242814 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.242746 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "fe0074ac-0c56-4c93-917e-2fd2f31106c7" (UID: "fe0074ac-0c56-4c93-917e-2fd2f31106c7"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:41:01.242814 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.242787 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "fe0074ac-0c56-4c93-917e-2fd2f31106c7" (UID: "fe0074ac-0c56-4c93-917e-2fd2f31106c7"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:41:01.242905 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.242717 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-console-config" (OuterVolumeSpecName: "console-config") pod "fe0074ac-0c56-4c93-917e-2fd2f31106c7" (UID: "fe0074ac-0c56-4c93-917e-2fd2f31106c7"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:41:01.242949 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.242930 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-service-ca" (OuterVolumeSpecName: "service-ca") pod "fe0074ac-0c56-4c93-917e-2fd2f31106c7" (UID: "fe0074ac-0c56-4c93-917e-2fd2f31106c7"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:41:01.244771 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.244745 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe0074ac-0c56-4c93-917e-2fd2f31106c7-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "fe0074ac-0c56-4c93-917e-2fd2f31106c7" (UID: "fe0074ac-0c56-4c93-917e-2fd2f31106c7"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:41:01.244771 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.244758 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/fe0074ac-0c56-4c93-917e-2fd2f31106c7-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "fe0074ac-0c56-4c93-917e-2fd2f31106c7" (UID: "fe0074ac-0c56-4c93-917e-2fd2f31106c7"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:41:01.244771 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.244765 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe0074ac-0c56-4c93-917e-2fd2f31106c7-kube-api-access-qgqv4" (OuterVolumeSpecName: "kube-api-access-qgqv4") pod "fe0074ac-0c56-4c93-917e-2fd2f31106c7" (UID: "fe0074ac-0c56-4c93-917e-2fd2f31106c7"). InnerVolumeSpecName "kube-api-access-qgqv4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:41:01.343813 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.343776 2573 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/fe0074ac-0c56-4c93-917e-2fd2f31106c7-console-serving-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:41:01.343813 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.343805 2573 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/fe0074ac-0c56-4c93-917e-2fd2f31106c7-console-oauth-config\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:41:01.343813 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.343814 2573 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-service-ca\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:41:01.343813 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.343824 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qgqv4\" (UniqueName: \"kubernetes.io/projected/fe0074ac-0c56-4c93-917e-2fd2f31106c7-kube-api-access-qgqv4\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:41:01.344079 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.343832 2573 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-trusted-ca-bundle\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:41:01.344079 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.343841 2573 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-console-config\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:41:01.344079 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.343849 2573 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/fe0074ac-0c56-4c93-917e-2fd2f31106c7-oauth-serving-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:41:01.917498 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.917455 2573 generic.go:356] "Generic (PLEG): container finished" podID="fe0074ac-0c56-4c93-917e-2fd2f31106c7" containerID="5fa3cd9c8388462b191cf1cbff460915cf8d78a7731ce70cce1a8903c799cb4b" exitCode=0 Jul 08 22:41:01.917498 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.917493 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6d6768c7cf-kwpcz" Jul 08 22:41:01.918019 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.917521 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6768c7cf-kwpcz" event={"ID":"fe0074ac-0c56-4c93-917e-2fd2f31106c7","Type":"ContainerDied","Data":"5fa3cd9c8388462b191cf1cbff460915cf8d78a7731ce70cce1a8903c799cb4b"} Jul 08 22:41:01.918019 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.917608 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6d6768c7cf-kwpcz" event={"ID":"fe0074ac-0c56-4c93-917e-2fd2f31106c7","Type":"ContainerDied","Data":"4ca0caffd515ea7f46a802d6e7133f6b0081d2d21aefe5f16db89b5db711798d"} Jul 08 22:41:01.918019 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.917639 2573 scope.go:117] "RemoveContainer" containerID="5fa3cd9c8388462b191cf1cbff460915cf8d78a7731ce70cce1a8903c799cb4b" Jul 08 22:41:01.928092 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.928075 2573 scope.go:117] "RemoveContainer" containerID="5fa3cd9c8388462b191cf1cbff460915cf8d78a7731ce70cce1a8903c799cb4b" Jul 08 22:41:01.928393 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:41:01.928374 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5fa3cd9c8388462b191cf1cbff460915cf8d78a7731ce70cce1a8903c799cb4b\": container with ID starting with 5fa3cd9c8388462b191cf1cbff460915cf8d78a7731ce70cce1a8903c799cb4b not found: ID does not exist" containerID="5fa3cd9c8388462b191cf1cbff460915cf8d78a7731ce70cce1a8903c799cb4b" Jul 08 22:41:01.928438 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.928404 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5fa3cd9c8388462b191cf1cbff460915cf8d78a7731ce70cce1a8903c799cb4b"} err="failed to get container status \"5fa3cd9c8388462b191cf1cbff460915cf8d78a7731ce70cce1a8903c799cb4b\": rpc error: code = NotFound desc = could not find container \"5fa3cd9c8388462b191cf1cbff460915cf8d78a7731ce70cce1a8903c799cb4b\": container with ID starting with 5fa3cd9c8388462b191cf1cbff460915cf8d78a7731ce70cce1a8903c799cb4b not found: ID does not exist" Jul 08 22:41:01.940473 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.940446 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6d6768c7cf-kwpcz"] Jul 08 22:41:01.944363 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:01.944339 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6d6768c7cf-kwpcz"] Jul 08 22:41:02.182915 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:02.182837 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe0074ac-0c56-4c93-917e-2fd2f31106c7" path="/var/lib/kubelet/pods/fe0074ac-0c56-4c93-917e-2fd2f31106c7/volumes" Jul 08 22:41:15.600528 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.600491 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq"] Jul 08 22:41:15.600982 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.600844 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe0074ac-0c56-4c93-917e-2fd2f31106c7" containerName="console" Jul 08 22:41:15.600982 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.600855 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe0074ac-0c56-4c93-917e-2fd2f31106c7" containerName="console" Jul 08 22:41:15.600982 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.600921 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe0074ac-0c56-4c93-917e-2fd2f31106c7" containerName="console" Jul 08 22:41:15.603934 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.603917 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.606547 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.606518 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 08 22:41:15.606972 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.606956 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 08 22:41:15.607125 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.607109 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 08 22:41:15.607511 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.607494 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-4vlxt\"" Jul 08 22:41:15.618987 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.618963 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq"] Jul 08 22:41:15.677633 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.677590 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/836f886d-cb79-47df-91e5-9f9a276c79cc-workload-socket\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.677819 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.677658 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/836f886d-cb79-47df-91e5-9f9a276c79cc-credential-socket\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.677819 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.677685 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/836f886d-cb79-47df-91e5-9f9a276c79cc-workload-certs\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.677819 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.677750 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4w8k\" (UniqueName: \"kubernetes.io/projected/836f886d-cb79-47df-91e5-9f9a276c79cc-kube-api-access-t4w8k\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.677819 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.677775 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/836f886d-cb79-47df-91e5-9f9a276c79cc-istio-token\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.677819 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.677804 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/836f886d-cb79-47df-91e5-9f9a276c79cc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.678017 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.677843 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/836f886d-cb79-47df-91e5-9f9a276c79cc-istio-data\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.678017 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.677867 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/836f886d-cb79-47df-91e5-9f9a276c79cc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.678017 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.677914 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/836f886d-cb79-47df-91e5-9f9a276c79cc-istio-envoy\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.778298 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.778258 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4w8k\" (UniqueName: \"kubernetes.io/projected/836f886d-cb79-47df-91e5-9f9a276c79cc-kube-api-access-t4w8k\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.778298 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.778298 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/836f886d-cb79-47df-91e5-9f9a276c79cc-istio-token\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.778955 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.778335 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/836f886d-cb79-47df-91e5-9f9a276c79cc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.778955 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.778379 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/836f886d-cb79-47df-91e5-9f9a276c79cc-istio-data\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.778955 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.778401 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/836f886d-cb79-47df-91e5-9f9a276c79cc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.778955 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.778457 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/836f886d-cb79-47df-91e5-9f9a276c79cc-istio-envoy\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.778955 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.778484 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/836f886d-cb79-47df-91e5-9f9a276c79cc-workload-socket\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.778955 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.778542 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/836f886d-cb79-47df-91e5-9f9a276c79cc-credential-socket\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.778955 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.778603 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/836f886d-cb79-47df-91e5-9f9a276c79cc-workload-certs\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.778955 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.778909 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/836f886d-cb79-47df-91e5-9f9a276c79cc-istio-data\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.779232 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.778987 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/836f886d-cb79-47df-91e5-9f9a276c79cc-credential-socket\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.779232 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.779033 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/836f886d-cb79-47df-91e5-9f9a276c79cc-workload-socket\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.779232 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.779156 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/836f886d-cb79-47df-91e5-9f9a276c79cc-workload-certs\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.779232 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.779202 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/836f886d-cb79-47df-91e5-9f9a276c79cc-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.781039 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.781017 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/836f886d-cb79-47df-91e5-9f9a276c79cc-istio-envoy\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.781112 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.781096 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/836f886d-cb79-47df-91e5-9f9a276c79cc-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.789315 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.789289 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/836f886d-cb79-47df-91e5-9f9a276c79cc-istio-token\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.789315 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.789307 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4w8k\" (UniqueName: \"kubernetes.io/projected/836f886d-cb79-47df-91e5-9f9a276c79cc-kube-api-access-t4w8k\") pod \"maas-default-gateway-openshift-default-5d7b8c9489-fsrbq\" (UID: \"836f886d-cb79-47df-91e5-9f9a276c79cc\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:15.914255 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:15.914161 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:16.083171 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:16.083145 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq"] Jul 08 22:41:16.085308 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:41:16.085282 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod836f886d_cb79_47df_91e5_9f9a276c79cc.slice/crio-0bd85effbc89797feef287d150db5716cbacb33927e885fcbc7bf6c39687228e WatchSource:0}: Error finding container 0bd85effbc89797feef287d150db5716cbacb33927e885fcbc7bf6c39687228e: Status 404 returned error can't find the container with id 0bd85effbc89797feef287d150db5716cbacb33927e885fcbc7bf6c39687228e Jul 08 22:41:16.087941 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:16.087904 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 22:41:16.088013 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:16.087989 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 22:41:16.088059 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:16.088019 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 22:41:17.002050 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:17.002015 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" event={"ID":"836f886d-cb79-47df-91e5-9f9a276c79cc","Type":"ContainerStarted","Data":"ddb10140ffe306e8f8075a5798f6474508e64c3965837073ac0f4ce2e5c8337d"} Jul 08 22:41:17.002502 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:17.002071 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" event={"ID":"836f886d-cb79-47df-91e5-9f9a276c79cc","Type":"ContainerStarted","Data":"0bd85effbc89797feef287d150db5716cbacb33927e885fcbc7bf6c39687228e"} Jul 08 22:41:17.025714 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:17.025663 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" podStartSLOduration=2.025647432 podStartE2EDuration="2.025647432s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:41:15 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:41:17.024017262 +0000 UTC m=+687.362724230" watchObservedRunningTime="2026-07-08 22:41:17.025647432 +0000 UTC m=+687.364354478" Jul 08 22:41:17.914549 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:17.914509 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:17.919374 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:17.919347 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:18.007425 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:18.007395 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:18.008572 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:18.008538 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:41:18.840804 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:18.840771 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-wndbj"] Jul 08 22:41:18.844360 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:18.844336 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wndbj" Jul 08 22:41:18.847425 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:18.847403 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lmnjk\"" Jul 08 22:41:18.852506 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:18.852272 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wndbj"] Jul 08 22:41:18.902603 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:18.902573 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nlcfw\" (UniqueName: \"kubernetes.io/projected/ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9-kube-api-access-nlcfw\") pod \"authorino-58cd955675-wndbj\" (UID: \"ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9\") " pod="kuadrant-system/authorino-58cd955675-wndbj" Jul 08 22:41:19.003652 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:19.003617 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nlcfw\" (UniqueName: \"kubernetes.io/projected/ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9-kube-api-access-nlcfw\") pod \"authorino-58cd955675-wndbj\" (UID: \"ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9\") " pod="kuadrant-system/authorino-58cd955675-wndbj" Jul 08 22:41:19.016064 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:19.016031 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-nlcfw\" (UniqueName: \"kubernetes.io/projected/ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9-kube-api-access-nlcfw\") pod \"authorino-58cd955675-wndbj\" (UID: \"ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9\") " pod="kuadrant-system/authorino-58cd955675-wndbj" Jul 08 22:41:19.154799 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:19.154709 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wndbj" Jul 08 22:41:19.291615 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:19.291589 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-wndbj"] Jul 08 22:41:19.293407 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:41:19.293376 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podef33bdc7_09ab_4afe_b567_e1de7ccc7ed9.slice/crio-ba4e9282ed4d819228976e06748f612a2829b6204e440d4cd39d054ddd085377 WatchSource:0}: Error finding container ba4e9282ed4d819228976e06748f612a2829b6204e440d4cd39d054ddd085377: Status 404 returned error can't find the container with id ba4e9282ed4d819228976e06748f612a2829b6204e440d4cd39d054ddd085377 Jul 08 22:41:20.018616 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:20.018582 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wndbj" event={"ID":"ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9","Type":"ContainerStarted","Data":"ba4e9282ed4d819228976e06748f612a2829b6204e440d4cd39d054ddd085377"} Jul 08 22:41:23.042538 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:23.042494 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wndbj" event={"ID":"ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9","Type":"ContainerStarted","Data":"61cfd428f82703b7b4ced703506f2d5d9888eed21fdb4d3b2e3cc175503a4167"} Jul 08 22:41:23.058733 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:23.058676 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-wndbj" podStartSLOduration=1.703440557 podStartE2EDuration="5.058657022s" totalImagesPullingTime="3.355216465s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:41:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:41:23.057938439 +0000 UTC m=+693.396645413" watchObservedRunningTime="2026-07-08 22:41:23.058657022 +0000 UTC m=+693.397363994" Jul 08 22:41:24.435491 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:24.435455 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wndbj"] Jul 08 22:41:25.054076 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:25.054033 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-wndbj" podUID="ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9" containerName="authorino" containerID="cri-o://61cfd428f82703b7b4ced703506f2d5d9888eed21fdb4d3b2e3cc175503a4167" gracePeriod=30 Jul 08 22:41:25.303675 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:25.303652 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wndbj" Jul 08 22:41:25.350613 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:25.350491 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nlcfw\" (UniqueName: \"kubernetes.io/projected/ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9-kube-api-access-nlcfw\") pod \"ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9\" (UID: \"ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9\") " Jul 08 22:41:25.352658 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:25.352635 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9-kube-api-access-nlcfw" (OuterVolumeSpecName: "kube-api-access-nlcfw") pod "ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9" (UID: "ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9"). InnerVolumeSpecName "kube-api-access-nlcfw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:41:25.451369 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:25.451333 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nlcfw\" (UniqueName: \"kubernetes.io/projected/ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9-kube-api-access-nlcfw\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:41:26.061370 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:26.061331 2573 generic.go:356] "Generic (PLEG): container finished" podID="ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9" containerID="61cfd428f82703b7b4ced703506f2d5d9888eed21fdb4d3b2e3cc175503a4167" exitCode=0 Jul 08 22:41:26.061594 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:26.061377 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-wndbj" Jul 08 22:41:26.061594 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:26.061419 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wndbj" event={"ID":"ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9","Type":"ContainerDied","Data":"61cfd428f82703b7b4ced703506f2d5d9888eed21fdb4d3b2e3cc175503a4167"} Jul 08 22:41:26.061594 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:26.061470 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-wndbj" event={"ID":"ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9","Type":"ContainerDied","Data":"ba4e9282ed4d819228976e06748f612a2829b6204e440d4cd39d054ddd085377"} Jul 08 22:41:26.061594 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:26.061493 2573 scope.go:117] "RemoveContainer" containerID="61cfd428f82703b7b4ced703506f2d5d9888eed21fdb4d3b2e3cc175503a4167" Jul 08 22:41:26.071350 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:26.071315 2573 scope.go:117] "RemoveContainer" containerID="61cfd428f82703b7b4ced703506f2d5d9888eed21fdb4d3b2e3cc175503a4167" Jul 08 22:41:26.071642 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:41:26.071622 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"61cfd428f82703b7b4ced703506f2d5d9888eed21fdb4d3b2e3cc175503a4167\": container with ID starting with 61cfd428f82703b7b4ced703506f2d5d9888eed21fdb4d3b2e3cc175503a4167 not found: ID does not exist" containerID="61cfd428f82703b7b4ced703506f2d5d9888eed21fdb4d3b2e3cc175503a4167" Jul 08 22:41:26.071715 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:26.071651 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"61cfd428f82703b7b4ced703506f2d5d9888eed21fdb4d3b2e3cc175503a4167"} err="failed to get container status \"61cfd428f82703b7b4ced703506f2d5d9888eed21fdb4d3b2e3cc175503a4167\": rpc error: code = NotFound desc = could not find container \"61cfd428f82703b7b4ced703506f2d5d9888eed21fdb4d3b2e3cc175503a4167\": container with ID starting with 61cfd428f82703b7b4ced703506f2d5d9888eed21fdb4d3b2e3cc175503a4167 not found: ID does not exist" Jul 08 22:41:26.082441 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:26.082417 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-wndbj"] Jul 08 22:41:26.085961 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:26.085939 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-wndbj"] Jul 08 22:41:26.183926 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:26.183892 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9" path="/var/lib/kubelet/pods/ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9/volumes" Jul 08 22:41:39.679881 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:39.679846 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xm8p7"] Jul 08 22:41:39.680272 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:39.680192 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9" containerName="authorino" Jul 08 22:41:39.680272 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:39.680203 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9" containerName="authorino" Jul 08 22:41:39.680272 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:39.680260 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef33bdc7-09ab-4afe-b567-e1de7ccc7ed9" containerName="authorino" Jul 08 22:41:39.684747 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:39.684723 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xm8p7" Jul 08 22:41:39.687546 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:39.687520 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 08 22:41:39.687694 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:39.687530 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-splk4\"" Jul 08 22:41:39.688695 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:39.688674 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 08 22:41:39.688807 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:39.688675 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 08 22:41:39.692218 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:39.692193 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xm8p7"] Jul 08 22:41:39.772638 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:39.772597 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-spvx6\" (UniqueName: \"kubernetes.io/projected/aa9338d1-d4fe-46f8-a024-d4d5ceb0b63c-kube-api-access-spvx6\") pod \"postgres-69fb4594cf-xm8p7\" (UID: \"aa9338d1-d4fe-46f8-a024-d4d5ceb0b63c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xm8p7" Jul 08 22:41:39.772821 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:39.772674 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aa9338d1-d4fe-46f8-a024-d4d5ceb0b63c-data\") pod \"postgres-69fb4594cf-xm8p7\" (UID: \"aa9338d1-d4fe-46f8-a024-d4d5ceb0b63c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xm8p7" Jul 08 22:41:39.874102 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:39.874052 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-spvx6\" (UniqueName: \"kubernetes.io/projected/aa9338d1-d4fe-46f8-a024-d4d5ceb0b63c-kube-api-access-spvx6\") pod \"postgres-69fb4594cf-xm8p7\" (UID: \"aa9338d1-d4fe-46f8-a024-d4d5ceb0b63c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xm8p7" Jul 08 22:41:39.874287 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:39.874117 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aa9338d1-d4fe-46f8-a024-d4d5ceb0b63c-data\") pod \"postgres-69fb4594cf-xm8p7\" (UID: \"aa9338d1-d4fe-46f8-a024-d4d5ceb0b63c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xm8p7" Jul 08 22:41:39.874449 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:39.874434 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/aa9338d1-d4fe-46f8-a024-d4d5ceb0b63c-data\") pod \"postgres-69fb4594cf-xm8p7\" (UID: \"aa9338d1-d4fe-46f8-a024-d4d5ceb0b63c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xm8p7" Jul 08 22:41:39.883586 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:39.883517 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-spvx6\" (UniqueName: \"kubernetes.io/projected/aa9338d1-d4fe-46f8-a024-d4d5ceb0b63c-kube-api-access-spvx6\") pod \"postgres-69fb4594cf-xm8p7\" (UID: \"aa9338d1-d4fe-46f8-a024-d4d5ceb0b63c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-xm8p7" Jul 08 22:41:39.997631 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:39.997592 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xm8p7" Jul 08 22:41:40.139725 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:40.139699 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-xm8p7"] Jul 08 22:41:40.142208 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:41:40.142181 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa9338d1_d4fe_46f8_a024_d4d5ceb0b63c.slice/crio-0ea971ba03084373dc291a9aa57b4bc515975e96983aad7f67bc6e3e3cc8ed78 WatchSource:0}: Error finding container 0ea971ba03084373dc291a9aa57b4bc515975e96983aad7f67bc6e3e3cc8ed78: Status 404 returned error can't find the container with id 0ea971ba03084373dc291a9aa57b4bc515975e96983aad7f67bc6e3e3cc8ed78 Jul 08 22:41:41.149714 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:41.149655 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xm8p7" event={"ID":"aa9338d1-d4fe-46f8-a024-d4d5ceb0b63c","Type":"ContainerStarted","Data":"0ea971ba03084373dc291a9aa57b4bc515975e96983aad7f67bc6e3e3cc8ed78"} Jul 08 22:41:46.183375 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:46.183344 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xm8p7" event={"ID":"aa9338d1-d4fe-46f8-a024-d4d5ceb0b63c","Type":"ContainerStarted","Data":"bf45fead1b222a6dfc95032b0dfc2e406911bc2632c5d2907e1dffc2ddaefaee"} Jul 08 22:41:46.183786 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:46.183457 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xm8p7" Jul 08 22:41:46.202607 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:46.202530 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xm8p7" podStartSLOduration=2.198165516 podStartE2EDuration="7.202514998s" totalImagesPullingTime="5.004349482s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:41:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:41:46.201899099 +0000 UTC m=+716.540606072" watchObservedRunningTime="2026-07-08 22:41:46.202514998 +0000 UTC m=+716.541221970" Jul 08 22:41:52.218943 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:52.218914 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-xm8p7" Jul 08 22:41:59.108320 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:59.108280 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-678658b869-mrjsj"] Jul 08 22:41:59.127681 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:59.127638 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-678658b869-mrjsj" Jul 08 22:41:59.128822 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:59.128795 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-678658b869-mrjsj"] Jul 08 22:41:59.132776 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:59.132753 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 08 22:41:59.132929 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:59.132779 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 08 22:41:59.132929 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:59.132784 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-nqptr\"" Jul 08 22:41:59.249295 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:59.249262 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86271000-4e29-4539-ab4a-6000420eb57d-webhook-cert\") pod \"maas-controller-678658b869-mrjsj\" (UID: \"86271000-4e29-4539-ab4a-6000420eb57d\") " pod="opendatahub/maas-controller-678658b869-mrjsj" Jul 08 22:41:59.249504 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:59.249424 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-96qch\" (UniqueName: \"kubernetes.io/projected/86271000-4e29-4539-ab4a-6000420eb57d-kube-api-access-96qch\") pod \"maas-controller-678658b869-mrjsj\" (UID: \"86271000-4e29-4539-ab4a-6000420eb57d\") " pod="opendatahub/maas-controller-678658b869-mrjsj" Jul 08 22:41:59.350141 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:59.350102 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-96qch\" (UniqueName: \"kubernetes.io/projected/86271000-4e29-4539-ab4a-6000420eb57d-kube-api-access-96qch\") pod \"maas-controller-678658b869-mrjsj\" (UID: \"86271000-4e29-4539-ab4a-6000420eb57d\") " pod="opendatahub/maas-controller-678658b869-mrjsj" Jul 08 22:41:59.350325 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:59.350173 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86271000-4e29-4539-ab4a-6000420eb57d-webhook-cert\") pod \"maas-controller-678658b869-mrjsj\" (UID: \"86271000-4e29-4539-ab4a-6000420eb57d\") " pod="opendatahub/maas-controller-678658b869-mrjsj" Jul 08 22:41:59.352804 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:59.352783 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86271000-4e29-4539-ab4a-6000420eb57d-webhook-cert\") pod \"maas-controller-678658b869-mrjsj\" (UID: \"86271000-4e29-4539-ab4a-6000420eb57d\") " pod="opendatahub/maas-controller-678658b869-mrjsj" Jul 08 22:41:59.362008 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:59.361940 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-96qch\" (UniqueName: \"kubernetes.io/projected/86271000-4e29-4539-ab4a-6000420eb57d-kube-api-access-96qch\") pod \"maas-controller-678658b869-mrjsj\" (UID: \"86271000-4e29-4539-ab4a-6000420eb57d\") " pod="opendatahub/maas-controller-678658b869-mrjsj" Jul 08 22:41:59.439972 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:59.439923 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-678658b869-mrjsj" Jul 08 22:41:59.583949 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:41:59.583923 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-678658b869-mrjsj"] Jul 08 22:41:59.585421 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:41:59.585393 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod86271000_4e29_4539_ab4a_6000420eb57d.slice/crio-4a3060d7d344ce0126855b23ee0c5106375590678e29fbd4e63328ce3c36ed95 WatchSource:0}: Error finding container 4a3060d7d344ce0126855b23ee0c5106375590678e29fbd4e63328ce3c36ed95: Status 404 returned error can't find the container with id 4a3060d7d344ce0126855b23ee0c5106375590678e29fbd4e63328ce3c36ed95 Jul 08 22:42:00.261893 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:00.261853 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-678658b869-mrjsj" event={"ID":"86271000-4e29-4539-ab4a-6000420eb57d","Type":"ContainerStarted","Data":"4a3060d7d344ce0126855b23ee0c5106375590678e29fbd4e63328ce3c36ed95"} Jul 08 22:42:02.276156 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:02.276119 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-678658b869-mrjsj" event={"ID":"86271000-4e29-4539-ab4a-6000420eb57d","Type":"ContainerStarted","Data":"231a76d3c050211b9f4a89b3647da7afd10be39071c2f837c2b5224cfd0dff4a"} Jul 08 22:42:02.276590 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:02.276187 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-678658b869-mrjsj" Jul 08 22:42:02.298391 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:02.298335 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-678658b869-mrjsj" podStartSLOduration=1.204367674 podStartE2EDuration="3.298318347s" totalImagesPullingTime="2.093950673s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:41:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:42:02.296382249 +0000 UTC m=+732.635089238" watchObservedRunningTime="2026-07-08 22:42:02.298318347 +0000 UTC m=+732.637025319" Jul 08 22:42:13.287688 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:13.287658 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-678658b869-mrjsj" Jul 08 22:42:36.050579 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:36.050522 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-m7xp8"] Jul 08 22:42:36.053835 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:36.053813 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-m7xp8" Jul 08 22:42:36.056270 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:36.056250 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 08 22:42:36.067962 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:36.067940 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-m7xp8"] Jul 08 22:42:36.179290 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:36.179257 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bb174de-58d5-4694-a615-7325f2d9d7ae-plugins-config-volume\") pod \"payload-processing-58f86c7798-m7xp8\" (UID: \"9bb174de-58d5-4694-a615-7325f2d9d7ae\") " pod="openshift-ingress/payload-processing-58f86c7798-m7xp8" Jul 08 22:42:36.179481 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:36.179298 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsvzf\" (UniqueName: \"kubernetes.io/projected/9bb174de-58d5-4694-a615-7325f2d9d7ae-kube-api-access-bsvzf\") pod \"payload-processing-58f86c7798-m7xp8\" (UID: \"9bb174de-58d5-4694-a615-7325f2d9d7ae\") " pod="openshift-ingress/payload-processing-58f86c7798-m7xp8" Jul 08 22:42:36.280430 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:36.280395 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bb174de-58d5-4694-a615-7325f2d9d7ae-plugins-config-volume\") pod \"payload-processing-58f86c7798-m7xp8\" (UID: \"9bb174de-58d5-4694-a615-7325f2d9d7ae\") " pod="openshift-ingress/payload-processing-58f86c7798-m7xp8" Jul 08 22:42:36.280430 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:36.280436 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsvzf\" (UniqueName: \"kubernetes.io/projected/9bb174de-58d5-4694-a615-7325f2d9d7ae-kube-api-access-bsvzf\") pod \"payload-processing-58f86c7798-m7xp8\" (UID: \"9bb174de-58d5-4694-a615-7325f2d9d7ae\") " pod="openshift-ingress/payload-processing-58f86c7798-m7xp8" Jul 08 22:42:36.281322 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:36.281294 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/9bb174de-58d5-4694-a615-7325f2d9d7ae-plugins-config-volume\") pod \"payload-processing-58f86c7798-m7xp8\" (UID: \"9bb174de-58d5-4694-a615-7325f2d9d7ae\") " pod="openshift-ingress/payload-processing-58f86c7798-m7xp8" Jul 08 22:42:36.289825 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:36.289797 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsvzf\" (UniqueName: \"kubernetes.io/projected/9bb174de-58d5-4694-a615-7325f2d9d7ae-kube-api-access-bsvzf\") pod \"payload-processing-58f86c7798-m7xp8\" (UID: \"9bb174de-58d5-4694-a615-7325f2d9d7ae\") " pod="openshift-ingress/payload-processing-58f86c7798-m7xp8" Jul 08 22:42:36.364920 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:36.364831 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-58f86c7798-m7xp8" Jul 08 22:42:36.503325 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:36.503291 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-58f86c7798-m7xp8"] Jul 08 22:42:36.504527 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:42:36.504502 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bb174de_58d5_4694_a615_7325f2d9d7ae.slice/crio-1965b62f98f2b64001432e497509087e3206ceb0fb58dcb7d54366e43409f561 WatchSource:0}: Error finding container 1965b62f98f2b64001432e497509087e3206ceb0fb58dcb7d54366e43409f561: Status 404 returned error can't find the container with id 1965b62f98f2b64001432e497509087e3206ceb0fb58dcb7d54366e43409f561 Jul 08 22:42:37.476381 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:37.476341 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-m7xp8" event={"ID":"9bb174de-58d5-4694-a615-7325f2d9d7ae","Type":"ContainerStarted","Data":"1965b62f98f2b64001432e497509087e3206ceb0fb58dcb7d54366e43409f561"} Jul 08 22:42:38.483057 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:38.483006 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-58f86c7798-m7xp8" event={"ID":"9bb174de-58d5-4694-a615-7325f2d9d7ae","Type":"ContainerStarted","Data":"9c6f4c74003b4654b27e66a94eaa54996d6b1978b987ee9678e66884bd71e285"} Jul 08 22:42:38.483508 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:38.483140 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-58f86c7798-m7xp8" Jul 08 22:42:38.502763 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:38.502689 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-58f86c7798-m7xp8" podStartSLOduration=0.937759574 podStartE2EDuration="2.502667395s" totalImagesPullingTime="1.564907821s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:42:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:42:38.499928219 +0000 UTC m=+768.838635195" watchObservedRunningTime="2026-07-08 22:42:38.502667395 +0000 UTC m=+768.841374369" Jul 08 22:42:44.521712 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:44.521672 2573 generic.go:356] "Generic (PLEG): container finished" podID="836f886d-cb79-47df-91e5-9f9a276c79cc" containerID="ddb10140ffe306e8f8075a5798f6474508e64c3965837073ac0f4ce2e5c8337d" exitCode=0 Jul 08 22:42:44.521712 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:44.521712 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" event={"ID":"836f886d-cb79-47df-91e5-9f9a276c79cc","Type":"ContainerDied","Data":"ddb10140ffe306e8f8075a5798f6474508e64c3965837073ac0f4ce2e5c8337d"} Jul 08 22:42:44.522195 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:44.522056 2573 scope.go:117] "RemoveContainer" containerID="ddb10140ffe306e8f8075a5798f6474508e64c3965837073ac0f4ce2e5c8337d" Jul 08 22:42:44.523202 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:44.523169 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 22:42:44.523277 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:44.523259 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 22:42:44.523335 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:44.523311 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 22:42:45.528776 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:45.528740 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" event={"ID":"836f886d-cb79-47df-91e5-9f9a276c79cc","Type":"ContainerStarted","Data":"205f01e5f05594fb3d444f381044e8ce084ab752ce74958ab2313d500c8738cf"} Jul 08 22:42:45.914382 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:45.914273 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:42:45.915264 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:45.915240 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 08 22:42:45.915380 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:45.915290 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" podUID="836f886d-cb79-47df-91e5-9f9a276c79cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 08 22:42:46.914612 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:46.914547 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 08 22:42:46.915265 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:46.915229 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" podUID="836f886d-cb79-47df-91e5-9f9a276c79cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 08 22:42:47.915475 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:47.915429 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 08 22:42:47.915899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:47.915494 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" podUID="836f886d-cb79-47df-91e5-9f9a276c79cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 08 22:42:48.009901 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:48.008369 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:42:48.914665 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:48.914621 2573 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" start-of-body= Jul 08 22:42:48.914857 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:48.914684 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" podUID="836f886d-cb79-47df-91e5-9f9a276c79cc" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.43:15021/healthz/ready\": dial tcp 10.132.0.43:15021: connect: connection refused" Jul 08 22:42:49.492309 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:49.492278 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-58f86c7798-m7xp8" Jul 08 22:42:49.918782 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:49.918690 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:42:49.919728 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:42:49.919702 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5d7b8c9489-fsrbq" Jul 08 22:43:06.260093 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.260059 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g"] Jul 08 22:43:06.262760 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.262737 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:06.265372 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.265344 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 08 22:43:06.265520 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.265413 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-vvz8b\"" Jul 08 22:43:06.265520 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.265431 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 08 22:43:06.265520 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.265475 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-2-simulated-kserve-self-signed-certs\"" Jul 08 22:43:06.273371 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.273342 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g"] Jul 08 22:43:06.380360 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.380327 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b716715a-498f-434d-90ea-22ac66a7b23a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g\" (UID: \"b716715a-498f-434d-90ea-22ac66a7b23a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:06.380531 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.380378 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b9lf4\" (UniqueName: \"kubernetes.io/projected/b716715a-498f-434d-90ea-22ac66a7b23a-kube-api-access-b9lf4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g\" (UID: \"b716715a-498f-434d-90ea-22ac66a7b23a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:06.380531 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.380412 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b716715a-498f-434d-90ea-22ac66a7b23a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g\" (UID: \"b716715a-498f-434d-90ea-22ac66a7b23a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:06.380531 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.380444 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b716715a-498f-434d-90ea-22ac66a7b23a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g\" (UID: \"b716715a-498f-434d-90ea-22ac66a7b23a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:06.380531 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.380459 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b716715a-498f-434d-90ea-22ac66a7b23a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g\" (UID: \"b716715a-498f-434d-90ea-22ac66a7b23a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:06.380531 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.380479 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b716715a-498f-434d-90ea-22ac66a7b23a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g\" (UID: \"b716715a-498f-434d-90ea-22ac66a7b23a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:06.481549 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.481499 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b716715a-498f-434d-90ea-22ac66a7b23a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g\" (UID: \"b716715a-498f-434d-90ea-22ac66a7b23a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:06.481753 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.481577 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b716715a-498f-434d-90ea-22ac66a7b23a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g\" (UID: \"b716715a-498f-434d-90ea-22ac66a7b23a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:06.481753 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.481618 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b716715a-498f-434d-90ea-22ac66a7b23a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g\" (UID: \"b716715a-498f-434d-90ea-22ac66a7b23a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:06.481753 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.481709 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b716715a-498f-434d-90ea-22ac66a7b23a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g\" (UID: \"b716715a-498f-434d-90ea-22ac66a7b23a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:06.481863 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.481772 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b9lf4\" (UniqueName: \"kubernetes.io/projected/b716715a-498f-434d-90ea-22ac66a7b23a-kube-api-access-b9lf4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g\" (UID: \"b716715a-498f-434d-90ea-22ac66a7b23a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:06.481863 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.481814 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b716715a-498f-434d-90ea-22ac66a7b23a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g\" (UID: \"b716715a-498f-434d-90ea-22ac66a7b23a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:06.482001 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.481980 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/b716715a-498f-434d-90ea-22ac66a7b23a-home\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g\" (UID: \"b716715a-498f-434d-90ea-22ac66a7b23a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:06.482052 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.482007 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b716715a-498f-434d-90ea-22ac66a7b23a-tmp-dir\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g\" (UID: \"b716715a-498f-434d-90ea-22ac66a7b23a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:06.482133 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.482113 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/b716715a-498f-434d-90ea-22ac66a7b23a-model-cache\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g\" (UID: \"b716715a-498f-434d-90ea-22ac66a7b23a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:06.484129 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.484105 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/b716715a-498f-434d-90ea-22ac66a7b23a-dshm\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g\" (UID: \"b716715a-498f-434d-90ea-22ac66a7b23a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:06.484377 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.484359 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/b716715a-498f-434d-90ea-22ac66a7b23a-tls-certs\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g\" (UID: \"b716715a-498f-434d-90ea-22ac66a7b23a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:06.491248 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.491208 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-b9lf4\" (UniqueName: \"kubernetes.io/projected/b716715a-498f-434d-90ea-22ac66a7b23a-kube-api-access-b9lf4\") pod \"e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g\" (UID: \"b716715a-498f-434d-90ea-22ac66a7b23a\") " pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:06.574177 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.574079 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:06.722973 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:06.722943 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g"] Jul 08 22:43:06.725245 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:43:06.725214 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb716715a_498f_434d_90ea_22ac66a7b23a.slice/crio-b0bc4a0e222753fab3cfe4bce3347eeedeff4e9b052537d535c79ac2c7cda18f WatchSource:0}: Error finding container b0bc4a0e222753fab3cfe4bce3347eeedeff4e9b052537d535c79ac2c7cda18f: Status 404 returned error can't find the container with id b0bc4a0e222753fab3cfe4bce3347eeedeff4e9b052537d535c79ac2c7cda18f Jul 08 22:43:07.656042 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:07.655995 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" event={"ID":"b716715a-498f-434d-90ea-22ac66a7b23a","Type":"ContainerStarted","Data":"b0bc4a0e222753fab3cfe4bce3347eeedeff4e9b052537d535c79ac2c7cda18f"} Jul 08 22:43:08.663143 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:08.663101 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" event={"ID":"b716715a-498f-434d-90ea-22ac66a7b23a","Type":"ContainerStarted","Data":"036c63ad4cc7a2195cb82ff00f69e2e932828042d6268f467422fb2c4e942f01"} Jul 08 22:43:08.683573 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:08.683502 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" podStartSLOduration=1.582194798 podStartE2EDuration="2.683485275s" totalImagesPullingTime="1.101290477s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:43:06 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:43:08.681420964 +0000 UTC m=+799.020127939" watchObservedRunningTime="2026-07-08 22:43:08.683485275 +0000 UTC m=+799.022192247" Jul 08 22:43:16.574855 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:16.574755 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:16.574855 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:16.574830 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:16.587614 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:16.587577 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:43:16.717115 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:43:16.717087 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g" Jul 08 22:44:03.344945 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.344904 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj"] Jul 08 22:44:03.348666 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.348644 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:03.351824 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.351801 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"facebook-opt-125m-simulated-kserve-self-signed-certs\"" Jul 08 22:44:03.360710 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.360685 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj"] Jul 08 22:44:03.487410 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.487348 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fe5f423-fe02-4b3b-ab35-1d888026c1dc-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fmrbj\" (UID: \"5fe5f423-fe02-4b3b-ab35-1d888026c1dc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:03.487410 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.487412 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fe5f423-fe02-4b3b-ab35-1d888026c1dc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fmrbj\" (UID: \"5fe5f423-fe02-4b3b-ab35-1d888026c1dc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:03.487754 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.487492 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fe5f423-fe02-4b3b-ab35-1d888026c1dc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fmrbj\" (UID: \"5fe5f423-fe02-4b3b-ab35-1d888026c1dc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:03.487754 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.487640 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fe5f423-fe02-4b3b-ab35-1d888026c1dc-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fmrbj\" (UID: \"5fe5f423-fe02-4b3b-ab35-1d888026c1dc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:03.487754 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.487685 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fe5f423-fe02-4b3b-ab35-1d888026c1dc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fmrbj\" (UID: \"5fe5f423-fe02-4b3b-ab35-1d888026c1dc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:03.487754 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.487716 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gmlgn\" (UniqueName: \"kubernetes.io/projected/5fe5f423-fe02-4b3b-ab35-1d888026c1dc-kube-api-access-gmlgn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fmrbj\" (UID: \"5fe5f423-fe02-4b3b-ab35-1d888026c1dc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:03.588926 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.588883 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fe5f423-fe02-4b3b-ab35-1d888026c1dc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fmrbj\" (UID: \"5fe5f423-fe02-4b3b-ab35-1d888026c1dc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:03.589129 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.588955 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fe5f423-fe02-4b3b-ab35-1d888026c1dc-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fmrbj\" (UID: \"5fe5f423-fe02-4b3b-ab35-1d888026c1dc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:03.589129 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.588981 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fe5f423-fe02-4b3b-ab35-1d888026c1dc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fmrbj\" (UID: \"5fe5f423-fe02-4b3b-ab35-1d888026c1dc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:03.589129 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.588999 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gmlgn\" (UniqueName: \"kubernetes.io/projected/5fe5f423-fe02-4b3b-ab35-1d888026c1dc-kube-api-access-gmlgn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fmrbj\" (UID: \"5fe5f423-fe02-4b3b-ab35-1d888026c1dc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:03.589129 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.589036 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fe5f423-fe02-4b3b-ab35-1d888026c1dc-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fmrbj\" (UID: \"5fe5f423-fe02-4b3b-ab35-1d888026c1dc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:03.589129 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.589055 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fe5f423-fe02-4b3b-ab35-1d888026c1dc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fmrbj\" (UID: \"5fe5f423-fe02-4b3b-ab35-1d888026c1dc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:03.589602 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.589575 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/5fe5f423-fe02-4b3b-ab35-1d888026c1dc-tmp-dir\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fmrbj\" (UID: \"5fe5f423-fe02-4b3b-ab35-1d888026c1dc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:03.589739 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.589585 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/5fe5f423-fe02-4b3b-ab35-1d888026c1dc-home\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fmrbj\" (UID: \"5fe5f423-fe02-4b3b-ab35-1d888026c1dc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:03.589739 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.589651 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/5fe5f423-fe02-4b3b-ab35-1d888026c1dc-model-cache\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fmrbj\" (UID: \"5fe5f423-fe02-4b3b-ab35-1d888026c1dc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:03.591542 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.591520 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/5fe5f423-fe02-4b3b-ab35-1d888026c1dc-dshm\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fmrbj\" (UID: \"5fe5f423-fe02-4b3b-ab35-1d888026c1dc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:03.591692 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.591679 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/5fe5f423-fe02-4b3b-ab35-1d888026c1dc-tls-certs\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fmrbj\" (UID: \"5fe5f423-fe02-4b3b-ab35-1d888026c1dc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:03.597297 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.597243 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-gmlgn\" (UniqueName: \"kubernetes.io/projected/5fe5f423-fe02-4b3b-ab35-1d888026c1dc-kube-api-access-gmlgn\") pod \"facebook-opt-125m-simulated-kserve-74b68447df-fmrbj\" (UID: \"5fe5f423-fe02-4b3b-ab35-1d888026c1dc\") " pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:03.659590 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.659523 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:03.803680 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.803448 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj"] Jul 08 22:44:03.806873 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:44:03.806831 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5fe5f423_fe02_4b3b_ab35_1d888026c1dc.slice/crio-b168533e70943173aa91824fc9206cab253ddb3423127196b803942b96b9742a WatchSource:0}: Error finding container b168533e70943173aa91824fc9206cab253ddb3423127196b803942b96b9742a: Status 404 returned error can't find the container with id b168533e70943173aa91824fc9206cab253ddb3423127196b803942b96b9742a Jul 08 22:44:03.968530 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:03.968492 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" event={"ID":"5fe5f423-fe02-4b3b-ab35-1d888026c1dc","Type":"ContainerStarted","Data":"b168533e70943173aa91824fc9206cab253ddb3423127196b803942b96b9742a"} Jul 08 22:44:04.976012 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:04.975946 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" event={"ID":"5fe5f423-fe02-4b3b-ab35-1d888026c1dc","Type":"ContainerStarted","Data":"89abeedc3f7bf26328fc9f4df51a8c8ebeee76735f3c5d806a6b7944bbfce084"} Jul 08 22:44:04.996937 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:04.996879 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" podStartSLOduration=1.7617203689999998 podStartE2EDuration="1.996862253s" totalImagesPullingTime="235.141884ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:44:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:44:04.993963933 +0000 UTC m=+855.332670925" watchObservedRunningTime="2026-07-08 22:44:04.996862253 +0000 UTC m=+855.335569226" Jul 08 22:44:13.660016 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:13.659978 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:13.660496 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:13.660041 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:13.672516 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:13.672486 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:14.037730 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:14.037686 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/facebook-opt-125m-simulated-kserve-74b68447df-fmrbj" Jul 08 22:44:50.155243 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:50.155159 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/1.log" Jul 08 22:44:50.157386 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:44:50.157354 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/1.log" Jul 08 22:45:00.142784 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:00.142749 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725845-lnwk5"] Jul 08 22:45:00.146364 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:00.146346 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725845-lnwk5" Jul 08 22:45:00.148959 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:00.148934 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-l9zqm\"" Jul 08 22:45:00.154240 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:00.153950 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725845-lnwk5"] Jul 08 22:45:00.186130 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:00.186101 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5wbmw\" (UniqueName: \"kubernetes.io/projected/a0c849a8-93c2-4aaa-ac32-e82e0a97b359-kube-api-access-5wbmw\") pod \"maas-api-key-cleanup-29725845-lnwk5\" (UID: \"a0c849a8-93c2-4aaa-ac32-e82e0a97b359\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725845-lnwk5" Jul 08 22:45:00.287017 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:00.286977 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5wbmw\" (UniqueName: \"kubernetes.io/projected/a0c849a8-93c2-4aaa-ac32-e82e0a97b359-kube-api-access-5wbmw\") pod \"maas-api-key-cleanup-29725845-lnwk5\" (UID: \"a0c849a8-93c2-4aaa-ac32-e82e0a97b359\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725845-lnwk5" Jul 08 22:45:00.296040 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:00.296005 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-5wbmw\" (UniqueName: \"kubernetes.io/projected/a0c849a8-93c2-4aaa-ac32-e82e0a97b359-kube-api-access-5wbmw\") pod \"maas-api-key-cleanup-29725845-lnwk5\" (UID: \"a0c849a8-93c2-4aaa-ac32-e82e0a97b359\") " pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725845-lnwk5" Jul 08 22:45:00.458052 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:00.457954 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725845-lnwk5" Jul 08 22:45:00.598360 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:00.598335 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725845-lnwk5"] Jul 08 22:45:00.600587 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:45:00.600527 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0c849a8_93c2_4aaa_ac32_e82e0a97b359.slice/crio-8629f788edf1c3936f4237a525266578958626d7e3fb0a97841d6b0ff74d3143 WatchSource:0}: Error finding container 8629f788edf1c3936f4237a525266578958626d7e3fb0a97841d6b0ff74d3143: Status 404 returned error can't find the container with id 8629f788edf1c3936f4237a525266578958626d7e3fb0a97841d6b0ff74d3143 Jul 08 22:45:00.602514 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:00.602496 2573 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 08 22:45:01.290218 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:01.290183 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725845-lnwk5" event={"ID":"a0c849a8-93c2-4aaa-ac32-e82e0a97b359","Type":"ContainerStarted","Data":"8629f788edf1c3936f4237a525266578958626d7e3fb0a97841d6b0ff74d3143"} Jul 08 22:45:04.312887 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:04.312846 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725845-lnwk5" event={"ID":"a0c849a8-93c2-4aaa-ac32-e82e0a97b359","Type":"ContainerStarted","Data":"a5e38895b4dfc02ebd2c16edbae1964590026872e42e48af9e4df27c5b23aad9"} Jul 08 22:45:04.330347 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:04.330295 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725845-lnwk5" podStartSLOduration=1.386128087 podStartE2EDuration="4.330276184s" totalImagesPullingTime="2.944148097s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:45:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:45:04.328088105 +0000 UTC m=+914.666795082" watchObservedRunningTime="2026-07-08 22:45:04.330276184 +0000 UTC m=+914.668983156" Jul 08 22:45:24.719362 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:24.719328 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6bb55c5c8c-9vmbz"] Jul 08 22:45:24.722910 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:24.722888 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bb55c5c8c-9vmbz" Jul 08 22:45:24.726700 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:24.726680 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 08 22:45:24.726830 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:24.726684 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-lmnjk\"" Jul 08 22:45:24.731491 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:24.731470 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bb55c5c8c-9vmbz"] Jul 08 22:45:24.806958 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:24.806920 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qqldx\" (UniqueName: \"kubernetes.io/projected/82d4c9f4-8da5-489a-932d-1bd749e1dc17-kube-api-access-qqldx\") pod \"authorino-6bb55c5c8c-9vmbz\" (UID: \"82d4c9f4-8da5-489a-932d-1bd749e1dc17\") " pod="kuadrant-system/authorino-6bb55c5c8c-9vmbz" Jul 08 22:45:24.807144 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:24.806988 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/82d4c9f4-8da5-489a-932d-1bd749e1dc17-tls-cert\") pod \"authorino-6bb55c5c8c-9vmbz\" (UID: \"82d4c9f4-8da5-489a-932d-1bd749e1dc17\") " pod="kuadrant-system/authorino-6bb55c5c8c-9vmbz" Jul 08 22:45:24.907963 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:24.907926 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/82d4c9f4-8da5-489a-932d-1bd749e1dc17-tls-cert\") pod \"authorino-6bb55c5c8c-9vmbz\" (UID: \"82d4c9f4-8da5-489a-932d-1bd749e1dc17\") " pod="kuadrant-system/authorino-6bb55c5c8c-9vmbz" Jul 08 22:45:24.908176 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:24.907994 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qqldx\" (UniqueName: \"kubernetes.io/projected/82d4c9f4-8da5-489a-932d-1bd749e1dc17-kube-api-access-qqldx\") pod \"authorino-6bb55c5c8c-9vmbz\" (UID: \"82d4c9f4-8da5-489a-932d-1bd749e1dc17\") " pod="kuadrant-system/authorino-6bb55c5c8c-9vmbz" Jul 08 22:45:24.910676 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:24.910647 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/82d4c9f4-8da5-489a-932d-1bd749e1dc17-tls-cert\") pod \"authorino-6bb55c5c8c-9vmbz\" (UID: \"82d4c9f4-8da5-489a-932d-1bd749e1dc17\") " pod="kuadrant-system/authorino-6bb55c5c8c-9vmbz" Jul 08 22:45:24.917453 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:24.917428 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-qqldx\" (UniqueName: \"kubernetes.io/projected/82d4c9f4-8da5-489a-932d-1bd749e1dc17-kube-api-access-qqldx\") pod \"authorino-6bb55c5c8c-9vmbz\" (UID: \"82d4c9f4-8da5-489a-932d-1bd749e1dc17\") " pod="kuadrant-system/authorino-6bb55c5c8c-9vmbz" Jul 08 22:45:25.033294 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:25.033179 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6bb55c5c8c-9vmbz" Jul 08 22:45:25.182596 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:25.182570 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6bb55c5c8c-9vmbz"] Jul 08 22:45:25.185165 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:45:25.185141 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod82d4c9f4_8da5_489a_932d_1bd749e1dc17.slice/crio-e9775d9edb9f211e14a5b71fc2f9ee500c5ac184fc6f028cda9fca095ffed82f WatchSource:0}: Error finding container e9775d9edb9f211e14a5b71fc2f9ee500c5ac184fc6f028cda9fca095ffed82f: Status 404 returned error can't find the container with id e9775d9edb9f211e14a5b71fc2f9ee500c5ac184fc6f028cda9fca095ffed82f Jul 08 22:45:25.436056 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:25.435972 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bb55c5c8c-9vmbz" event={"ID":"82d4c9f4-8da5-489a-932d-1bd749e1dc17","Type":"ContainerStarted","Data":"e9775d9edb9f211e14a5b71fc2f9ee500c5ac184fc6f028cda9fca095ffed82f"} Jul 08 22:45:26.443419 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:26.443380 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6bb55c5c8c-9vmbz" event={"ID":"82d4c9f4-8da5-489a-932d-1bd749e1dc17","Type":"ContainerStarted","Data":"79a802df21292a1380684e1f1752555aac211281497552ac1d2aa2f8aadb23c5"} Jul 08 22:45:26.467979 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:45:26.467923 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6bb55c5c8c-9vmbz" podStartSLOduration=2.138719515 podStartE2EDuration="2.467905276s" totalImagesPullingTime="329.185761ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:45:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:45:26.467132101 +0000 UTC m=+936.805839076" watchObservedRunningTime="2026-07-08 22:45:26.467905276 +0000 UTC m=+936.806612249" Jul 08 22:46:00.011982 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:00.011934 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725845-lnwk5"] Jul 08 22:46:00.012672 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:00.012184 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725845-lnwk5" podUID="a0c849a8-93c2-4aaa-ac32-e82e0a97b359" containerName="cleanup" containerID="cri-o://a5e38895b4dfc02ebd2c16edbae1964590026872e42e48af9e4df27c5b23aad9" gracePeriod=30 Jul 08 22:46:30.213642 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:30.213612 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725845-lnwk5" Jul 08 22:46:30.284402 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:30.284297 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5wbmw\" (UniqueName: \"kubernetes.io/projected/a0c849a8-93c2-4aaa-ac32-e82e0a97b359-kube-api-access-5wbmw\") pod \"a0c849a8-93c2-4aaa-ac32-e82e0a97b359\" (UID: \"a0c849a8-93c2-4aaa-ac32-e82e0a97b359\") " Jul 08 22:46:30.286706 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:30.286677 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/a0c849a8-93c2-4aaa-ac32-e82e0a97b359-kube-api-access-5wbmw" (OuterVolumeSpecName: "kube-api-access-5wbmw") pod "a0c849a8-93c2-4aaa-ac32-e82e0a97b359" (UID: "a0c849a8-93c2-4aaa-ac32-e82e0a97b359"). InnerVolumeSpecName "kube-api-access-5wbmw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:46:30.385685 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:30.385643 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5wbmw\" (UniqueName: \"kubernetes.io/projected/a0c849a8-93c2-4aaa-ac32-e82e0a97b359-kube-api-access-5wbmw\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:46:30.806188 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:30.806144 2573 generic.go:356] "Generic (PLEG): container finished" podID="a0c849a8-93c2-4aaa-ac32-e82e0a97b359" containerID="a5e38895b4dfc02ebd2c16edbae1964590026872e42e48af9e4df27c5b23aad9" exitCode=137 Jul 08 22:46:30.806188 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:30.806191 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725845-lnwk5" event={"ID":"a0c849a8-93c2-4aaa-ac32-e82e0a97b359","Type":"ContainerDied","Data":"a5e38895b4dfc02ebd2c16edbae1964590026872e42e48af9e4df27c5b23aad9"} Jul 08 22:46:30.806405 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:30.806200 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725845-lnwk5" Jul 08 22:46:30.806405 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:30.806274 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29725845-lnwk5" event={"ID":"a0c849a8-93c2-4aaa-ac32-e82e0a97b359","Type":"ContainerDied","Data":"8629f788edf1c3936f4237a525266578958626d7e3fb0a97841d6b0ff74d3143"} Jul 08 22:46:30.806405 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:30.806298 2573 scope.go:117] "RemoveContainer" containerID="a5e38895b4dfc02ebd2c16edbae1964590026872e42e48af9e4df27c5b23aad9" Jul 08 22:46:30.816020 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:30.815999 2573 scope.go:117] "RemoveContainer" containerID="a5e38895b4dfc02ebd2c16edbae1964590026872e42e48af9e4df27c5b23aad9" Jul 08 22:46:30.816293 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:46:30.816272 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a5e38895b4dfc02ebd2c16edbae1964590026872e42e48af9e4df27c5b23aad9\": container with ID starting with a5e38895b4dfc02ebd2c16edbae1964590026872e42e48af9e4df27c5b23aad9 not found: ID does not exist" containerID="a5e38895b4dfc02ebd2c16edbae1964590026872e42e48af9e4df27c5b23aad9" Jul 08 22:46:30.816336 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:30.816303 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a5e38895b4dfc02ebd2c16edbae1964590026872e42e48af9e4df27c5b23aad9"} err="failed to get container status \"a5e38895b4dfc02ebd2c16edbae1964590026872e42e48af9e4df27c5b23aad9\": rpc error: code = NotFound desc = could not find container \"a5e38895b4dfc02ebd2c16edbae1964590026872e42e48af9e4df27c5b23aad9\": container with ID starting with a5e38895b4dfc02ebd2c16edbae1964590026872e42e48af9e4df27c5b23aad9 not found: ID does not exist" Jul 08 22:46:30.828208 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:30.828177 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725845-lnwk5"] Jul 08 22:46:30.832283 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:30.832257 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29725845-lnwk5"] Jul 08 22:46:32.183352 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:32.183319 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="a0c849a8-93c2-4aaa-ac32-e82e0a97b359" path="/var/lib/kubelet/pods/a0c849a8-93c2-4aaa-ac32-e82e0a97b359/volumes" Jul 08 22:46:35.738999 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:35.738961 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-678658b869-mrjsj"] Jul 08 22:46:35.739483 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:35.739284 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="opendatahub/maas-controller-678658b869-mrjsj" podUID="86271000-4e29-4539-ab4a-6000420eb57d" containerName="manager" containerID="cri-o://231a76d3c050211b9f4a89b3647da7afd10be39071c2f837c2b5224cfd0dff4a" gracePeriod=30 Jul 08 22:46:35.995341 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:35.995276 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-678658b869-mrjsj" Jul 08 22:46:36.035163 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:36.035123 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86271000-4e29-4539-ab4a-6000420eb57d-webhook-cert\") pod \"86271000-4e29-4539-ab4a-6000420eb57d\" (UID: \"86271000-4e29-4539-ab4a-6000420eb57d\") " Jul 08 22:46:36.035355 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:36.035266 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-96qch\" (UniqueName: \"kubernetes.io/projected/86271000-4e29-4539-ab4a-6000420eb57d-kube-api-access-96qch\") pod \"86271000-4e29-4539-ab4a-6000420eb57d\" (UID: \"86271000-4e29-4539-ab4a-6000420eb57d\") " Jul 08 22:46:36.037631 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:36.037594 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/86271000-4e29-4539-ab4a-6000420eb57d-kube-api-access-96qch" (OuterVolumeSpecName: "kube-api-access-96qch") pod "86271000-4e29-4539-ab4a-6000420eb57d" (UID: "86271000-4e29-4539-ab4a-6000420eb57d"). InnerVolumeSpecName "kube-api-access-96qch". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:46:36.037631 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:36.037613 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/86271000-4e29-4539-ab4a-6000420eb57d-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "86271000-4e29-4539-ab4a-6000420eb57d" (UID: "86271000-4e29-4539-ab4a-6000420eb57d"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 08 22:46:36.135970 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:36.135929 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-96qch\" (UniqueName: \"kubernetes.io/projected/86271000-4e29-4539-ab4a-6000420eb57d-kube-api-access-96qch\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:46:36.135970 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:36.135963 2573 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/86271000-4e29-4539-ab4a-6000420eb57d-webhook-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:46:36.842312 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:36.842269 2573 generic.go:356] "Generic (PLEG): container finished" podID="86271000-4e29-4539-ab4a-6000420eb57d" containerID="231a76d3c050211b9f4a89b3647da7afd10be39071c2f837c2b5224cfd0dff4a" exitCode=0 Jul 08 22:46:36.842858 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:36.842319 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-678658b869-mrjsj" Jul 08 22:46:36.842858 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:36.842364 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-678658b869-mrjsj" event={"ID":"86271000-4e29-4539-ab4a-6000420eb57d","Type":"ContainerDied","Data":"231a76d3c050211b9f4a89b3647da7afd10be39071c2f837c2b5224cfd0dff4a"} Jul 08 22:46:36.842858 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:36.842429 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-678658b869-mrjsj" event={"ID":"86271000-4e29-4539-ab4a-6000420eb57d","Type":"ContainerDied","Data":"4a3060d7d344ce0126855b23ee0c5106375590678e29fbd4e63328ce3c36ed95"} Jul 08 22:46:36.842858 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:36.842468 2573 scope.go:117] "RemoveContainer" containerID="231a76d3c050211b9f4a89b3647da7afd10be39071c2f837c2b5224cfd0dff4a" Jul 08 22:46:36.851857 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:36.851838 2573 scope.go:117] "RemoveContainer" containerID="231a76d3c050211b9f4a89b3647da7afd10be39071c2f837c2b5224cfd0dff4a" Jul 08 22:46:36.852111 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:46:36.852093 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"231a76d3c050211b9f4a89b3647da7afd10be39071c2f837c2b5224cfd0dff4a\": container with ID starting with 231a76d3c050211b9f4a89b3647da7afd10be39071c2f837c2b5224cfd0dff4a not found: ID does not exist" containerID="231a76d3c050211b9f4a89b3647da7afd10be39071c2f837c2b5224cfd0dff4a" Jul 08 22:46:36.852175 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:36.852121 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"231a76d3c050211b9f4a89b3647da7afd10be39071c2f837c2b5224cfd0dff4a"} err="failed to get container status \"231a76d3c050211b9f4a89b3647da7afd10be39071c2f837c2b5224cfd0dff4a\": rpc error: code = NotFound desc = could not find container \"231a76d3c050211b9f4a89b3647da7afd10be39071c2f837c2b5224cfd0dff4a\": container with ID starting with 231a76d3c050211b9f4a89b3647da7afd10be39071c2f837c2b5224cfd0dff4a not found: ID does not exist" Jul 08 22:46:36.860241 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:36.860220 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-678658b869-mrjsj"] Jul 08 22:46:36.864178 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:36.864155 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-678658b869-mrjsj"] Jul 08 22:46:38.183465 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:46:38.183432 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="86271000-4e29-4539-ab4a-6000420eb57d" path="/var/lib/kubelet/pods/86271000-4e29-4539-ab4a-6000420eb57d/volumes" Jul 08 22:49:50.197177 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:49:50.197144 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/1.log" Jul 08 22:49:50.201989 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:49:50.201964 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/1.log" Jul 08 22:54:50.234907 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:54:50.234877 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/1.log" Jul 08 22:54:50.242841 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:54:50.242809 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/1.log" Jul 08 22:58:28.299233 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.299189 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z"] Jul 08 22:58:28.299899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.299604 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="86271000-4e29-4539-ab4a-6000420eb57d" containerName="manager" Jul 08 22:58:28.299899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.299616 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="86271000-4e29-4539-ab4a-6000420eb57d" containerName="manager" Jul 08 22:58:28.299899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.299624 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="a0c849a8-93c2-4aaa-ac32-e82e0a97b359" containerName="cleanup" Jul 08 22:58:28.299899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.299630 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="a0c849a8-93c2-4aaa-ac32-e82e0a97b359" containerName="cleanup" Jul 08 22:58:28.299899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.299688 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="86271000-4e29-4539-ab4a-6000420eb57d" containerName="manager" Jul 08 22:58:28.299899 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.299699 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="a0c849a8-93c2-4aaa-ac32-e82e0a97b359" containerName="cleanup" Jul 08 22:58:28.302797 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.302774 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.305311 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.305290 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-1ee383f3-openshift-default-dockercfg-gcx8f\"" Jul 08 22:58:28.324996 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.324962 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z"] Jul 08 22:58:28.437656 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.437621 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-workload-socket\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.437656 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.437658 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecf958d6-1612-477f-9166-b4b37bea2828-istio-podinfo\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.437898 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.437680 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecf958d6-1612-477f-9166-b4b37bea2828-istio-token\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.437898 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.437753 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-credential-socket\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.437898 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.437773 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-istio-data\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.437898 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.437787 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jwdh\" (UniqueName: \"kubernetes.io/projected/ecf958d6-1612-477f-9166-b4b37bea2828-kube-api-access-4jwdh\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.437898 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.437834 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-istio-envoy\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.437898 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.437864 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecf958d6-1612-477f-9166-b4b37bea2828-istiod-ca-cert\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.438103 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.437953 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-workload-certs\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.539360 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.539319 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-workload-socket\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.539360 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.539358 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecf958d6-1612-477f-9166-b4b37bea2828-istio-podinfo\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.539681 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.539388 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecf958d6-1612-477f-9166-b4b37bea2828-istio-token\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.539681 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.539435 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-credential-socket\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.539681 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.539464 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-istio-data\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.539681 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.539485 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jwdh\" (UniqueName: \"kubernetes.io/projected/ecf958d6-1612-477f-9166-b4b37bea2828-kube-api-access-4jwdh\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.539681 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.539594 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-istio-envoy\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.539927 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.539683 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecf958d6-1612-477f-9166-b4b37bea2828-istiod-ca-cert\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.539927 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.539765 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-workload-certs\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.539927 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.539826 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-workload-socket\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.539927 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.539827 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-credential-socket\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.540088 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.540066 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-workload-certs\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.540328 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.540310 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-istio-data\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.540419 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.540402 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecf958d6-1612-477f-9166-b4b37bea2828-istiod-ca-cert\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.542392 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.542369 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-istio-envoy\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.542610 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.542591 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecf958d6-1612-477f-9166-b4b37bea2828-istio-podinfo\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.547259 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.547234 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecf958d6-1612-477f-9166-b4b37bea2828-istio-token\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.547647 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.547628 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jwdh\" (UniqueName: \"kubernetes.io/projected/ecf958d6-1612-477f-9166-b4b37bea2828-kube-api-access-4jwdh\") pod \"e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.613168 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.613069 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:28.761719 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.761692 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z"] Jul 08 22:58:28.763316 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:58:28.763287 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecf958d6_1612_477f_9166_b4b37bea2828.slice/crio-2f4d5d522a140bafa5c3cdf8a45c678dac2917c7743d9bb802816c159c3a176c WatchSource:0}: Error finding container 2f4d5d522a140bafa5c3cdf8a45c678dac2917c7743d9bb802816c159c3a176c: Status 404 returned error can't find the container with id 2f4d5d522a140bafa5c3cdf8a45c678dac2917c7743d9bb802816c159c3a176c Jul 08 22:58:28.765542 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.765505 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 22:58:28.765679 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.765604 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 22:58:28.765679 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.765652 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 22:58:28.896105 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.896014 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" event={"ID":"ecf958d6-1612-477f-9166-b4b37bea2828","Type":"ContainerStarted","Data":"940eb534e5a59a343ba49feaddb30e4a7a59aa44ed07a6921be32be264e59b3e"} Jul 08 22:58:28.896105 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.896066 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" event={"ID":"ecf958d6-1612-477f-9166-b4b37bea2828","Type":"ContainerStarted","Data":"2f4d5d522a140bafa5c3cdf8a45c678dac2917c7743d9bb802816c159c3a176c"} Jul 08 22:58:28.917840 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:28.917789 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" podStartSLOduration=0.917770938 podStartE2EDuration="917.770938ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:58:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:58:28.915370323 +0000 UTC m=+1719.254077325" watchObservedRunningTime="2026-07-08 22:58:28.917770938 +0000 UTC m=+1719.256477911" Jul 08 22:58:29.613675 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:29.613636 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:29.619852 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:29.619824 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:29.902061 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:29.901974 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:29.902885 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:29.902863 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:34.738845 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:34.738807 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z"] Jul 08 22:58:34.739377 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:34.738980 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" podUID="ecf958d6-1612-477f-9166-b4b37bea2828" containerName="istio-proxy" containerID="cri-o://940eb534e5a59a343ba49feaddb30e4a7a59aa44ed07a6921be32be264e59b3e" gracePeriod=30 Jul 08 22:58:40.704321 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.704279 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c"] Jul 08 22:58:40.710644 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.710619 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.713075 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.713050 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-638bd430-openshift-default-dockercfg-xjhnd\"" Jul 08 22:58:40.718343 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.718316 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c"] Jul 08 22:58:40.763450 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.763408 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-data\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.763683 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.763464 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-token\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.763683 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.763547 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-podinfo\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.763683 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.763613 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/357aa739-4cfd-44fc-9bf6-a50eba44c117-istiod-ca-cert\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.763683 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.763640 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-workload-socket\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.763886 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.763719 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-workload-certs\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.763886 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.763751 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-credential-socket\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.763886 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.763783 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-envoy\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.763886 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.763836 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctfvh\" (UniqueName: \"kubernetes.io/projected/357aa739-4cfd-44fc-9bf6-a50eba44c117-kube-api-access-ctfvh\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.864353 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.864318 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-workload-certs\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.864581 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.864363 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-credential-socket\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.864581 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.864390 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-envoy\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.864581 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.864419 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctfvh\" (UniqueName: \"kubernetes.io/projected/357aa739-4cfd-44fc-9bf6-a50eba44c117-kube-api-access-ctfvh\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.864581 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.864448 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-data\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.864581 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.864497 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-token\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.864581 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.864529 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-podinfo\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.864909 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.864649 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/357aa739-4cfd-44fc-9bf6-a50eba44c117-istiod-ca-cert\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.864909 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.864684 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-workload-socket\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.864909 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.864750 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-workload-certs\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.865071 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.864909 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-credential-socket\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.865071 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.865048 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-data\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.865177 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.865152 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-workload-socket\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.865424 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.865402 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/357aa739-4cfd-44fc-9bf6-a50eba44c117-istiod-ca-cert\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.867116 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.867096 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-envoy\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.867936 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.867900 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-podinfo\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.872986 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.872956 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-token\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:40.873088 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:40.873072 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctfvh\" (UniqueName: \"kubernetes.io/projected/357aa739-4cfd-44fc-9bf6-a50eba44c117-kube-api-access-ctfvh\") pod \"e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:41.024401 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.024367 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:41.173255 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.173228 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c"] Jul 08 22:58:41.208584 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:58:41.208519 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod357aa739_4cfd_44fc_9bf6_a50eba44c117.slice/crio-8084916e322644fc1f525a43ec6dd381da8fd7c5d9098117617ba6b9f92bf32a WatchSource:0}: Error finding container 8084916e322644fc1f525a43ec6dd381da8fd7c5d9098117617ba6b9f92bf32a: Status 404 returned error can't find the container with id 8084916e322644fc1f525a43ec6dd381da8fd7c5d9098117617ba6b9f92bf32a Jul 08 22:58:41.244704 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.244667 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 22:58:41.244839 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.244752 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 22:58:41.244839 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.244800 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 22:58:41.398653 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.398620 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:41.470160 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.470112 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecf958d6-1612-477f-9166-b4b37bea2828-istio-token\") pod \"ecf958d6-1612-477f-9166-b4b37bea2828\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " Jul 08 22:58:41.470160 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.470155 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-istio-data\") pod \"ecf958d6-1612-477f-9166-b4b37bea2828\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " Jul 08 22:58:41.470442 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.470188 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-workload-certs\") pod \"ecf958d6-1612-477f-9166-b4b37bea2828\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " Jul 08 22:58:41.470442 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.470228 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-credential-socket\") pod \"ecf958d6-1612-477f-9166-b4b37bea2828\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " Jul 08 22:58:41.470442 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.470267 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecf958d6-1612-477f-9166-b4b37bea2828-istio-podinfo\") pod \"ecf958d6-1612-477f-9166-b4b37bea2828\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " Jul 08 22:58:41.470442 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.470304 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-workload-socket\") pod \"ecf958d6-1612-477f-9166-b4b37bea2828\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " Jul 08 22:58:41.470442 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.470329 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecf958d6-1612-477f-9166-b4b37bea2828-istiod-ca-cert\") pod \"ecf958d6-1612-477f-9166-b4b37bea2828\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " Jul 08 22:58:41.470442 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.470366 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4jwdh\" (UniqueName: \"kubernetes.io/projected/ecf958d6-1612-477f-9166-b4b37bea2828-kube-api-access-4jwdh\") pod \"ecf958d6-1612-477f-9166-b4b37bea2828\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " Jul 08 22:58:41.470442 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.470398 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-istio-envoy\") pod \"ecf958d6-1612-477f-9166-b4b37bea2828\" (UID: \"ecf958d6-1612-477f-9166-b4b37bea2828\") " Jul 08 22:58:41.470870 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.470598 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "ecf958d6-1612-477f-9166-b4b37bea2828" (UID: "ecf958d6-1612-477f-9166-b4b37bea2828"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:58:41.470870 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.470699 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/ecf958d6-1612-477f-9166-b4b37bea2828-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "ecf958d6-1612-477f-9166-b4b37bea2828" (UID: "ecf958d6-1612-477f-9166-b4b37bea2828"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:58:41.470870 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.470763 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-workload-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:58:41.470870 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.470770 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "ecf958d6-1612-477f-9166-b4b37bea2828" (UID: "ecf958d6-1612-477f-9166-b4b37bea2828"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:58:41.471089 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.470988 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "ecf958d6-1612-477f-9166-b4b37bea2828" (UID: "ecf958d6-1612-477f-9166-b4b37bea2828"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:58:41.471928 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.471902 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-istio-data" (OuterVolumeSpecName: "istio-data") pod "ecf958d6-1612-477f-9166-b4b37bea2828" (UID: "ecf958d6-1612-477f-9166-b4b37bea2828"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:58:41.473020 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.472987 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "ecf958d6-1612-477f-9166-b4b37bea2828" (UID: "ecf958d6-1612-477f-9166-b4b37bea2828"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:58:41.473209 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.473185 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecf958d6-1612-477f-9166-b4b37bea2828-kube-api-access-4jwdh" (OuterVolumeSpecName: "kube-api-access-4jwdh") pod "ecf958d6-1612-477f-9166-b4b37bea2828" (UID: "ecf958d6-1612-477f-9166-b4b37bea2828"). InnerVolumeSpecName "kube-api-access-4jwdh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:58:41.473461 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.473439 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ecf958d6-1612-477f-9166-b4b37bea2828-istio-token" (OuterVolumeSpecName: "istio-token") pod "ecf958d6-1612-477f-9166-b4b37bea2828" (UID: "ecf958d6-1612-477f-9166-b4b37bea2828"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:58:41.473521 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.473469 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/ecf958d6-1612-477f-9166-b4b37bea2828-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "ecf958d6-1612-477f-9166-b4b37bea2828" (UID: "ecf958d6-1612-477f-9166-b4b37bea2828"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 22:58:41.571395 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.571305 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-credential-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:58:41.571395 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.571338 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/ecf958d6-1612-477f-9166-b4b37bea2828-istio-podinfo\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:58:41.571395 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.571348 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/ecf958d6-1612-477f-9166-b4b37bea2828-istiod-ca-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:58:41.571395 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.571356 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4jwdh\" (UniqueName: \"kubernetes.io/projected/ecf958d6-1612-477f-9166-b4b37bea2828-kube-api-access-4jwdh\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:58:41.571395 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.571366 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-istio-envoy\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:58:41.571395 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.571374 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/ecf958d6-1612-477f-9166-b4b37bea2828-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:58:41.571395 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.571381 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-istio-data\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:58:41.571395 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.571388 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/ecf958d6-1612-477f-9166-b4b37bea2828-workload-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:58:41.976409 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.976368 2573 generic.go:356] "Generic (PLEG): container finished" podID="ecf958d6-1612-477f-9166-b4b37bea2828" containerID="940eb534e5a59a343ba49feaddb30e4a7a59aa44ed07a6921be32be264e59b3e" exitCode=0 Jul 08 22:58:41.976924 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.976415 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" Jul 08 22:58:41.976924 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.976450 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" event={"ID":"ecf958d6-1612-477f-9166-b4b37bea2828","Type":"ContainerDied","Data":"940eb534e5a59a343ba49feaddb30e4a7a59aa44ed07a6921be32be264e59b3e"} Jul 08 22:58:41.976924 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.976527 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z" event={"ID":"ecf958d6-1612-477f-9166-b4b37bea2828","Type":"ContainerDied","Data":"2f4d5d522a140bafa5c3cdf8a45c678dac2917c7743d9bb802816c159c3a176c"} Jul 08 22:58:41.976924 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.976584 2573 scope.go:117] "RemoveContainer" containerID="940eb534e5a59a343ba49feaddb30e4a7a59aa44ed07a6921be32be264e59b3e" Jul 08 22:58:41.978607 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.978577 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" event={"ID":"357aa739-4cfd-44fc-9bf6-a50eba44c117","Type":"ContainerStarted","Data":"0d608736f717d0304916fc7ac01285fa8597a967708f016872f1c04bc8a8945b"} Jul 08 22:58:41.978748 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.978631 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" event={"ID":"357aa739-4cfd-44fc-9bf6-a50eba44c117","Type":"ContainerStarted","Data":"8084916e322644fc1f525a43ec6dd381da8fd7c5d9098117617ba6b9f92bf32a"} Jul 08 22:58:41.994528 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.994484 2573 scope.go:117] "RemoveContainer" containerID="940eb534e5a59a343ba49feaddb30e4a7a59aa44ed07a6921be32be264e59b3e" Jul 08 22:58:41.994872 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:58:41.994850 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"940eb534e5a59a343ba49feaddb30e4a7a59aa44ed07a6921be32be264e59b3e\": container with ID starting with 940eb534e5a59a343ba49feaddb30e4a7a59aa44ed07a6921be32be264e59b3e not found: ID does not exist" containerID="940eb534e5a59a343ba49feaddb30e4a7a59aa44ed07a6921be32be264e59b3e" Jul 08 22:58:41.994963 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:41.994880 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"940eb534e5a59a343ba49feaddb30e4a7a59aa44ed07a6921be32be264e59b3e"} err="failed to get container status \"940eb534e5a59a343ba49feaddb30e4a7a59aa44ed07a6921be32be264e59b3e\": rpc error: code = NotFound desc = could not find container \"940eb534e5a59a343ba49feaddb30e4a7a59aa44ed07a6921be32be264e59b3e\": container with ID starting with 940eb534e5a59a343ba49feaddb30e4a7a59aa44ed07a6921be32be264e59b3e not found: ID does not exist" Jul 08 22:58:42.002214 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:42.002161 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" podStartSLOduration=2.002142726 podStartE2EDuration="2.002142726s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:58:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:58:42.001442982 +0000 UTC m=+1732.340149979" watchObservedRunningTime="2026-07-08 22:58:42.002142726 +0000 UTC m=+1732.340849700" Jul 08 22:58:42.024358 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:42.024313 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z"] Jul 08 22:58:42.025398 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:42.025375 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:42.027202 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:42.027150 2573 patch_prober.go:28] interesting pod/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" start-of-body= Jul 08 22:58:42.027348 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:42.027218 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" podUID="357aa739-4cfd-44fc-9bf6-a50eba44c117" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.53:15021/healthz/ready\": dial tcp 10.132.0.53:15021: connect: connection refused" Jul 08 22:58:42.030802 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:42.030778 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-1ee383f3-openshift-default-9966bfd67-hnk2z"] Jul 08 22:58:42.184618 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:42.184519 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ecf958d6-1612-477f-9166-b4b37bea2828" path="/var/lib/kubelet/pods/ecf958d6-1612-477f-9166-b4b37bea2828/volumes" Jul 08 22:58:43.029609 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:43.029578 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:43.991658 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:43.991628 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:43.992682 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:43.992663 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:53.008064 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:53.008018 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c"] Jul 08 22:58:53.008512 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:53.008258 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" podUID="357aa739-4cfd-44fc-9bf6-a50eba44c117" containerName="istio-proxy" containerID="cri-o://0d608736f717d0304916fc7ac01285fa8597a967708f016872f1c04bc8a8945b" gracePeriod=30 Jul 08 22:58:58.274635 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.274569 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:58.335987 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.335946 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/357aa739-4cfd-44fc-9bf6-a50eba44c117-istiod-ca-cert\") pod \"357aa739-4cfd-44fc-9bf6-a50eba44c117\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " Jul 08 22:58:58.336187 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.336009 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-workload-socket\") pod \"357aa739-4cfd-44fc-9bf6-a50eba44c117\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " Jul 08 22:58:58.336187 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.336089 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-data\") pod \"357aa739-4cfd-44fc-9bf6-a50eba44c117\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " Jul 08 22:58:58.336187 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.336130 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctfvh\" (UniqueName: \"kubernetes.io/projected/357aa739-4cfd-44fc-9bf6-a50eba44c117-kube-api-access-ctfvh\") pod \"357aa739-4cfd-44fc-9bf6-a50eba44c117\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " Jul 08 22:58:58.336187 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.336164 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-podinfo\") pod \"357aa739-4cfd-44fc-9bf6-a50eba44c117\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " Jul 08 22:58:58.336420 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.336191 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-token\") pod \"357aa739-4cfd-44fc-9bf6-a50eba44c117\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " Jul 08 22:58:58.336420 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.336231 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-envoy\") pod \"357aa739-4cfd-44fc-9bf6-a50eba44c117\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " Jul 08 22:58:58.336420 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.336258 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-credential-socket\") pod \"357aa739-4cfd-44fc-9bf6-a50eba44c117\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " Jul 08 22:58:58.336420 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.336290 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-workload-certs\") pod \"357aa739-4cfd-44fc-9bf6-a50eba44c117\" (UID: \"357aa739-4cfd-44fc-9bf6-a50eba44c117\") " Jul 08 22:58:58.336420 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.336302 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/357aa739-4cfd-44fc-9bf6-a50eba44c117-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "357aa739-4cfd-44fc-9bf6-a50eba44c117" (UID: "357aa739-4cfd-44fc-9bf6-a50eba44c117"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:58:58.336420 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.336302 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "357aa739-4cfd-44fc-9bf6-a50eba44c117" (UID: "357aa739-4cfd-44fc-9bf6-a50eba44c117"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:58:58.336420 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.336380 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-data" (OuterVolumeSpecName: "istio-data") pod "357aa739-4cfd-44fc-9bf6-a50eba44c117" (UID: "357aa739-4cfd-44fc-9bf6-a50eba44c117"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:58:58.336832 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.336541 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "357aa739-4cfd-44fc-9bf6-a50eba44c117" (UID: "357aa739-4cfd-44fc-9bf6-a50eba44c117"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:58:58.336832 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.336676 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-credential-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:58:58.336832 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.336696 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/357aa739-4cfd-44fc-9bf6-a50eba44c117-istiod-ca-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:58:58.336832 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.336710 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-workload-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:58:58.336832 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.336721 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-data\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:58:58.336832 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.336771 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "357aa739-4cfd-44fc-9bf6-a50eba44c117" (UID: "357aa739-4cfd-44fc-9bf6-a50eba44c117"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:58:58.338821 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.338793 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-token" (OuterVolumeSpecName: "istio-token") pod "357aa739-4cfd-44fc-9bf6-a50eba44c117" (UID: "357aa739-4cfd-44fc-9bf6-a50eba44c117"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:58:58.339312 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.339285 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "357aa739-4cfd-44fc-9bf6-a50eba44c117" (UID: "357aa739-4cfd-44fc-9bf6-a50eba44c117"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:58:58.339462 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.339287 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "357aa739-4cfd-44fc-9bf6-a50eba44c117" (UID: "357aa739-4cfd-44fc-9bf6-a50eba44c117"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 22:58:58.339601 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.339577 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/357aa739-4cfd-44fc-9bf6-a50eba44c117-kube-api-access-ctfvh" (OuterVolumeSpecName: "kube-api-access-ctfvh") pod "357aa739-4cfd-44fc-9bf6-a50eba44c117" (UID: "357aa739-4cfd-44fc-9bf6-a50eba44c117"). InnerVolumeSpecName "kube-api-access-ctfvh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:58:58.438140 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.438101 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctfvh\" (UniqueName: \"kubernetes.io/projected/357aa739-4cfd-44fc-9bf6-a50eba44c117-kube-api-access-ctfvh\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:58:58.438140 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.438133 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-podinfo\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:58:58.438140 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.438142 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:58:58.438140 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.438152 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-istio-envoy\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:58:58.438464 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.438162 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/357aa739-4cfd-44fc-9bf6-a50eba44c117-workload-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:58:58.910378 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.910344 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt"] Jul 08 22:58:58.910958 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.910942 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="357aa739-4cfd-44fc-9bf6-a50eba44c117" containerName="istio-proxy" Jul 08 22:58:58.911019 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.910963 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="357aa739-4cfd-44fc-9bf6-a50eba44c117" containerName="istio-proxy" Jul 08 22:58:58.911019 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.910993 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ecf958d6-1612-477f-9166-b4b37bea2828" containerName="istio-proxy" Jul 08 22:58:58.911019 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.911002 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="ecf958d6-1612-477f-9166-b4b37bea2828" containerName="istio-proxy" Jul 08 22:58:58.911115 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.911100 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="357aa739-4cfd-44fc-9bf6-a50eba44c117" containerName="istio-proxy" Jul 08 22:58:58.911152 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.911115 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="ecf958d6-1612-477f-9166-b4b37bea2828" containerName="istio-proxy" Jul 08 22:58:58.913525 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.913507 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:58.916147 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.916120 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-b75060c7-openshift-default-dockercfg-dv8l4\"" Jul 08 22:58:58.925585 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:58.925541 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt"] Jul 08 22:58:59.042896 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.042855 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istiod-ca-cert\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.042896 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.042896 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-data\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.043130 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.042974 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-credential-socket\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.043130 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.042999 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-token\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.043130 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.043023 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7npd5\" (UniqueName: \"kubernetes.io/projected/0be5d3b8-9181-48ae-b290-1a8a48728bf7-kube-api-access-7npd5\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.043130 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.043070 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-podinfo\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.043130 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.043117 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-envoy\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.043302 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.043142 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-workload-socket\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.043302 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.043165 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-workload-certs\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.078451 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.078421 2573 generic.go:356] "Generic (PLEG): container finished" podID="357aa739-4cfd-44fc-9bf6-a50eba44c117" containerID="0d608736f717d0304916fc7ac01285fa8597a967708f016872f1c04bc8a8945b" exitCode=0 Jul 08 22:58:59.078665 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.078473 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" Jul 08 22:58:59.078665 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.078515 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" event={"ID":"357aa739-4cfd-44fc-9bf6-a50eba44c117","Type":"ContainerDied","Data":"0d608736f717d0304916fc7ac01285fa8597a967708f016872f1c04bc8a8945b"} Jul 08 22:58:59.078665 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.078595 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c" event={"ID":"357aa739-4cfd-44fc-9bf6-a50eba44c117","Type":"ContainerDied","Data":"8084916e322644fc1f525a43ec6dd381da8fd7c5d9098117617ba6b9f92bf32a"} Jul 08 22:58:59.078665 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.078620 2573 scope.go:117] "RemoveContainer" containerID="0d608736f717d0304916fc7ac01285fa8597a967708f016872f1c04bc8a8945b" Jul 08 22:58:59.089211 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.089191 2573 scope.go:117] "RemoveContainer" containerID="0d608736f717d0304916fc7ac01285fa8597a967708f016872f1c04bc8a8945b" Jul 08 22:58:59.089527 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:58:59.089507 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0d608736f717d0304916fc7ac01285fa8597a967708f016872f1c04bc8a8945b\": container with ID starting with 0d608736f717d0304916fc7ac01285fa8597a967708f016872f1c04bc8a8945b not found: ID does not exist" containerID="0d608736f717d0304916fc7ac01285fa8597a967708f016872f1c04bc8a8945b" Jul 08 22:58:59.089655 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.089536 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0d608736f717d0304916fc7ac01285fa8597a967708f016872f1c04bc8a8945b"} err="failed to get container status \"0d608736f717d0304916fc7ac01285fa8597a967708f016872f1c04bc8a8945b\": rpc error: code = NotFound desc = could not find container \"0d608736f717d0304916fc7ac01285fa8597a967708f016872f1c04bc8a8945b\": container with ID starting with 0d608736f717d0304916fc7ac01285fa8597a967708f016872f1c04bc8a8945b not found: ID does not exist" Jul 08 22:58:59.101130 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.101102 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c"] Jul 08 22:58:59.105377 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.105353 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-638bd430-openshift-default-5b7958bb87-rf52c"] Jul 08 22:58:59.144208 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.144177 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-envoy\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.144335 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.144216 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-workload-socket\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.144335 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.144235 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-workload-certs\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.144335 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.144262 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istiod-ca-cert\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.144335 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.144288 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-data\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.144526 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.144364 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-credential-socket\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.144526 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.144395 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-token\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.144526 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.144428 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7npd5\" (UniqueName: \"kubernetes.io/projected/0be5d3b8-9181-48ae-b290-1a8a48728bf7-kube-api-access-7npd5\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.144526 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.144455 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-podinfo\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.144786 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.144728 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-workload-socket\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.144894 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.144875 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-data\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.144998 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.144978 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-workload-certs\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.145048 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.145035 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-credential-socket\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.145361 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.145341 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istiod-ca-cert\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.146929 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.146909 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-envoy\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.147150 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.147128 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-podinfo\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.152680 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.152653 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-7npd5\" (UniqueName: \"kubernetes.io/projected/0be5d3b8-9181-48ae-b290-1a8a48728bf7-kube-api-access-7npd5\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.152809 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.152793 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-token\") pod \"e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.226606 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.226550 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:58:59.365015 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.364990 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt"] Jul 08 22:58:59.366288 ip-10-0-131-200 kubenswrapper[2573]: W0708 22:58:59.366259 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0be5d3b8_9181_48ae_b290_1a8a48728bf7.slice/crio-dda179cd94e0f69bb2e83d1b05c6df18a6ab72afa75a9a104be4209d75a4a83c WatchSource:0}: Error finding container dda179cd94e0f69bb2e83d1b05c6df18a6ab72afa75a9a104be4209d75a4a83c: Status 404 returned error can't find the container with id dda179cd94e0f69bb2e83d1b05c6df18a6ab72afa75a9a104be4209d75a4a83c Jul 08 22:58:59.368585 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.368531 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 22:58:59.368671 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.368615 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 22:58:59.368671 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:58:59.368648 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 22:59:00.088037 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:00.088003 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" event={"ID":"0be5d3b8-9181-48ae-b290-1a8a48728bf7","Type":"ContainerStarted","Data":"f45a1d8d1667b1dd77ba7333198101c1e909f835f9ed49c26f3dfb683536173f"} Jul 08 22:59:00.088227 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:00.088058 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" event={"ID":"0be5d3b8-9181-48ae-b290-1a8a48728bf7","Type":"ContainerStarted","Data":"dda179cd94e0f69bb2e83d1b05c6df18a6ab72afa75a9a104be4209d75a4a83c"} Jul 08 22:59:00.121256 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:00.121203 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" podStartSLOduration=2.121186667 podStartE2EDuration="2.121186667s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 22:58:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 22:59:00.11951412 +0000 UTC m=+1750.458221111" watchObservedRunningTime="2026-07-08 22:59:00.121186667 +0000 UTC m=+1750.459893640" Jul 08 22:59:00.190601 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:00.190536 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="357aa739-4cfd-44fc-9bf6-a50eba44c117" path="/var/lib/kubelet/pods/357aa739-4cfd-44fc-9bf6-a50eba44c117/volumes" Jul 08 22:59:00.227097 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:00.227054 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:59:00.231884 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:00.231856 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:59:01.093371 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:01.093332 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:59:01.094330 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:01.094313 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:59:04.644441 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:04.644407 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt"] Jul 08 22:59:04.644909 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:04.644614 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" podUID="0be5d3b8-9181-48ae-b290-1a8a48728bf7" containerName="istio-proxy" containerID="cri-o://f45a1d8d1667b1dd77ba7333198101c1e909f835f9ed49c26f3dfb683536173f" gracePeriod=30 Jul 08 22:59:10.803609 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:10.803532 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:59:10.959395 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:10.959301 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-token\") pod \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " Jul 08 22:59:10.959395 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:10.959344 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-envoy\") pod \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " Jul 08 22:59:10.959661 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:10.959405 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-credential-socket\") pod \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " Jul 08 22:59:10.959661 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:10.959454 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istiod-ca-cert\") pod \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " Jul 08 22:59:10.959661 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:10.959482 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-workload-socket\") pod \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " Jul 08 22:59:10.959661 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:10.959549 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7npd5\" (UniqueName: \"kubernetes.io/projected/0be5d3b8-9181-48ae-b290-1a8a48728bf7-kube-api-access-7npd5\") pod \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " Jul 08 22:59:10.959661 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:10.959610 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-podinfo\") pod \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " Jul 08 22:59:10.959661 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:10.959643 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-data\") pod \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " Jul 08 22:59:10.959991 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:10.959675 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-workload-certs\") pod \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\" (UID: \"0be5d3b8-9181-48ae-b290-1a8a48728bf7\") " Jul 08 22:59:10.959991 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:10.959793 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "0be5d3b8-9181-48ae-b290-1a8a48728bf7" (UID: "0be5d3b8-9181-48ae-b290-1a8a48728bf7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:59:10.959991 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:10.959824 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "0be5d3b8-9181-48ae-b290-1a8a48728bf7" (UID: "0be5d3b8-9181-48ae-b290-1a8a48728bf7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:59:10.959991 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:10.959923 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "0be5d3b8-9181-48ae-b290-1a8a48728bf7" (UID: "0be5d3b8-9181-48ae-b290-1a8a48728bf7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 22:59:10.960218 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:10.960007 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-credential-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:59:10.960218 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:10.960029 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "0be5d3b8-9181-48ae-b290-1a8a48728bf7" (UID: "0be5d3b8-9181-48ae-b290-1a8a48728bf7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:59:10.960218 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:10.960039 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istiod-ca-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:59:10.960218 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:10.960056 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-workload-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:59:10.960615 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:10.960534 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-data" (OuterVolumeSpecName: "istio-data") pod "0be5d3b8-9181-48ae-b290-1a8a48728bf7" (UID: "0be5d3b8-9181-48ae-b290-1a8a48728bf7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:59:10.961863 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:10.961838 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "0be5d3b8-9181-48ae-b290-1a8a48728bf7" (UID: "0be5d3b8-9181-48ae-b290-1a8a48728bf7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 22:59:10.961975 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:10.961927 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0be5d3b8-9181-48ae-b290-1a8a48728bf7-kube-api-access-7npd5" (OuterVolumeSpecName: "kube-api-access-7npd5") pod "0be5d3b8-9181-48ae-b290-1a8a48728bf7" (UID: "0be5d3b8-9181-48ae-b290-1a8a48728bf7"). InnerVolumeSpecName "kube-api-access-7npd5". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:59:10.962293 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:10.962274 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-token" (OuterVolumeSpecName: "istio-token") pod "0be5d3b8-9181-48ae-b290-1a8a48728bf7" (UID: "0be5d3b8-9181-48ae-b290-1a8a48728bf7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 22:59:10.962362 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:10.962276 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "0be5d3b8-9181-48ae-b290-1a8a48728bf7" (UID: "0be5d3b8-9181-48ae-b290-1a8a48728bf7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 22:59:11.060945 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:11.060902 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:59:11.060945 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:11.060938 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-envoy\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:59:11.060945 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:11.060948 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7npd5\" (UniqueName: \"kubernetes.io/projected/0be5d3b8-9181-48ae-b290-1a8a48728bf7-kube-api-access-7npd5\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:59:11.060945 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:11.060957 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-podinfo\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:59:11.061219 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:11.060966 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-istio-data\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:59:11.061219 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:11.060974 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/0be5d3b8-9181-48ae-b290-1a8a48728bf7-workload-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 22:59:11.158748 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:11.158715 2573 generic.go:356] "Generic (PLEG): container finished" podID="0be5d3b8-9181-48ae-b290-1a8a48728bf7" containerID="f45a1d8d1667b1dd77ba7333198101c1e909f835f9ed49c26f3dfb683536173f" exitCode=0 Jul 08 22:59:11.158938 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:11.158783 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" Jul 08 22:59:11.158938 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:11.158796 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" event={"ID":"0be5d3b8-9181-48ae-b290-1a8a48728bf7","Type":"ContainerDied","Data":"f45a1d8d1667b1dd77ba7333198101c1e909f835f9ed49c26f3dfb683536173f"} Jul 08 22:59:11.158938 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:11.158897 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt" event={"ID":"0be5d3b8-9181-48ae-b290-1a8a48728bf7","Type":"ContainerDied","Data":"dda179cd94e0f69bb2e83d1b05c6df18a6ab72afa75a9a104be4209d75a4a83c"} Jul 08 22:59:11.158938 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:11.158934 2573 scope.go:117] "RemoveContainer" containerID="f45a1d8d1667b1dd77ba7333198101c1e909f835f9ed49c26f3dfb683536173f" Jul 08 22:59:11.169600 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:11.169582 2573 scope.go:117] "RemoveContainer" containerID="f45a1d8d1667b1dd77ba7333198101c1e909f835f9ed49c26f3dfb683536173f" Jul 08 22:59:11.169900 ip-10-0-131-200 kubenswrapper[2573]: E0708 22:59:11.169882 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f45a1d8d1667b1dd77ba7333198101c1e909f835f9ed49c26f3dfb683536173f\": container with ID starting with f45a1d8d1667b1dd77ba7333198101c1e909f835f9ed49c26f3dfb683536173f not found: ID does not exist" containerID="f45a1d8d1667b1dd77ba7333198101c1e909f835f9ed49c26f3dfb683536173f" Jul 08 22:59:11.169973 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:11.169911 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f45a1d8d1667b1dd77ba7333198101c1e909f835f9ed49c26f3dfb683536173f"} err="failed to get container status \"f45a1d8d1667b1dd77ba7333198101c1e909f835f9ed49c26f3dfb683536173f\": rpc error: code = NotFound desc = could not find container \"f45a1d8d1667b1dd77ba7333198101c1e909f835f9ed49c26f3dfb683536173f\": container with ID starting with f45a1d8d1667b1dd77ba7333198101c1e909f835f9ed49c26f3dfb683536173f not found: ID does not exist" Jul 08 22:59:11.192819 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:11.192787 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt"] Jul 08 22:59:11.197166 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:11.197135 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-b75060c7-openshift-default-6668fd4b7-8zqzt"] Jul 08 22:59:12.182201 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:12.182164 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0be5d3b8-9181-48ae-b290-1a8a48728bf7" path="/var/lib/kubelet/pods/0be5d3b8-9181-48ae-b290-1a8a48728bf7/volumes" Jul 08 22:59:50.271739 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:50.271705 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/1.log" Jul 08 22:59:50.283143 ip-10-0-131-200 kubenswrapper[2573]: I0708 22:59:50.283115 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/1.log" Jul 08 23:00:45.734834 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.734789 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh"] Jul 08 23:00:45.735438 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.735406 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0be5d3b8-9181-48ae-b290-1a8a48728bf7" containerName="istio-proxy" Jul 08 23:00:45.735438 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.735430 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="0be5d3b8-9181-48ae-b290-1a8a48728bf7" containerName="istio-proxy" Jul 08 23:00:45.735584 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.735573 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="0be5d3b8-9181-48ae-b290-1a8a48728bf7" containerName="istio-proxy" Jul 08 23:00:45.739194 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.739168 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.741842 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.741818 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-014044e8-openshift-default-dockercfg-lnl98\"" Jul 08 23:00:45.750150 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.750126 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh"] Jul 08 23:00:45.780870 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.780828 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-data\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.781066 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.780876 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-token\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.781066 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.780914 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-credential-socket\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.781066 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.780947 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-workload-socket\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.781066 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.780995 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4869544-75c1-4d86-ab29-41f52f27b2b9-istiod-ca-cert\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.781272 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.781074 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-envoy\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.781272 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.781143 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-workload-certs\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.781272 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.781189 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ss4rh\" (UniqueName: \"kubernetes.io/projected/c4869544-75c1-4d86-ab29-41f52f27b2b9-kube-api-access-ss4rh\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.781272 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.781239 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-podinfo\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.882369 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.882329 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ss4rh\" (UniqueName: \"kubernetes.io/projected/c4869544-75c1-4d86-ab29-41f52f27b2b9-kube-api-access-ss4rh\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.882369 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.882369 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-podinfo\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.882706 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.882409 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-data\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.882706 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.882426 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-token\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.882706 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.882443 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-credential-socket\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.882706 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.882465 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-workload-socket\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.882706 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.882489 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4869544-75c1-4d86-ab29-41f52f27b2b9-istiod-ca-cert\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.882706 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.882531 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-envoy\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.882706 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.882625 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-workload-certs\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.883098 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.883054 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-data\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.883241 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.883213 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-workload-certs\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.883546 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.883279 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-workload-socket\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.883546 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.883367 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-credential-socket\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.883546 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.883521 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4869544-75c1-4d86-ab29-41f52f27b2b9-istiod-ca-cert\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.885061 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.885042 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-envoy\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.885196 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.885177 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-podinfo\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.890582 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.890524 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ss4rh\" (UniqueName: \"kubernetes.io/projected/c4869544-75c1-4d86-ab29-41f52f27b2b9-kube-api-access-ss4rh\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:45.890928 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:45.890909 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-token\") pod \"e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:46.051864 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:46.051756 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:46.199324 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:46.199298 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh"] Jul 08 23:00:46.201416 ip-10-0-131-200 kubenswrapper[2573]: W0708 23:00:46.201392 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc4869544_75c1_4d86_ab29_41f52f27b2b9.slice/crio-17d737a37fab82a740d9ad62313f696066711b38aae5dfd63e3b51c39d43bd12 WatchSource:0}: Error finding container 17d737a37fab82a740d9ad62313f696066711b38aae5dfd63e3b51c39d43bd12: Status 404 returned error can't find the container with id 17d737a37fab82a740d9ad62313f696066711b38aae5dfd63e3b51c39d43bd12 Jul 08 23:00:46.203952 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:46.203918 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:00:46.204062 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:46.203997 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:00:46.204062 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:46.204040 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:00:46.685174 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:46.685133 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" event={"ID":"c4869544-75c1-4d86-ab29-41f52f27b2b9","Type":"ContainerStarted","Data":"3281c3d6e87b4bc87e3c8b398e16f31a9f49efc858e1f310691e2600c5407bb1"} Jul 08 23:00:46.685360 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:46.685184 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" event={"ID":"c4869544-75c1-4d86-ab29-41f52f27b2b9","Type":"ContainerStarted","Data":"17d737a37fab82a740d9ad62313f696066711b38aae5dfd63e3b51c39d43bd12"} Jul 08 23:00:46.706498 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:46.706441 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" podStartSLOduration=1.706417734 podStartE2EDuration="1.706417734s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:00:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:00:46.703600615 +0000 UTC m=+1857.042307608" watchObservedRunningTime="2026-07-08 23:00:46.706417734 +0000 UTC m=+1857.045124707" Jul 08 23:00:47.052179 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:47.052135 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:47.057457 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:47.057428 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:47.692500 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:47.692464 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:47.693578 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:47.693533 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:00:59.766303 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:59.766267 2573 generic.go:356] "Generic (PLEG): container finished" podID="c4869544-75c1-4d86-ab29-41f52f27b2b9" containerID="3281c3d6e87b4bc87e3c8b398e16f31a9f49efc858e1f310691e2600c5407bb1" exitCode=0 Jul 08 23:00:59.766745 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:59.766336 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" event={"ID":"c4869544-75c1-4d86-ab29-41f52f27b2b9","Type":"ContainerDied","Data":"3281c3d6e87b4bc87e3c8b398e16f31a9f49efc858e1f310691e2600c5407bb1"} Jul 08 23:00:59.766796 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:59.766776 2573 scope.go:117] "RemoveContainer" containerID="3281c3d6e87b4bc87e3c8b398e16f31a9f49efc858e1f310691e2600c5407bb1" Jul 08 23:00:59.767839 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:59.767809 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:00:59.767917 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:59.767900 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:00:59.767966 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:00:59.767952 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:01:00.774083 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:00.774045 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" event={"ID":"c4869544-75c1-4d86-ab29-41f52f27b2b9","Type":"ContainerStarted","Data":"790f15d538776156722c3a5fabd1e322fa2b6fff291f2bf50ead9bef5a9478eb"} Jul 08 23:01:01.052700 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:01.052606 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:01:01.053666 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:01.053642 2573 patch_prober.go:28] interesting pod/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 08 23:01:01.053720 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:01.053699 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" podUID="c4869544-75c1-4d86-ab29-41f52f27b2b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 08 23:01:02.052875 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:02.052834 2573 patch_prober.go:28] interesting pod/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 08 23:01:02.053284 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:02.052910 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" podUID="c4869544-75c1-4d86-ab29-41f52f27b2b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 08 23:01:02.692670 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:02.692628 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:01:03.053044 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:03.053004 2573 patch_prober.go:28] interesting pod/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 08 23:01:03.053433 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:03.053088 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" podUID="c4869544-75c1-4d86-ab29-41f52f27b2b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 08 23:01:04.052244 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:04.052206 2573 patch_prober.go:28] interesting pod/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" start-of-body= Jul 08 23:01:04.052439 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:04.052265 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" podUID="c4869544-75c1-4d86-ab29-41f52f27b2b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.55:15021/healthz/ready\": dial tcp 10.132.0.55:15021: connect: connection refused" Jul 08 23:01:05.056810 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:05.056777 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:01:05.057647 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:05.057625 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:01:06.552086 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:06.552049 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh"] Jul 08 23:01:06.814772 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:06.814648 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" podUID="c4869544-75c1-4d86-ab29-41f52f27b2b9" containerName="istio-proxy" containerID="cri-o://790f15d538776156722c3a5fabd1e322fa2b6fff291f2bf50ead9bef5a9478eb" gracePeriod=30 Jul 08 23:01:12.071125 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.071097 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:01:12.233733 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.233698 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4869544-75c1-4d86-ab29-41f52f27b2b9-istiod-ca-cert\") pod \"c4869544-75c1-4d86-ab29-41f52f27b2b9\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " Jul 08 23:01:12.233918 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.233742 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-envoy\") pod \"c4869544-75c1-4d86-ab29-41f52f27b2b9\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " Jul 08 23:01:12.233918 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.233791 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-token\") pod \"c4869544-75c1-4d86-ab29-41f52f27b2b9\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " Jul 08 23:01:12.233918 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.233825 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-credential-socket\") pod \"c4869544-75c1-4d86-ab29-41f52f27b2b9\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " Jul 08 23:01:12.233918 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.233857 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-workload-socket\") pod \"c4869544-75c1-4d86-ab29-41f52f27b2b9\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " Jul 08 23:01:12.233918 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.233880 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-podinfo\") pod \"c4869544-75c1-4d86-ab29-41f52f27b2b9\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " Jul 08 23:01:12.234228 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.233922 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-workload-certs\") pod \"c4869544-75c1-4d86-ab29-41f52f27b2b9\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " Jul 08 23:01:12.234228 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.234089 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ss4rh\" (UniqueName: \"kubernetes.io/projected/c4869544-75c1-4d86-ab29-41f52f27b2b9-kube-api-access-ss4rh\") pod \"c4869544-75c1-4d86-ab29-41f52f27b2b9\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " Jul 08 23:01:12.234228 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.234142 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-data\") pod \"c4869544-75c1-4d86-ab29-41f52f27b2b9\" (UID: \"c4869544-75c1-4d86-ab29-41f52f27b2b9\") " Jul 08 23:01:12.234228 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.234178 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c4869544-75c1-4d86-ab29-41f52f27b2b9" (UID: "c4869544-75c1-4d86-ab29-41f52f27b2b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:01:12.234461 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.234226 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c4869544-75c1-4d86-ab29-41f52f27b2b9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c4869544-75c1-4d86-ab29-41f52f27b2b9" (UID: "c4869544-75c1-4d86-ab29-41f52f27b2b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 23:01:12.234461 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.234243 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c4869544-75c1-4d86-ab29-41f52f27b2b9" (UID: "c4869544-75c1-4d86-ab29-41f52f27b2b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:01:12.234590 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.234515 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c4869544-75c1-4d86-ab29-41f52f27b2b9-istiod-ca-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:01:12.234590 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.234535 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-workload-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:01:12.234590 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.234570 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-workload-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:01:12.234945 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.234915 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c4869544-75c1-4d86-ab29-41f52f27b2b9" (UID: "c4869544-75c1-4d86-ab29-41f52f27b2b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:01:12.235235 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.235215 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-data" (OuterVolumeSpecName: "istio-data") pod "c4869544-75c1-4d86-ab29-41f52f27b2b9" (UID: "c4869544-75c1-4d86-ab29-41f52f27b2b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:01:12.236332 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.236295 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c4869544-75c1-4d86-ab29-41f52f27b2b9" (UID: "c4869544-75c1-4d86-ab29-41f52f27b2b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 23:01:12.236332 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.236303 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-token" (OuterVolumeSpecName: "istio-token") pod "c4869544-75c1-4d86-ab29-41f52f27b2b9" (UID: "c4869544-75c1-4d86-ab29-41f52f27b2b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:01:12.236700 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.236684 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c4869544-75c1-4d86-ab29-41f52f27b2b9" (UID: "c4869544-75c1-4d86-ab29-41f52f27b2b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:01:12.236875 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.236858 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c4869544-75c1-4d86-ab29-41f52f27b2b9-kube-api-access-ss4rh" (OuterVolumeSpecName: "kube-api-access-ss4rh") pod "c4869544-75c1-4d86-ab29-41f52f27b2b9" (UID: "c4869544-75c1-4d86-ab29-41f52f27b2b9"). InnerVolumeSpecName "kube-api-access-ss4rh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:01:12.335574 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.335521 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-credential-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:01:12.335574 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.335574 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-podinfo\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:01:12.335784 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.335586 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ss4rh\" (UniqueName: \"kubernetes.io/projected/c4869544-75c1-4d86-ab29-41f52f27b2b9-kube-api-access-ss4rh\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:01:12.335784 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.335596 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-data\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:01:12.335784 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.335604 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-envoy\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:01:12.335784 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.335611 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c4869544-75c1-4d86-ab29-41f52f27b2b9-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:01:12.852051 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.852019 2573 generic.go:356] "Generic (PLEG): container finished" podID="c4869544-75c1-4d86-ab29-41f52f27b2b9" containerID="790f15d538776156722c3a5fabd1e322fa2b6fff291f2bf50ead9bef5a9478eb" exitCode=0 Jul 08 23:01:12.852225 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.852058 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" event={"ID":"c4869544-75c1-4d86-ab29-41f52f27b2b9","Type":"ContainerDied","Data":"790f15d538776156722c3a5fabd1e322fa2b6fff291f2bf50ead9bef5a9478eb"} Jul 08 23:01:12.852225 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.852075 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" Jul 08 23:01:12.852225 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.852101 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh" event={"ID":"c4869544-75c1-4d86-ab29-41f52f27b2b9","Type":"ContainerDied","Data":"17d737a37fab82a740d9ad62313f696066711b38aae5dfd63e3b51c39d43bd12"} Jul 08 23:01:12.852225 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.852123 2573 scope.go:117] "RemoveContainer" containerID="790f15d538776156722c3a5fabd1e322fa2b6fff291f2bf50ead9bef5a9478eb" Jul 08 23:01:12.862312 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.862283 2573 scope.go:117] "RemoveContainer" containerID="3281c3d6e87b4bc87e3c8b398e16f31a9f49efc858e1f310691e2600c5407bb1" Jul 08 23:01:12.870935 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.870917 2573 scope.go:117] "RemoveContainer" containerID="790f15d538776156722c3a5fabd1e322fa2b6fff291f2bf50ead9bef5a9478eb" Jul 08 23:01:12.871233 ip-10-0-131-200 kubenswrapper[2573]: E0708 23:01:12.871214 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"790f15d538776156722c3a5fabd1e322fa2b6fff291f2bf50ead9bef5a9478eb\": container with ID starting with 790f15d538776156722c3a5fabd1e322fa2b6fff291f2bf50ead9bef5a9478eb not found: ID does not exist" containerID="790f15d538776156722c3a5fabd1e322fa2b6fff291f2bf50ead9bef5a9478eb" Jul 08 23:01:12.871289 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.871242 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"790f15d538776156722c3a5fabd1e322fa2b6fff291f2bf50ead9bef5a9478eb"} err="failed to get container status \"790f15d538776156722c3a5fabd1e322fa2b6fff291f2bf50ead9bef5a9478eb\": rpc error: code = NotFound desc = could not find container \"790f15d538776156722c3a5fabd1e322fa2b6fff291f2bf50ead9bef5a9478eb\": container with ID starting with 790f15d538776156722c3a5fabd1e322fa2b6fff291f2bf50ead9bef5a9478eb not found: ID does not exist" Jul 08 23:01:12.871289 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.871262 2573 scope.go:117] "RemoveContainer" containerID="3281c3d6e87b4bc87e3c8b398e16f31a9f49efc858e1f310691e2600c5407bb1" Jul 08 23:01:12.871532 ip-10-0-131-200 kubenswrapper[2573]: E0708 23:01:12.871510 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3281c3d6e87b4bc87e3c8b398e16f31a9f49efc858e1f310691e2600c5407bb1\": container with ID starting with 3281c3d6e87b4bc87e3c8b398e16f31a9f49efc858e1f310691e2600c5407bb1 not found: ID does not exist" containerID="3281c3d6e87b4bc87e3c8b398e16f31a9f49efc858e1f310691e2600c5407bb1" Jul 08 23:01:12.871602 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.871542 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3281c3d6e87b4bc87e3c8b398e16f31a9f49efc858e1f310691e2600c5407bb1"} err="failed to get container status \"3281c3d6e87b4bc87e3c8b398e16f31a9f49efc858e1f310691e2600c5407bb1\": rpc error: code = NotFound desc = could not find container \"3281c3d6e87b4bc87e3c8b398e16f31a9f49efc858e1f310691e2600c5407bb1\": container with ID starting with 3281c3d6e87b4bc87e3c8b398e16f31a9f49efc858e1f310691e2600c5407bb1 not found: ID does not exist" Jul 08 23:01:12.874882 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.874857 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh"] Jul 08 23:01:12.878710 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:12.878686 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-014044e8-openshift-default-7b7f94fbcf-r2rlh"] Jul 08 23:01:14.183536 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:14.183491 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c4869544-75c1-4d86-ab29-41f52f27b2b9" path="/var/lib/kubelet/pods/c4869544-75c1-4d86-ab29-41f52f27b2b9/volumes" Jul 08 23:01:25.713828 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.713790 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5"] Jul 08 23:01:25.714401 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.714384 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4869544-75c1-4d86-ab29-41f52f27b2b9" containerName="istio-proxy" Jul 08 23:01:25.714449 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.714405 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4869544-75c1-4d86-ab29-41f52f27b2b9" containerName="istio-proxy" Jul 08 23:01:25.714527 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.714515 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4869544-75c1-4d86-ab29-41f52f27b2b9" containerName="istio-proxy" Jul 08 23:01:25.718063 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.718037 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.720418 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.720397 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-3444d81d-openshift-default-dockercfg-4pp6b\"" Jul 08 23:01:25.727075 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.727051 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5"] Jul 08 23:01:25.752255 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.752222 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-credential-socket\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.752255 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.752267 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-f6qqz\" (UniqueName: \"kubernetes.io/projected/82ba68e2-c8a1-4be6-81f2-188f689d02c0-kube-api-access-f6qqz\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.752497 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.752290 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istiod-ca-cert\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.752497 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.752422 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-workload-certs\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.752497 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.752474 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-envoy\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.752670 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.752508 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-data\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.752670 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.752537 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-token\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.752777 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.752666 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-podinfo\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.752777 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.752704 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-workload-socket\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.853636 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.853598 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-token\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.853852 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.853673 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-podinfo\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.853852 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.853709 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-workload-socket\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.853852 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.853745 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-credential-socket\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.854010 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.853881 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-f6qqz\" (UniqueName: \"kubernetes.io/projected/82ba68e2-c8a1-4be6-81f2-188f689d02c0-kube-api-access-f6qqz\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.854010 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.853927 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istiod-ca-cert\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.854010 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.853990 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-workload-certs\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.854175 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.854027 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-envoy\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.854175 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.854064 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-data\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.854284 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.854262 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-workload-socket\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.854432 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.854390 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-workload-certs\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.854541 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.854438 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-credential-socket\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.854781 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.854759 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-data\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.854941 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.854920 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istiod-ca-cert\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.856365 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.856346 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-envoy\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.856436 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.856420 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-podinfo\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.861530 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.861506 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-token\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:25.861803 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:25.861784 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-f6qqz\" (UniqueName: \"kubernetes.io/projected/82ba68e2-c8a1-4be6-81f2-188f689d02c0-kube-api-access-f6qqz\") pod \"e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:26.030111 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:26.030064 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:26.186159 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:26.186126 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5"] Jul 08 23:01:26.187572 ip-10-0-131-200 kubenswrapper[2573]: W0708 23:01:26.187529 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod82ba68e2_c8a1_4be6_81f2_188f689d02c0.slice/crio-c8e340bb6a67cb8b67f691080ccc5a3736ca42aeb6d3948363745c57269fba3e WatchSource:0}: Error finding container c8e340bb6a67cb8b67f691080ccc5a3736ca42aeb6d3948363745c57269fba3e: Status 404 returned error can't find the container with id c8e340bb6a67cb8b67f691080ccc5a3736ca42aeb6d3948363745c57269fba3e Jul 08 23:01:26.190120 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:26.190074 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:01:26.190241 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:26.190157 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:01:26.190241 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:26.190203 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:01:26.931142 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:26.931104 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" event={"ID":"82ba68e2-c8a1-4be6-81f2-188f689d02c0","Type":"ContainerStarted","Data":"ba4a51d710cbde8af8e6378f4ee07f5df929a38655493b5abcfa31b24d42a502"} Jul 08 23:01:26.931544 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:26.931166 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" event={"ID":"82ba68e2-c8a1-4be6-81f2-188f689d02c0","Type":"ContainerStarted","Data":"c8e340bb6a67cb8b67f691080ccc5a3736ca42aeb6d3948363745c57269fba3e"} Jul 08 23:01:26.951214 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:26.951160 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" podStartSLOduration=1.951144429 podStartE2EDuration="1.951144429s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:01:25 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:01:26.948933683 +0000 UTC m=+1897.287640663" watchObservedRunningTime="2026-07-08 23:01:26.951144429 +0000 UTC m=+1897.289851467" Jul 08 23:01:27.031028 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:27.030987 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:27.036074 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:27.036045 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:27.937170 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:27.937136 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:27.938087 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:27.938062 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:42.034837 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:42.034808 2573 generic.go:356] "Generic (PLEG): container finished" podID="82ba68e2-c8a1-4be6-81f2-188f689d02c0" containerID="ba4a51d710cbde8af8e6378f4ee07f5df929a38655493b5abcfa31b24d42a502" exitCode=0 Jul 08 23:01:42.035193 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:42.034885 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" event={"ID":"82ba68e2-c8a1-4be6-81f2-188f689d02c0","Type":"ContainerDied","Data":"ba4a51d710cbde8af8e6378f4ee07f5df929a38655493b5abcfa31b24d42a502"} Jul 08 23:01:42.035351 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:42.035336 2573 scope.go:117] "RemoveContainer" containerID="ba4a51d710cbde8af8e6378f4ee07f5df929a38655493b5abcfa31b24d42a502" Jul 08 23:01:42.036377 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:42.036349 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:01:42.036432 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:42.036416 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:01:42.036488 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:42.036474 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:01:42.937364 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:42.937321 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:43.042667 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:43.042632 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" event={"ID":"82ba68e2-c8a1-4be6-81f2-188f689d02c0","Type":"ContainerStarted","Data":"f6bf39898ccc8a26c3835ad301374e2181bc743975fff4081391165257f5f9e4"} Jul 08 23:01:44.030337 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:44.030296 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:44.031543 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:44.031517 2573 patch_prober.go:28] interesting pod/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 08 23:01:44.031685 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:44.031588 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" podUID="82ba68e2-c8a1-4be6-81f2-188f689d02c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 08 23:01:45.031222 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:45.031188 2573 patch_prober.go:28] interesting pod/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 08 23:01:45.031686 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:45.031257 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" podUID="82ba68e2-c8a1-4be6-81f2-188f689d02c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 08 23:01:46.030627 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:46.030590 2573 patch_prober.go:28] interesting pod/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" start-of-body= Jul 08 23:01:46.030808 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:46.030646 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" podUID="82ba68e2-c8a1-4be6-81f2-188f689d02c0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.56:15021/healthz/ready\": dial tcp 10.132.0.56:15021: connect: connection refused" Jul 08 23:01:47.034833 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:47.034799 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:47.035282 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:47.035223 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:01:47.035996 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:01:47.035976 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:03:04.489774 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:04.489741 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5"] Jul 08 23:03:04.490333 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:04.490001 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" podUID="82ba68e2-c8a1-4be6-81f2-188f689d02c0" containerName="istio-proxy" containerID="cri-o://f6bf39898ccc8a26c3835ad301374e2181bc743975fff4081391165257f5f9e4" gracePeriod=30 Jul 08 23:03:09.737330 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.737305 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:03:09.801789 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.801705 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istiod-ca-cert\") pod \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " Jul 08 23:03:09.801789 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.801750 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-data\") pod \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " Jul 08 23:03:09.801789 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.801792 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-envoy\") pod \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " Jul 08 23:03:09.802070 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.801812 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-workload-socket\") pod \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " Jul 08 23:03:09.802070 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.801836 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-token\") pod \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " Jul 08 23:03:09.802070 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.801861 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-credential-socket\") pod \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " Jul 08 23:03:09.802070 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.801888 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-f6qqz\" (UniqueName: \"kubernetes.io/projected/82ba68e2-c8a1-4be6-81f2-188f689d02c0-kube-api-access-f6qqz\") pod \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " Jul 08 23:03:09.802070 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.801929 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-workload-certs\") pod \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " Jul 08 23:03:09.802070 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.801955 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-podinfo\") pod \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\" (UID: \"82ba68e2-c8a1-4be6-81f2-188f689d02c0\") " Jul 08 23:03:09.802508 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.802478 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "82ba68e2-c8a1-4be6-81f2-188f689d02c0" (UID: "82ba68e2-c8a1-4be6-81f2-188f689d02c0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:03:09.802927 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.802702 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "82ba68e2-c8a1-4be6-81f2-188f689d02c0" (UID: "82ba68e2-c8a1-4be6-81f2-188f689d02c0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 23:03:09.802927 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.802786 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-workload-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:03:09.803214 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.803142 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "82ba68e2-c8a1-4be6-81f2-188f689d02c0" (UID: "82ba68e2-c8a1-4be6-81f2-188f689d02c0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:03:09.803396 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.803291 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-data" (OuterVolumeSpecName: "istio-data") pod "82ba68e2-c8a1-4be6-81f2-188f689d02c0" (UID: "82ba68e2-c8a1-4be6-81f2-188f689d02c0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:03:09.805627 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.803513 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "82ba68e2-c8a1-4be6-81f2-188f689d02c0" (UID: "82ba68e2-c8a1-4be6-81f2-188f689d02c0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:03:09.811281 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.805667 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "82ba68e2-c8a1-4be6-81f2-188f689d02c0" (UID: "82ba68e2-c8a1-4be6-81f2-188f689d02c0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:03:09.811281 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.805940 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "82ba68e2-c8a1-4be6-81f2-188f689d02c0" (UID: "82ba68e2-c8a1-4be6-81f2-188f689d02c0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 23:03:09.811399 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.811298 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82ba68e2-c8a1-4be6-81f2-188f689d02c0-kube-api-access-f6qqz" (OuterVolumeSpecName: "kube-api-access-f6qqz") pod "82ba68e2-c8a1-4be6-81f2-188f689d02c0" (UID: "82ba68e2-c8a1-4be6-81f2-188f689d02c0"). InnerVolumeSpecName "kube-api-access-f6qqz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:03:09.811399 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.811334 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-token" (OuterVolumeSpecName: "istio-token") pod "82ba68e2-c8a1-4be6-81f2-188f689d02c0" (UID: "82ba68e2-c8a1-4be6-81f2-188f689d02c0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:03:09.903894 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.903856 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-podinfo\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:03:09.903894 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.903890 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istiod-ca-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:03:09.903894 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.903899 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-data\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:03:09.904133 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.903912 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-envoy\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:03:09.904133 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.903925 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-workload-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:03:09.904133 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.903933 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/82ba68e2-c8a1-4be6-81f2-188f689d02c0-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:03:09.904133 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.903941 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/82ba68e2-c8a1-4be6-81f2-188f689d02c0-credential-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:03:09.904133 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:09.903950 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-f6qqz\" (UniqueName: \"kubernetes.io/projected/82ba68e2-c8a1-4be6-81f2-188f689d02c0-kube-api-access-f6qqz\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:03:10.544903 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:10.544864 2573 generic.go:356] "Generic (PLEG): container finished" podID="82ba68e2-c8a1-4be6-81f2-188f689d02c0" containerID="f6bf39898ccc8a26c3835ad301374e2181bc743975fff4081391165257f5f9e4" exitCode=0 Jul 08 23:03:10.545096 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:10.544934 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" Jul 08 23:03:10.545096 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:10.544940 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" event={"ID":"82ba68e2-c8a1-4be6-81f2-188f689d02c0","Type":"ContainerDied","Data":"f6bf39898ccc8a26c3835ad301374e2181bc743975fff4081391165257f5f9e4"} Jul 08 23:03:10.545096 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:10.544998 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5" event={"ID":"82ba68e2-c8a1-4be6-81f2-188f689d02c0","Type":"ContainerDied","Data":"c8e340bb6a67cb8b67f691080ccc5a3736ca42aeb6d3948363745c57269fba3e"} Jul 08 23:03:10.545096 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:10.545021 2573 scope.go:117] "RemoveContainer" containerID="f6bf39898ccc8a26c3835ad301374e2181bc743975fff4081391165257f5f9e4" Jul 08 23:03:10.554417 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:10.554393 2573 scope.go:117] "RemoveContainer" containerID="ba4a51d710cbde8af8e6378f4ee07f5df929a38655493b5abcfa31b24d42a502" Jul 08 23:03:10.564834 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:10.564810 2573 scope.go:117] "RemoveContainer" containerID="f6bf39898ccc8a26c3835ad301374e2181bc743975fff4081391165257f5f9e4" Jul 08 23:03:10.565173 ip-10-0-131-200 kubenswrapper[2573]: E0708 23:03:10.565143 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f6bf39898ccc8a26c3835ad301374e2181bc743975fff4081391165257f5f9e4\": container with ID starting with f6bf39898ccc8a26c3835ad301374e2181bc743975fff4081391165257f5f9e4 not found: ID does not exist" containerID="f6bf39898ccc8a26c3835ad301374e2181bc743975fff4081391165257f5f9e4" Jul 08 23:03:10.565359 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:10.565327 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f6bf39898ccc8a26c3835ad301374e2181bc743975fff4081391165257f5f9e4"} err="failed to get container status \"f6bf39898ccc8a26c3835ad301374e2181bc743975fff4081391165257f5f9e4\": rpc error: code = NotFound desc = could not find container \"f6bf39898ccc8a26c3835ad301374e2181bc743975fff4081391165257f5f9e4\": container with ID starting with f6bf39898ccc8a26c3835ad301374e2181bc743975fff4081391165257f5f9e4 not found: ID does not exist" Jul 08 23:03:10.565359 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:10.565360 2573 scope.go:117] "RemoveContainer" containerID="ba4a51d710cbde8af8e6378f4ee07f5df929a38655493b5abcfa31b24d42a502" Jul 08 23:03:10.565683 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:10.565667 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5"] Jul 08 23:03:10.565753 ip-10-0-131-200 kubenswrapper[2573]: E0708 23:03:10.565697 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ba4a51d710cbde8af8e6378f4ee07f5df929a38655493b5abcfa31b24d42a502\": container with ID starting with ba4a51d710cbde8af8e6378f4ee07f5df929a38655493b5abcfa31b24d42a502 not found: ID does not exist" containerID="ba4a51d710cbde8af8e6378f4ee07f5df929a38655493b5abcfa31b24d42a502" Jul 08 23:03:10.565753 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:10.565725 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ba4a51d710cbde8af8e6378f4ee07f5df929a38655493b5abcfa31b24d42a502"} err="failed to get container status \"ba4a51d710cbde8af8e6378f4ee07f5df929a38655493b5abcfa31b24d42a502\": rpc error: code = NotFound desc = could not find container \"ba4a51d710cbde8af8e6378f4ee07f5df929a38655493b5abcfa31b24d42a502\": container with ID starting with ba4a51d710cbde8af8e6378f4ee07f5df929a38655493b5abcfa31b24d42a502 not found: ID does not exist" Jul 08 23:03:10.567932 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:10.567914 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-3444d81d-openshift-default-bfd88459f-ghws5"] Jul 08 23:03:12.182934 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:12.182902 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="82ba68e2-c8a1-4be6-81f2-188f689d02c0" path="/var/lib/kubelet/pods/82ba68e2-c8a1-4be6-81f2-188f689d02c0/volumes" Jul 08 23:03:58.564713 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.564671 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68"] Jul 08 23:03:58.565176 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.565064 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82ba68e2-c8a1-4be6-81f2-188f689d02c0" containerName="istio-proxy" Jul 08 23:03:58.565176 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.565075 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ba68e2-c8a1-4be6-81f2-188f689d02c0" containerName="istio-proxy" Jul 08 23:03:58.565176 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.565088 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c4869544-75c1-4d86-ab29-41f52f27b2b9" containerName="istio-proxy" Jul 08 23:03:58.565176 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.565093 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="c4869544-75c1-4d86-ab29-41f52f27b2b9" containerName="istio-proxy" Jul 08 23:03:58.565176 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.565103 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="82ba68e2-c8a1-4be6-81f2-188f689d02c0" containerName="istio-proxy" Jul 08 23:03:58.565176 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.565109 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="82ba68e2-c8a1-4be6-81f2-188f689d02c0" containerName="istio-proxy" Jul 08 23:03:58.565176 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.565170 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="82ba68e2-c8a1-4be6-81f2-188f689d02c0" containerName="istio-proxy" Jul 08 23:03:58.565176 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.565176 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="c4869544-75c1-4d86-ab29-41f52f27b2b9" containerName="istio-proxy" Jul 08 23:03:58.568232 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.568210 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.574187 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.574166 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-7a2631-openshift-default-dockercfg-k44tq\"" Jul 08 23:03:58.584286 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.584253 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68"] Jul 08 23:03:58.646476 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.646440 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-podinfo\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.646661 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.646482 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4936eb37-e839-47d3-aafe-c0794b911ed5-istiod-ca-cert\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.646661 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.646564 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-workload-socket\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.646661 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.646583 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-data\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.646661 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.646622 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-token\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.646801 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.646670 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-envoy\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.646801 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.646725 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ksskk\" (UniqueName: \"kubernetes.io/projected/4936eb37-e839-47d3-aafe-c0794b911ed5-kube-api-access-ksskk\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.646801 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.646781 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-workload-certs\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.646893 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.646806 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-credential-socket\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.747801 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.747762 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-workload-certs\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.747990 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.747808 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-credential-socket\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.747990 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.747843 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-podinfo\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.747990 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.747881 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4936eb37-e839-47d3-aafe-c0794b911ed5-istiod-ca-cert\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.747990 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.747933 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-workload-socket\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.747990 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.747956 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-data\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.748271 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.748014 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-token\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.748271 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.748046 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-envoy\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.748271 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.748089 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ksskk\" (UniqueName: \"kubernetes.io/projected/4936eb37-e839-47d3-aafe-c0794b911ed5-kube-api-access-ksskk\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.748271 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.748252 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-workload-certs\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.748473 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.748341 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-credential-socket\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.748627 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.748609 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4936eb37-e839-47d3-aafe-c0794b911ed5-istiod-ca-cert\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.748726 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.748669 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-workload-socket\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.748726 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.748711 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-data\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.750989 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.750962 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-envoy\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.751197 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.751177 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-podinfo\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.759618 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.759593 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-token\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.759750 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.759683 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-ksskk\" (UniqueName: \"kubernetes.io/projected/4936eb37-e839-47d3-aafe-c0794b911ed5-kube-api-access-ksskk\") pod \"e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:58.878608 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:58.878477 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:03:59.023953 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:59.023927 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68"] Jul 08 23:03:59.026127 ip-10-0-131-200 kubenswrapper[2573]: W0708 23:03:59.026099 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4936eb37_e839_47d3_aafe_c0794b911ed5.slice/crio-c4da0ec88b19607f4213094007cb37b4d4f2766958693475e12aec0f797ae794 WatchSource:0}: Error finding container c4da0ec88b19607f4213094007cb37b4d4f2766958693475e12aec0f797ae794: Status 404 returned error can't find the container with id c4da0ec88b19607f4213094007cb37b4d4f2766958693475e12aec0f797ae794 Jul 08 23:03:59.028664 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:59.028630 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:03:59.028775 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:59.028700 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:03:59.028775 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:59.028730 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:03:59.822918 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:59.822885 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" event={"ID":"4936eb37-e839-47d3-aafe-c0794b911ed5","Type":"ContainerStarted","Data":"2b77aa707ba655c6a447f132fecff164eefd14318cb0108ed38e85b546f68011"} Jul 08 23:03:59.823377 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:59.822934 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" event={"ID":"4936eb37-e839-47d3-aafe-c0794b911ed5","Type":"ContainerStarted","Data":"c4da0ec88b19607f4213094007cb37b4d4f2766958693475e12aec0f797ae794"} Jul 08 23:03:59.844126 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:59.844075 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" podStartSLOduration=1.844058842 podStartE2EDuration="1.844058842s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:03:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:03:59.841203068 +0000 UTC m=+2050.179910073" watchObservedRunningTime="2026-07-08 23:03:59.844058842 +0000 UTC m=+2050.182765814" Jul 08 23:03:59.879008 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:03:59.878980 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:04:00.884942 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:00.884903 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:04:01.833994 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:01.833962 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:04:01.835208 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:01.835181 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:04:17.453122 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:17.453085 2573 patch_prober.go:28] interesting pod/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": read tcp 10.132.0.2:43736->10.132.0.57:15021: read: connection reset by peer" start-of-body= Jul 08 23:04:17.453825 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:17.453173 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" podUID="4936eb37-e839-47d3-aafe-c0794b911ed5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": read tcp 10.132.0.2:43736->10.132.0.57:15021: read: connection reset by peer" Jul 08 23:04:17.938839 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:17.938808 2573 generic.go:356] "Generic (PLEG): container finished" podID="4936eb37-e839-47d3-aafe-c0794b911ed5" containerID="2b77aa707ba655c6a447f132fecff164eefd14318cb0108ed38e85b546f68011" exitCode=0 Jul 08 23:04:17.939039 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:17.938885 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" event={"ID":"4936eb37-e839-47d3-aafe-c0794b911ed5","Type":"ContainerDied","Data":"2b77aa707ba655c6a447f132fecff164eefd14318cb0108ed38e85b546f68011"} Jul 08 23:04:17.939374 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:17.939343 2573 scope.go:117] "RemoveContainer" containerID="2b77aa707ba655c6a447f132fecff164eefd14318cb0108ed38e85b546f68011" Jul 08 23:04:17.940406 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:17.940378 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:04:17.940511 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:17.940444 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:04:17.940511 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:17.940475 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:04:18.948049 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:18.948005 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" event={"ID":"4936eb37-e839-47d3-aafe-c0794b911ed5","Type":"ContainerStarted","Data":"dcc4409ce3cc9875c48264e4ba2fbe343890f5637a3bbf4e2b41cb3dbed9e201"} Jul 08 23:04:19.879260 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:19.879215 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:04:19.879464 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:19.879432 2573 patch_prober.go:28] interesting pod/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 08 23:04:19.879512 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:19.879485 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" podUID="4936eb37-e839-47d3-aafe-c0794b911ed5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 08 23:04:20.879761 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:20.879721 2573 patch_prober.go:28] interesting pod/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 08 23:04:20.880176 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:20.879781 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" podUID="4936eb37-e839-47d3-aafe-c0794b911ed5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 08 23:04:21.878752 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:21.878720 2573 patch_prober.go:28] interesting pod/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 08 23:04:21.878944 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:21.878784 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" podUID="4936eb37-e839-47d3-aafe-c0794b911ed5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 08 23:04:22.879658 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:22.879615 2573 patch_prober.go:28] interesting pod/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" start-of-body= Jul 08 23:04:22.880077 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:22.879697 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" podUID="4936eb37-e839-47d3-aafe-c0794b911ed5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.57:15021/healthz/ready\": dial tcp 10.132.0.57:15021: connect: connection refused" Jul 08 23:04:23.882414 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:23.882382 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:04:23.882899 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:23.882816 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:04:23.883510 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:23.883494 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:04:50.312384 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:50.312356 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/1.log" Jul 08 23:04:50.322906 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:04:50.322884 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/1.log" Jul 08 23:06:06.549960 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:06.549929 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68"] Jul 08 23:06:06.550483 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:06.550140 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" podUID="4936eb37-e839-47d3-aafe-c0794b911ed5" containerName="istio-proxy" containerID="cri-o://dcc4409ce3cc9875c48264e4ba2fbe343890f5637a3bbf4e2b41cb3dbed9e201" gracePeriod=30 Jul 08 23:06:08.885166 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:08.885122 2573 patch_prober.go:28] interesting pod/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 08 23:06:08.885591 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:08.885182 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" podUID="4936eb37-e839-47d3-aafe-c0794b911ed5" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 08 23:06:11.809009 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.808943 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:06:11.950334 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.950296 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ksskk\" (UniqueName: \"kubernetes.io/projected/4936eb37-e839-47d3-aafe-c0794b911ed5-kube-api-access-ksskk\") pod \"4936eb37-e839-47d3-aafe-c0794b911ed5\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " Jul 08 23:06:11.950505 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.950359 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-workload-certs\") pod \"4936eb37-e839-47d3-aafe-c0794b911ed5\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " Jul 08 23:06:11.950505 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.950397 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-credential-socket\") pod \"4936eb37-e839-47d3-aafe-c0794b911ed5\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " Jul 08 23:06:11.950633 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.950578 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-workload-socket\") pod \"4936eb37-e839-47d3-aafe-c0794b911ed5\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " Jul 08 23:06:11.950698 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.950640 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-envoy\") pod \"4936eb37-e839-47d3-aafe-c0794b911ed5\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " Jul 08 23:06:11.950756 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.950720 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4936eb37-e839-47d3-aafe-c0794b911ed5-istiod-ca-cert\") pod \"4936eb37-e839-47d3-aafe-c0794b911ed5\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " Jul 08 23:06:11.950756 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.950723 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "4936eb37-e839-47d3-aafe-c0794b911ed5" (UID: "4936eb37-e839-47d3-aafe-c0794b911ed5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:06:11.950756 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.950734 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "4936eb37-e839-47d3-aafe-c0794b911ed5" (UID: "4936eb37-e839-47d3-aafe-c0794b911ed5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:06:11.950756 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.950741 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-token\") pod \"4936eb37-e839-47d3-aafe-c0794b911ed5\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " Jul 08 23:06:11.950964 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.950799 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "4936eb37-e839-47d3-aafe-c0794b911ed5" (UID: "4936eb37-e839-47d3-aafe-c0794b911ed5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:06:11.950964 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.950808 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-data\") pod \"4936eb37-e839-47d3-aafe-c0794b911ed5\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " Jul 08 23:06:11.950964 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.950868 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-podinfo\") pod \"4936eb37-e839-47d3-aafe-c0794b911ed5\" (UID: \"4936eb37-e839-47d3-aafe-c0794b911ed5\") " Jul 08 23:06:11.951098 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.951071 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/4936eb37-e839-47d3-aafe-c0794b911ed5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "4936eb37-e839-47d3-aafe-c0794b911ed5" (UID: "4936eb37-e839-47d3-aafe-c0794b911ed5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 23:06:11.951254 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.951232 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-workload-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:06:11.951354 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.951257 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-credential-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:06:11.951354 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.951272 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-workload-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:06:11.951354 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.951284 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/4936eb37-e839-47d3-aafe-c0794b911ed5-istiod-ca-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:06:11.951708 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.951650 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-data" (OuterVolumeSpecName: "istio-data") pod "4936eb37-e839-47d3-aafe-c0794b911ed5" (UID: "4936eb37-e839-47d3-aafe-c0794b911ed5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:06:11.953067 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.953037 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-token" (OuterVolumeSpecName: "istio-token") pod "4936eb37-e839-47d3-aafe-c0794b911ed5" (UID: "4936eb37-e839-47d3-aafe-c0794b911ed5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:06:11.953178 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.953079 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "4936eb37-e839-47d3-aafe-c0794b911ed5" (UID: "4936eb37-e839-47d3-aafe-c0794b911ed5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 23:06:11.953273 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.953254 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "4936eb37-e839-47d3-aafe-c0794b911ed5" (UID: "4936eb37-e839-47d3-aafe-c0794b911ed5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:06:11.953311 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:11.953265 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/4936eb37-e839-47d3-aafe-c0794b911ed5-kube-api-access-ksskk" (OuterVolumeSpecName: "kube-api-access-ksskk") pod "4936eb37-e839-47d3-aafe-c0794b911ed5" (UID: "4936eb37-e839-47d3-aafe-c0794b911ed5"). InnerVolumeSpecName "kube-api-access-ksskk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:06:12.052352 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:12.052320 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-envoy\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:06:12.052352 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:12.052348 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:06:12.052352 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:12.052356 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-data\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:06:12.052615 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:12.052364 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/4936eb37-e839-47d3-aafe-c0794b911ed5-istio-podinfo\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:06:12.052615 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:12.052372 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ksskk\" (UniqueName: \"kubernetes.io/projected/4936eb37-e839-47d3-aafe-c0794b911ed5-kube-api-access-ksskk\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:06:12.584054 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:12.584017 2573 generic.go:356] "Generic (PLEG): container finished" podID="4936eb37-e839-47d3-aafe-c0794b911ed5" containerID="dcc4409ce3cc9875c48264e4ba2fbe343890f5637a3bbf4e2b41cb3dbed9e201" exitCode=0 Jul 08 23:06:12.584237 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:12.584054 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" event={"ID":"4936eb37-e839-47d3-aafe-c0794b911ed5","Type":"ContainerDied","Data":"dcc4409ce3cc9875c48264e4ba2fbe343890f5637a3bbf4e2b41cb3dbed9e201"} Jul 08 23:06:12.584237 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:12.584119 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" event={"ID":"4936eb37-e839-47d3-aafe-c0794b911ed5","Type":"ContainerDied","Data":"c4da0ec88b19607f4213094007cb37b4d4f2766958693475e12aec0f797ae794"} Jul 08 23:06:12.584237 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:12.584146 2573 scope.go:117] "RemoveContainer" containerID="dcc4409ce3cc9875c48264e4ba2fbe343890f5637a3bbf4e2b41cb3dbed9e201" Jul 08 23:06:12.584237 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:12.584068 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68" Jul 08 23:06:12.594073 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:12.594054 2573 scope.go:117] "RemoveContainer" containerID="2b77aa707ba655c6a447f132fecff164eefd14318cb0108ed38e85b546f68011" Jul 08 23:06:12.604737 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:12.604592 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68"] Jul 08 23:06:12.604798 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:12.604769 2573 scope.go:117] "RemoveContainer" containerID="dcc4409ce3cc9875c48264e4ba2fbe343890f5637a3bbf4e2b41cb3dbed9e201" Jul 08 23:06:12.605078 ip-10-0-131-200 kubenswrapper[2573]: E0708 23:06:12.605057 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dcc4409ce3cc9875c48264e4ba2fbe343890f5637a3bbf4e2b41cb3dbed9e201\": container with ID starting with dcc4409ce3cc9875c48264e4ba2fbe343890f5637a3bbf4e2b41cb3dbed9e201 not found: ID does not exist" containerID="dcc4409ce3cc9875c48264e4ba2fbe343890f5637a3bbf4e2b41cb3dbed9e201" Jul 08 23:06:12.605124 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:12.605088 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dcc4409ce3cc9875c48264e4ba2fbe343890f5637a3bbf4e2b41cb3dbed9e201"} err="failed to get container status \"dcc4409ce3cc9875c48264e4ba2fbe343890f5637a3bbf4e2b41cb3dbed9e201\": rpc error: code = NotFound desc = could not find container \"dcc4409ce3cc9875c48264e4ba2fbe343890f5637a3bbf4e2b41cb3dbed9e201\": container with ID starting with dcc4409ce3cc9875c48264e4ba2fbe343890f5637a3bbf4e2b41cb3dbed9e201 not found: ID does not exist" Jul 08 23:06:12.605124 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:12.605107 2573 scope.go:117] "RemoveContainer" containerID="2b77aa707ba655c6a447f132fecff164eefd14318cb0108ed38e85b546f68011" Jul 08 23:06:12.605367 ip-10-0-131-200 kubenswrapper[2573]: E0708 23:06:12.605352 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2b77aa707ba655c6a447f132fecff164eefd14318cb0108ed38e85b546f68011\": container with ID starting with 2b77aa707ba655c6a447f132fecff164eefd14318cb0108ed38e85b546f68011 not found: ID does not exist" containerID="2b77aa707ba655c6a447f132fecff164eefd14318cb0108ed38e85b546f68011" Jul 08 23:06:12.605419 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:12.605371 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2b77aa707ba655c6a447f132fecff164eefd14318cb0108ed38e85b546f68011"} err="failed to get container status \"2b77aa707ba655c6a447f132fecff164eefd14318cb0108ed38e85b546f68011\": rpc error: code = NotFound desc = could not find container \"2b77aa707ba655c6a447f132fecff164eefd14318cb0108ed38e85b546f68011\": container with ID starting with 2b77aa707ba655c6a447f132fecff164eefd14318cb0108ed38e85b546f68011 not found: ID does not exist" Jul 08 23:06:12.609095 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:12.609073 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-7a2631-openshift-default-7f9588c55c-ctf68"] Jul 08 23:06:14.182789 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.182748 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="4936eb37-e839-47d3-aafe-c0794b911ed5" path="/var/lib/kubelet/pods/4936eb37-e839-47d3-aafe-c0794b911ed5/volumes" Jul 08 23:06:14.378215 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.378180 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt"] Jul 08 23:06:14.378762 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.378744 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4936eb37-e839-47d3-aafe-c0794b911ed5" containerName="istio-proxy" Jul 08 23:06:14.378859 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.378764 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4936eb37-e839-47d3-aafe-c0794b911ed5" containerName="istio-proxy" Jul 08 23:06:14.378859 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.378783 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4936eb37-e839-47d3-aafe-c0794b911ed5" containerName="istio-proxy" Jul 08 23:06:14.378859 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.378792 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="4936eb37-e839-47d3-aafe-c0794b911ed5" containerName="istio-proxy" Jul 08 23:06:14.378956 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.378899 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="82ba68e2-c8a1-4be6-81f2-188f689d02c0" containerName="istio-proxy" Jul 08 23:06:14.378956 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.378914 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4936eb37-e839-47d3-aafe-c0794b911ed5" containerName="istio-proxy" Jul 08 23:06:14.378956 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.378924 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="4936eb37-e839-47d3-aafe-c0794b911ed5" containerName="istio-proxy" Jul 08 23:06:14.383492 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.383469 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.386123 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.386102 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-8b0dbb-openshift-default-dockercfg-s6jk2\"" Jul 08 23:06:14.395428 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.395406 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt"] Jul 08 23:06:14.475131 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.475084 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-envoy\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.475334 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.475151 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-workload-certs\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.475334 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.475183 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-token\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.475334 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.475199 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/737ef00c-fb0e-424f-9d40-d019ddaaa122-istiod-ca-cert\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.475334 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.475223 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-workload-socket\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.475334 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.475283 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-data\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.475334 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.475303 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8d5r6\" (UniqueName: \"kubernetes.io/projected/737ef00c-fb0e-424f-9d40-d019ddaaa122-kube-api-access-8d5r6\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.475706 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.475356 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-credential-socket\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.475706 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.475428 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-podinfo\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.576961 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.576924 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-podinfo\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.577121 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.576997 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-envoy\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.577121 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.577043 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-workload-certs\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.577121 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.577069 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-token\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.577121 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.577092 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/737ef00c-fb0e-424f-9d40-d019ddaaa122-istiod-ca-cert\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.577365 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.577126 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-workload-socket\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.577365 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.577159 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-data\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.577365 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.577183 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8d5r6\" (UniqueName: \"kubernetes.io/projected/737ef00c-fb0e-424f-9d40-d019ddaaa122-kube-api-access-8d5r6\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.577365 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.577215 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-credential-socket\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.577631 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.577603 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-workload-certs\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.577746 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.577714 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-workload-socket\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.577866 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.577721 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-credential-socket\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.577995 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.577976 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-data\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.578034 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.577983 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/737ef00c-fb0e-424f-9d40-d019ddaaa122-istiod-ca-cert\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.579593 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.579573 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-envoy\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.579820 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.579798 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-podinfo\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.585220 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.585196 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-token\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.585714 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.585692 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-8d5r6\" (UniqueName: \"kubernetes.io/projected/737ef00c-fb0e-424f-9d40-d019ddaaa122-kube-api-access-8d5r6\") pod \"e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.697278 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.697225 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:14.843980 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.843950 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt"] Jul 08 23:06:14.845626 ip-10-0-131-200 kubenswrapper[2573]: W0708 23:06:14.845598 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod737ef00c_fb0e_424f_9d40_d019ddaaa122.slice/crio-c5e0ce8f0c59a388b2dfdf44904a6ede9d2353dfa205a0892fe11d1d54ec588b WatchSource:0}: Error finding container c5e0ce8f0c59a388b2dfdf44904a6ede9d2353dfa205a0892fe11d1d54ec588b: Status 404 returned error can't find the container with id c5e0ce8f0c59a388b2dfdf44904a6ede9d2353dfa205a0892fe11d1d54ec588b Jul 08 23:06:14.847771 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.847735 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:06:14.847875 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.847827 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:06:14.847938 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:14.847875 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:06:15.602904 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:15.602870 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" event={"ID":"737ef00c-fb0e-424f-9d40-d019ddaaa122","Type":"ContainerStarted","Data":"f651c8e3216b5568b1c7a3436028ec8481693e268ed0958e094faf3aa4d5ed03"} Jul 08 23:06:15.603298 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:15.602925 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" event={"ID":"737ef00c-fb0e-424f-9d40-d019ddaaa122","Type":"ContainerStarted","Data":"c5e0ce8f0c59a388b2dfdf44904a6ede9d2353dfa205a0892fe11d1d54ec588b"} Jul 08 23:06:15.623299 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:15.623136 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" podStartSLOduration=1.6231151719999999 podStartE2EDuration="1.623115172s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:06:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:06:15.622171092 +0000 UTC m=+2185.960878064" watchObservedRunningTime="2026-07-08 23:06:15.623115172 +0000 UTC m=+2185.961822146" Jul 08 23:06:15.698184 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:15.698143 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:15.703267 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:15.703241 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:16.608226 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:16.608193 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:16.609103 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:16.609081 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:32.649750 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:32.649705 2573 patch_prober.go:28] interesting pod/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 08 23:06:32.650201 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:32.649771 2573 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" podUID="737ef00c-fb0e-424f-9d40-d019ddaaa122" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 08 23:06:34.716899 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:34.716799 2573 generic.go:356] "Generic (PLEG): container finished" podID="737ef00c-fb0e-424f-9d40-d019ddaaa122" containerID="f651c8e3216b5568b1c7a3436028ec8481693e268ed0958e094faf3aa4d5ed03" exitCode=0 Jul 08 23:06:34.716899 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:34.716877 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" event={"ID":"737ef00c-fb0e-424f-9d40-d019ddaaa122","Type":"ContainerDied","Data":"f651c8e3216b5568b1c7a3436028ec8481693e268ed0958e094faf3aa4d5ed03"} Jul 08 23:06:34.717489 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:34.717390 2573 scope.go:117] "RemoveContainer" containerID="f651c8e3216b5568b1c7a3436028ec8481693e268ed0958e094faf3aa4d5ed03" Jul 08 23:06:34.718478 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:34.718446 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:06:34.718616 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:34.718532 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:06:34.718616 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:34.718607 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:06:35.725021 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:35.724970 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" event={"ID":"737ef00c-fb0e-424f-9d40-d019ddaaa122","Type":"ContainerStarted","Data":"e2088753a9d96a4f2e0e8b33d9df77fb3e9c1363f34a9d2a573fe4658369a4fc"} Jul 08 23:06:36.698671 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:36.698636 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:36.698980 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:36.698695 2573 patch_prober.go:28] interesting pod/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 08 23:06:36.699161 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:36.699135 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" podUID="737ef00c-fb0e-424f-9d40-d019ddaaa122" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 08 23:06:37.698778 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:37.698742 2573 patch_prober.go:28] interesting pod/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 08 23:06:37.699380 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:37.699349 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" podUID="737ef00c-fb0e-424f-9d40-d019ddaaa122" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 08 23:06:38.698663 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:38.698626 2573 patch_prober.go:28] interesting pod/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 08 23:06:38.699004 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:38.698970 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" podUID="737ef00c-fb0e-424f-9d40-d019ddaaa122" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 08 23:06:39.698396 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:39.698361 2573 patch_prober.go:28] interesting pod/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" start-of-body= Jul 08 23:06:39.698620 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:39.698438 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" podUID="737ef00c-fb0e-424f-9d40-d019ddaaa122" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.58:15021/healthz/ready\": dial tcp 10.132.0.58:15021: connect: connection refused" Jul 08 23:06:40.701066 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:40.701033 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:40.701589 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:40.701323 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:40.702186 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:40.702168 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:44.104804 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:44.104771 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt"] Jul 08 23:06:44.105265 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:44.105000 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" podUID="737ef00c-fb0e-424f-9d40-d019ddaaa122" containerName="istio-proxy" containerID="cri-o://e2088753a9d96a4f2e0e8b33d9df77fb3e9c1363f34a9d2a573fe4658369a4fc" gracePeriod=30 Jul 08 23:06:49.365612 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.365582 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:49.517672 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.517633 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-workload-socket\") pod \"737ef00c-fb0e-424f-9d40-d019ddaaa122\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " Jul 08 23:06:49.517672 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.517676 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-8d5r6\" (UniqueName: \"kubernetes.io/projected/737ef00c-fb0e-424f-9d40-d019ddaaa122-kube-api-access-8d5r6\") pod \"737ef00c-fb0e-424f-9d40-d019ddaaa122\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " Jul 08 23:06:49.517951 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.517701 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-credential-socket\") pod \"737ef00c-fb0e-424f-9d40-d019ddaaa122\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " Jul 08 23:06:49.517951 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.517751 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-token\") pod \"737ef00c-fb0e-424f-9d40-d019ddaaa122\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " Jul 08 23:06:49.517951 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.517784 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/737ef00c-fb0e-424f-9d40-d019ddaaa122-istiod-ca-cert\") pod \"737ef00c-fb0e-424f-9d40-d019ddaaa122\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " Jul 08 23:06:49.517951 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.517813 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-data\") pod \"737ef00c-fb0e-424f-9d40-d019ddaaa122\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " Jul 08 23:06:49.517951 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.517854 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-podinfo\") pod \"737ef00c-fb0e-424f-9d40-d019ddaaa122\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " Jul 08 23:06:49.517951 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.517895 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-workload-certs\") pod \"737ef00c-fb0e-424f-9d40-d019ddaaa122\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " Jul 08 23:06:49.517951 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.517928 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-envoy\") pod \"737ef00c-fb0e-424f-9d40-d019ddaaa122\" (UID: \"737ef00c-fb0e-424f-9d40-d019ddaaa122\") " Jul 08 23:06:49.518317 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.517968 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "737ef00c-fb0e-424f-9d40-d019ddaaa122" (UID: "737ef00c-fb0e-424f-9d40-d019ddaaa122"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:06:49.518317 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.518015 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "737ef00c-fb0e-424f-9d40-d019ddaaa122" (UID: "737ef00c-fb0e-424f-9d40-d019ddaaa122"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:06:49.518317 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.518191 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "737ef00c-fb0e-424f-9d40-d019ddaaa122" (UID: "737ef00c-fb0e-424f-9d40-d019ddaaa122"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:06:49.518317 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.518214 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/737ef00c-fb0e-424f-9d40-d019ddaaa122-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "737ef00c-fb0e-424f-9d40-d019ddaaa122" (UID: "737ef00c-fb0e-424f-9d40-d019ddaaa122"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 23:06:49.518317 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.518302 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-workload-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:06:49.518546 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.518319 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-workload-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:06:49.518546 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.518333 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-credential-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:06:49.518928 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.518898 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-data" (OuterVolumeSpecName: "istio-data") pod "737ef00c-fb0e-424f-9d40-d019ddaaa122" (UID: "737ef00c-fb0e-424f-9d40-d019ddaaa122"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:06:49.520177 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.520149 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "737ef00c-fb0e-424f-9d40-d019ddaaa122" (UID: "737ef00c-fb0e-424f-9d40-d019ddaaa122"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 23:06:49.520294 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.520179 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-token" (OuterVolumeSpecName: "istio-token") pod "737ef00c-fb0e-424f-9d40-d019ddaaa122" (UID: "737ef00c-fb0e-424f-9d40-d019ddaaa122"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:06:49.520294 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.520236 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "737ef00c-fb0e-424f-9d40-d019ddaaa122" (UID: "737ef00c-fb0e-424f-9d40-d019ddaaa122"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:06:49.520294 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.520260 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/737ef00c-fb0e-424f-9d40-d019ddaaa122-kube-api-access-8d5r6" (OuterVolumeSpecName: "kube-api-access-8d5r6") pod "737ef00c-fb0e-424f-9d40-d019ddaaa122" (UID: "737ef00c-fb0e-424f-9d40-d019ddaaa122"). InnerVolumeSpecName "kube-api-access-8d5r6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:06:49.619147 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.619108 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-data\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:06:49.619147 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.619148 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-podinfo\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:06:49.619358 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.619163 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-envoy\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:06:49.619358 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.619178 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-8d5r6\" (UniqueName: \"kubernetes.io/projected/737ef00c-fb0e-424f-9d40-d019ddaaa122-kube-api-access-8d5r6\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:06:49.619358 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.619194 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/737ef00c-fb0e-424f-9d40-d019ddaaa122-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:06:49.619358 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.619207 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/737ef00c-fb0e-424f-9d40-d019ddaaa122-istiod-ca-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:06:49.805290 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.805189 2573 generic.go:356] "Generic (PLEG): container finished" podID="737ef00c-fb0e-424f-9d40-d019ddaaa122" containerID="e2088753a9d96a4f2e0e8b33d9df77fb3e9c1363f34a9d2a573fe4658369a4fc" exitCode=0 Jul 08 23:06:49.805290 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.805251 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" Jul 08 23:06:49.805290 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.805278 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" event={"ID":"737ef00c-fb0e-424f-9d40-d019ddaaa122","Type":"ContainerDied","Data":"e2088753a9d96a4f2e0e8b33d9df77fb3e9c1363f34a9d2a573fe4658369a4fc"} Jul 08 23:06:49.805602 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.805368 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt" event={"ID":"737ef00c-fb0e-424f-9d40-d019ddaaa122","Type":"ContainerDied","Data":"c5e0ce8f0c59a388b2dfdf44904a6ede9d2353dfa205a0892fe11d1d54ec588b"} Jul 08 23:06:49.805602 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.805394 2573 scope.go:117] "RemoveContainer" containerID="e2088753a9d96a4f2e0e8b33d9df77fb3e9c1363f34a9d2a573fe4658369a4fc" Jul 08 23:06:49.815462 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.815435 2573 scope.go:117] "RemoveContainer" containerID="f651c8e3216b5568b1c7a3436028ec8481693e268ed0958e094faf3aa4d5ed03" Jul 08 23:06:49.824029 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.824013 2573 scope.go:117] "RemoveContainer" containerID="e2088753a9d96a4f2e0e8b33d9df77fb3e9c1363f34a9d2a573fe4658369a4fc" Jul 08 23:06:49.824287 ip-10-0-131-200 kubenswrapper[2573]: E0708 23:06:49.824270 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e2088753a9d96a4f2e0e8b33d9df77fb3e9c1363f34a9d2a573fe4658369a4fc\": container with ID starting with e2088753a9d96a4f2e0e8b33d9df77fb3e9c1363f34a9d2a573fe4658369a4fc not found: ID does not exist" containerID="e2088753a9d96a4f2e0e8b33d9df77fb3e9c1363f34a9d2a573fe4658369a4fc" Jul 08 23:06:49.824340 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.824294 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e2088753a9d96a4f2e0e8b33d9df77fb3e9c1363f34a9d2a573fe4658369a4fc"} err="failed to get container status \"e2088753a9d96a4f2e0e8b33d9df77fb3e9c1363f34a9d2a573fe4658369a4fc\": rpc error: code = NotFound desc = could not find container \"e2088753a9d96a4f2e0e8b33d9df77fb3e9c1363f34a9d2a573fe4658369a4fc\": container with ID starting with e2088753a9d96a4f2e0e8b33d9df77fb3e9c1363f34a9d2a573fe4658369a4fc not found: ID does not exist" Jul 08 23:06:49.824340 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.824311 2573 scope.go:117] "RemoveContainer" containerID="f651c8e3216b5568b1c7a3436028ec8481693e268ed0958e094faf3aa4d5ed03" Jul 08 23:06:49.824668 ip-10-0-131-200 kubenswrapper[2573]: E0708 23:06:49.824632 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f651c8e3216b5568b1c7a3436028ec8481693e268ed0958e094faf3aa4d5ed03\": container with ID starting with f651c8e3216b5568b1c7a3436028ec8481693e268ed0958e094faf3aa4d5ed03 not found: ID does not exist" containerID="f651c8e3216b5568b1c7a3436028ec8481693e268ed0958e094faf3aa4d5ed03" Jul 08 23:06:49.824830 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.824805 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f651c8e3216b5568b1c7a3436028ec8481693e268ed0958e094faf3aa4d5ed03"} err="failed to get container status \"f651c8e3216b5568b1c7a3436028ec8481693e268ed0958e094faf3aa4d5ed03\": rpc error: code = NotFound desc = could not find container \"f651c8e3216b5568b1c7a3436028ec8481693e268ed0958e094faf3aa4d5ed03\": container with ID starting with f651c8e3216b5568b1c7a3436028ec8481693e268ed0958e094faf3aa4d5ed03 not found: ID does not exist" Jul 08 23:06:49.827912 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.827891 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt"] Jul 08 23:06:49.831495 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:49.831475 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-8b0dbb-openshift-default-68958c4b5f-b5qqt"] Jul 08 23:06:50.184762 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:50.184683 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="737ef00c-fb0e-424f-9d40-d019ddaaa122" path="/var/lib/kubelet/pods/737ef00c-fb0e-424f-9d40-d019ddaaa122/volumes" Jul 08 23:06:51.569906 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.569871 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5"] Jul 08 23:06:51.570509 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.570494 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="737ef00c-fb0e-424f-9d40-d019ddaaa122" containerName="istio-proxy" Jul 08 23:06:51.570585 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.570513 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="737ef00c-fb0e-424f-9d40-d019ddaaa122" containerName="istio-proxy" Jul 08 23:06:51.570636 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.570628 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="737ef00c-fb0e-424f-9d40-d019ddaaa122" containerName="istio-proxy" Jul 08 23:06:51.570670 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.570641 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="737ef00c-fb0e-424f-9d40-d019ddaaa122" containerName="istio-proxy" Jul 08 23:06:51.575828 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.575806 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.578138 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.578120 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-d4367d-openshift-default-dockercfg-jv7fz\"" Jul 08 23:06:51.581782 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.581760 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5"] Jul 08 23:06:51.741953 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.741912 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-czhvs\" (UniqueName: \"kubernetes.io/projected/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-kube-api-access-czhvs\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.741953 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.741954 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-workload-certs\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.742214 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.741994 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-token\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.742214 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.742025 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istiod-ca-cert\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.742214 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.742092 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-envoy\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.742214 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.742114 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-podinfo\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.742214 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.742153 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-workload-socket\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.742214 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.742203 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-data\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.742433 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.742226 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-credential-socket\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.843207 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.843102 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-token\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.843207 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.843151 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istiod-ca-cert\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.843207 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.843191 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-envoy\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.843207 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.843206 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-podinfo\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.843660 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.843243 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-workload-socket\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.843660 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.843284 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-data\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.843660 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.843333 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-credential-socket\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.843660 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.843380 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-czhvs\" (UniqueName: \"kubernetes.io/projected/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-kube-api-access-czhvs\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.843660 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.843408 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-workload-certs\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.843931 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.843853 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-data\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.844120 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.844096 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istiod-ca-cert\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.844215 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.844126 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-workload-certs\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.844215 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.844101 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-credential-socket\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.844331 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.844281 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-workload-socket\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.846250 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.846225 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-envoy\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.846515 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.846483 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-podinfo\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.851815 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.851790 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-token\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.852009 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.851986 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-czhvs\" (UniqueName: \"kubernetes.io/projected/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-kube-api-access-czhvs\") pod \"e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:51.888305 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:51.888278 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:52.033971 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:52.033946 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5"] Jul 08 23:06:52.036093 ip-10-0-131-200 kubenswrapper[2573]: W0708 23:06:52.036064 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6061560f_f5b3_4eca_bdfc_91c9a5d9b4b9.slice/crio-a3108b380d3706ccbc7dd36c69c9a066c06aa7b051b29072f2835620f7aac7d2 WatchSource:0}: Error finding container a3108b380d3706ccbc7dd36c69c9a066c06aa7b051b29072f2835620f7aac7d2: Status 404 returned error can't find the container with id a3108b380d3706ccbc7dd36c69c9a066c06aa7b051b29072f2835620f7aac7d2 Jul 08 23:06:52.038950 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:52.038912 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:06:52.039040 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:52.039002 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:06:52.039087 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:52.039071 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:06:52.825828 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:52.825785 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" event={"ID":"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9","Type":"ContainerStarted","Data":"bffbb2c48c0b71b6147c79b5d35982d564e078ade345ffada5634e934d035331"} Jul 08 23:06:52.826235 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:52.825850 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" event={"ID":"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9","Type":"ContainerStarted","Data":"a3108b380d3706ccbc7dd36c69c9a066c06aa7b051b29072f2835620f7aac7d2"} Jul 08 23:06:52.844423 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:52.844359 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" podStartSLOduration=1.844338768 podStartE2EDuration="1.844338768s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-08 23:06:51 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:06:52.843775531 +0000 UTC m=+2223.182482540" watchObservedRunningTime="2026-07-08 23:06:52.844338768 +0000 UTC m=+2223.183045733" Jul 08 23:06:52.889422 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:52.889387 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:53.894853 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:53.894814 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:54.836840 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:54.836805 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:06:54.837960 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:06:54.837940 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:07:08.928493 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:07:08.928396 2573 generic.go:356] "Generic (PLEG): container finished" podID="6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9" containerID="bffbb2c48c0b71b6147c79b5d35982d564e078ade345ffada5634e934d035331" exitCode=0 Jul 08 23:07:08.928493 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:07:08.928476 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" event={"ID":"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9","Type":"ContainerDied","Data":"bffbb2c48c0b71b6147c79b5d35982d564e078ade345ffada5634e934d035331"} Jul 08 23:07:08.928974 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:07:08.928890 2573 scope.go:117] "RemoveContainer" containerID="bffbb2c48c0b71b6147c79b5d35982d564e078ade345ffada5634e934d035331" Jul 08 23:07:08.929998 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:07:08.929963 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:07:08.930120 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:07:08.930032 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:07:08.930120 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:07:08.930064 2573 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892168Ki","pods":"250"} Jul 08 23:07:09.837633 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:07:09.837590 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:07:09.935823 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:07:09.935785 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" event={"ID":"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9","Type":"ContainerStarted","Data":"5c1166ff563446b4a82c30e8c937e954616fdf41b55421ea376c30eed0b29458"} Jul 08 23:07:10.892271 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:07:10.892228 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:07:10.892495 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:07:10.892383 2573 patch_prober.go:28] interesting pod/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 08 23:07:10.892495 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:07:10.892432 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" podUID="6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 08 23:07:11.889232 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:07:11.889138 2573 patch_prober.go:28] interesting pod/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 08 23:07:11.889232 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:07:11.889207 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" podUID="6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 08 23:07:12.889427 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:07:12.889384 2573 patch_prober.go:28] interesting pod/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 08 23:07:12.890083 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:07:12.890047 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" podUID="6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 08 23:07:13.889831 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:07:13.889791 2573 patch_prober.go:28] interesting pod/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" start-of-body= Jul 08 23:07:13.890405 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:07:13.890373 2573 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" podUID="6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.59:15021/healthz/ready\": dial tcp 10.132.0.59:15021: connect: connection refused" Jul 08 23:07:14.893234 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:07:14.893198 2573 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:07:14.893664 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:07:14.893499 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:07:14.894331 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:07:14.894309 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:09:50.352593 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:09:50.352535 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/1.log" Jul 08 23:09:50.363934 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:09:50.363912 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/1.log" Jul 08 23:10:18.236487 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:18.236402 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5"] Jul 08 23:10:18.236915 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:18.236672 2573 kuberuntime_container.go:872] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" podUID="6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9" containerName="istio-proxy" containerID="cri-o://5c1166ff563446b4a82c30e8c937e954616fdf41b55421ea376c30eed0b29458" gracePeriod=30 Jul 08 23:10:23.491430 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.491404 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:10:23.629474 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.629365 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-data\") pod \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " Jul 08 23:10:23.629474 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.629426 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-envoy\") pod \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " Jul 08 23:10:23.629474 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.629457 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-workload-socket\") pod \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " Jul 08 23:10:23.629474 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.629476 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istiod-ca-cert\") pod \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " Jul 08 23:10:23.629861 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.629532 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-credential-socket\") pod \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " Jul 08 23:10:23.629861 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.629641 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-workload-certs\") pod \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " Jul 08 23:10:23.629861 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.629701 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-token\") pod \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " Jul 08 23:10:23.629861 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.629736 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-czhvs\" (UniqueName: \"kubernetes.io/projected/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-kube-api-access-czhvs\") pod \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " Jul 08 23:10:23.629861 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.629756 2573 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-podinfo\") pod \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\" (UID: \"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9\") " Jul 08 23:10:23.630119 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.629875 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9" (UID: "6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:10:23.630119 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.629957 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9" (UID: "6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:10:23.630119 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.629981 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9" (UID: "6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 08 23:10:23.630277 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.630184 2573 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-workload-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:10:23.630277 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.630206 2573 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istiod-ca-cert\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:10:23.630277 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.630221 2573 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-workload-certs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:10:23.630425 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.630275 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9" (UID: "6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:10:23.630425 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.630317 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-data" (OuterVolumeSpecName: "istio-data") pod "6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9" (UID: "6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:10:23.632023 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.631987 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9" (UID: "6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 08 23:10:23.632138 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.632114 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9" (UID: "6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 08 23:10:23.632192 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.632174 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-token" (OuterVolumeSpecName: "istio-token") pod "6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9" (UID: "6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:10:23.632435 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.632413 2573 operation_generator.go:781] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-kube-api-access-czhvs" (OuterVolumeSpecName: "kube-api-access-czhvs") pod "6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9" (UID: "6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9"). InnerVolumeSpecName "kube-api-access-czhvs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 08 23:10:23.731519 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.731487 2573 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-token\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:10:23.731519 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.731517 2573 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-czhvs\" (UniqueName: \"kubernetes.io/projected/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-kube-api-access-czhvs\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:10:23.731519 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.731527 2573 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-podinfo\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:10:23.731519 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.731535 2573 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-data\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:10:23.732237 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.731545 2573 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-istio-envoy\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:10:23.732237 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:23.731583 2573 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9-credential-socket\") on node \"ip-10-0-131-200.ec2.internal\" DevicePath \"\"" Jul 08 23:10:24.028105 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:24.028068 2573 generic.go:356] "Generic (PLEG): container finished" podID="6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9" containerID="5c1166ff563446b4a82c30e8c937e954616fdf41b55421ea376c30eed0b29458" exitCode=0 Jul 08 23:10:24.028281 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:24.028127 2573 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" Jul 08 23:10:24.028281 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:24.028158 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" event={"ID":"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9","Type":"ContainerDied","Data":"5c1166ff563446b4a82c30e8c937e954616fdf41b55421ea376c30eed0b29458"} Jul 08 23:10:24.028281 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:24.028224 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5" event={"ID":"6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9","Type":"ContainerDied","Data":"a3108b380d3706ccbc7dd36c69c9a066c06aa7b051b29072f2835620f7aac7d2"} Jul 08 23:10:24.028281 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:24.028249 2573 scope.go:117] "RemoveContainer" containerID="5c1166ff563446b4a82c30e8c937e954616fdf41b55421ea376c30eed0b29458" Jul 08 23:10:24.040225 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:24.040202 2573 scope.go:117] "RemoveContainer" containerID="bffbb2c48c0b71b6147c79b5d35982d564e078ade345ffada5634e934d035331" Jul 08 23:10:24.049904 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:24.049885 2573 scope.go:117] "RemoveContainer" containerID="5c1166ff563446b4a82c30e8c937e954616fdf41b55421ea376c30eed0b29458" Jul 08 23:10:24.050186 ip-10-0-131-200 kubenswrapper[2573]: E0708 23:10:24.050157 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5c1166ff563446b4a82c30e8c937e954616fdf41b55421ea376c30eed0b29458\": container with ID starting with 5c1166ff563446b4a82c30e8c937e954616fdf41b55421ea376c30eed0b29458 not found: ID does not exist" containerID="5c1166ff563446b4a82c30e8c937e954616fdf41b55421ea376c30eed0b29458" Jul 08 23:10:24.050290 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:24.050197 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5c1166ff563446b4a82c30e8c937e954616fdf41b55421ea376c30eed0b29458"} err="failed to get container status \"5c1166ff563446b4a82c30e8c937e954616fdf41b55421ea376c30eed0b29458\": rpc error: code = NotFound desc = could not find container \"5c1166ff563446b4a82c30e8c937e954616fdf41b55421ea376c30eed0b29458\": container with ID starting with 5c1166ff563446b4a82c30e8c937e954616fdf41b55421ea376c30eed0b29458 not found: ID does not exist" Jul 08 23:10:24.050290 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:24.050218 2573 scope.go:117] "RemoveContainer" containerID="bffbb2c48c0b71b6147c79b5d35982d564e078ade345ffada5634e934d035331" Jul 08 23:10:24.050528 ip-10-0-131-200 kubenswrapper[2573]: E0708 23:10:24.050506 2573 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bffbb2c48c0b71b6147c79b5d35982d564e078ade345ffada5634e934d035331\": container with ID starting with bffbb2c48c0b71b6147c79b5d35982d564e078ade345ffada5634e934d035331 not found: ID does not exist" containerID="bffbb2c48c0b71b6147c79b5d35982d564e078ade345ffada5634e934d035331" Jul 08 23:10:24.050604 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:24.050536 2573 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bffbb2c48c0b71b6147c79b5d35982d564e078ade345ffada5634e934d035331"} err="failed to get container status \"bffbb2c48c0b71b6147c79b5d35982d564e078ade345ffada5634e934d035331\": rpc error: code = NotFound desc = could not find container \"bffbb2c48c0b71b6147c79b5d35982d564e078ade345ffada5634e934d035331\": container with ID starting with bffbb2c48c0b71b6147c79b5d35982d564e078ade345ffada5634e934d035331 not found: ID does not exist" Jul 08 23:10:24.050867 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:24.050851 2573 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5"] Jul 08 23:10:24.054623 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:24.054602 2573 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-d4367d-openshift-default-7748ff5db7-fwdh5"] Jul 08 23:10:24.183864 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:24.183830 2573 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9" path="/var/lib/kubelet/pods/6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9/volumes" Jul 08 23:10:25.695545 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:25.695509 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6bb55c5c8c-9vmbz_82d4c9f4-8da5-489a-932d-1bd749e1dc17/authorino/0.log" Jul 08 23:10:30.188514 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:30.188483 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-tbr82_28f8b75a-156a-411c-b513-d2e8c0507e6c/manager/0.log" Jul 08 23:10:30.860033 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:30.860008 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67f464889d-vfkhr_0c3f38fa-2f25-49d9-9868-acd602cf0eb0/copy-manifests/0.log" Jul 08 23:10:30.866276 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:30.866252 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67f464889d-vfkhr_0c3f38fa-2f25-49d9-9868-acd602cf0eb0/manager/0.log" Jul 08 23:10:31.628969 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:31.628934 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j_56aa51ca-f677-4767-bc30-57e3f1b6765f/util/0.log" Jul 08 23:10:31.635437 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:31.635410 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j_56aa51ca-f677-4767-bc30-57e3f1b6765f/pull/0.log" Jul 08 23:10:31.641181 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:31.641162 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j_56aa51ca-f677-4767-bc30-57e3f1b6765f/extract/0.log" Jul 08 23:10:31.753113 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:31.753083 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w_83d9d177-a817-4a7f-90ea-192dc9dbf3c1/util/0.log" Jul 08 23:10:31.761654 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:31.761625 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w_83d9d177-a817-4a7f-90ea-192dc9dbf3c1/pull/0.log" Jul 08 23:10:31.767883 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:31.767863 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w_83d9d177-a817-4a7f-90ea-192dc9dbf3c1/extract/0.log" Jul 08 23:10:31.874715 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:31.874690 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk_4edba4af-741a-4267-b2e5-541731048617/util/0.log" Jul 08 23:10:31.881044 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:31.880977 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk_4edba4af-741a-4267-b2e5-541731048617/pull/0.log" Jul 08 23:10:31.887040 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:31.887023 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk_4edba4af-741a-4267-b2e5-541731048617/extract/0.log" Jul 08 23:10:31.993672 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:31.993645 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5_17e4d5d9-9948-457c-b6da-69617f0991fd/util/0.log" Jul 08 23:10:31.999282 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:31.999266 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5_17e4d5d9-9948-457c-b6da-69617f0991fd/pull/0.log" Jul 08 23:10:32.004723 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:32.004708 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5_17e4d5d9-9948-457c-b6da-69617f0991fd/extract/0.log" Jul 08 23:10:32.116353 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:32.116317 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6bb55c5c8c-9vmbz_82d4c9f4-8da5-489a-932d-1bd749e1dc17/authorino/0.log" Jul 08 23:10:32.891307 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:32.891271 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-z454c_585d2c5a-237e-4347-a9c1-ec1e869ec56c/manager/0.log" Jul 08 23:10:33.665665 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:33.665633 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5d7b8c9489-fsrbq_836f886d-cb79-47df-91e5-9f9a276c79cc/istio-proxy/1.log" Jul 08 23:10:33.895292 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:33.895255 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-m7xp8_9bb174de-58d5-4694-a615-7325f2d9d7ae/payload-processing/0.log" Jul 08 23:10:34.339342 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:34.339307 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-2-simulated-kserve-67d8d5d6d-sl48g_b716715a-498f-434d-90ea-22ac66a7b23a/main/0.log" Jul 08 23:10:34.774912 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:34.774881 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_facebook-opt-125m-simulated-kserve-74b68447df-fmrbj_5fe5f423-fe02-4b3b-ab35-1d888026c1dc/main/0.log" Jul 08 23:10:41.958054 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:41.958024 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-58csw_98d1079e-ad90-4a60-bcaf-9005a7796b03/global-pull-secret-syncer/0.log" Jul 08 23:10:42.101325 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:42.101290 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-j9nc8_f7ec2b7c-a8c1-402e-9166-6cfc487a0115/konnectivity-agent/0.log" Jul 08 23:10:42.149632 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:42.149604 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-131-200.ec2.internal_b88aa8db4d51f2f1daa8b6c561a11e94/haproxy/0.log" Jul 08 23:10:46.468390 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:46.468357 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j_56aa51ca-f677-4767-bc30-57e3f1b6765f/extract/0.log" Jul 08 23:10:46.489985 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:46.489957 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j_56aa51ca-f677-4767-bc30-57e3f1b6765f/util/0.log" Jul 08 23:10:46.510913 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:46.510850 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b75922k5j_56aa51ca-f677-4767-bc30-57e3f1b6765f/pull/0.log" Jul 08 23:10:46.536019 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:46.535983 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w_83d9d177-a817-4a7f-90ea-192dc9dbf3c1/extract/0.log" Jul 08 23:10:46.558838 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:46.558807 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w_83d9d177-a817-4a7f-90ea-192dc9dbf3c1/util/0.log" Jul 08 23:10:46.578109 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:46.578081 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0jq66w_83d9d177-a817-4a7f-90ea-192dc9dbf3c1/pull/0.log" Jul 08 23:10:46.624335 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:46.624281 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk_4edba4af-741a-4267-b2e5-541731048617/extract/0.log" Jul 08 23:10:46.647012 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:46.646981 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk_4edba4af-741a-4267-b2e5-541731048617/util/0.log" Jul 08 23:10:46.670183 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:46.670157 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73blnsk_4edba4af-741a-4267-b2e5-541731048617/pull/0.log" Jul 08 23:10:46.727416 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:46.727337 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5_17e4d5d9-9948-457c-b6da-69617f0991fd/extract/0.log" Jul 08 23:10:46.746763 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:46.746737 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5_17e4d5d9-9948-457c-b6da-69617f0991fd/util/0.log" Jul 08 23:10:46.778834 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:46.778803 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1rngk5_17e4d5d9-9948-457c-b6da-69617f0991fd/pull/0.log" Jul 08 23:10:47.054701 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:47.054620 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-6bb55c5c8c-9vmbz_82d4c9f4-8da5-489a-932d-1bd749e1dc17/authorino/0.log" Jul 08 23:10:47.420648 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:47.420550 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-operator-controller-manager-859d7b78bd-z454c_585d2c5a-237e-4347-a9c1-ec1e869ec56c/manager/0.log" Jul 08 23:10:49.035307 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:49.035279 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-n425q_e1863738-5f7e-492c-939e-b9b748e4f658/kube-state-metrics/0.log" Jul 08 23:10:49.050434 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:49.050410 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-n425q_e1863738-5f7e-492c-939e-b9b748e4f658/kube-rbac-proxy-main/0.log" Jul 08 23:10:49.069768 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:49.069743 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-7c9dbb8b7d-n425q_e1863738-5f7e-492c-939e-b9b748e4f658/kube-rbac-proxy-self/0.log" Jul 08 23:10:49.121278 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:49.121252 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-d5dcff7cf-fksxf_cd4087f8-0815-45a0-a17a-f67b29cca667/monitoring-plugin/0.log" Jul 08 23:10:49.346907 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:49.346835 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2fn2_4a267882-3b16-4c31-9b32-49995f135456/node-exporter/0.log" Jul 08 23:10:49.369180 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:49.369157 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2fn2_4a267882-3b16-4c31-9b32-49995f135456/kube-rbac-proxy/0.log" Jul 08 23:10:49.390795 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:49.390769 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-z2fn2_4a267882-3b16-4c31-9b32-49995f135456/init-textfile/0.log" Jul 08 23:10:49.851634 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:49.851604 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7568cd6c-dk8sc_18593320-7883-47f8-84fa-0a4d95dd1eaa/thanos-query/0.log" Jul 08 23:10:49.876597 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:49.876549 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7568cd6c-dk8sc_18593320-7883-47f8-84fa-0a4d95dd1eaa/kube-rbac-proxy-web/0.log" Jul 08 23:10:49.904254 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:49.904221 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7568cd6c-dk8sc_18593320-7883-47f8-84fa-0a4d95dd1eaa/kube-rbac-proxy/0.log" Jul 08 23:10:49.923292 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:49.923266 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7568cd6c-dk8sc_18593320-7883-47f8-84fa-0a4d95dd1eaa/prom-label-proxy/0.log" Jul 08 23:10:49.944488 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:49.944469 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7568cd6c-dk8sc_18593320-7883-47f8-84fa-0a4d95dd1eaa/kube-rbac-proxy-rules/0.log" Jul 08 23:10:49.966154 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:49.966127 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-7d7568cd6c-dk8sc_18593320-7883-47f8-84fa-0a4d95dd1eaa/kube-rbac-proxy-metrics/0.log" Jul 08 23:10:51.255172 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:51.255143 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-6bffdf9778-x8r8h_2025a9dd-3c77-4432-a494-4da125abf86f/networking-console-plugin/0.log" Jul 08 23:10:51.860570 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:51.860528 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/1.log" Jul 08 23:10:51.865648 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:51.865619 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-68b757fb67-tscmz_77abbd4d-d10d-47f8-8f2f-6fddd5bb1657/console-operator/2.log" Jul 08 23:10:52.343323 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.343288 2573 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr"] Jul 08 23:10:52.343971 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.343940 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9" containerName="istio-proxy" Jul 08 23:10:52.343971 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.343967 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9" containerName="istio-proxy" Jul 08 23:10:52.344161 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.343985 2573 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="737ef00c-fb0e-424f-9d40-d019ddaaa122" containerName="istio-proxy" Jul 08 23:10:52.344161 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.343993 2573 state_mem.go:107] "Deleted CPUSet assignment" podUID="737ef00c-fb0e-424f-9d40-d019ddaaa122" containerName="istio-proxy" Jul 08 23:10:52.344161 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.344111 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9" containerName="istio-proxy" Jul 08 23:10:52.344161 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.344128 2573 memory_manager.go:368] "RemoveStaleState removing state" podUID="6061560f-f5b3-4eca-bdfc-91c9a5d9b4b9" containerName="istio-proxy" Jul 08 23:10:52.348395 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.348377 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr" Jul 08 23:10:52.351012 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.350991 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-86dvd\"/\"kube-root-ca.crt\"" Jul 08 23:10:52.351979 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.351947 2573 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-86dvd\"/\"default-dockercfg-cpnsg\"" Jul 08 23:10:52.351979 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.351958 2573 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-86dvd\"/\"openshift-service-ca.crt\"" Jul 08 23:10:52.356823 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.356798 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr"] Jul 08 23:10:52.414267 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.414235 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-cbcc88b7d-kz7dz_8e87b7ce-978e-4fd4-9c4c-68bd7b273953/console/0.log" Jul 08 23:10:52.493858 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.493826 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/22c1ca50-5be1-4c16-9ade-db2c8c7c6da0-proc\") pod \"perf-node-gather-daemonset-sv8zr\" (UID: \"22c1ca50-5be1-4c16-9ade-db2c8c7c6da0\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr" Jul 08 23:10:52.494036 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.493878 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/22c1ca50-5be1-4c16-9ade-db2c8c7c6da0-podres\") pod \"perf-node-gather-daemonset-sv8zr\" (UID: \"22c1ca50-5be1-4c16-9ade-db2c8c7c6da0\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr" Jul 08 23:10:52.494036 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.493896 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prkfb\" (UniqueName: \"kubernetes.io/projected/22c1ca50-5be1-4c16-9ade-db2c8c7c6da0-kube-api-access-prkfb\") pod \"perf-node-gather-daemonset-sv8zr\" (UID: \"22c1ca50-5be1-4c16-9ade-db2c8c7c6da0\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr" Jul 08 23:10:52.494036 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.494007 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22c1ca50-5be1-4c16-9ade-db2c8c7c6da0-lib-modules\") pod \"perf-node-gather-daemonset-sv8zr\" (UID: \"22c1ca50-5be1-4c16-9ade-db2c8c7c6da0\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr" Jul 08 23:10:52.494174 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.494056 2573 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22c1ca50-5be1-4c16-9ade-db2c8c7c6da0-sys\") pod \"perf-node-gather-daemonset-sv8zr\" (UID: \"22c1ca50-5be1-4c16-9ade-db2c8c7c6da0\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr" Jul 08 23:10:52.595485 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.595388 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/22c1ca50-5be1-4c16-9ade-db2c8c7c6da0-podres\") pod \"perf-node-gather-daemonset-sv8zr\" (UID: \"22c1ca50-5be1-4c16-9ade-db2c8c7c6da0\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr" Jul 08 23:10:52.595485 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.595422 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prkfb\" (UniqueName: \"kubernetes.io/projected/22c1ca50-5be1-4c16-9ade-db2c8c7c6da0-kube-api-access-prkfb\") pod \"perf-node-gather-daemonset-sv8zr\" (UID: \"22c1ca50-5be1-4c16-9ade-db2c8c7c6da0\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr" Jul 08 23:10:52.595485 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.595445 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22c1ca50-5be1-4c16-9ade-db2c8c7c6da0-lib-modules\") pod \"perf-node-gather-daemonset-sv8zr\" (UID: \"22c1ca50-5be1-4c16-9ade-db2c8c7c6da0\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr" Jul 08 23:10:52.595485 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.595476 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22c1ca50-5be1-4c16-9ade-db2c8c7c6da0-sys\") pod \"perf-node-gather-daemonset-sv8zr\" (UID: \"22c1ca50-5be1-4c16-9ade-db2c8c7c6da0\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr" Jul 08 23:10:52.595891 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.595535 2573 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/22c1ca50-5be1-4c16-9ade-db2c8c7c6da0-proc\") pod \"perf-node-gather-daemonset-sv8zr\" (UID: \"22c1ca50-5be1-4c16-9ade-db2c8c7c6da0\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr" Jul 08 23:10:52.595891 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.595616 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/22c1ca50-5be1-4c16-9ade-db2c8c7c6da0-podres\") pod \"perf-node-gather-daemonset-sv8zr\" (UID: \"22c1ca50-5be1-4c16-9ade-db2c8c7c6da0\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr" Jul 08 23:10:52.595891 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.595637 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/22c1ca50-5be1-4c16-9ade-db2c8c7c6da0-proc\") pod \"perf-node-gather-daemonset-sv8zr\" (UID: \"22c1ca50-5be1-4c16-9ade-db2c8c7c6da0\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr" Jul 08 23:10:52.595891 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.595637 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/22c1ca50-5be1-4c16-9ade-db2c8c7c6da0-sys\") pod \"perf-node-gather-daemonset-sv8zr\" (UID: \"22c1ca50-5be1-4c16-9ade-db2c8c7c6da0\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr" Jul 08 23:10:52.595891 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.595621 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/22c1ca50-5be1-4c16-9ade-db2c8c7c6da0-lib-modules\") pod \"perf-node-gather-daemonset-sv8zr\" (UID: \"22c1ca50-5be1-4c16-9ade-db2c8c7c6da0\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr" Jul 08 23:10:52.603211 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.603188 2573 operation_generator.go:615] "MountVolume.SetUp succeeded for volume \"kube-api-access-prkfb\" (UniqueName: \"kubernetes.io/projected/22c1ca50-5be1-4c16-9ade-db2c8c7c6da0-kube-api-access-prkfb\") pod \"perf-node-gather-daemonset-sv8zr\" (UID: \"22c1ca50-5be1-4c16-9ade-db2c8c7c6da0\") " pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr" Jul 08 23:10:52.660089 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.660055 2573 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr" Jul 08 23:10:52.795764 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:52.795734 2573 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr"] Jul 08 23:10:52.797081 ip-10-0-131-200 kubenswrapper[2573]: W0708 23:10:52.797047 2573 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod22c1ca50_5be1_4c16_9ade_db2c8c7c6da0.slice/crio-879795d1850cc3213948af799cca58b2880798cc2aebfdb3421070e470152872 WatchSource:0}: Error finding container 879795d1850cc3213948af799cca58b2880798cc2aebfdb3421070e470152872: Status 404 returned error can't find the container with id 879795d1850cc3213948af799cca58b2880798cc2aebfdb3421070e470152872 Jul 08 23:10:53.104045 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:53.103964 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-5d456fdbcd-mk5g9_b7e9ab54-1734-465c-9c1c-85315d415441/volume-data-source-validator/0.log" Jul 08 23:10:53.193466 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:53.193432 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr" event={"ID":"22c1ca50-5be1-4c16-9ade-db2c8c7c6da0","Type":"ContainerStarted","Data":"4082a19910cc797394111b6e04c98760dd1dd09d5c89913482aa9f87894f95d8"} Jul 08 23:10:53.193698 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:53.193486 2573 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr" event={"ID":"22c1ca50-5be1-4c16-9ade-db2c8c7c6da0","Type":"ContainerStarted","Data":"879795d1850cc3213948af799cca58b2880798cc2aebfdb3421070e470152872"} Jul 08 23:10:53.193698 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:53.193539 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr" Jul 08 23:10:53.209225 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:53.209174 2573 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr" podStartSLOduration=1.209159452 podStartE2EDuration="1.209159452s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-08 23:10:52 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-08 23:10:53.208132746 +0000 UTC m=+2463.546839720" watchObservedRunningTime="2026-07-08 23:10:53.209159452 +0000 UTC m=+2463.547866426" Jul 08 23:10:54.118694 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:54.118663 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ldnsr_67bdd4c4-38d8-4f50-92bd-73055c10f401/dns/0.log" Jul 08 23:10:54.137371 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:54.137339 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-ldnsr_67bdd4c4-38d8-4f50-92bd-73055c10f401/kube-rbac-proxy/0.log" Jul 08 23:10:54.241424 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:54.241397 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-pn7b8_6863dfc5-3c16-42a7-93a6-dc36e4722c27/dns-node-resolver/0.log" Jul 08 23:10:54.828433 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:54.828403 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-rm7kj_5aaf8eb4-8a4e-43e1-a844-2226f1ca100b/node-ca/0.log" Jul 08 23:10:55.884966 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:55.884931 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5d7b8c9489-fsrbq_836f886d-cb79-47df-91e5-9f9a276c79cc/istio-proxy/0.log" Jul 08 23:10:55.913762 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:55.913731 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5d7b8c9489-fsrbq_836f886d-cb79-47df-91e5-9f9a276c79cc/istio-proxy/1.log" Jul 08 23:10:56.000193 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:56.000158 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-m7xp8_9bb174de-58d5-4694-a615-7325f2d9d7ae/payload-processing/0.log" Jul 08 23:10:56.697522 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:56.697482 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-2g9hb_ff30c41b-0ed8-4b43-a28c-75834602f728/serve-healthcheck-canary/0.log" Jul 08 23:10:57.291915 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:57.291885 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-45r85_52435621-b805-464a-84e1-ed7cf0ebc95b/kube-rbac-proxy/0.log" Jul 08 23:10:57.310500 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:57.310465 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-45r85_52435621-b805-464a-84e1-ed7cf0ebc95b/exporter/0.log" Jul 08 23:10:57.331616 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:57.331592 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-45r85_52435621-b805-464a-84e1-ed7cf0ebc95b/extractor/0.log" Jul 08 23:10:59.209880 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:59.209854 2573 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-86dvd/perf-node-gather-daemonset-sv8zr" Jul 08 23:10:59.494621 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:59.494591 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-tbr82_28f8b75a-156a-411c-b513-d2e8c0507e6c/manager/0.log" Jul 08 23:10:59.847394 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:59.847311 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67f464889d-vfkhr_0c3f38fa-2f25-49d9-9868-acd602cf0eb0/manager/0.log" Jul 08 23:10:59.866048 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:10:59.866025 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-67f464889d-vfkhr_0c3f38fa-2f25-49d9-9868-acd602cf0eb0/copy-manifests/0.log" Jul 08 23:11:01.069286 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:01.069252 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-7c47f9b476-zbnfb_cfe33462-9c0e-4e5a-8c96-e4b87a3443a5/manager/0.log" Jul 08 23:11:01.094083 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:01.094052 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-xrv46_e3e3bb21-646b-4cab-8051-95380702b6fe/openshift-lws-operator/0.log" Jul 08 23:11:02.708026 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:02.707991 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5d7b8c9489-fsrbq_836f886d-cb79-47df-91e5-9f9a276c79cc/istio-proxy/0.log" Jul 08 23:11:02.735297 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:02.735267 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5d7b8c9489-fsrbq_836f886d-cb79-47df-91e5-9f9a276c79cc/istio-proxy/1.log" Jul 08 23:11:02.807442 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:02.807406 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-m7xp8_9bb174de-58d5-4694-a615-7325f2d9d7ae/payload-processing/0.log" Jul 08 23:11:04.300572 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:04.300455 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5d7b8c9489-fsrbq_836f886d-cb79-47df-91e5-9f9a276c79cc/istio-proxy/0.log" Jul 08 23:11:04.331780 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:04.331747 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5d7b8c9489-fsrbq_836f886d-cb79-47df-91e5-9f9a276c79cc/istio-proxy/1.log" Jul 08 23:11:04.406989 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:04.406953 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-58f86c7798-m7xp8_9bb174de-58d5-4694-a615-7325f2d9d7ae/payload-processing/0.log" Jul 08 23:11:06.306006 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:06.305976 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-n5xrb_b96bff0e-6f67-4ce8-ac4e-053a5ce4d27d/migrator/0.log" Jul 08 23:11:06.325340 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:06.325313 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-d57d58cc9-n5xrb_b96bff0e-6f67-4ce8-ac4e-053a5ce4d27d/graceful-termination/0.log" Jul 08 23:11:06.721782 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:06.721746 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-5gdxt_db970960-4fdf-45e5-b4fb-b5028b2c05c0/kube-storage-version-migrator-operator/1.log" Jul 08 23:11:06.722475 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:06.722461 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-846bf668f7-5gdxt_db970960-4fdf-45e5-b4fb-b5028b2c05c0/kube-storage-version-migrator-operator/0.log" Jul 08 23:11:07.720285 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:07.720256 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-8pfgv_87424d7c-287f-40f1-8708-bc4a8c81f996/kube-multus/0.log" Jul 08 23:11:07.879894 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:07.879865 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtwhq_ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4/kube-multus-additional-cni-plugins/0.log" Jul 08 23:11:07.898787 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:07.898730 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtwhq_ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4/egress-router-binary-copy/0.log" Jul 08 23:11:07.917241 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:07.917208 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtwhq_ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4/cni-plugins/0.log" Jul 08 23:11:07.935797 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:07.935771 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtwhq_ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4/bond-cni-plugin/0.log" Jul 08 23:11:07.955291 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:07.955263 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtwhq_ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4/routeoverride-cni/0.log" Jul 08 23:11:07.976089 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:07.976011 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtwhq_ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4/whereabouts-cni-bincopy/0.log" Jul 08 23:11:07.994128 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:07.994100 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-mtwhq_ffa96bf6-022d-4ee9-aa64-0c39c7e41ed4/whereabouts-cni/0.log" Jul 08 23:11:08.236172 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:08.236056 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2t2gl_83988472-fc5e-4e4a-a7ab-248bd26e4a48/network-metrics-daemon/0.log" Jul 08 23:11:08.268805 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:08.268782 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-2t2gl_83988472-fc5e-4e4a-a7ab-248bd26e4a48/kube-rbac-proxy/0.log" Jul 08 23:11:09.573817 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:09.573788 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsj6p_71dfdf35-72dc-4e6d-8b65-516381e2e9a8/ovn-controller/0.log" Jul 08 23:11:09.589479 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:09.589453 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsj6p_71dfdf35-72dc-4e6d-8b65-516381e2e9a8/ovn-acl-logging/0.log" Jul 08 23:11:09.613451 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:09.613420 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsj6p_71dfdf35-72dc-4e6d-8b65-516381e2e9a8/kube-rbac-proxy-node/0.log" Jul 08 23:11:09.637311 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:09.637287 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsj6p_71dfdf35-72dc-4e6d-8b65-516381e2e9a8/kube-rbac-proxy-ovn-metrics/0.log" Jul 08 23:11:09.653638 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:09.653615 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsj6p_71dfdf35-72dc-4e6d-8b65-516381e2e9a8/northd/0.log" Jul 08 23:11:09.672918 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:09.672896 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsj6p_71dfdf35-72dc-4e6d-8b65-516381e2e9a8/nbdb/0.log" Jul 08 23:11:09.691568 ip-10-0-131-200 kubenswrapper[2573]: I0708 23:11:09.691539 2573 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-wsj6p_71dfdf35-72dc-4e6d-8b65-516381e2e9a8/sbdb/0.log"