Jul 28 00:51:36.841983 ip-10-0-132-44 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 28 00:51:36.841996 ip-10-0-132-44 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 28 00:51:36.842005 ip-10-0-132-44 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 28 00:51:36.842311 ip-10-0-132-44 systemd[1]: Failed to start Kubernetes Kubelet. Jul 28 00:51:47.091822 ip-10-0-132-44 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 28 00:51:47.091841 ip-10-0-132-44 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot 9181d32a9ef9492fa7b40b24ae7dfe48 -- Jul 28 00:53:22.964927 ip-10-0-132-44 systemd[1]: Starting Kubernetes Kubelet... Jul 28 00:53:23.342022 ip-10-0-132-44 kubenswrapper[2568]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 00:53:23.342022 ip-10-0-132-44 kubenswrapper[2568]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 28 00:53:23.342022 ip-10-0-132-44 kubenswrapper[2568]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 00:53:23.342022 ip-10-0-132-44 kubenswrapper[2568]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 28 00:53:23.342022 ip-10-0-132-44 kubenswrapper[2568]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 28 00:53:23.343755 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.343538 2568 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 28 00:53:23.349430 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349391 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:53:23.349430 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349420 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:53:23.349430 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349425 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:53:23.349430 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349428 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:53:23.349430 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349431 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:53:23.349430 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349434 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:53:23.349430 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349439 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:53:23.349430 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349443 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:53:23.349430 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349446 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:53:23.349824 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349449 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:53:23.349824 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349453 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:53:23.349824 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349456 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:53:23.349824 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349459 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:53:23.349824 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349462 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:53:23.349824 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349466 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:53:23.349824 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349469 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:53:23.349824 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349472 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:53:23.349824 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349475 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:53:23.349824 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349478 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:53:23.349824 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349481 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:53:23.349824 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349483 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:53:23.349824 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349486 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:53:23.349824 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349489 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:53:23.349824 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349492 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:53:23.349824 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349495 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:53:23.349824 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349498 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:53:23.349824 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349500 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:53:23.349824 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349503 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:53:23.349824 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349506 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:53:23.350296 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349517 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:53:23.350296 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349520 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:53:23.350296 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349523 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:53:23.350296 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349525 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:53:23.350296 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349528 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:53:23.350296 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349531 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:53:23.350296 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349533 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:53:23.350296 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349536 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:53:23.350296 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349538 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:53:23.350296 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349541 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:53:23.350296 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349543 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:53:23.350296 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349546 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:53:23.350296 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349549 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:53:23.350296 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349552 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:53:23.350296 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349555 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:53:23.350296 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349558 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:53:23.350296 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349561 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:53:23.350296 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349579 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:53:23.350296 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349581 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:53:23.350781 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349590 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:53:23.350781 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349593 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:53:23.350781 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349596 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:53:23.350781 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349598 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:53:23.350781 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349601 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:53:23.350781 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349603 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:53:23.350781 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349606 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:53:23.350781 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349608 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:53:23.350781 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349611 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:53:23.350781 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349614 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:53:23.350781 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349617 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:53:23.350781 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349619 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:53:23.350781 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349622 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:53:23.350781 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349624 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:53:23.350781 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349627 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:53:23.350781 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349629 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:53:23.350781 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349634 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:53:23.350781 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349638 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:53:23.350781 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349646 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:53:23.350781 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349649 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:53:23.351259 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349652 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:53:23.351259 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349655 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:53:23.351259 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349657 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:53:23.351259 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349659 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:53:23.351259 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349662 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:53:23.351259 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349665 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:53:23.351259 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349670 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:53:23.351259 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349672 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:53:23.351259 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349675 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:53:23.351259 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349678 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:53:23.351259 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349680 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:53:23.351259 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349682 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:53:23.351259 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349685 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:53:23.351259 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349693 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:53:23.351259 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349696 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:53:23.351259 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349698 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:53:23.351259 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349701 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:53:23.351259 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349703 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:53:23.351259 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349705 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:53:23.351259 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349708 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:53:23.351778 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349710 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:53:23.351778 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349713 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:53:23.351778 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349715 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:53:23.351778 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349717 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:53:23.351778 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349720 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:53:23.351778 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349722 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:53:23.351778 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349725 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:53:23.351778 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349729 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:53:23.351778 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349732 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:53:23.351778 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349735 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:53:23.351778 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.349738 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:53:23.351778 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350547 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:53:23.351778 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350554 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:53:23.351778 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350557 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:53:23.351778 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350559 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:53:23.351778 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350578 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:53:23.351778 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350581 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:53:23.351778 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350584 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:53:23.351778 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350588 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:53:23.352231 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350591 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:53:23.352231 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350594 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:53:23.352231 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350597 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:53:23.352231 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350599 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:53:23.352231 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350602 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:53:23.352231 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350604 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:53:23.352231 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350607 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:53:23.352231 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350616 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:53:23.352231 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350618 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:53:23.352231 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350621 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:53:23.352231 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350624 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:53:23.352231 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350626 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:53:23.352231 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350629 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:53:23.352231 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350631 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:53:23.352231 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350634 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:53:23.352231 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350636 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:53:23.352231 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350639 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:53:23.352231 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350641 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:53:23.352231 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350645 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:53:23.352231 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350648 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:53:23.352790 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350651 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:53:23.352790 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350653 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:53:23.352790 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350656 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:53:23.352790 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350659 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:53:23.352790 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350661 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:53:23.352790 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350665 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:53:23.352790 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350669 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:53:23.352790 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350672 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:53:23.352790 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350675 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:53:23.352790 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350678 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:53:23.352790 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350681 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:53:23.352790 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350684 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:53:23.352790 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350686 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:53:23.352790 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350689 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:53:23.352790 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350692 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:53:23.352790 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350694 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:53:23.352790 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350697 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:53:23.352790 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350700 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:53:23.352790 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350702 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:53:23.353256 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350704 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:53:23.353256 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350713 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:53:23.353256 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350716 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:53:23.353256 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350719 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:53:23.353256 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350721 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:53:23.353256 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350724 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:53:23.353256 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350726 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:53:23.353256 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350728 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:53:23.353256 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350730 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:53:23.353256 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350733 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:53:23.353256 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350735 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:53:23.353256 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350738 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:53:23.353256 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350741 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:53:23.353256 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350743 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:53:23.353256 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350746 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:53:23.353256 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350755 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:53:23.353256 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350758 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:53:23.353256 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350762 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:53:23.353256 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350766 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:53:23.353256 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350769 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:53:23.353773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350772 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:53:23.353773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350775 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:53:23.353773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350778 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:53:23.353773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350781 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:53:23.353773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350788 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:53:23.353773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350790 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:53:23.353773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350793 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:53:23.353773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350795 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:53:23.353773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350798 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:53:23.353773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350801 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:53:23.353773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350803 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:53:23.353773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350805 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:53:23.353773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350808 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:53:23.353773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350810 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:53:23.353773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350819 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:53:23.353773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350822 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:53:23.353773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350825 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:53:23.353773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350828 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:53:23.353773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350830 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:53:23.353773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350832 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:53:23.354275 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350835 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:53:23.354275 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350837 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:53:23.354275 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350840 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:53:23.354275 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350842 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:53:23.354275 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350845 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:53:23.354275 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350847 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:53:23.354275 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350849 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:53:23.354275 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350852 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:53:23.354275 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350854 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:53:23.354275 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350857 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:53:23.354275 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350861 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:53:23.354275 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.350863 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:53:23.354275 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351331 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:53:23.354275 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351338 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:53:23.354275 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351342 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:53:23.354275 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351345 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:53:23.354275 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351349 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:53:23.354275 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351351 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:53:23.354275 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351354 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:53:23.354275 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351356 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:53:23.354792 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351359 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:53:23.354792 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351361 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:53:23.354792 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351364 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:53:23.354792 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351367 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:53:23.354792 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351369 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:53:23.354792 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351372 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:53:23.354792 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351381 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:53:23.354792 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351384 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:53:23.354792 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351386 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:53:23.354792 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351389 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:53:23.354792 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351392 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:53:23.354792 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351394 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:53:23.354792 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351397 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:53:23.354792 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351399 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:53:23.354792 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351401 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:53:23.354792 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351404 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:53:23.354792 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351406 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:53:23.354792 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351408 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:53:23.354792 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351411 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:53:23.354792 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351413 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:53:23.355277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351415 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:53:23.355277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351418 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:53:23.355277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351422 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:53:23.355277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351425 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:53:23.355277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351427 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:53:23.355277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351430 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:53:23.355277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351432 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:53:23.355277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351437 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:53:23.355277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351440 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:53:23.355277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351443 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:53:23.355277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351446 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:53:23.355277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351450 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:53:23.355277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351453 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:53:23.355277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351455 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:53:23.355277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351458 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:53:23.355277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351460 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:53:23.355277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351463 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:53:23.355277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351465 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:53:23.355277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351467 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:53:23.355773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351475 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:53:23.355773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351478 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:53:23.355773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351480 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:53:23.355773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351489 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:53:23.355773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351491 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:53:23.355773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351494 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:53:23.355773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351496 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:53:23.355773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351499 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:53:23.355773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351501 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:53:23.355773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351504 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:53:23.355773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351506 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:53:23.355773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351508 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:53:23.355773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351511 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:53:23.355773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351513 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:53:23.355773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351515 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:53:23.355773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351519 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:53:23.355773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351522 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:53:23.355773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351524 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:53:23.355773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351527 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:53:23.355773 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351530 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:53:23.356248 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351532 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:53:23.356248 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351535 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:53:23.356248 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351537 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:53:23.356248 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351540 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:53:23.356248 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351542 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:53:23.356248 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351545 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:53:23.356248 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351548 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:53:23.356248 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351550 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:53:23.356248 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351552 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:53:23.356248 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351555 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:53:23.356248 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351558 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:53:23.356248 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351560 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:53:23.356248 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351578 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:53:23.356248 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351588 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:53:23.356248 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351590 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:53:23.356248 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351593 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:53:23.356248 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351597 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:53:23.356248 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351600 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:53:23.356248 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351603 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:53:23.356248 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351606 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:53:23.356738 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351609 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:53:23.356738 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351612 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:53:23.356738 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351614 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:53:23.356738 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351621 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:53:23.356738 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351624 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:53:23.356738 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351626 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:53:23.356738 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351629 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:53:23.356738 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351633 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:53:23.356738 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351635 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:53:23.356738 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351638 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:53:23.356738 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351641 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:53:23.356738 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.351644 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:53:23.356738 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351747 2568 flags.go:64] FLAG: --address="0.0.0.0" Jul 28 00:53:23.356738 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351759 2568 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 28 00:53:23.356738 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351770 2568 flags.go:64] FLAG: --anonymous-auth="true" Jul 28 00:53:23.356738 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351774 2568 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 28 00:53:23.356738 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351778 2568 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 28 00:53:23.356738 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351781 2568 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 28 00:53:23.356738 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351786 2568 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 28 00:53:23.356738 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351790 2568 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351793 2568 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351796 2568 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351804 2568 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351807 2568 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351810 2568 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351813 2568 flags.go:64] FLAG: --cgroup-root="" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351824 2568 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351827 2568 flags.go:64] FLAG: --client-ca-file="" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351830 2568 flags.go:64] FLAG: --cloud-provider="external" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351833 2568 flags.go:64] FLAG: --cluster-dns="[]" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351845 2568 flags.go:64] FLAG: --cluster-domain="" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351848 2568 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351851 2568 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351854 2568 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351858 2568 flags.go:64] FLAG: --container-log-max-files="5" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351861 2568 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351864 2568 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351867 2568 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351870 2568 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351874 2568 flags.go:64] FLAG: --contention-profiling="false" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351877 2568 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351879 2568 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351882 2568 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 28 00:53:23.357213 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351885 2568 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351889 2568 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351894 2568 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351897 2568 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351899 2568 flags.go:64] FLAG: --enable-load-reader="false" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351902 2568 flags.go:64] FLAG: --enable-server="true" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351905 2568 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351912 2568 flags.go:64] FLAG: --event-burst="100" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351915 2568 flags.go:64] FLAG: --event-qps="50" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351917 2568 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351920 2568 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351923 2568 flags.go:64] FLAG: --eviction-hard="" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351927 2568 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351929 2568 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351932 2568 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351935 2568 flags.go:64] FLAG: --eviction-soft="" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351940 2568 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351943 2568 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351946 2568 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351949 2568 flags.go:64] FLAG: --experimental-mounter-path="" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351951 2568 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351954 2568 flags.go:64] FLAG: --fail-swap-on="true" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351957 2568 flags.go:64] FLAG: --feature-gates="" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351961 2568 flags.go:64] FLAG: --file-check-frequency="20s" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351963 2568 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 28 00:53:23.357919 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351966 2568 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351970 2568 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351973 2568 flags.go:64] FLAG: --healthz-port="10248" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351976 2568 flags.go:64] FLAG: --help="false" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351979 2568 flags.go:64] FLAG: --hostname-override="ip-10-0-132-44.ec2.internal" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351982 2568 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351985 2568 flags.go:64] FLAG: --http-check-frequency="20s" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351988 2568 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351991 2568 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351996 2568 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.351999 2568 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352002 2568 flags.go:64] FLAG: --image-service-endpoint="" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352004 2568 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352007 2568 flags.go:64] FLAG: --kube-api-burst="100" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352010 2568 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352013 2568 flags.go:64] FLAG: --kube-api-qps="50" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352015 2568 flags.go:64] FLAG: --kube-reserved="" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352018 2568 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352021 2568 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352024 2568 flags.go:64] FLAG: --kubelet-cgroups="" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352026 2568 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352029 2568 flags.go:64] FLAG: --lock-file="" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352031 2568 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352034 2568 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 28 00:53:23.358556 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352038 2568 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352043 2568 flags.go:64] FLAG: --log-json-split-stream="false" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352046 2568 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352049 2568 flags.go:64] FLAG: --log-text-split-stream="false" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352052 2568 flags.go:64] FLAG: --logging-format="text" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352054 2568 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352057 2568 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352060 2568 flags.go:64] FLAG: --manifest-url="" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352063 2568 flags.go:64] FLAG: --manifest-url-header="" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352067 2568 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352070 2568 flags.go:64] FLAG: --max-open-files="1000000" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352074 2568 flags.go:64] FLAG: --max-pods="110" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352077 2568 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352080 2568 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352083 2568 flags.go:64] FLAG: --memory-manager-policy="None" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352086 2568 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352089 2568 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352093 2568 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352096 2568 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352104 2568 flags.go:64] FLAG: --node-status-max-images="50" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352107 2568 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352110 2568 flags.go:64] FLAG: --oom-score-adj="-999" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352113 2568 flags.go:64] FLAG: --pod-cidr="" Jul 28 00:53:23.359330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352116 2568 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:7505336a406394b8c1c77d14d890a9f628aa4cfff172312179cb9af8c28c30bb" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352121 2568 flags.go:64] FLAG: --pod-manifest-path="" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352124 2568 flags.go:64] FLAG: --pod-max-pids="-1" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352127 2568 flags.go:64] FLAG: --pods-per-core="0" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352130 2568 flags.go:64] FLAG: --port="10250" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352133 2568 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352136 2568 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-06090d98435e679b8" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352139 2568 flags.go:64] FLAG: --qos-reserved="" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352142 2568 flags.go:64] FLAG: --read-only-port="10255" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352145 2568 flags.go:64] FLAG: --register-node="true" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352149 2568 flags.go:64] FLAG: --register-with-taints="" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352152 2568 flags.go:64] FLAG: --registry-burst="10" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352155 2568 flags.go:64] FLAG: --registry-qps="5" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352158 2568 flags.go:64] FLAG: --reserved-cpus="" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352160 2568 flags.go:64] FLAG: --reserved-memory="" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352164 2568 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352167 2568 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352170 2568 flags.go:64] FLAG: --rotate-certificates="false" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352172 2568 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352175 2568 flags.go:64] FLAG: --runonce="false" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352178 2568 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352182 2568 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352184 2568 flags.go:64] FLAG: --seccomp-default="false" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352187 2568 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352190 2568 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352192 2568 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 28 00:53:23.360465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352196 2568 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352199 2568 flags.go:64] FLAG: --storage-driver-password="root" Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352202 2568 flags.go:64] FLAG: --storage-driver-secure="false" Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352205 2568 flags.go:64] FLAG: --storage-driver-table="stats" Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352207 2568 flags.go:64] FLAG: --storage-driver-user="root" Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352210 2568 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352213 2568 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352215 2568 flags.go:64] FLAG: --system-cgroups="" Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352218 2568 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352223 2568 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352226 2568 flags.go:64] FLAG: --tls-cert-file="" Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352229 2568 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352233 2568 flags.go:64] FLAG: --tls-min-version="" Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352236 2568 flags.go:64] FLAG: --tls-private-key-file="" Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352239 2568 flags.go:64] FLAG: --topology-manager-policy="none" Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352242 2568 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352245 2568 flags.go:64] FLAG: --topology-manager-scope="container" Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352249 2568 flags.go:64] FLAG: --v="2" Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352253 2568 flags.go:64] FLAG: --version="false" Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352257 2568 flags.go:64] FLAG: --vmodule="" Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352261 2568 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.352264 2568 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352395 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352400 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352403 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:53:23.361605 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352406 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:53:23.362688 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352410 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:53:23.362688 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352413 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:53:23.362688 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352416 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:53:23.362688 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352418 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:53:23.362688 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352422 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:53:23.362688 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352426 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:53:23.362688 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352430 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:53:23.362688 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352433 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:53:23.362688 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352435 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:53:23.362688 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352438 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:53:23.362688 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352441 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:53:23.362688 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352444 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:53:23.362688 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352446 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:53:23.362688 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352449 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:53:23.362688 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352452 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:53:23.362688 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352454 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:53:23.362688 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352457 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:53:23.362688 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352459 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:53:23.362688 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352462 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:53:23.363507 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352464 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:53:23.363507 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352467 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:53:23.363507 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352469 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:53:23.363507 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352471 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:53:23.363507 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352474 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:53:23.363507 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352477 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:53:23.363507 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352480 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:53:23.363507 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352482 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:53:23.363507 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352485 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:53:23.363507 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352487 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:53:23.363507 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352490 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:53:23.363507 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352492 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:53:23.363507 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352495 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:53:23.363507 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352500 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:53:23.363507 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352503 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:53:23.363507 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352505 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:53:23.363507 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352507 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:53:23.363507 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352510 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:53:23.363507 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352513 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:53:23.363507 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352516 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:53:23.364192 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352519 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:53:23.364192 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352522 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:53:23.364192 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352524 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:53:23.364192 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352526 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:53:23.364192 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352529 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:53:23.364192 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352531 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:53:23.364192 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352534 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:53:23.364192 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352536 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:53:23.364192 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352539 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:53:23.364192 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352541 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:53:23.364192 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352544 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:53:23.364192 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352546 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:53:23.364192 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352549 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:53:23.364192 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352551 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:53:23.364192 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352553 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:53:23.364192 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352556 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:53:23.364192 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352559 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:53:23.364192 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352579 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:53:23.364192 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352583 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:53:23.364192 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352586 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:53:23.365016 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352589 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:53:23.365016 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352591 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:53:23.365016 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352594 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:53:23.365016 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352598 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:53:23.365016 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352601 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:53:23.365016 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352606 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:53:23.365016 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352610 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:53:23.365016 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352613 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:53:23.365016 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352615 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:53:23.365016 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352618 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:53:23.365016 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352620 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:53:23.365016 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352624 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:53:23.365016 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352627 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:53:23.365016 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352630 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:53:23.365016 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352632 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:53:23.365016 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352635 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:53:23.365016 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352638 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:53:23.365016 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352641 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:53:23.365016 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352643 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:53:23.365777 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352646 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:53:23.365777 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352648 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:53:23.365777 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352651 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:53:23.365777 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352653 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:53:23.365777 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352655 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:53:23.365777 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352658 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:53:23.365777 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352661 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:53:23.365777 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352663 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:53:23.365777 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352667 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:53:23.365777 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352670 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:53:23.365777 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352673 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:53:23.365777 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352676 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:53:23.365777 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352679 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:53:23.365777 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352682 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:53:23.365777 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352685 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:53:23.365777 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352688 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:53:23.365777 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.352690 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:53:23.366277 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.353354 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 00:53:23.366277 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.361732 2568 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 28 00:53:23.366277 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.361765 2568 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 28 00:53:23.366277 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.361791 2568 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 28 00:53:23.366277 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.361802 2568 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 28 00:53:23.366277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.361914 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:53:23.366277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.361923 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:53:23.366277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.361929 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:53:23.366277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.361935 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:53:23.366277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.361940 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:53:23.366277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.361945 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:53:23.366277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.361949 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:53:23.366277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.361953 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:53:23.366277 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.361958 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:53:23.366741 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.361961 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:53:23.366741 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.361966 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:53:23.366741 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.361970 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:53:23.366741 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.361974 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:53:23.366741 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.361979 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:53:23.366741 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.361983 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:53:23.366741 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.361987 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:53:23.366741 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.361991 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:53:23.366741 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.361998 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:53:23.366741 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362004 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:53:23.366741 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362008 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:53:23.366741 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362013 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:53:23.366741 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362017 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:53:23.366741 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362022 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:53:23.366741 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362026 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:53:23.366741 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362031 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:53:23.366741 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362035 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:53:23.366741 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362039 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:53:23.366741 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362043 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:53:23.367245 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362048 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:53:23.367245 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362062 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:53:23.367245 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362067 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:53:23.367245 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362071 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:53:23.367245 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362075 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:53:23.367245 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362080 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:53:23.367245 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362083 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:53:23.367245 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362088 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:53:23.367245 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362092 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:53:23.367245 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362097 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:53:23.367245 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362101 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:53:23.367245 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362105 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:53:23.367245 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362109 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:53:23.367245 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362114 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:53:23.367245 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362118 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:53:23.367245 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362123 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:53:23.367245 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362127 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:53:23.367245 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362132 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:53:23.367245 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362136 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:53:23.367245 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362141 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:53:23.367795 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362145 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:53:23.367795 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362149 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:53:23.367795 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362153 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:53:23.367795 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362157 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:53:23.367795 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362162 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:53:23.367795 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362166 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:53:23.367795 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362171 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:53:23.367795 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362176 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:53:23.367795 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362180 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:53:23.367795 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362184 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:53:23.367795 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362188 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:53:23.367795 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362192 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:53:23.367795 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362196 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:53:23.367795 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362201 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:53:23.367795 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362208 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:53:23.367795 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362212 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:53:23.367795 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362216 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:53:23.367795 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362220 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:53:23.367795 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362224 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:53:23.367795 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362228 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:53:23.368359 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362232 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:53:23.368359 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362237 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:53:23.368359 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362241 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:53:23.368359 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362245 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:53:23.368359 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362249 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:53:23.368359 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362253 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:53:23.368359 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362258 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:53:23.368359 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362262 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:53:23.368359 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362266 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:53:23.368359 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362271 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:53:23.368359 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362277 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:53:23.368359 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362284 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:53:23.368359 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362290 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:53:23.368359 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362295 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:53:23.368359 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362300 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:53:23.368359 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362305 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:53:23.368359 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362309 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:53:23.368359 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362313 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:53:23.368359 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362317 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:53:23.368940 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362321 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:53:23.368940 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362325 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:53:23.368940 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362329 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:53:23.368940 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362334 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:53:23.368940 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362338 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:53:23.368940 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362342 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:53:23.368940 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362348 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:53:23.368940 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362353 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:53:23.368940 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362363 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:53:23.368940 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362367 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:53:23.368940 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362371 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:53:23.368940 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362375 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:53:23.368940 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.362384 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 00:53:23.368940 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362617 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 28 00:53:23.368940 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362626 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 28 00:53:23.369352 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362631 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 28 00:53:23.369352 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362636 2568 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 28 00:53:23.369352 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362640 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 28 00:53:23.369352 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362644 2568 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 28 00:53:23.369352 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362649 2568 feature_gate.go:328] unrecognized feature gate: Example Jul 28 00:53:23.369352 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362653 2568 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 28 00:53:23.369352 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362658 2568 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 28 00:53:23.369352 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362662 2568 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 28 00:53:23.369352 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362666 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 28 00:53:23.369352 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362670 2568 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 28 00:53:23.369352 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362674 2568 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 28 00:53:23.369352 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362679 2568 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 28 00:53:23.369352 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362683 2568 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 28 00:53:23.369352 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362686 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 28 00:53:23.369352 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362690 2568 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 28 00:53:23.369352 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362694 2568 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 28 00:53:23.369352 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362698 2568 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 28 00:53:23.369352 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362701 2568 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 28 00:53:23.369352 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362705 2568 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 28 00:53:23.369352 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362710 2568 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 28 00:53:23.370015 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362714 2568 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 28 00:53:23.370015 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362718 2568 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 28 00:53:23.370015 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362723 2568 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 28 00:53:23.370015 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362727 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 28 00:53:23.370015 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362733 2568 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 28 00:53:23.370015 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362737 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 28 00:53:23.370015 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362746 2568 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 28 00:53:23.370015 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362752 2568 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 28 00:53:23.370015 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362757 2568 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 28 00:53:23.370015 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362761 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 28 00:53:23.370015 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362766 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 28 00:53:23.370015 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362770 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 28 00:53:23.370015 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362775 2568 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 28 00:53:23.370015 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362779 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 28 00:53:23.370015 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362783 2568 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 28 00:53:23.370015 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362788 2568 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 28 00:53:23.370015 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362792 2568 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 28 00:53:23.370015 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362797 2568 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 28 00:53:23.370015 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362801 2568 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 28 00:53:23.370015 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362805 2568 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 28 00:53:23.370831 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362810 2568 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 28 00:53:23.370831 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362814 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 28 00:53:23.370831 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362818 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 28 00:53:23.370831 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362822 2568 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 28 00:53:23.370831 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362827 2568 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 28 00:53:23.370831 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362831 2568 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 28 00:53:23.370831 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362835 2568 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 28 00:53:23.370831 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362840 2568 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 28 00:53:23.370831 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362844 2568 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 28 00:53:23.370831 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362848 2568 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 28 00:53:23.370831 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362852 2568 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 28 00:53:23.370831 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362856 2568 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 28 00:53:23.370831 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362861 2568 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 28 00:53:23.370831 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362865 2568 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 28 00:53:23.370831 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362869 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 28 00:53:23.370831 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362874 2568 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 28 00:53:23.370831 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362879 2568 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 28 00:53:23.370831 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362883 2568 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 28 00:53:23.370831 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362888 2568 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 28 00:53:23.370831 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362897 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 28 00:53:23.371701 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362902 2568 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 28 00:53:23.371701 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362906 2568 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 28 00:53:23.371701 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362910 2568 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 28 00:53:23.371701 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362915 2568 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 28 00:53:23.371701 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362919 2568 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 28 00:53:23.371701 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362923 2568 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 28 00:53:23.371701 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362927 2568 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 28 00:53:23.371701 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362931 2568 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 28 00:53:23.371701 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362935 2568 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 28 00:53:23.371701 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362939 2568 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 28 00:53:23.371701 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362943 2568 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 28 00:53:23.371701 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362949 2568 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 28 00:53:23.371701 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362955 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 28 00:53:23.371701 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362961 2568 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 28 00:53:23.371701 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362967 2568 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 28 00:53:23.371701 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362971 2568 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 28 00:53:23.371701 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362975 2568 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 28 00:53:23.371701 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362980 2568 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 28 00:53:23.371701 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362983 2568 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 28 00:53:23.371701 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362988 2568 feature_gate.go:328] unrecognized feature gate: Example2 Jul 28 00:53:23.372199 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362992 2568 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 28 00:53:23.372199 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.362996 2568 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 28 00:53:23.372199 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.363000 2568 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 28 00:53:23.372199 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.363004 2568 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 28 00:53:23.372199 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.363009 2568 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 28 00:53:23.372199 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.363013 2568 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 28 00:53:23.372199 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.363018 2568 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 28 00:53:23.372199 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.363022 2568 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 28 00:53:23.372199 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.363027 2568 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 28 00:53:23.372199 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.363032 2568 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 28 00:53:23.372199 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.363036 2568 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 28 00:53:23.372199 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.363040 2568 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 28 00:53:23.372199 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.363049 2568 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 28 00:53:23.372199 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.363053 2568 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 28 00:53:23.372199 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.363057 2568 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 28 00:53:23.372199 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.363062 2568 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 28 00:53:23.372199 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:23.363068 2568 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 28 00:53:23.372709 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.363077 2568 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 28 00:53:23.372709 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.363273 2568 server.go:962] "Client rotation is on, will bootstrap in background" Jul 28 00:53:23.372709 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.366236 2568 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 28 00:53:23.372709 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.367769 2568 server.go:1019] "Starting client certificate rotation" Jul 28 00:53:23.372709 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.367892 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 00:53:23.372709 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.368657 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 28 00:53:23.372709 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.370501 2568 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 00:53:23.373317 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.373298 2568 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 28 00:53:23.384913 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.384886 2568 log.go:25] "Validated CRI v1 runtime API" Jul 28 00:53:23.388123 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.388099 2568 log.go:25] "Validated CRI v1 image API" Jul 28 00:53:23.391043 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.391021 2568 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 28 00:53:23.397474 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.397449 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 00:53:23.400956 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.400931 2568 fs.go:135] Filesystem UUIDs: map[5bf66e69-85e0-4dca-8cf5-feeeb12213af:/dev/nvme0n1p3 6c922186-dc70-4690-b780-05ee9c1e47fe:/dev/nvme0n1p4 7B77-95E7:/dev/nvme0n1p2] Jul 28 00:53:23.401040 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.400954 2568 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 28 00:53:23.407395 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.407251 2568 manager.go:216] Machine: {Timestamp:2026-07-28 00:53:23.405753282 +0000 UTC m=+0.325353957 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3100591 MemoryCapacity:32812167168 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec28ff8970dceac49b19d8aba9399c85 SystemUUID:ec28ff89-70dc-eac4-9b19-d8aba9399c85 BootID:9181d32a-9ef9-492f-a7b4-0b24ae7dfe48 Filesystems:[{Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16406085632 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true} {Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16406081536 Type:vfs Inodes:4005391 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6562435072 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6111232 Type:vfs Inodes:18446744073709551615 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:5d:77:bc:a3:81 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:5d:77:bc:a3:81 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:52:fd:b4:e4:f9:7d Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:32812167168 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:34603008 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 28 00:53:23.407395 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.407377 2568 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 28 00:53:23.407543 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.407479 2568 manager.go:232] Version: {KernelVersion:5.14.0-570.129.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260717-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 28 00:53:23.410125 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.410078 2568 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 28 00:53:23.410316 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.410127 2568 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-132-44.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 28 00:53:23.410990 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.410975 2568 topology_manager.go:138] "Creating topology manager with none policy" Jul 28 00:53:23.411055 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.410998 2568 container_manager_linux.go:309] "Creating device plugin manager" Jul 28 00:53:23.411055 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.411009 2568 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 00:53:23.411521 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.411508 2568 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 28 00:53:23.413153 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.413136 2568 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 28 00:53:23.417146 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.417123 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 28 00:53:23.417305 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.417293 2568 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 28 00:53:23.417380 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.417338 2568 kubelet.go:486] "Attempting to sync node with API server" Jul 28 00:53:23.417380 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.417353 2568 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 28 00:53:23.417380 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.417375 2568 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 28 00:53:23.417502 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.417394 2568 kubelet.go:398] "Adding apiserver pod source" Jul 28 00:53:23.417502 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.417410 2568 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 28 00:53:23.417893 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.417879 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 00:53:23.417976 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.417903 2568 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 28 00:53:23.420437 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.420415 2568 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 28 00:53:23.421963 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.421948 2568 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 28 00:53:23.422026 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.421980 2568 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 28 00:53:23.423056 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.423044 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 28 00:53:23.423121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.423060 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 28 00:53:23.423121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.423066 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 28 00:53:23.423121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.423072 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 28 00:53:23.423121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.423081 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 28 00:53:23.423121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.423086 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 28 00:53:23.423121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.423095 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 28 00:53:23.423121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.423100 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 28 00:53:23.423121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.423107 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 28 00:53:23.423121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.423112 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 28 00:53:23.423121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.423121 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 28 00:53:23.423402 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.423127 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 28 00:53:23.424657 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.424642 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 28 00:53:23.424657 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.424656 2568 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 28 00:53:23.427975 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.427960 2568 server.go:1268] "Started kubelet" Jul 28 00:53:23.428099 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.428065 2568 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 28 00:53:23.428602 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.428517 2568 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 28 00:53:23.428675 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.428634 2568 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 28 00:53:23.429016 ip-10-0-132-44 systemd[1]: Started Kubernetes Kubelet. Jul 28 00:53:23.429817 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.429169 2568 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-132-44.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 28 00:53:23.429817 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:23.429164 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 28 00:53:23.429817 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:23.429291 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-132-44.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 28 00:53:23.431140 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.431121 2568 server.go:310] "Adding debug handlers to kubelet server" Jul 28 00:53:23.432775 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.432754 2568 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 28 00:53:23.432903 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:23.432888 2568 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 28 00:53:23.439290 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:23.438118 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-44.ec2.internal.18c64df1d958fb01 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-44.ec2.internal,UID:ip-10-0-132-44.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-132-44.ec2.internal,},FirstTimestamp:2026-07-28 00:53:23.427924737 +0000 UTC m=+0.347525463,LastTimestamp:2026-07-28 00:53:23.427924737 +0000 UTC m=+0.347525463,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-44.ec2.internal,}" Jul 28 00:53:23.439957 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.439882 2568 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 28 00:53:23.440056 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.440033 2568 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 28 00:53:23.440482 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:23.440453 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-44.ec2.internal\" not found" Jul 28 00:53:23.440814 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.440779 2568 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 28 00:53:23.440902 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.440819 2568 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 28 00:53:23.441152 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.441132 2568 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 28 00:53:23.441152 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.441153 2568 reconstruct.go:97] "Volume reconstruction finished" Jul 28 00:53:23.441264 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.441162 2568 reconciler.go:29] "Reconciler: start to sync state" Jul 28 00:53:23.442163 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.442137 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-74ldp" Jul 28 00:53:23.442336 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.442318 2568 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 28 00:53:23.442454 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.442442 2568 factory.go:55] Registering systemd factory Jul 28 00:53:23.442515 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.442486 2568 factory.go:223] Registration of the systemd container factory successfully Jul 28 00:53:23.442853 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.442836 2568 factory.go:153] Registering CRI-O factory Jul 28 00:53:23.442971 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.442954 2568 factory.go:223] Registration of the crio container factory successfully Jul 28 00:53:23.443070 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.442987 2568 factory.go:103] Registering Raw factory Jul 28 00:53:23.443070 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.443002 2568 manager.go:1196] Started watching for new ooms in manager Jul 28 00:53:23.443501 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.443483 2568 manager.go:349] Starting recovery of all containers Jul 28 00:53:23.444192 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:23.444161 2568 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-132-44.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 28 00:53:23.444192 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:23.444175 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 28 00:53:23.450502 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.450464 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-74ldp" Jul 28 00:53:23.456304 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.456281 2568 manager.go:354] Recovery completed Jul 28 00:53:23.460935 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.460916 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:53:23.463912 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.463886 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-44.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:53:23.463987 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.463932 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-44.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:53:23.463987 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.463945 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-44.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:53:23.464529 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.464515 2568 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 28 00:53:23.464529 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.464527 2568 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 28 00:53:23.464663 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.464531 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:53:23.464663 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.464547 2568 state_mem.go:36] "Initialized new in-memory state store" Jul 28 00:53:23.465299 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.465284 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-44.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:53:23.465362 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.465311 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-44.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:53:23.465362 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.465326 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-44.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:53:23.466110 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:23.466036 2568 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-132-44.ec2.internal.18c64df1db7e2a30 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-132-44.ec2.internal,UID:ip-10-0-132-44.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-132-44.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-132-44.ec2.internal,},FirstTimestamp:2026-07-28 00:53:23.46391608 +0000 UTC m=+0.383516760,LastTimestamp:2026-07-28 00:53:23.46391608 +0000 UTC m=+0.383516760,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-132-44.ec2.internal,}" Jul 28 00:53:23.466228 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.466216 2568 policy_none.go:49] "None policy: Start" Jul 28 00:53:23.466266 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.466234 2568 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 28 00:53:23.466266 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.466245 2568 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 28 00:53:23.467256 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.467239 2568 policy_none.go:47] "Start" Jul 28 00:53:23.510485 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.510303 2568 manager.go:337] "Starting Device Plugin manager" Jul 28 00:53:23.525126 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:23.510513 2568 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 28 00:53:23.525126 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.510529 2568 server.go:87] "Starting device plugin registration server" Jul 28 00:53:23.525126 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.510841 2568 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 28 00:53:23.525126 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.510857 2568 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 28 00:53:23.525126 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.510980 2568 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 28 00:53:23.525126 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.511069 2568 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 28 00:53:23.525126 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.511077 2568 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 28 00:53:23.525126 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:23.511602 2568 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 28 00:53:23.525126 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:23.511655 2568 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-132-44.ec2.internal\" not found" Jul 28 00:53:23.525736 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.525710 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 28 00:53:23.527051 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.527026 2568 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 28 00:53:23.527152 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.527072 2568 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 28 00:53:23.527152 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.527098 2568 kubelet.go:2448] "Starting kubelet main sync loop" Jul 28 00:53:23.527152 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:23.527138 2568 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 28 00:53:23.529941 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.529423 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:53:23.612071 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.611982 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:53:23.613090 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.613067 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-44.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:53:23.613150 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.613111 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-44.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:53:23.613150 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.613126 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-44.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:53:23.613218 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.613153 2568 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-132-44.ec2.internal" Jul 28 00:53:23.623051 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.623026 2568 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-132-44.ec2.internal" Jul 28 00:53:23.623135 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:23.623061 2568 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-132-44.ec2.internal\": node \"ip-10-0-132-44.ec2.internal\" not found" Jul 28 00:53:23.628238 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.628201 2568 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-44.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-132-44.ec2.internal"] Jul 28 00:53:23.628328 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.628281 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:53:23.629223 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.629200 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-44.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:53:23.629352 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.629237 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-44.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:53:23.629352 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.629252 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-44.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:53:23.630729 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.630715 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:53:23.630834 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.630816 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-44.ec2.internal" Jul 28 00:53:23.630874 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.630860 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:53:23.631626 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.631610 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-44.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:53:23.631735 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.631616 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-44.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:53:23.631735 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.631657 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-44.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:53:23.631735 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.631671 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-44.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:53:23.631735 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.631639 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-44.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:53:23.631735 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.631729 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-44.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:53:23.633177 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.633160 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-44.ec2.internal" Jul 28 00:53:23.633355 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.633189 2568 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 28 00:53:23.634005 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.633987 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-44.ec2.internal" event="NodeHasSufficientMemory" Jul 28 00:53:23.634077 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.634018 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-44.ec2.internal" event="NodeHasNoDiskPressure" Jul 28 00:53:23.634077 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.634032 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-44.ec2.internal" event="NodeHasSufficientPID" Jul 28 00:53:23.642543 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.642510 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d73b36015dd37be22737c4ae60f1f3ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-44.ec2.internal\" (UID: \"d73b36015dd37be22737c4ae60f1f3ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-44.ec2.internal" Jul 28 00:53:23.642697 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.642551 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d73b36015dd37be22737c4ae60f1f3ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-44.ec2.internal\" (UID: \"d73b36015dd37be22737c4ae60f1f3ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-44.ec2.internal" Jul 28 00:53:23.642697 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.642626 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7ee893b47080271f4b0fa8967f643209-config\") pod \"kube-apiserver-proxy-ip-10-0-132-44.ec2.internal\" (UID: \"7ee893b47080271f4b0fa8967f643209\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-44.ec2.internal" Jul 28 00:53:23.646581 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:23.646545 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-44.ec2.internal\" not found" Jul 28 00:53:23.661654 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:23.661625 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-44.ec2.internal\" not found" node="ip-10-0-132-44.ec2.internal" Jul 28 00:53:23.666648 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:23.666628 2568 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-132-44.ec2.internal\" not found" node="ip-10-0-132-44.ec2.internal" Jul 28 00:53:23.742879 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.742835 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d73b36015dd37be22737c4ae60f1f3ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-44.ec2.internal\" (UID: \"d73b36015dd37be22737c4ae60f1f3ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-44.ec2.internal" Jul 28 00:53:23.742879 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.742874 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d73b36015dd37be22737c4ae60f1f3ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-44.ec2.internal\" (UID: \"d73b36015dd37be22737c4ae60f1f3ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-44.ec2.internal" Jul 28 00:53:23.743132 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.742908 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7ee893b47080271f4b0fa8967f643209-config\") pod \"kube-apiserver-proxy-ip-10-0-132-44.ec2.internal\" (UID: \"7ee893b47080271f4b0fa8967f643209\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-44.ec2.internal" Jul 28 00:53:23.743132 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.742948 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/d73b36015dd37be22737c4ae60f1f3ea-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-132-44.ec2.internal\" (UID: \"d73b36015dd37be22737c4ae60f1f3ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-44.ec2.internal" Jul 28 00:53:23.743132 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.742963 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/d73b36015dd37be22737c4ae60f1f3ea-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-132-44.ec2.internal\" (UID: \"d73b36015dd37be22737c4ae60f1f3ea\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-44.ec2.internal" Jul 28 00:53:23.743132 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.742954 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/7ee893b47080271f4b0fa8967f643209-config\") pod \"kube-apiserver-proxy-ip-10-0-132-44.ec2.internal\" (UID: \"7ee893b47080271f4b0fa8967f643209\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-132-44.ec2.internal" Jul 28 00:53:23.746986 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:23.746954 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-44.ec2.internal\" not found" Jul 28 00:53:23.847586 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:23.847544 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-44.ec2.internal\" not found" Jul 28 00:53:23.948598 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:23.948479 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-44.ec2.internal\" not found" Jul 28 00:53:23.966681 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.966654 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-44.ec2.internal" Jul 28 00:53:23.970084 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:23.970060 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-44.ec2.internal" Jul 28 00:53:24.049008 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:24.048952 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-44.ec2.internal\" not found" Jul 28 00:53:24.149582 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:24.149524 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-44.ec2.internal\" not found" Jul 28 00:53:24.250147 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:24.250054 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-44.ec2.internal\" not found" Jul 28 00:53:24.350649 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:24.350600 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-44.ec2.internal\" not found" Jul 28 00:53:24.366822 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:24.366784 2568 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 28 00:53:24.367015 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:24.366991 2568 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 28 00:53:24.451580 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:24.451527 2568 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-132-44.ec2.internal\" not found" Jul 28 00:53:24.453714 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:24.453681 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-27 00:48:23 +0000 UTC" deadline="2028-02-02 10:26:38.404406176 +0000 UTC" Jul 28 00:53:24.453790 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:24.453716 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="13305h33m13.950694733s" Jul 28 00:53:24.488456 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:24.488422 2568 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:53:24.514240 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:24.514176 2568 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:53:24.541334 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:24.541297 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-44.ec2.internal" Jul 28 00:53:24.554405 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:24.554377 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 00:53:24.555339 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:24.555321 2568 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-44.ec2.internal" Jul 28 00:53:24.561756 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:24.561730 2568 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 28 00:53:24.679721 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:24.679669 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7ee893b47080271f4b0fa8967f643209.slice/crio-9bff99e92349eab4e9a97cb0dbc1f4a6b81f6730f75648cb67daad34fcf6fb9e WatchSource:0}: Error finding container 9bff99e92349eab4e9a97cb0dbc1f4a6b81f6730f75648cb67daad34fcf6fb9e: Status 404 returned error can't find the container with id 9bff99e92349eab4e9a97cb0dbc1f4a6b81f6730f75648cb67daad34fcf6fb9e Jul 28 00:53:24.679972 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:24.679956 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd73b36015dd37be22737c4ae60f1f3ea.slice/crio-31b04fa1c5353902d4378b6b13c1b989bd5627c8d6f01f5ed1b4525b1b66625b WatchSource:0}: Error finding container 31b04fa1c5353902d4378b6b13c1b989bd5627c8d6f01f5ed1b4525b1b66625b: Status 404 returned error can't find the container with id 31b04fa1c5353902d4378b6b13c1b989bd5627c8d6f01f5ed1b4525b1b66625b Jul 28 00:53:24.684667 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:24.684646 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 00:53:24.992585 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:24.992548 2568 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:53:25.258250 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.258155 2568 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 28 00:53:25.418585 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.418543 2568 apiserver.go:52] "Watching apiserver" Jul 28 00:53:25.433208 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.431447 2568 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 28 00:53:25.433208 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.432570 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-multus/network-metrics-daemon-26zg4","openshift-ovn-kubernetes/ovnkube-node-j25gd","kube-system/global-pull-secret-syncer-9mbj7","kube-system/kube-apiserver-proxy-ip-10-0-132-44.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6","openshift-dns/node-resolver-mjj4c","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-44.ec2.internal","openshift-multus/multus-additional-cni-plugins-tpt6j","openshift-network-diagnostics/network-check-target-f76c6","openshift-network-operator/iptables-alerter-k8xz4","kube-system/konnectivity-agent-5rpd2","openshift-cluster-node-tuning-operator/tuned-m4xdf","openshift-image-registry/node-ca-jd4kr","openshift-multus/multus-fq7zn"] Jul 28 00:53:25.435843 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.435811 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:25.436012 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:25.435921 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f76c6" podUID="32eb3a5b-feee-4950-8a7c-7370e73c6b3c" Jul 28 00:53:25.438525 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.438495 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.441086 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.441054 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-t9w4q\"" Jul 28 00:53:25.441219 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.441189 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.441483 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.441461 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 28 00:53:25.441671 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.441656 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 28 00:53:25.442582 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.441939 2568 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 28 00:53:25.442582 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.442014 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 28 00:53:25.442582 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.442016 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 28 00:53:25.442582 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.442281 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 28 00:53:25.442582 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.442344 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 28 00:53:25.443374 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.443343 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 28 00:53:25.444129 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.444099 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 28 00:53:25.444410 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.444357 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-n77xz\"" Jul 28 00:53:25.444813 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.444769 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 28 00:53:25.446057 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.445381 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 28 00:53:25.446057 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.445662 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:25.446057 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:25.445754 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26zg4" podUID="0281eb31-f259-4470-acc3-5499c546004c" Jul 28 00:53:25.447363 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.446685 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.449165 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.449121 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5rpd2" Jul 28 00:53:25.449376 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.449329 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:53:25.449824 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.449804 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-h7rjf\"" Jul 28 00:53:25.449906 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.449850 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 28 00:53:25.451816 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.451530 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-q5z4q\"" Jul 28 00:53:25.451816 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.451644 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 28 00:53:25.451816 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.451779 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 28 00:53:25.452066 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.451844 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-host-run-netns\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.452066 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.451874 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-cnibin\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.452066 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.451903 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-host-var-lib-kubelet\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.452066 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.451928 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-multus-conf-dir\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.452066 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.451975 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b6c5d039-4cf3-4bc0-b792-dbab331da95b-multus-daemon-config\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.452066 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452003 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-host-run-multus-certs\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.452066 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452032 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs\") pod \"network-metrics-daemon-26zg4\" (UID: \"0281eb31-f259-4470-acc3-5499c546004c\") " pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:25.452066 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452058 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-host-kubelet\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.452436 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452092 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-systemd-units\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.452436 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452115 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-host-cni-bin\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.452436 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452146 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.452436 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452167 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-etc-kubernetes\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.452436 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452184 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-host-cni-netd\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.452436 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452226 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4198cefb-f29f-46b4-8780-60cdd7a79110-ovnkube-script-lib\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.452436 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452258 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htzkv\" (UniqueName: \"kubernetes.io/projected/4198cefb-f29f-46b4-8780-60cdd7a79110-kube-api-access-htzkv\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.452436 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452289 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-system-cni-dir\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.452436 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452311 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-host-var-lib-cni-bin\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.452436 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452338 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-host-var-lib-cni-multus\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.452436 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452383 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-multus-cni-dir\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.452436 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452413 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-var-lib-openvswitch\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.453263 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452444 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-etc-openvswitch\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.453263 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452487 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-node-log\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.453263 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452527 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-log-socket\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.453263 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452608 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4198cefb-f29f-46b4-8780-60cdd7a79110-ovn-node-metrics-cert\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.453263 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452641 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zltmc\" (UniqueName: \"kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc\") pod \"network-check-target-f76c6\" (UID: \"32eb3a5b-feee-4950-8a7c-7370e73c6b3c\") " pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:25.453263 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452672 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-host-slash\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.453263 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452692 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-host-run-ovn-kubernetes\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.453263 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452708 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-hostroot\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.453263 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452743 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wqht4\" (UniqueName: \"kubernetes.io/projected/0281eb31-f259-4470-acc3-5499c546004c-kube-api-access-wqht4\") pod \"network-metrics-daemon-26zg4\" (UID: \"0281eb31-f259-4470-acc3-5499c546004c\") " pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:25.453263 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452774 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-os-release\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.453263 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452797 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-run-systemd\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.453263 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452815 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-run-openvswitch\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.453263 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452830 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-run-ovn\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.453263 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452850 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4198cefb-f29f-46b4-8780-60cdd7a79110-env-overrides\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.453263 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452903 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-host-run-k8s-cni-cncf-io\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.453263 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452939 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-host-run-netns\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.454215 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452968 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4198cefb-f29f-46b4-8780-60cdd7a79110-ovnkube-config\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.454215 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.452995 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6c5d039-4cf3-4bc0-b792-dbab331da95b-cni-binary-copy\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.454215 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.453022 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-multus-socket-dir-parent\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.454215 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.453052 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hgprh\" (UniqueName: \"kubernetes.io/projected/b6c5d039-4cf3-4bc0-b792-dbab331da95b-kube-api-access-hgprh\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.455668 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.455646 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k8xz4" Jul 28 00:53:25.457772 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.457316 2568 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 28 00:53:25.457772 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.457367 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.457772 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.457659 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-z9jfm\"" Jul 28 00:53:25.458173 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.458149 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 28 00:53:25.458884 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.458817 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 28 00:53:25.460168 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.460142 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 28 00:53:25.460368 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.460352 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 28 00:53:25.460577 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.460560 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-gjx9x\"" Jul 28 00:53:25.462208 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.461133 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mjj4c" Jul 28 00:53:25.462353 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.462313 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:53:25.463331 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.463309 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 28 00:53:25.463584 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.463565 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-49nz8\"" Jul 28 00:53:25.463812 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.463792 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 28 00:53:25.464366 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.464346 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.469173 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.469143 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jd4kr" Jul 28 00:53:25.470337 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.470311 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:25.470600 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:25.470565 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mbj7" podUID="0b32935c-be84-4ae4-bc60-0e462f6c89f6" Jul 28 00:53:25.471625 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.471601 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 28 00:53:25.471863 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.471607 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 28 00:53:25.471863 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.471852 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 28 00:53:25.472004 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.471915 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 28 00:53:25.472698 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.472668 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-trkfd\"" Jul 28 00:53:25.472884 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.472868 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 28 00:53:25.473649 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.473537 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 28 00:53:25.474485 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.474097 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-txw5m\"" Jul 28 00:53:25.478674 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.478621 2568 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-r7zcg" Jul 28 00:53:25.486318 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.486286 2568 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-r7zcg" Jul 28 00:53:25.534217 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.534149 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-44.ec2.internal" event={"ID":"7ee893b47080271f4b0fa8967f643209","Type":"ContainerStarted","Data":"9bff99e92349eab4e9a97cb0dbc1f4a6b81f6730f75648cb67daad34fcf6fb9e"} Jul 28 00:53:25.537872 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.537833 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-44.ec2.internal" event={"ID":"d73b36015dd37be22737c4ae60f1f3ea","Type":"ContainerStarted","Data":"31b04fa1c5353902d4378b6b13c1b989bd5627c8d6f01f5ed1b4525b1b66625b"} Jul 28 00:53:25.542397 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.542367 2568 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 28 00:53:25.553795 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.553746 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4198cefb-f29f-46b4-8780-60cdd7a79110-ovnkube-script-lib\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.553795 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.553801 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htzkv\" (UniqueName: \"kubernetes.io/projected/4198cefb-f29f-46b4-8780-60cdd7a79110-kube-api-access-htzkv\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.554027 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.553821 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-system-cni-dir\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.554027 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.553839 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-host-var-lib-cni-bin\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.554027 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.553857 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-host-var-lib-cni-multus\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.554027 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.553878 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/639e6665-3b8f-4490-a41a-daae8669ff8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hwhp6\" (UID: \"639e6665-3b8f-4490-a41a-daae8669ff8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.554027 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.553898 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/666b80c4-e226-4307-b25e-4f7ffd02f5b9-host\") pod \"node-ca-jd4kr\" (UID: \"666b80c4-e226-4307-b25e-4f7ffd02f5b9\") " pod="openshift-image-registry/node-ca-jd4kr" Jul 28 00:53:25.554027 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.553921 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2408ba36-e5e9-465c-8434-b17d73f6febb-agent-certs\") pod \"konnectivity-agent-5rpd2\" (UID: \"2408ba36-e5e9-465c-8434-b17d73f6febb\") " pod="kube-system/konnectivity-agent-5rpd2" Jul 28 00:53:25.554027 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.553960 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-etc-openvswitch\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.554027 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.553987 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-log-socket\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.554425 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554014 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4198cefb-f29f-46b4-8780-60cdd7a79110-ovn-node-metrics-cert\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.554425 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554056 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/639e6665-3b8f-4490-a41a-daae8669ff8b-registration-dir\") pod \"aws-ebs-csi-driver-node-hwhp6\" (UID: \"639e6665-3b8f-4490-a41a-daae8669ff8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.554425 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554075 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64b5029e-0628-4bbd-b16c-1ec599f76a21-hosts-file\") pod \"node-resolver-mjj4c\" (UID: \"64b5029e-0628-4bbd-b16c-1ec599f76a21\") " pod="openshift-dns/node-resolver-mjj4c" Jul 28 00:53:25.554425 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554100 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64b5029e-0628-4bbd-b16c-1ec599f76a21-tmp-dir\") pod \"node-resolver-mjj4c\" (UID: \"64b5029e-0628-4bbd-b16c-1ec599f76a21\") " pod="openshift-dns/node-resolver-mjj4c" Jul 28 00:53:25.554425 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554151 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret\") pod \"global-pull-secret-syncer-9mbj7\" (UID: \"0b32935c-be84-4ae4-bc60-0e462f6c89f6\") " pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:25.554425 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554178 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-var-lib-kubelet\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.554425 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554207 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-host-slash\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.554425 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554233 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/639e6665-3b8f-4490-a41a-daae8669ff8b-socket-dir\") pod \"aws-ebs-csi-driver-node-hwhp6\" (UID: \"639e6665-3b8f-4490-a41a-daae8669ff8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.554425 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554252 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/639e6665-3b8f-4490-a41a-daae8669ff8b-device-dir\") pod \"aws-ebs-csi-driver-node-hwhp6\" (UID: \"639e6665-3b8f-4490-a41a-daae8669ff8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.554425 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554274 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-etc-modprobe-d\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.554425 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554302 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-etc-sysctl-d\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.554425 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554330 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0ce119b-c2be-46da-a9b6-e68fadfacf30-tmp\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.554425 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554360 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wqht4\" (UniqueName: \"kubernetes.io/projected/0281eb31-f259-4470-acc3-5499c546004c-kube-api-access-wqht4\") pod \"network-metrics-daemon-26zg4\" (UID: \"0281eb31-f259-4470-acc3-5499c546004c\") " pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:25.554425 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554388 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-sys\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.554425 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554420 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/639e6665-3b8f-4490-a41a-daae8669ff8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-hwhp6\" (UID: \"639e6665-3b8f-4490-a41a-daae8669ff8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.555056 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554450 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-os-release\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.555056 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554482 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-run-openvswitch\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.555056 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554510 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-run-ovn\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.555056 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554537 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4198cefb-f29f-46b4-8780-60cdd7a79110-env-overrides\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.555056 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554569 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-host-run-k8s-cni-cncf-io\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.555056 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554595 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hgprh\" (UniqueName: \"kubernetes.io/projected/b6c5d039-4cf3-4bc0-b792-dbab331da95b-kube-api-access-hgprh\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.555056 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554677 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4198cefb-f29f-46b4-8780-60cdd7a79110-ovnkube-config\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.555056 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554723 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6c5d039-4cf3-4bc0-b792-dbab331da95b-cni-binary-copy\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.555056 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554751 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/632dce7c-ff33-4238-84bb-c82356acc1d6-system-cni-dir\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.555056 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554782 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/632dce7c-ff33-4238-84bb-c82356acc1d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.555056 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554807 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/639e6665-3b8f-4490-a41a-daae8669ff8b-sys-fs\") pod \"aws-ebs-csi-driver-node-hwhp6\" (UID: \"639e6665-3b8f-4490-a41a-daae8669ff8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.555056 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554842 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2zqt\" (UniqueName: \"kubernetes.io/projected/666b80c4-e226-4307-b25e-4f7ffd02f5b9-kube-api-access-s2zqt\") pod \"node-ca-jd4kr\" (UID: \"666b80c4-e226-4307-b25e-4f7ffd02f5b9\") " pod="openshift-image-registry/node-ca-jd4kr" Jul 28 00:53:25.555056 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554871 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-multus-conf-dir\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.555056 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554898 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-host-run-multus-certs\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.555056 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554927 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs\") pod \"network-metrics-daemon-26zg4\" (UID: \"0281eb31-f259-4470-acc3-5499c546004c\") " pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:25.555056 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554963 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/632dce7c-ff33-4238-84bb-c82356acc1d6-cnibin\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.555056 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.554993 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mkbbq\" (UniqueName: \"kubernetes.io/projected/632dce7c-ff33-4238-84bb-c82356acc1d6-kube-api-access-mkbbq\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.555533 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555028 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-etc-kubernetes\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.555533 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555055 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-95gcp\" (UniqueName: \"kubernetes.io/projected/2567e6a4-152a-47c0-b847-c36069b68643-kube-api-access-95gcp\") pod \"iptables-alerter-k8xz4\" (UID: \"2567e6a4-152a-47c0-b847-c36069b68643\") " pod="openshift-network-operator/iptables-alerter-k8xz4" Jul 28 00:53:25.555533 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555083 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-systemd-units\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.555533 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555111 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-host-cni-bin\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.555533 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555141 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.555533 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555172 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-etc-kubernetes\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.555533 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555203 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-etc-systemd\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.555533 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555229 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-run\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.555533 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555255 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-host-cni-netd\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.555533 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555282 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/666b80c4-e226-4307-b25e-4f7ffd02f5b9-serviceca\") pod \"node-ca-jd4kr\" (UID: \"666b80c4-e226-4307-b25e-4f7ffd02f5b9\") " pod="openshift-image-registry/node-ca-jd4kr" Jul 28 00:53:25.555533 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555312 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-multus-cni-dir\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.555533 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555340 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-var-lib-openvswitch\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.555533 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555390 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-node-log\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.555533 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555430 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/632dce7c-ff33-4238-84bb-c82356acc1d6-os-release\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.555533 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555459 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2408ba36-e5e9-465c-8434-b17d73f6febb-konnectivity-ca\") pod \"konnectivity-agent-5rpd2\" (UID: \"2408ba36-e5e9-465c-8434-b17d73f6febb\") " pod="kube-system/konnectivity-agent-5rpd2" Jul 28 00:53:25.555533 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555491 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0b32935c-be84-4ae4-bc60-0e462f6c89f6-kubelet-config\") pod \"global-pull-secret-syncer-9mbj7\" (UID: \"0b32935c-be84-4ae4-bc60-0e462f6c89f6\") " pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:25.555533 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555519 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2567e6a4-152a-47c0-b847-c36069b68643-iptables-alerter-script\") pod \"iptables-alerter-k8xz4\" (UID: \"2567e6a4-152a-47c0-b847-c36069b68643\") " pod="openshift-network-operator/iptables-alerter-k8xz4" Jul 28 00:53:25.556132 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555557 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zltmc\" (UniqueName: \"kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc\") pod \"network-check-target-f76c6\" (UID: \"32eb3a5b-feee-4950-8a7c-7370e73c6b3c\") " pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:25.556132 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555681 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-host-run-ovn-kubernetes\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.556132 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555713 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-hostroot\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.556132 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555754 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-lib-modules\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.556132 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555783 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-host\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.556132 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555819 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-etc-sysconfig\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.556132 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555852 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-etc-sysctl-conf\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.556132 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555880 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c0ce119b-c2be-46da-a9b6-e68fadfacf30-etc-tuned\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.556132 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555908 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fmkwv\" (UniqueName: \"kubernetes.io/projected/c0ce119b-c2be-46da-a9b6-e68fadfacf30-kube-api-access-fmkwv\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.556132 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555953 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-run-systemd\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.556132 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555976 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-host-run-netns\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.556132 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.555998 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/632dce7c-ff33-4238-84bb-c82356acc1d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.556132 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.556031 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q2z7g\" (UniqueName: \"kubernetes.io/projected/639e6665-3b8f-4490-a41a-daae8669ff8b-kube-api-access-q2z7g\") pod \"aws-ebs-csi-driver-node-hwhp6\" (UID: \"639e6665-3b8f-4490-a41a-daae8669ff8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.556132 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.556059 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2567e6a4-152a-47c0-b847-c36069b68643-host-slash\") pod \"iptables-alerter-k8xz4\" (UID: \"2567e6a4-152a-47c0-b847-c36069b68643\") " pod="openshift-network-operator/iptables-alerter-k8xz4" Jul 28 00:53:25.556132 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.556106 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-multus-socket-dir-parent\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.556132 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.556134 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-host-run-netns\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.556698 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.556163 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-cnibin\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.556698 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.556204 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-host-var-lib-kubelet\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.556698 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.556236 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b6c5d039-4cf3-4bc0-b792-dbab331da95b-multus-daemon-config\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.556698 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.556266 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/632dce7c-ff33-4238-84bb-c82356acc1d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.556698 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.556295 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0b32935c-be84-4ae4-bc60-0e462f6c89f6-dbus\") pod \"global-pull-secret-syncer-9mbj7\" (UID: \"0b32935c-be84-4ae4-bc60-0e462f6c89f6\") " pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:25.556698 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.556327 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-host-kubelet\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.556698 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.556358 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/632dce7c-ff33-4238-84bb-c82356acc1d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.556698 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.556387 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wjpcj\" (UniqueName: \"kubernetes.io/projected/64b5029e-0628-4bbd-b16c-1ec599f76a21-kube-api-access-wjpcj\") pod \"node-resolver-mjj4c\" (UID: \"64b5029e-0628-4bbd-b16c-1ec599f76a21\") " pod="openshift-dns/node-resolver-mjj4c" Jul 28 00:53:25.557191 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.557168 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/4198cefb-f29f-46b4-8780-60cdd7a79110-ovnkube-script-lib\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.557718 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.557657 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-system-cni-dir\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.557815 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.557730 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-host-var-lib-cni-bin\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.557815 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.557783 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-host-var-lib-cni-multus\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.557929 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.557867 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-etc-openvswitch\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.557929 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.557916 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-log-socket\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.558352 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.558325 2568 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 28 00:53:25.558929 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.558899 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-etc-kubernetes\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.559037 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.558998 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-multus-socket-dir-parent\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.559199 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.559161 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-multus-cni-dir\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.559244 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.559219 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-node-log\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.559398 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.559341 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-run-systemd\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.559398 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.559389 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-host-run-netns\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.559561 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.558987 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-host-cni-netd\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.559561 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.559546 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-var-lib-openvswitch\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.559694 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.559603 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-cnibin\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.559694 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.559664 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-host-run-netns\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.559799 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.559708 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-hostroot\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.559799 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.559754 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-host-run-ovn-kubernetes\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.559906 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.559827 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-host-kubelet\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.559962 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.559903 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-host-var-lib-kubelet\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.559962 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.559940 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/b6c5d039-4cf3-4bc0-b792-dbab331da95b-multus-daemon-config\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.560065 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.560018 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-multus-conf-dir\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.560065 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.560052 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-host-run-k8s-cni-cncf-io\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.560552 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.560459 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/4198cefb-f29f-46b4-8780-60cdd7a79110-env-overrides\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.560778 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.560703 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/4198cefb-f29f-46b4-8780-60cdd7a79110-ovnkube-config\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.560850 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.560782 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-run-ovn\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.560850 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.560828 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-run-openvswitch\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.560956 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.560420 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-host-slash\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.561013 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:25.560989 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:53:25.561067 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.560706 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-os-release\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.561067 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.561041 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.561167 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:25.561093 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs podName:0281eb31-f259-4470-acc3-5499c546004c nodeName:}" failed. No retries permitted until 2026-07-28 00:53:26.061067865 +0000 UTC m=+2.980668546 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs") pod "network-metrics-daemon-26zg4" (UID: "0281eb31-f259-4470-acc3-5499c546004c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:53:25.561167 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.561086 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/b6c5d039-4cf3-4bc0-b792-dbab331da95b-host-run-multus-certs\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.561167 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.561137 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-systemd-units\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.561167 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.561147 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/4198cefb-f29f-46b4-8780-60cdd7a79110-host-cni-bin\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.561377 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.561171 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/b6c5d039-4cf3-4bc0-b792-dbab331da95b-cni-binary-copy\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.564534 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:25.564504 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:53:25.564534 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:25.564541 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:53:25.564765 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:25.564557 2568 projected.go:196] Error preparing data for projected volume kube-api-access-zltmc for pod openshift-network-diagnostics/network-check-target-f76c6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:53:25.564765 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:25.564663 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc podName:32eb3a5b-feee-4950-8a7c-7370e73c6b3c nodeName:}" failed. No retries permitted until 2026-07-28 00:53:26.064640718 +0000 UTC m=+2.984241404 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-zltmc" (UniqueName: "kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc") pod "network-check-target-f76c6" (UID: "32eb3a5b-feee-4950-8a7c-7370e73c6b3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:53:25.568126 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.568079 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htzkv\" (UniqueName: \"kubernetes.io/projected/4198cefb-f29f-46b4-8780-60cdd7a79110-kube-api-access-htzkv\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.571488 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.571441 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hgprh\" (UniqueName: \"kubernetes.io/projected/b6c5d039-4cf3-4bc0-b792-dbab331da95b-kube-api-access-hgprh\") pod \"multus-fq7zn\" (UID: \"b6c5d039-4cf3-4bc0-b792-dbab331da95b\") " pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.572096 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.572063 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wqht4\" (UniqueName: \"kubernetes.io/projected/0281eb31-f259-4470-acc3-5499c546004c-kube-api-access-wqht4\") pod \"network-metrics-daemon-26zg4\" (UID: \"0281eb31-f259-4470-acc3-5499c546004c\") " pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:25.575239 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.575206 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/4198cefb-f29f-46b4-8780-60cdd7a79110-ovn-node-metrics-cert\") pod \"ovnkube-node-j25gd\" (UID: \"4198cefb-f29f-46b4-8780-60cdd7a79110\") " pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.657579 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.657515 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/632dce7c-ff33-4238-84bb-c82356acc1d6-system-cni-dir\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.657794 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.657576 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/632dce7c-ff33-4238-84bb-c82356acc1d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.657794 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.657635 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/639e6665-3b8f-4490-a41a-daae8669ff8b-sys-fs\") pod \"aws-ebs-csi-driver-node-hwhp6\" (UID: \"639e6665-3b8f-4490-a41a-daae8669ff8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.657794 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.657663 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2zqt\" (UniqueName: \"kubernetes.io/projected/666b80c4-e226-4307-b25e-4f7ffd02f5b9-kube-api-access-s2zqt\") pod \"node-ca-jd4kr\" (UID: \"666b80c4-e226-4307-b25e-4f7ffd02f5b9\") " pod="openshift-image-registry/node-ca-jd4kr" Jul 28 00:53:25.657794 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.657704 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/632dce7c-ff33-4238-84bb-c82356acc1d6-cnibin\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.657794 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.657734 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mkbbq\" (UniqueName: \"kubernetes.io/projected/632dce7c-ff33-4238-84bb-c82356acc1d6-kube-api-access-mkbbq\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.657794 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.657761 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-etc-kubernetes\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.657794 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.657794 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-95gcp\" (UniqueName: \"kubernetes.io/projected/2567e6a4-152a-47c0-b847-c36069b68643-kube-api-access-95gcp\") pod \"iptables-alerter-k8xz4\" (UID: \"2567e6a4-152a-47c0-b847-c36069b68643\") " pod="openshift-network-operator/iptables-alerter-k8xz4" Jul 28 00:53:25.658121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.657823 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-etc-systemd\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.658121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.657846 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-run\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.658121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.657869 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/666b80c4-e226-4307-b25e-4f7ffd02f5b9-serviceca\") pod \"node-ca-jd4kr\" (UID: \"666b80c4-e226-4307-b25e-4f7ffd02f5b9\") " pod="openshift-image-registry/node-ca-jd4kr" Jul 28 00:53:25.658121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.657895 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/632dce7c-ff33-4238-84bb-c82356acc1d6-os-release\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.658121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.657920 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2408ba36-e5e9-465c-8434-b17d73f6febb-konnectivity-ca\") pod \"konnectivity-agent-5rpd2\" (UID: \"2408ba36-e5e9-465c-8434-b17d73f6febb\") " pod="kube-system/konnectivity-agent-5rpd2" Jul 28 00:53:25.658121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.657946 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0b32935c-be84-4ae4-bc60-0e462f6c89f6-kubelet-config\") pod \"global-pull-secret-syncer-9mbj7\" (UID: \"0b32935c-be84-4ae4-bc60-0e462f6c89f6\") " pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:25.658121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.657970 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2567e6a4-152a-47c0-b847-c36069b68643-iptables-alerter-script\") pod \"iptables-alerter-k8xz4\" (UID: \"2567e6a4-152a-47c0-b847-c36069b68643\") " pod="openshift-network-operator/iptables-alerter-k8xz4" Jul 28 00:53:25.658121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658000 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-lib-modules\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.658121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658016 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-host\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.658121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658030 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-etc-sysconfig\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.658121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658045 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-etc-sysctl-conf\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.658121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658076 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c0ce119b-c2be-46da-a9b6-e68fadfacf30-etc-tuned\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.658121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658093 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fmkwv\" (UniqueName: \"kubernetes.io/projected/c0ce119b-c2be-46da-a9b6-e68fadfacf30-kube-api-access-fmkwv\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.658121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658114 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/632dce7c-ff33-4238-84bb-c82356acc1d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.658696 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658138 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q2z7g\" (UniqueName: \"kubernetes.io/projected/639e6665-3b8f-4490-a41a-daae8669ff8b-kube-api-access-q2z7g\") pod \"aws-ebs-csi-driver-node-hwhp6\" (UID: \"639e6665-3b8f-4490-a41a-daae8669ff8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.658696 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658154 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2567e6a4-152a-47c0-b847-c36069b68643-host-slash\") pod \"iptables-alerter-k8xz4\" (UID: \"2567e6a4-152a-47c0-b847-c36069b68643\") " pod="openshift-network-operator/iptables-alerter-k8xz4" Jul 28 00:53:25.658696 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658174 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/632dce7c-ff33-4238-84bb-c82356acc1d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.658696 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658198 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0b32935c-be84-4ae4-bc60-0e462f6c89f6-dbus\") pod \"global-pull-secret-syncer-9mbj7\" (UID: \"0b32935c-be84-4ae4-bc60-0e462f6c89f6\") " pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:25.658696 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658221 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/632dce7c-ff33-4238-84bb-c82356acc1d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.658696 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658239 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wjpcj\" (UniqueName: \"kubernetes.io/projected/64b5029e-0628-4bbd-b16c-1ec599f76a21-kube-api-access-wjpcj\") pod \"node-resolver-mjj4c\" (UID: \"64b5029e-0628-4bbd-b16c-1ec599f76a21\") " pod="openshift-dns/node-resolver-mjj4c" Jul 28 00:53:25.658696 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658260 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/639e6665-3b8f-4490-a41a-daae8669ff8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hwhp6\" (UID: \"639e6665-3b8f-4490-a41a-daae8669ff8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.658696 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658278 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/666b80c4-e226-4307-b25e-4f7ffd02f5b9-host\") pod \"node-ca-jd4kr\" (UID: \"666b80c4-e226-4307-b25e-4f7ffd02f5b9\") " pod="openshift-image-registry/node-ca-jd4kr" Jul 28 00:53:25.658696 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658298 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2408ba36-e5e9-465c-8434-b17d73f6febb-agent-certs\") pod \"konnectivity-agent-5rpd2\" (UID: \"2408ba36-e5e9-465c-8434-b17d73f6febb\") " pod="kube-system/konnectivity-agent-5rpd2" Jul 28 00:53:25.658696 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658324 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/639e6665-3b8f-4490-a41a-daae8669ff8b-registration-dir\") pod \"aws-ebs-csi-driver-node-hwhp6\" (UID: \"639e6665-3b8f-4490-a41a-daae8669ff8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.658696 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658343 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64b5029e-0628-4bbd-b16c-1ec599f76a21-hosts-file\") pod \"node-resolver-mjj4c\" (UID: \"64b5029e-0628-4bbd-b16c-1ec599f76a21\") " pod="openshift-dns/node-resolver-mjj4c" Jul 28 00:53:25.658696 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658358 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64b5029e-0628-4bbd-b16c-1ec599f76a21-tmp-dir\") pod \"node-resolver-mjj4c\" (UID: \"64b5029e-0628-4bbd-b16c-1ec599f76a21\") " pod="openshift-dns/node-resolver-mjj4c" Jul 28 00:53:25.658696 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658373 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret\") pod \"global-pull-secret-syncer-9mbj7\" (UID: \"0b32935c-be84-4ae4-bc60-0e462f6c89f6\") " pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:25.658696 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658396 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-var-lib-kubelet\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.658696 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658412 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/639e6665-3b8f-4490-a41a-daae8669ff8b-socket-dir\") pod \"aws-ebs-csi-driver-node-hwhp6\" (UID: \"639e6665-3b8f-4490-a41a-daae8669ff8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.658696 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658428 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/639e6665-3b8f-4490-a41a-daae8669ff8b-device-dir\") pod \"aws-ebs-csi-driver-node-hwhp6\" (UID: \"639e6665-3b8f-4490-a41a-daae8669ff8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.658696 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658444 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-etc-modprobe-d\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.659397 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658463 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-etc-sysctl-d\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.659397 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658478 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0ce119b-c2be-46da-a9b6-e68fadfacf30-tmp\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.659397 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658494 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-sys\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.659397 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658509 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/639e6665-3b8f-4490-a41a-daae8669ff8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-hwhp6\" (UID: \"639e6665-3b8f-4490-a41a-daae8669ff8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.659397 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658668 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/639e6665-3b8f-4490-a41a-daae8669ff8b-etc-selinux\") pod \"aws-ebs-csi-driver-node-hwhp6\" (UID: \"639e6665-3b8f-4490-a41a-daae8669ff8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.659397 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.658708 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/632dce7c-ff33-4238-84bb-c82356acc1d6-system-cni-dir\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.659397 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.659078 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/639e6665-3b8f-4490-a41a-daae8669ff8b-sys-fs\") pod \"aws-ebs-csi-driver-node-hwhp6\" (UID: \"639e6665-3b8f-4490-a41a-daae8669ff8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.659786 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.659423 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/632dce7c-ff33-4238-84bb-c82356acc1d6-cnibin\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.659786 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.659726 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-etc-kubernetes\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.659949 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.659919 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-etc-systemd\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.660098 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.659975 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/632dce7c-ff33-4238-84bb-c82356acc1d6-cni-binary-copy\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.660098 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.660034 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-etc-sysconfig\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.660098 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.660047 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/0b32935c-be84-4ae4-bc60-0e462f6c89f6-dbus\") pod \"global-pull-secret-syncer-9mbj7\" (UID: \"0b32935c-be84-4ae4-bc60-0e462f6c89f6\") " pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:25.660098 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.660078 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/632dce7c-ff33-4238-84bb-c82356acc1d6-tuning-conf-dir\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.660098 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.660087 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-host\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.660098 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:25.660089 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:53:25.660356 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.660116 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-run\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.660356 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.660131 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-var-lib-kubelet\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.660356 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.660148 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/639e6665-3b8f-4490-a41a-daae8669ff8b-kubelet-dir\") pod \"aws-ebs-csi-driver-node-hwhp6\" (UID: \"639e6665-3b8f-4490-a41a-daae8669ff8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.660356 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:25.660176 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret podName:0b32935c-be84-4ae4-bc60-0e462f6c89f6 nodeName:}" failed. No retries permitted until 2026-07-28 00:53:26.160153082 +0000 UTC m=+3.079753753 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret") pod "global-pull-secret-syncer-9mbj7" (UID: "0b32935c-be84-4ae4-bc60-0e462f6c89f6") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:53:25.660356 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.660179 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/632dce7c-ff33-4238-84bb-c82356acc1d6-os-release\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.660356 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.660196 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/666b80c4-e226-4307-b25e-4f7ffd02f5b9-host\") pod \"node-ca-jd4kr\" (UID: \"666b80c4-e226-4307-b25e-4f7ffd02f5b9\") " pod="openshift-image-registry/node-ca-jd4kr" Jul 28 00:53:25.660356 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.660329 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-etc-sysctl-conf\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.660729 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.660409 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/639e6665-3b8f-4490-a41a-daae8669ff8b-socket-dir\") pod \"aws-ebs-csi-driver-node-hwhp6\" (UID: \"639e6665-3b8f-4490-a41a-daae8669ff8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.660729 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.660469 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/639e6665-3b8f-4490-a41a-daae8669ff8b-device-dir\") pod \"aws-ebs-csi-driver-node-hwhp6\" (UID: \"639e6665-3b8f-4490-a41a-daae8669ff8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.660729 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.660558 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-etc-modprobe-d\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.660729 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.660602 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-sys\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.660729 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.660713 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/2408ba36-e5e9-465c-8434-b17d73f6febb-konnectivity-ca\") pod \"konnectivity-agent-5rpd2\" (UID: \"2408ba36-e5e9-465c-8434-b17d73f6febb\") " pod="kube-system/konnectivity-agent-5rpd2" Jul 28 00:53:25.661050 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.660782 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/0b32935c-be84-4ae4-bc60-0e462f6c89f6-kubelet-config\") pod \"global-pull-secret-syncer-9mbj7\" (UID: \"0b32935c-be84-4ae4-bc60-0e462f6c89f6\") " pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:25.661050 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.661035 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/666b80c4-e226-4307-b25e-4f7ffd02f5b9-serviceca\") pod \"node-ca-jd4kr\" (UID: \"666b80c4-e226-4307-b25e-4f7ffd02f5b9\") " pod="openshift-image-registry/node-ca-jd4kr" Jul 28 00:53:25.661673 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.661194 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/639e6665-3b8f-4490-a41a-daae8669ff8b-registration-dir\") pod \"aws-ebs-csi-driver-node-hwhp6\" (UID: \"639e6665-3b8f-4490-a41a-daae8669ff8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.661673 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.661260 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/64b5029e-0628-4bbd-b16c-1ec599f76a21-hosts-file\") pod \"node-resolver-mjj4c\" (UID: \"64b5029e-0628-4bbd-b16c-1ec599f76a21\") " pod="openshift-dns/node-resolver-mjj4c" Jul 28 00:53:25.661673 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.661306 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-etc-sysctl-d\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.661673 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.661312 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/2567e6a4-152a-47c0-b847-c36069b68643-iptables-alerter-script\") pod \"iptables-alerter-k8xz4\" (UID: \"2567e6a4-152a-47c0-b847-c36069b68643\") " pod="openshift-network-operator/iptables-alerter-k8xz4" Jul 28 00:53:25.661673 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.661377 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/c0ce119b-c2be-46da-a9b6-e68fadfacf30-lib-modules\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.661673 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.661430 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/2567e6a4-152a-47c0-b847-c36069b68643-host-slash\") pod \"iptables-alerter-k8xz4\" (UID: \"2567e6a4-152a-47c0-b847-c36069b68643\") " pod="openshift-network-operator/iptables-alerter-k8xz4" Jul 28 00:53:25.661673 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.661551 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/64b5029e-0628-4bbd-b16c-1ec599f76a21-tmp-dir\") pod \"node-resolver-mjj4c\" (UID: \"64b5029e-0628-4bbd-b16c-1ec599f76a21\") " pod="openshift-dns/node-resolver-mjj4c" Jul 28 00:53:25.662003 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.661765 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/632dce7c-ff33-4238-84bb-c82356acc1d6-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.662163 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.662136 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/632dce7c-ff33-4238-84bb-c82356acc1d6-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.663242 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.663215 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/c0ce119b-c2be-46da-a9b6-e68fadfacf30-etc-tuned\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.663940 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.663904 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/2408ba36-e5e9-465c-8434-b17d73f6febb-agent-certs\") pod \"konnectivity-agent-5rpd2\" (UID: \"2408ba36-e5e9-465c-8434-b17d73f6febb\") " pod="kube-system/konnectivity-agent-5rpd2" Jul 28 00:53:25.664592 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.664553 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/c0ce119b-c2be-46da-a9b6-e68fadfacf30-tmp\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.672550 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.672508 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2zqt\" (UniqueName: \"kubernetes.io/projected/666b80c4-e226-4307-b25e-4f7ffd02f5b9-kube-api-access-s2zqt\") pod \"node-ca-jd4kr\" (UID: \"666b80c4-e226-4307-b25e-4f7ffd02f5b9\") " pod="openshift-image-registry/node-ca-jd4kr" Jul 28 00:53:25.673021 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.672991 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mkbbq\" (UniqueName: \"kubernetes.io/projected/632dce7c-ff33-4238-84bb-c82356acc1d6-kube-api-access-mkbbq\") pod \"multus-additional-cni-plugins-tpt6j\" (UID: \"632dce7c-ff33-4238-84bb-c82356acc1d6\") " pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.673559 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.673528 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-95gcp\" (UniqueName: \"kubernetes.io/projected/2567e6a4-152a-47c0-b847-c36069b68643-kube-api-access-95gcp\") pod \"iptables-alerter-k8xz4\" (UID: \"2567e6a4-152a-47c0-b847-c36069b68643\") " pod="openshift-network-operator/iptables-alerter-k8xz4" Jul 28 00:53:25.674697 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.674452 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wjpcj\" (UniqueName: \"kubernetes.io/projected/64b5029e-0628-4bbd-b16c-1ec599f76a21-kube-api-access-wjpcj\") pod \"node-resolver-mjj4c\" (UID: \"64b5029e-0628-4bbd-b16c-1ec599f76a21\") " pod="openshift-dns/node-resolver-mjj4c" Jul 28 00:53:25.674697 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.674622 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q2z7g\" (UniqueName: \"kubernetes.io/projected/639e6665-3b8f-4490-a41a-daae8669ff8b-kube-api-access-q2z7g\") pod \"aws-ebs-csi-driver-node-hwhp6\" (UID: \"639e6665-3b8f-4490-a41a-daae8669ff8b\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.675686 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.675611 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fmkwv\" (UniqueName: \"kubernetes.io/projected/c0ce119b-c2be-46da-a9b6-e68fadfacf30-kube-api-access-fmkwv\") pod \"tuned-m4xdf\" (UID: \"c0ce119b-c2be-46da-a9b6-e68fadfacf30\") " pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.757325 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.757289 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:25.779685 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.779560 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-fq7zn" Jul 28 00:53:25.797619 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.797559 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" Jul 28 00:53:25.799781 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.799752 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-5rpd2" Jul 28 00:53:25.813426 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.813385 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-k8xz4" Jul 28 00:53:25.822882 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.822851 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-tpt6j" Jul 28 00:53:25.832313 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.832276 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mjj4c" Jul 28 00:53:25.843864 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.843820 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" Jul 28 00:53:25.850996 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:25.850951 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-jd4kr" Jul 28 00:53:26.061770 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:26.061676 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs\") pod \"network-metrics-daemon-26zg4\" (UID: \"0281eb31-f259-4470-acc3-5499c546004c\") " pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:26.061925 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:26.061832 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:53:26.061925 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:26.061898 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs podName:0281eb31-f259-4470-acc3-5499c546004c nodeName:}" failed. No retries permitted until 2026-07-28 00:53:27.061880713 +0000 UTC m=+3.981481376 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs") pod "network-metrics-daemon-26zg4" (UID: "0281eb31-f259-4470-acc3-5499c546004c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:53:26.162619 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:26.162547 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zltmc\" (UniqueName: \"kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc\") pod \"network-check-target-f76c6\" (UID: \"32eb3a5b-feee-4950-8a7c-7370e73c6b3c\") " pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:26.162784 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:26.162643 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret\") pod \"global-pull-secret-syncer-9mbj7\" (UID: \"0b32935c-be84-4ae4-bc60-0e462f6c89f6\") " pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:26.162784 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:26.162729 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:53:26.162784 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:26.162754 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:53:26.162784 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:26.162764 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:53:26.162784 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:26.162767 2568 projected.go:196] Error preparing data for projected volume kube-api-access-zltmc for pod openshift-network-diagnostics/network-check-target-f76c6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:53:26.162995 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:26.162832 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc podName:32eb3a5b-feee-4950-8a7c-7370e73c6b3c nodeName:}" failed. No retries permitted until 2026-07-28 00:53:27.162813197 +0000 UTC m=+4.082413955 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-zltmc" (UniqueName: "kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc") pod "network-check-target-f76c6" (UID: "32eb3a5b-feee-4950-8a7c-7370e73c6b3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:53:26.162995 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:26.162854 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret podName:0b32935c-be84-4ae4-bc60-0e462f6c89f6 nodeName:}" failed. No retries permitted until 2026-07-28 00:53:27.162844474 +0000 UTC m=+4.082445136 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret") pod "global-pull-secret-syncer-9mbj7" (UID: "0b32935c-be84-4ae4-bc60-0e462f6c89f6") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:53:26.490736 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:26.490639 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 00:48:25 +0000 UTC" deadline="2028-03-03 08:03:09.38567196 +0000 UTC" Jul 28 00:53:26.490736 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:26.490681 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14023h9m42.894994686s" Jul 28 00:53:26.802467 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:26.802435 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4198cefb_f29f_46b4_8780_60cdd7a79110.slice/crio-a807f6ff4f0004d005643127c4a9c27cc5112a1a3006c8348f97a7a630fc3b0f WatchSource:0}: Error finding container a807f6ff4f0004d005643127c4a9c27cc5112a1a3006c8348f97a7a630fc3b0f: Status 404 returned error can't find the container with id a807f6ff4f0004d005643127c4a9c27cc5112a1a3006c8348f97a7a630fc3b0f Jul 28 00:53:26.809506 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:26.809456 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod639e6665_3b8f_4490_a41a_daae8669ff8b.slice/crio-faf3d62b55492d1d741e7d564a77c85067186f937bd0bc9bba8a3b80474300e5 WatchSource:0}: Error finding container faf3d62b55492d1d741e7d564a77c85067186f937bd0bc9bba8a3b80474300e5: Status 404 returned error can't find the container with id faf3d62b55492d1d741e7d564a77c85067186f937bd0bc9bba8a3b80474300e5 Jul 28 00:53:26.815121 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:53:26.812237 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod632dce7c_ff33_4238_84bb_c82356acc1d6.slice/crio-98ce40efe29b70e3efbdd7e1d752aec2dc766805bca4c5cd9c613fc30c604e65 WatchSource:0}: Error finding container 98ce40efe29b70e3efbdd7e1d752aec2dc766805bca4c5cd9c613fc30c604e65: Status 404 returned error can't find the container with id 98ce40efe29b70e3efbdd7e1d752aec2dc766805bca4c5cd9c613fc30c604e65 Jul 28 00:53:27.070396 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:27.070189 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs\") pod \"network-metrics-daemon-26zg4\" (UID: \"0281eb31-f259-4470-acc3-5499c546004c\") " pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:27.070560 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:27.070346 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:53:27.070560 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:27.070486 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs podName:0281eb31-f259-4470-acc3-5499c546004c nodeName:}" failed. No retries permitted until 2026-07-28 00:53:29.070470642 +0000 UTC m=+5.990071305 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs") pod "network-metrics-daemon-26zg4" (UID: "0281eb31-f259-4470-acc3-5499c546004c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:53:27.171607 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:27.171550 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zltmc\" (UniqueName: \"kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc\") pod \"network-check-target-f76c6\" (UID: \"32eb3a5b-feee-4950-8a7c-7370e73c6b3c\") " pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:27.171759 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:27.171635 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret\") pod \"global-pull-secret-syncer-9mbj7\" (UID: \"0b32935c-be84-4ae4-bc60-0e462f6c89f6\") " pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:27.171759 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:27.171727 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:53:27.171759 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:27.171729 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:53:27.171759 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:27.171754 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:53:27.171900 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:27.171767 2568 projected.go:196] Error preparing data for projected volume kube-api-access-zltmc for pod openshift-network-diagnostics/network-check-target-f76c6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:53:27.171900 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:27.171794 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret podName:0b32935c-be84-4ae4-bc60-0e462f6c89f6 nodeName:}" failed. No retries permitted until 2026-07-28 00:53:29.171776968 +0000 UTC m=+6.091377649 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret") pod "global-pull-secret-syncer-9mbj7" (UID: "0b32935c-be84-4ae4-bc60-0e462f6c89f6") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:53:27.171900 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:27.171811 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc podName:32eb3a5b-feee-4950-8a7c-7370e73c6b3c nodeName:}" failed. No retries permitted until 2026-07-28 00:53:29.171802663 +0000 UTC m=+6.091403325 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-zltmc" (UniqueName: "kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc") pod "network-check-target-f76c6" (UID: "32eb3a5b-feee-4950-8a7c-7370e73c6b3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:53:27.491705 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:27.491580 2568 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-27 00:48:25 +0000 UTC" deadline="2028-01-19 08:23:53.158741677 +0000 UTC" Jul 28 00:53:27.491705 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:27.491651 2568 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="12967h30m25.66709526s" Jul 28 00:53:27.529070 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:27.529036 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:27.529246 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:27.529181 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mbj7" podUID="0b32935c-be84-4ae4-bc60-0e462f6c89f6" Jul 28 00:53:27.529646 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:27.529622 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:27.529777 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:27.529725 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f76c6" podUID="32eb3a5b-feee-4950-8a7c-7370e73c6b3c" Jul 28 00:53:27.529882 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:27.529864 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:27.529988 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:27.529967 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26zg4" podUID="0281eb31-f259-4470-acc3-5499c546004c" Jul 28 00:53:27.553425 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:27.552146 2568 generic.go:356] "Generic (PLEG): container finished" podID="d73b36015dd37be22737c4ae60f1f3ea" containerID="6b38978f40ee6c6f1247829e5874dba97eba25b28dc0fddc8c464f04b60829c6" exitCode=0 Jul 28 00:53:27.553425 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:27.553171 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-44.ec2.internal" event={"ID":"d73b36015dd37be22737c4ae60f1f3ea","Type":"ContainerDied","Data":"6b38978f40ee6c6f1247829e5874dba97eba25b28dc0fddc8c464f04b60829c6"} Jul 28 00:53:27.573655 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:27.573542 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpt6j" event={"ID":"632dce7c-ff33-4238-84bb-c82356acc1d6","Type":"ContainerStarted","Data":"98ce40efe29b70e3efbdd7e1d752aec2dc766805bca4c5cd9c613fc30c604e65"} Jul 28 00:53:27.586316 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:27.586269 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" event={"ID":"639e6665-3b8f-4490-a41a-daae8669ff8b","Type":"ContainerStarted","Data":"faf3d62b55492d1d741e7d564a77c85067186f937bd0bc9bba8a3b80474300e5"} Jul 28 00:53:27.599983 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:27.599943 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" event={"ID":"4198cefb-f29f-46b4-8780-60cdd7a79110","Type":"ContainerStarted","Data":"a807f6ff4f0004d005643127c4a9c27cc5112a1a3006c8348f97a7a630fc3b0f"} Jul 28 00:53:27.604448 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:27.604406 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mjj4c" event={"ID":"64b5029e-0628-4bbd-b16c-1ec599f76a21","Type":"ContainerStarted","Data":"4414902abf0f9bd192f4e2e3fbd4f731c05f07ed0a76b2d8de07b6d4ae7314df"} Jul 28 00:53:27.610438 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:27.610398 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fq7zn" event={"ID":"b6c5d039-4cf3-4bc0-b792-dbab331da95b","Type":"ContainerStarted","Data":"d46f215287790164f69b6bcd035e2e0b501a925f4e29b32eabeb557c18628837"} Jul 28 00:53:27.626991 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:27.626891 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5rpd2" event={"ID":"2408ba36-e5e9-465c-8434-b17d73f6febb","Type":"ContainerStarted","Data":"9d20ba324ba9c49b3bd4fedc2da95076a68597cef1907acbc16f08952c6179ce"} Jul 28 00:53:27.648171 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:27.648127 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jd4kr" event={"ID":"666b80c4-e226-4307-b25e-4f7ffd02f5b9","Type":"ContainerStarted","Data":"84249f6025eb03df072c4836f861630dc213535ffb76fdcc1bd0bde194cfb1a9"} Jul 28 00:53:27.665591 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:27.661024 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k8xz4" event={"ID":"2567e6a4-152a-47c0-b847-c36069b68643","Type":"ContainerStarted","Data":"8857e0e0ee9db89cdc24dbf09c9ad61d6e4669a872c1085be69419528d81e15c"} Jul 28 00:53:27.665591 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:27.663331 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" event={"ID":"c0ce119b-c2be-46da-a9b6-e68fadfacf30","Type":"ContainerStarted","Data":"48e810ad2def4ab7c5d77363cd5f84fdd22c212ea4307cfa68cb1829cada97b9"} Jul 28 00:53:27.678071 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:27.678013 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-44.ec2.internal" event={"ID":"7ee893b47080271f4b0fa8967f643209","Type":"ContainerStarted","Data":"4cf45c1b6c0a420afbe4a5460369c72bf84f598dd7fbb257a93af53a16d94b49"} Jul 28 00:53:27.693046 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:27.692966 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-132-44.ec2.internal" podStartSLOduration=3.69294346 podStartE2EDuration="3.69294346s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:53:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:53:27.692762982 +0000 UTC m=+4.612363666" watchObservedRunningTime="2026-07-28 00:53:27.69294346 +0000 UTC m=+4.612544146" Jul 28 00:53:28.694178 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:28.693981 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-44.ec2.internal" event={"ID":"d73b36015dd37be22737c4ae60f1f3ea","Type":"ContainerStarted","Data":"2c5b7e30eaf0bc3749c1325a1ad8442860dc3d1a41914e607f575a47e44daedb"} Jul 28 00:53:28.718122 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:28.718051 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-132-44.ec2.internal" podStartSLOduration=4.718028046 podStartE2EDuration="4.718028046s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:53:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:53:28.716898717 +0000 UTC m=+5.636499402" watchObservedRunningTime="2026-07-28 00:53:28.718028046 +0000 UTC m=+5.637628733" Jul 28 00:53:29.088421 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:29.087736 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs\") pod \"network-metrics-daemon-26zg4\" (UID: \"0281eb31-f259-4470-acc3-5499c546004c\") " pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:29.088421 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:29.087912 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:53:29.088421 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:29.087986 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs podName:0281eb31-f259-4470-acc3-5499c546004c nodeName:}" failed. No retries permitted until 2026-07-28 00:53:33.087964105 +0000 UTC m=+10.007564787 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs") pod "network-metrics-daemon-26zg4" (UID: "0281eb31-f259-4470-acc3-5499c546004c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:53:29.189130 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:29.188526 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zltmc\" (UniqueName: \"kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc\") pod \"network-check-target-f76c6\" (UID: \"32eb3a5b-feee-4950-8a7c-7370e73c6b3c\") " pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:29.189130 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:29.188618 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret\") pod \"global-pull-secret-syncer-9mbj7\" (UID: \"0b32935c-be84-4ae4-bc60-0e462f6c89f6\") " pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:29.189130 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:29.188667 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:53:29.189130 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:29.188693 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:53:29.189130 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:29.188706 2568 projected.go:196] Error preparing data for projected volume kube-api-access-zltmc for pod openshift-network-diagnostics/network-check-target-f76c6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:53:29.189130 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:29.188735 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:53:29.189130 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:29.188767 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc podName:32eb3a5b-feee-4950-8a7c-7370e73c6b3c nodeName:}" failed. No retries permitted until 2026-07-28 00:53:33.188748799 +0000 UTC m=+10.108349484 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-zltmc" (UniqueName: "kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc") pod "network-check-target-f76c6" (UID: "32eb3a5b-feee-4950-8a7c-7370e73c6b3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:53:29.189130 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:29.188788 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret podName:0b32935c-be84-4ae4-bc60-0e462f6c89f6 nodeName:}" failed. No retries permitted until 2026-07-28 00:53:33.188777557 +0000 UTC m=+10.108378219 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret") pod "global-pull-secret-syncer-9mbj7" (UID: "0b32935c-be84-4ae4-bc60-0e462f6c89f6") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:53:29.528767 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:29.528688 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:29.528921 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:29.528822 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f76c6" podUID="32eb3a5b-feee-4950-8a7c-7370e73c6b3c" Jul 28 00:53:29.529286 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:29.529261 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:29.529418 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:29.529380 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26zg4" podUID="0281eb31-f259-4470-acc3-5499c546004c" Jul 28 00:53:29.531421 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:29.531394 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:29.531535 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:29.531508 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mbj7" podUID="0b32935c-be84-4ae4-bc60-0e462f6c89f6" Jul 28 00:53:31.529846 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:31.529815 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:31.530300 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:31.529948 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26zg4" podUID="0281eb31-f259-4470-acc3-5499c546004c" Jul 28 00:53:31.530367 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:31.530321 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:31.530458 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:31.530432 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f76c6" podUID="32eb3a5b-feee-4950-8a7c-7370e73c6b3c" Jul 28 00:53:31.530597 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:31.530486 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:31.530597 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:31.530553 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mbj7" podUID="0b32935c-be84-4ae4-bc60-0e462f6c89f6" Jul 28 00:53:33.125538 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:33.125486 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs\") pod \"network-metrics-daemon-26zg4\" (UID: \"0281eb31-f259-4470-acc3-5499c546004c\") " pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:33.126058 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:33.125686 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:53:33.126058 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:33.125774 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs podName:0281eb31-f259-4470-acc3-5499c546004c nodeName:}" failed. No retries permitted until 2026-07-28 00:53:41.12575267 +0000 UTC m=+18.045353334 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs") pod "network-metrics-daemon-26zg4" (UID: "0281eb31-f259-4470-acc3-5499c546004c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:53:33.226385 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:33.226336 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zltmc\" (UniqueName: \"kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc\") pod \"network-check-target-f76c6\" (UID: \"32eb3a5b-feee-4950-8a7c-7370e73c6b3c\") " pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:33.226661 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:33.226430 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret\") pod \"global-pull-secret-syncer-9mbj7\" (UID: \"0b32935c-be84-4ae4-bc60-0e462f6c89f6\") " pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:33.226661 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:33.226602 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:53:33.226814 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:33.226666 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret podName:0b32935c-be84-4ae4-bc60-0e462f6c89f6 nodeName:}" failed. No retries permitted until 2026-07-28 00:53:41.226647786 +0000 UTC m=+18.146248449 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret") pod "global-pull-secret-syncer-9mbj7" (UID: "0b32935c-be84-4ae4-bc60-0e462f6c89f6") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:53:33.227210 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:33.227087 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:53:33.227210 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:33.227113 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:53:33.227210 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:33.227125 2568 projected.go:196] Error preparing data for projected volume kube-api-access-zltmc for pod openshift-network-diagnostics/network-check-target-f76c6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:53:33.227210 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:33.227170 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc podName:32eb3a5b-feee-4950-8a7c-7370e73c6b3c nodeName:}" failed. No retries permitted until 2026-07-28 00:53:41.227154555 +0000 UTC m=+18.146755222 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-zltmc" (UniqueName: "kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc") pod "network-check-target-f76c6" (UID: "32eb3a5b-feee-4950-8a7c-7370e73c6b3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:53:33.532679 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:33.532588 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:33.532843 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:33.532720 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f76c6" podUID="32eb3a5b-feee-4950-8a7c-7370e73c6b3c" Jul 28 00:53:33.533130 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:33.533110 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:33.533376 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:33.533343 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26zg4" podUID="0281eb31-f259-4470-acc3-5499c546004c" Jul 28 00:53:33.533484 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:33.533404 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:33.533484 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:33.533475 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mbj7" podUID="0b32935c-be84-4ae4-bc60-0e462f6c89f6" Jul 28 00:53:35.529306 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:35.528708 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:35.529306 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:35.528843 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mbj7" podUID="0b32935c-be84-4ae4-bc60-0e462f6c89f6" Jul 28 00:53:35.529306 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:35.528709 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:35.529306 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:35.528990 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f76c6" podUID="32eb3a5b-feee-4950-8a7c-7370e73c6b3c" Jul 28 00:53:35.529306 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:35.529059 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:35.529306 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:35.529152 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26zg4" podUID="0281eb31-f259-4470-acc3-5499c546004c" Jul 28 00:53:37.527620 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:37.527579 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:37.527620 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:37.527623 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:37.528168 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:37.527591 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:37.528168 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:37.527724 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f76c6" podUID="32eb3a5b-feee-4950-8a7c-7370e73c6b3c" Jul 28 00:53:37.528168 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:37.527850 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26zg4" podUID="0281eb31-f259-4470-acc3-5499c546004c" Jul 28 00:53:37.528168 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:37.527932 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mbj7" podUID="0b32935c-be84-4ae4-bc60-0e462f6c89f6" Jul 28 00:53:39.527683 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:39.527636 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:39.527683 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:39.527662 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:39.528246 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:39.527636 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:39.528246 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:39.527769 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mbj7" podUID="0b32935c-be84-4ae4-bc60-0e462f6c89f6" Jul 28 00:53:39.528246 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:39.527869 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26zg4" podUID="0281eb31-f259-4470-acc3-5499c546004c" Jul 28 00:53:39.528246 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:39.527965 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f76c6" podUID="32eb3a5b-feee-4950-8a7c-7370e73c6b3c" Jul 28 00:53:41.195847 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:41.195802 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs\") pod \"network-metrics-daemon-26zg4\" (UID: \"0281eb31-f259-4470-acc3-5499c546004c\") " pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:41.196356 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:41.195931 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:53:41.196356 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:41.195995 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs podName:0281eb31-f259-4470-acc3-5499c546004c nodeName:}" failed. No retries permitted until 2026-07-28 00:53:57.195977073 +0000 UTC m=+34.115577751 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs") pod "network-metrics-daemon-26zg4" (UID: "0281eb31-f259-4470-acc3-5499c546004c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:53:41.297084 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:41.297045 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zltmc\" (UniqueName: \"kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc\") pod \"network-check-target-f76c6\" (UID: \"32eb3a5b-feee-4950-8a7c-7370e73c6b3c\") " pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:41.297289 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:41.297118 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret\") pod \"global-pull-secret-syncer-9mbj7\" (UID: \"0b32935c-be84-4ae4-bc60-0e462f6c89f6\") " pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:41.297289 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:41.297208 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:53:41.297289 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:41.297219 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:53:41.297289 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:41.297237 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:53:41.297289 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:41.297249 2568 projected.go:196] Error preparing data for projected volume kube-api-access-zltmc for pod openshift-network-diagnostics/network-check-target-f76c6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:53:41.297289 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:41.297271 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret podName:0b32935c-be84-4ae4-bc60-0e462f6c89f6 nodeName:}" failed. No retries permitted until 2026-07-28 00:53:57.297253451 +0000 UTC m=+34.216854117 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret") pod "global-pull-secret-syncer-9mbj7" (UID: "0b32935c-be84-4ae4-bc60-0e462f6c89f6") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:53:41.297289 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:41.297287 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc podName:32eb3a5b-feee-4950-8a7c-7370e73c6b3c nodeName:}" failed. No retries permitted until 2026-07-28 00:53:57.297278328 +0000 UTC m=+34.216878990 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-zltmc" (UniqueName: "kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc") pod "network-check-target-f76c6" (UID: "32eb3a5b-feee-4950-8a7c-7370e73c6b3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:53:41.527688 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:41.527605 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:41.527688 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:41.527619 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:41.527902 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:41.527710 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f76c6" podUID="32eb3a5b-feee-4950-8a7c-7370e73c6b3c" Jul 28 00:53:41.527902 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:41.527792 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26zg4" podUID="0281eb31-f259-4470-acc3-5499c546004c" Jul 28 00:53:41.527902 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:41.527824 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:41.528073 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:41.527940 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mbj7" podUID="0b32935c-be84-4ae4-bc60-0e462f6c89f6" Jul 28 00:53:43.528749 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:43.528713 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:43.529237 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:43.528807 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:43.529237 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:43.528851 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:43.529237 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:43.528866 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f76c6" podUID="32eb3a5b-feee-4950-8a7c-7370e73c6b3c" Jul 28 00:53:43.529237 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:43.528930 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mbj7" podUID="0b32935c-be84-4ae4-bc60-0e462f6c89f6" Jul 28 00:53:43.529237 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:43.529065 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26zg4" podUID="0281eb31-f259-4470-acc3-5499c546004c" Jul 28 00:53:45.530878 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:45.530844 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:45.531396 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:45.530987 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:45.531396 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:45.531002 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mbj7" podUID="0b32935c-be84-4ae4-bc60-0e462f6c89f6" Jul 28 00:53:45.531396 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:45.531022 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:45.531396 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:45.531118 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f76c6" podUID="32eb3a5b-feee-4950-8a7c-7370e73c6b3c" Jul 28 00:53:45.531396 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:45.531215 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26zg4" podUID="0281eb31-f259-4470-acc3-5499c546004c" Jul 28 00:53:46.733747 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:46.733402 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-fq7zn" event={"ID":"b6c5d039-4cf3-4bc0-b792-dbab331da95b","Type":"ContainerStarted","Data":"36b615717993dfd6c00f12d68330885f5b0ecda90eaa1950109fcedd5f363873"} Jul 28 00:53:46.735053 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:46.735018 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-5rpd2" event={"ID":"2408ba36-e5e9-465c-8434-b17d73f6febb","Type":"ContainerStarted","Data":"e41d716dcf95bc823a62b74c08b5c75f3e8b0947749b63570bbefe3d17d500b0"} Jul 28 00:53:46.736404 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:46.736373 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-jd4kr" event={"ID":"666b80c4-e226-4307-b25e-4f7ffd02f5b9","Type":"ContainerStarted","Data":"2d5f9b8dd2925d5ab98142c6eff5a2faa7f4daa20e02cac07569682d645beace"} Jul 28 00:53:46.737944 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:46.737915 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" event={"ID":"c0ce119b-c2be-46da-a9b6-e68fadfacf30","Type":"ContainerStarted","Data":"00359291efd0ad48016edbc26f962a2d35641e5693fd753a5364b47aa964ae7d"} Jul 28 00:53:46.739576 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:46.739532 2568 generic.go:356] "Generic (PLEG): container finished" podID="632dce7c-ff33-4238-84bb-c82356acc1d6" containerID="12d3c7354b852ac43c940eae8210858cec997f0e516ec527aac27e73f72635cd" exitCode=0 Jul 28 00:53:46.739702 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:46.739595 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpt6j" event={"ID":"632dce7c-ff33-4238-84bb-c82356acc1d6","Type":"ContainerDied","Data":"12d3c7354b852ac43c940eae8210858cec997f0e516ec527aac27e73f72635cd"} Jul 28 00:53:46.741217 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:46.741163 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" event={"ID":"639e6665-3b8f-4490-a41a-daae8669ff8b","Type":"ContainerStarted","Data":"d33965bd85b3c4cdf64c267f8c2aba34327d7169500b85640a19141aed48077e"} Jul 28 00:53:46.744687 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:46.744652 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" event={"ID":"4198cefb-f29f-46b4-8780-60cdd7a79110","Type":"ContainerStarted","Data":"92638f70f4b305f859a2a94947b2db574b553e67134c0eb887c6a0a17e7f03a4"} Jul 28 00:53:46.744802 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:46.744731 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" event={"ID":"4198cefb-f29f-46b4-8780-60cdd7a79110","Type":"ContainerStarted","Data":"5880c86cb5ca669dfd5c096261b9c2a1464853f298809ef4290e5392fcb50bfb"} Jul 28 00:53:46.744802 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:46.744772 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" event={"ID":"4198cefb-f29f-46b4-8780-60cdd7a79110","Type":"ContainerStarted","Data":"b8118e40868c57bd09ceb379c7a0fe9c47713094756f64a58434fb2ef9638871"} Jul 28 00:53:46.744901 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:46.744804 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" event={"ID":"4198cefb-f29f-46b4-8780-60cdd7a79110","Type":"ContainerStarted","Data":"f1b4a22066b0cace92062d565b2c11d5f84c3498da968e54dbba12c577658666"} Jul 28 00:53:46.744901 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:46.744851 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" event={"ID":"4198cefb-f29f-46b4-8780-60cdd7a79110","Type":"ContainerStarted","Data":"97e25f6330b1d3cff9c7aacaa38d6eb6e2721435721783256b930c7f0dbf8899"} Jul 28 00:53:46.744901 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:46.744891 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" event={"ID":"4198cefb-f29f-46b4-8780-60cdd7a79110","Type":"ContainerStarted","Data":"2b4900f830c6ede94de5b698e8b0b5a89afa93a5fdafb093e6d8e15c777d3eae"} Jul 28 00:53:46.747954 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:46.747925 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mjj4c" event={"ID":"64b5029e-0628-4bbd-b16c-1ec599f76a21","Type":"ContainerStarted","Data":"acf309be01b1008010e008f41be330b4af5b306e2ba18bca20e6d9a856af546c"} Jul 28 00:53:46.751647 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:46.751540 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-fq7zn" podStartSLOduration=4.811085104 podStartE2EDuration="23.751447924s" totalImagesPullingTime="18.94036282s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:53:46.750300873 +0000 UTC m=+23.669901559" watchObservedRunningTime="2026-07-28 00:53:46.751447924 +0000 UTC m=+23.671048608" Jul 28 00:53:46.770605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:46.770540 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-m4xdf" podStartSLOduration=4.866261759 podStartE2EDuration="23.770517409s" totalImagesPullingTime="18.90425565s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:53:46.770474309 +0000 UTC m=+23.690074993" watchObservedRunningTime="2026-07-28 00:53:46.770517409 +0000 UTC m=+23.690118094" Jul 28 00:53:46.783810 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:46.783677 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-jd4kr" podStartSLOduration=3.908997351 podStartE2EDuration="22.783655295s" totalImagesPullingTime="18.874657944s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:53:46.783043394 +0000 UTC m=+23.702644078" watchObservedRunningTime="2026-07-28 00:53:46.783655295 +0000 UTC m=+23.703255979" Jul 28 00:53:46.803035 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:46.802963 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-5rpd2" podStartSLOduration=12.813598971 podStartE2EDuration="23.802944838s" totalImagesPullingTime="10.989345867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:53:46.802552164 +0000 UTC m=+23.722152851" watchObservedRunningTime="2026-07-28 00:53:46.802944838 +0000 UTC m=+23.722545522" Jul 28 00:53:46.844858 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:46.844798 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mjj4c" podStartSLOduration=3.9700871639999997 podStartE2EDuration="22.844777482s" totalImagesPullingTime="18.874690318s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:53:46.844102995 +0000 UTC m=+23.763703679" watchObservedRunningTime="2026-07-28 00:53:46.844777482 +0000 UTC m=+23.764378167" Jul 28 00:53:47.343840 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:47.343810 2568 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 28 00:53:47.527054 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:47.526871 2568 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-28T00:53:47.343829604Z","UUID":"b9aae5ad-b17a-432f-a9ec-e8f93441822f","Handler":null,"Name":"","Endpoint":""} Jul 28 00:53:47.527384 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:47.527361 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:47.527530 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:47.527361 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:47.527530 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:47.527485 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26zg4" podUID="0281eb31-f259-4470-acc3-5499c546004c" Jul 28 00:53:47.527696 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:47.527585 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mbj7" podUID="0b32935c-be84-4ae4-bc60-0e462f6c89f6" Jul 28 00:53:47.527696 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:47.527363 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:47.527696 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:47.527684 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f76c6" podUID="32eb3a5b-feee-4950-8a7c-7370e73c6b3c" Jul 28 00:53:47.528619 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:47.528603 2568 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 28 00:53:47.528724 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:47.528646 2568 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 28 00:53:47.752051 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:47.752012 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-k8xz4" event={"ID":"2567e6a4-152a-47c0-b847-c36069b68643","Type":"ContainerStarted","Data":"d8134b77a758ec55e34db37cd0e998ff51336333aac1d6f45bb1bc1c0f1929f2"} Jul 28 00:53:47.754404 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:47.754336 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" event={"ID":"639e6665-3b8f-4490-a41a-daae8669ff8b","Type":"ContainerStarted","Data":"4e269b7b15e1f1ea8fd7aaeb8c8d041c07f73bae7b398efb00d3515d32e41404"} Jul 28 00:53:47.781897 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:47.781799 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-k8xz4" podStartSLOduration=5.881348075 podStartE2EDuration="24.781780245s" totalImagesPullingTime="18.90043217s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:53:47.781639842 +0000 UTC m=+24.701240525" watchObservedRunningTime="2026-07-28 00:53:47.781780245 +0000 UTC m=+24.701380931" Jul 28 00:53:48.759465 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:48.759365 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" event={"ID":"639e6665-3b8f-4490-a41a-daae8669ff8b","Type":"ContainerStarted","Data":"10177146e04eb48041c416b7b133ab2f7dd5f49461258025cb8f0bc4c84964f2"} Jul 28 00:53:48.763640 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:48.763604 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" event={"ID":"4198cefb-f29f-46b4-8780-60cdd7a79110","Type":"ContainerStarted","Data":"9dee995b0bad682cd5a94fc835d337b18f00fff8d6f9fe2fb5d35c19e19b1908"} Jul 28 00:53:48.776521 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:48.776469 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-hwhp6" podStartSLOduration=3.48549253 podStartE2EDuration="24.77645222s" totalImagesPullingTime="21.29095969s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:53:24 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:53:48.775862959 +0000 UTC m=+25.695463656" watchObservedRunningTime="2026-07-28 00:53:48.77645222 +0000 UTC m=+25.696052904" Jul 28 00:53:49.063380 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:49.063297 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-5rpd2" Jul 28 00:53:49.063981 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:49.063950 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-5rpd2" Jul 28 00:53:49.527500 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:49.527414 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:49.527686 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:49.527415 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:49.527686 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:49.527554 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f76c6" podUID="32eb3a5b-feee-4950-8a7c-7370e73c6b3c" Jul 28 00:53:49.527686 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:49.527415 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:49.527866 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:49.527703 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26zg4" podUID="0281eb31-f259-4470-acc3-5499c546004c" Jul 28 00:53:49.527866 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:49.527773 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mbj7" podUID="0b32935c-be84-4ae4-bc60-0e462f6c89f6" Jul 28 00:53:49.766182 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:49.766149 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-5rpd2" Jul 28 00:53:49.766833 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:49.766806 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-5rpd2" Jul 28 00:53:51.527745 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:51.527478 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:51.528498 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:51.527518 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:51.528498 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:51.527794 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26zg4" podUID="0281eb31-f259-4470-acc3-5499c546004c" Jul 28 00:53:51.528498 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:51.527612 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:51.528498 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:51.527866 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f76c6" podUID="32eb3a5b-feee-4950-8a7c-7370e73c6b3c" Jul 28 00:53:51.528498 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:51.527926 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mbj7" podUID="0b32935c-be84-4ae4-bc60-0e462f6c89f6" Jul 28 00:53:51.772527 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:51.772486 2568 generic.go:356] "Generic (PLEG): container finished" podID="632dce7c-ff33-4238-84bb-c82356acc1d6" containerID="54166ebf0f32e1ed38afb90bf02ae488637cf0b5b5a4edfd3cc849baa53276b9" exitCode=0 Jul 28 00:53:51.772726 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:51.772588 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpt6j" event={"ID":"632dce7c-ff33-4238-84bb-c82356acc1d6","Type":"ContainerDied","Data":"54166ebf0f32e1ed38afb90bf02ae488637cf0b5b5a4edfd3cc849baa53276b9"} Jul 28 00:53:51.776578 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:51.776535 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" event={"ID":"4198cefb-f29f-46b4-8780-60cdd7a79110","Type":"ContainerStarted","Data":"ebfe8c90700011f3c1cb25193768952a9f9fdd4e35e59e11c4972b0a85c7fc58"} Jul 28 00:53:51.813543 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:51.813436 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" podStartSLOduration=9.841450959 podStartE2EDuration="28.813421112s" totalImagesPullingTime="18.971970153s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:53:51.812907837 +0000 UTC m=+28.732508522" watchObservedRunningTime="2026-07-28 00:53:51.813421112 +0000 UTC m=+28.733021796" Jul 28 00:53:52.782653 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:52.782408 2568 generic.go:356] "Generic (PLEG): container finished" podID="632dce7c-ff33-4238-84bb-c82356acc1d6" containerID="85b1ca21bd1fedaac2a42896e61a128e6972930eddc1234791af8626900b042b" exitCode=0 Jul 28 00:53:52.783149 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:52.782480 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpt6j" event={"ID":"632dce7c-ff33-4238-84bb-c82356acc1d6","Type":"ContainerDied","Data":"85b1ca21bd1fedaac2a42896e61a128e6972930eddc1234791af8626900b042b"} Jul 28 00:53:52.784072 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:52.783155 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:52.784072 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:52.783229 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:52.784072 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:52.783280 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:52.800414 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:52.800385 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:52.800616 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:52.800496 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:53:53.087255 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:53.087175 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9mbj7"] Jul 28 00:53:53.087420 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:53.087317 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:53.087489 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:53.087432 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mbj7" podUID="0b32935c-be84-4ae4-bc60-0e462f6c89f6" Jul 28 00:53:53.091276 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:53.091160 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f76c6"] Jul 28 00:53:53.091999 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:53.091971 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:53.092136 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:53.092111 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f76c6" podUID="32eb3a5b-feee-4950-8a7c-7370e73c6b3c" Jul 28 00:53:53.092762 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:53.092727 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-26zg4"] Jul 28 00:53:53.092873 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:53.092855 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:53.092991 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:53.092970 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26zg4" podUID="0281eb31-f259-4470-acc3-5499c546004c" Jul 28 00:53:54.528280 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:54.528244 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:54.528280 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:54.528266 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:54.528786 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:54.528355 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26zg4" podUID="0281eb31-f259-4470-acc3-5499c546004c" Jul 28 00:53:54.528786 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:54.528405 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:54.528786 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:54.528476 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mbj7" podUID="0b32935c-be84-4ae4-bc60-0e462f6c89f6" Jul 28 00:53:54.528786 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:54.528545 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f76c6" podUID="32eb3a5b-feee-4950-8a7c-7370e73c6b3c" Jul 28 00:53:54.791444 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:54.791337 2568 generic.go:356] "Generic (PLEG): container finished" podID="632dce7c-ff33-4238-84bb-c82356acc1d6" containerID="97e56ba07955ab17c40493bac924ed6252349cd400a348ad46596371d0c1875a" exitCode=0 Jul 28 00:53:54.791444 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:54.791432 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpt6j" event={"ID":"632dce7c-ff33-4238-84bb-c82356acc1d6","Type":"ContainerDied","Data":"97e56ba07955ab17c40493bac924ed6252349cd400a348ad46596371d0c1875a"} Jul 28 00:53:56.528368 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:56.528163 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:56.528368 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:56.528207 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:56.528368 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:56.528163 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:56.528368 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:56.528311 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mbj7" podUID="0b32935c-be84-4ae4-bc60-0e462f6c89f6" Jul 28 00:53:56.528972 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:56.528406 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26zg4" podUID="0281eb31-f259-4470-acc3-5499c546004c" Jul 28 00:53:56.528972 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:56.528473 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f76c6" podUID="32eb3a5b-feee-4950-8a7c-7370e73c6b3c" Jul 28 00:53:57.215292 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:57.215258 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs\") pod \"network-metrics-daemon-26zg4\" (UID: \"0281eb31-f259-4470-acc3-5499c546004c\") " pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:57.215487 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:57.215415 2568 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:53:57.215487 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:57.215478 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs podName:0281eb31-f259-4470-acc3-5499c546004c nodeName:}" failed. No retries permitted until 2026-07-28 00:54:29.215462572 +0000 UTC m=+66.135063234 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs") pod "network-metrics-daemon-26zg4" (UID: "0281eb31-f259-4470-acc3-5499c546004c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 28 00:53:57.316281 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:57.316239 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zltmc\" (UniqueName: \"kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc\") pod \"network-check-target-f76c6\" (UID: \"32eb3a5b-feee-4950-8a7c-7370e73c6b3c\") " pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:57.316489 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:57.316321 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret\") pod \"global-pull-secret-syncer-9mbj7\" (UID: \"0b32935c-be84-4ae4-bc60-0e462f6c89f6\") " pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:57.316489 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:57.316419 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 28 00:53:57.316489 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:57.316442 2568 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 28 00:53:57.316489 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:57.316452 2568 projected.go:196] Error preparing data for projected volume kube-api-access-zltmc for pod openshift-network-diagnostics/network-check-target-f76c6: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:53:57.316489 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:57.316454 2568 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 28 00:53:57.316779 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:57.316500 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc podName:32eb3a5b-feee-4950-8a7c-7370e73c6b3c nodeName:}" failed. No retries permitted until 2026-07-28 00:54:29.316486004 +0000 UTC m=+66.236086666 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-zltmc" (UniqueName: "kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc") pod "network-check-target-f76c6" (UID: "32eb3a5b-feee-4950-8a7c-7370e73c6b3c") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 28 00:53:57.316779 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:57.316515 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret podName:0b32935c-be84-4ae4-bc60-0e462f6c89f6 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:29.316508784 +0000 UTC m=+66.236109446 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret") pod "global-pull-secret-syncer-9mbj7" (UID: "0b32935c-be84-4ae4-bc60-0e462f6c89f6") : object "kube-system"/"original-pull-secret" not registered Jul 28 00:53:58.527528 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:58.527314 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:53:58.527972 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:58.527368 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:53:58.527972 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:58.527366 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:53:58.527972 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:58.527663 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-26zg4" podUID="0281eb31-f259-4470-acc3-5499c546004c" Jul 28 00:53:58.527972 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:58.527763 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-9mbj7" podUID="0b32935c-be84-4ae4-bc60-0e462f6c89f6" Jul 28 00:53:58.527972 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:58.527851 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-f76c6" podUID="32eb3a5b-feee-4950-8a7c-7370e73c6b3c" Jul 28 00:53:59.437667 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.437631 2568 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-132-44.ec2.internal" event="NodeReady" Jul 28 00:53:59.437834 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.437762 2568 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 28 00:53:59.469765 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.469732 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/router-default-5b886669c7-2wtgq"] Jul 28 00:53:59.477312 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.472885 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:53:59.477312 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.474647 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7ndng"] Jul 28 00:53:59.477312 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.475770 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-metrics-certs-default\"" Jul 28 00:53:59.477312 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.477106 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"service-ca-bundle\"" Jul 28 00:53:59.477312 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.477183 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-stats-default\"" Jul 28 00:53:59.477982 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.477952 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 28 00:53:59.478105 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.478041 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"default-ingress-cert\"" Jul 28 00:53:59.478873 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.478483 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-27b4q\"" Jul 28 00:53:59.479155 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.479138 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 28 00:53:59.481454 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.481401 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-779fc55d8b-xxb9x"] Jul 28 00:53:59.481596 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.481508 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7ndng" Jul 28 00:53:59.483894 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.483871 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-storage-operator\"/\"volume-data-source-validator-dockercfg-k5bwk\"" Jul 28 00:53:59.484024 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.483876 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:53:59.484024 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.483876 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-storage-operator\"/\"kube-root-ca.crt\"" Jul 28 00:53:59.487139 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.484738 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg"] Jul 28 00:53:59.487139 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.485733 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.489179 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.488892 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xbmf2\"" Jul 28 00:53:59.489624 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.489438 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 28 00:53:59.489624 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.489552 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 28 00:53:59.489928 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.489891 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 28 00:53:59.490757 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.490732 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-operator-5885fdb759-8h8gt"] Jul 28 00:53:59.491848 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.491036 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg" Jul 28 00:53:59.495238 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.493243 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 28 00:53:59.495238 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.494014 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-l7dwd"] Jul 28 00:53:59.495238 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.494176 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 28 00:53:59.495238 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.494745 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-8h8gt" Jul 28 00:53:59.495545 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.495531 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-tls\"" Jul 28 00:53:59.495618 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.495586 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9n67c\"" Jul 28 00:53:59.495971 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.495950 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemetry-config\"" Jul 28 00:53:59.497173 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.497149 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"openshift-insights-serving-cert\"" Jul 28 00:53:59.497301 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.497270 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 28 00:53:59.497486 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.497434 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"service-ca-bundle\"" Jul 28 00:53:59.497712 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.497690 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"operator-dockercfg-x6zjf\"" Jul 28 00:53:59.497993 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.497931 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-gr7gw"] Jul 28 00:53:59.498242 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.498225 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-l7dwd" Jul 28 00:53:59.499707 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.499107 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 28 00:53:59.499707 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.499115 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 28 00:53:59.501675 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.501558 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk"] Jul 28 00:53:59.502824 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.502802 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"samples-operator-tls\"" Jul 28 00:53:59.504836 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.504813 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"kube-root-ca.crt\"" Jul 28 00:53:59.505319 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.505298 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-samples-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:53:59.505786 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.505768 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vbs59\"" Jul 28 00:53:59.507155 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.507136 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" Jul 28 00:53:59.510423 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.510391 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b886669c7-2wtgq"] Jul 28 00:53:59.510697 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.510461 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7ndng"] Jul 28 00:53:59.510697 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.510497 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jtg8n"] Jul 28 00:53:59.512223 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.512197 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:53:59.512862 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.512830 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"serving-cert\"" Jul 28 00:53:59.513309 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.513283 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"trusted-ca-bundle\"" Jul 28 00:53:59.513537 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.513514 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"console-operator-config\"" Jul 28 00:53:59.513792 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.513772 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"kube-root-ca.crt\"" Jul 28 00:53:59.514253 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.514236 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console-operator\"/\"console-operator-dockercfg-qq4ng\"" Jul 28 00:53:59.514755 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.514738 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk" Jul 28 00:53:59.516338 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.515962 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-xrzzl"] Jul 28 00:53:59.517137 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.517010 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jtg8n" Jul 28 00:53:59.519115 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.519087 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:53:59.519115 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.519103 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:53:59.519291 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.519090 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"serving-cert\"" Jul 28 00:53:59.519291 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.519204 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-storage-version-migrator-operator-dockercfg-jrgj8\"" Jul 28 00:53:59.519370 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.519346 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"config\"" Jul 28 00:53:59.519423 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.519407 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator-operator\"/\"kube-root-ca.crt\"" Jul 28 00:53:59.519876 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.519862 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"serving-cert\"" Jul 28 00:53:59.520688 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.520668 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-config\"" Jul 28 00:53:59.520986 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.520971 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca-operator\"/\"service-ca-operator-dockercfg-npdg7\"" Jul 28 00:53:59.521073 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.520999 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca-operator\"/\"kube-root-ca.crt\"" Jul 28 00:53:59.521329 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.521305 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-l7dwd"] Jul 28 00:53:59.521439 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.521356 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-5jr64"] Jul 28 00:53:59.521538 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.521518 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console-operator\"/\"trusted-ca\"" Jul 28 00:53:59.521643 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.521521 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-xrzzl" Jul 28 00:53:59.523624 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.523601 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 28 00:53:59.523714 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.523692 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 28 00:53:59.523772 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.523755 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"network-diagnostics-dockercfg-8rm2q\"" Jul 28 00:53:59.524403 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.524386 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-vjmlz"] Jul 28 00:53:59.525078 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.525063 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5jr64" Jul 28 00:53:59.527217 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.527197 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 28 00:53:59.527332 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.527264 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 28 00:53:59.527332 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.527312 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 28 00:53:59.527436 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.527359 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-s4cm9\"" Jul 28 00:53:59.527790 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.527773 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vjmlz" Jul 28 00:53:59.529684 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.529652 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 28 00:53:59.529684 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.529677 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 28 00:53:59.529947 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.529930 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w6lql\"" Jul 28 00:53:59.531766 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.531746 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg"] Jul 28 00:53:59.531845 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.531783 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-779fc55d8b-xxb9x"] Jul 28 00:53:59.531845 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.531798 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-gr7gw"] Jul 28 00:53:59.531845 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.531817 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-xrzzl"] Jul 28 00:53:59.531845 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.531835 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jtg8n"] Jul 28 00:53:59.531971 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.531853 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk"] Jul 28 00:53:59.531971 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.531874 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5jr64"] Jul 28 00:53:59.531971 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.531894 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vjmlz"] Jul 28 00:53:59.531971 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.531915 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-8h8gt"] Jul 28 00:53:59.618253 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.618199 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rpd2_2408ba36-e5e9-465c-8434-b17d73f6febb/konnectivity-agent/0.log" limit=1024 Jul 28 00:53:59.632587 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.632532 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t4glw\" (UniqueName: \"kubernetes.io/projected/d247409f-9d05-4a9d-b74f-484931e06d25-kube-api-access-t4glw\") pod \"volume-data-source-validator-549c6d54cf-7ndng\" (UID: \"d247409f-9d05-4a9d-b74f-484931e06d25\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7ndng" Jul 28 00:53:59.632587 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.632588 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ddjfs\" (UniqueName: \"kubernetes.io/projected/f63765b0-930b-4807-85d3-8447fd21dd69-kube-api-access-ddjfs\") pod \"ingress-canary-5jr64\" (UID: \"f63765b0-930b-4807-85d3-8447fd21dd69\") " pod="openshift-ingress-canary/ingress-canary-5jr64" Jul 28 00:53:59.632783 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.632607 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/80623db8-0901-4f5f-830d-f07ace2f6d05-snapshots\") pod \"insights-operator-5885fdb759-8h8gt\" (UID: \"80623db8-0901-4f5f-830d-f07ace2f6d05\") " pod="openshift-insights/insights-operator-5885fdb759-8h8gt" Jul 28 00:53:59.632783 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.632625 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pwsgv\" (UniqueName: \"kubernetes.io/projected/3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c-kube-api-access-pwsgv\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk\" (UID: \"3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk" Jul 28 00:53:59.632783 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.632643 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lk4bx\" (UniqueName: \"kubernetes.io/projected/b00b06e1-31f5-480d-81db-15a526c06b14-kube-api-access-lk4bx\") pod \"cluster-samples-operator-6748489656-l7dwd\" (UID: \"b00b06e1-31f5-480d-81db-15a526c06b14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-l7dwd" Jul 28 00:53:59.632783 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.632663 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49e28997-66bd-4404-a70a-63c65cd6a4a3-image-registry-private-configuration\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.632783 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.632681 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80623db8-0901-4f5f-830d-f07ace2f6d05-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-8h8gt\" (UID: \"80623db8-0901-4f5f-830d-f07ace2f6d05\") " pod="openshift-insights/insights-operator-5885fdb759-8h8gt" Jul 28 00:53:59.632783 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.632721 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.632783 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.632758 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-2g4mg\" (UID: \"a2f4fe8c-ef6c-459b-9e82-dbd224d85599\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg" Jul 28 00:53:59.632986 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.632816 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21d98251-4171-4c26-ab52-9ba123ba3be9-trusted-ca\") pod \"console-operator-584dcb6b54-gr7gw\" (UID: \"21d98251-4171-4c26-ab52-9ba123ba3be9\") " pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" Jul 28 00:53:59.632986 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.632839 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-klsh5\" (UniqueName: \"kubernetes.io/projected/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-kube-api-access-klsh5\") pod \"dns-default-vjmlz\" (UID: \"bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14\") " pod="openshift-dns/dns-default-vjmlz" Jul 28 00:53:59.632986 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.632872 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk\" (UID: \"3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk" Jul 28 00:53:59.632986 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.632928 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-frppn\" (UniqueName: \"kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-kube-api-access-frppn\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.632986 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.632946 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-default-certificate\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:53:59.632986 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.632963 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-bound-sa-token\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.632986 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.632984 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49e28997-66bd-4404-a70a-63c65cd6a4a3-installation-pull-secrets\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.633185 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633009 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cjzsn\" (UniqueName: \"kubernetes.io/projected/362e3f3f-7182-40f4-b5c1-1a1b54190669-kube-api-access-cjzsn\") pod \"service-ca-operator-5d6c75f84f-jtg8n\" (UID: \"362e3f3f-7182-40f4-b5c1-1a1b54190669\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jtg8n" Jul 28 00:53:59.633185 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633034 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f63765b0-930b-4807-85d3-8447fd21dd69-cert\") pod \"ingress-canary-5jr64\" (UID: \"f63765b0-930b-4807-85d3-8447fd21dd69\") " pod="openshift-ingress-canary/ingress-canary-5jr64" Jul 28 00:53:59.633185 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633051 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/21d98251-4171-4c26-ab52-9ba123ba3be9-serving-cert\") pod \"console-operator-584dcb6b54-gr7gw\" (UID: \"21d98251-4171-4c26-ab52-9ba123ba3be9\") " pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" Jul 28 00:53:59.633185 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633067 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n9r7l\" (UniqueName: \"kubernetes.io/projected/5d7d2131-ad67-4a02-bccf-0530ea749233-kube-api-access-n9r7l\") pod \"network-check-source-7d88cb55d8-xrzzl\" (UID: \"5d7d2131-ad67-4a02-bccf-0530ea749233\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-xrzzl" Jul 28 00:53:59.633185 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633084 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49e28997-66bd-4404-a70a-63c65cd6a4a3-ca-trust-extracted\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.633185 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633100 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28s29\" (UniqueName: \"kubernetes.io/projected/21d98251-4171-4c26-ab52-9ba123ba3be9-kube-api-access-28s29\") pod \"console-operator-584dcb6b54-gr7gw\" (UID: \"21d98251-4171-4c26-ab52-9ba123ba3be9\") " pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" Jul 28 00:53:59.633185 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633118 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/362e3f3f-7182-40f4-b5c1-1a1b54190669-serving-cert\") pod \"service-ca-operator-5d6c75f84f-jtg8n\" (UID: \"362e3f3f-7182-40f4-b5c1-1a1b54190669\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jtg8n" Jul 28 00:53:59.633185 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633142 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/21d98251-4171-4c26-ab52-9ba123ba3be9-config\") pod \"console-operator-584dcb6b54-gr7gw\" (UID: \"21d98251-4171-4c26-ab52-9ba123ba3be9\") " pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" Jul 28 00:53:59.633185 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633166 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-82l8p\" (UniqueName: \"kubernetes.io/projected/49fe97ad-3adc-4b96-a594-b0b505a0cffe-kube-api-access-82l8p\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:53:59.633428 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633202 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-2g4mg\" (UID: \"a2f4fe8c-ef6c-459b-9e82-dbd224d85599\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg" Jul 28 00:53:59.633428 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633219 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hj7w8\" (UniqueName: \"kubernetes.io/projected/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-kube-api-access-hj7w8\") pod \"cluster-monitoring-operator-548b489cb8-2g4mg\" (UID: \"a2f4fe8c-ef6c-459b-9e82-dbd224d85599\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg" Jul 28 00:53:59.633428 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633248 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b00b06e1-31f5-480d-81db-15a526c06b14-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-l7dwd\" (UID: \"b00b06e1-31f5-480d-81db-15a526c06b14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-l7dwd" Jul 28 00:53:59.633428 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633287 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49e28997-66bd-4404-a70a-63c65cd6a4a3-trusted-ca\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.633428 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633308 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-certificates\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.633428 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633335 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-config-volume\") pod \"dns-default-vjmlz\" (UID: \"bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14\") " pod="openshift-dns/dns-default-vjmlz" Jul 28 00:53:59.633428 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633354 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rf8dk\" (UniqueName: \"kubernetes.io/projected/80623db8-0901-4f5f-830d-f07ace2f6d05-kube-api-access-rf8dk\") pod \"insights-operator-5885fdb759-8h8gt\" (UID: \"80623db8-0901-4f5f-830d-f07ace2f6d05\") " pod="openshift-insights/insights-operator-5885fdb759-8h8gt" Jul 28 00:53:59.633428 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633369 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk\" (UID: \"3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk" Jul 28 00:53:59.633428 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633384 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80623db8-0901-4f5f-830d-f07ace2f6d05-tmp\") pod \"insights-operator-5885fdb759-8h8gt\" (UID: \"80623db8-0901-4f5f-830d-f07ace2f6d05\") " pod="openshift-insights/insights-operator-5885fdb759-8h8gt" Jul 28 00:53:59.633428 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633401 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-metrics-certs\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:53:59.633772 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633453 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/362e3f3f-7182-40f4-b5c1-1a1b54190669-config\") pod \"service-ca-operator-5d6c75f84f-jtg8n\" (UID: \"362e3f3f-7182-40f4-b5c1-1a1b54190669\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jtg8n" Jul 28 00:53:59.633772 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633474 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-tmp-dir\") pod \"dns-default-vjmlz\" (UID: \"bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14\") " pod="openshift-dns/dns-default-vjmlz" Jul 28 00:53:59.633772 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633489 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-stats-auth\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:53:59.633772 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633536 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80623db8-0901-4f5f-830d-f07ace2f6d05-service-ca-bundle\") pod \"insights-operator-5885fdb759-8h8gt\" (UID: \"80623db8-0901-4f5f-830d-f07ace2f6d05\") " pod="openshift-insights/insights-operator-5885fdb759-8h8gt" Jul 28 00:53:59.633772 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633554 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80623db8-0901-4f5f-830d-f07ace2f6d05-serving-cert\") pod \"insights-operator-5885fdb759-8h8gt\" (UID: \"80623db8-0901-4f5f-830d-f07ace2f6d05\") " pod="openshift-insights/insights-operator-5885fdb759-8h8gt" Jul 28 00:53:59.633772 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633612 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-metrics-tls\") pod \"dns-default-vjmlz\" (UID: \"bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14\") " pod="openshift-dns/dns-default-vjmlz" Jul 28 00:53:59.633772 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.633636 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49fe97ad-3adc-4b96-a594-b0b505a0cffe-service-ca-bundle\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:53:59.699428 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.699378 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rpd2_2408ba36-e5e9-465c-8434-b17d73f6febb/konnectivity-agent/0.log" limit=1024 Jul 28 00:53:59.734336 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.734302 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.734476 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.734342 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-2g4mg\" (UID: \"a2f4fe8c-ef6c-459b-9e82-dbd224d85599\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg" Jul 28 00:53:59.734476 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.734364 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21d98251-4171-4c26-ab52-9ba123ba3be9-trusted-ca\") pod \"console-operator-584dcb6b54-gr7gw\" (UID: \"21d98251-4171-4c26-ab52-9ba123ba3be9\") " pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" Jul 28 00:53:59.734476 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.734391 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-klsh5\" (UniqueName: \"kubernetes.io/projected/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-kube-api-access-klsh5\") pod \"dns-default-vjmlz\" (UID: \"bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14\") " pod="openshift-dns/dns-default-vjmlz" Jul 28 00:53:59.734476 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.734415 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk\" (UID: \"3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk" Jul 28 00:53:59.734476 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.734460 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-frppn\" (UniqueName: \"kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-kube-api-access-frppn\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.734768 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:59.734472 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:53:59.734768 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.734486 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-default-certificate\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:53:59.734768 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:59.734499 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-779fc55d8b-xxb9x: secret "image-registry-tls" not found Jul 28 00:53:59.734768 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.734511 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-bound-sa-token\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.734768 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.734538 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49e28997-66bd-4404-a70a-63c65cd6a4a3-installation-pull-secrets\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.734768 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.734588 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cjzsn\" (UniqueName: \"kubernetes.io/projected/362e3f3f-7182-40f4-b5c1-1a1b54190669-kube-api-access-cjzsn\") pod \"service-ca-operator-5d6c75f84f-jtg8n\" (UID: \"362e3f3f-7182-40f4-b5c1-1a1b54190669\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jtg8n" Jul 28 00:53:59.734768 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:59.734610 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls podName:49e28997-66bd-4404-a70a-63c65cd6a4a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:00.234561005 +0000 UTC m=+37.154161730 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls") pod "image-registry-779fc55d8b-xxb9x" (UID: "49e28997-66bd-4404-a70a-63c65cd6a4a3") : secret "image-registry-tls" not found Jul 28 00:53:59.734768 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.734660 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f63765b0-930b-4807-85d3-8447fd21dd69-cert\") pod \"ingress-canary-5jr64\" (UID: \"f63765b0-930b-4807-85d3-8447fd21dd69\") " pod="openshift-ingress-canary/ingress-canary-5jr64" Jul 28 00:53:59.734768 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.734693 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/21d98251-4171-4c26-ab52-9ba123ba3be9-serving-cert\") pod \"console-operator-584dcb6b54-gr7gw\" (UID: \"21d98251-4171-4c26-ab52-9ba123ba3be9\") " pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" Jul 28 00:53:59.734768 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.734724 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n9r7l\" (UniqueName: \"kubernetes.io/projected/5d7d2131-ad67-4a02-bccf-0530ea749233-kube-api-access-n9r7l\") pod \"network-check-source-7d88cb55d8-xrzzl\" (UID: \"5d7d2131-ad67-4a02-bccf-0530ea749233\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-xrzzl" Jul 28 00:53:59.734768 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.734759 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49e28997-66bd-4404-a70a-63c65cd6a4a3-ca-trust-extracted\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.735148 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.734784 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28s29\" (UniqueName: \"kubernetes.io/projected/21d98251-4171-4c26-ab52-9ba123ba3be9-kube-api-access-28s29\") pod \"console-operator-584dcb6b54-gr7gw\" (UID: \"21d98251-4171-4c26-ab52-9ba123ba3be9\") " pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" Jul 28 00:53:59.735148 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.734821 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/362e3f3f-7182-40f4-b5c1-1a1b54190669-serving-cert\") pod \"service-ca-operator-5d6c75f84f-jtg8n\" (UID: \"362e3f3f-7182-40f4-b5c1-1a1b54190669\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jtg8n" Jul 28 00:53:59.735148 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.734846 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/21d98251-4171-4c26-ab52-9ba123ba3be9-config\") pod \"console-operator-584dcb6b54-gr7gw\" (UID: \"21d98251-4171-4c26-ab52-9ba123ba3be9\") " pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" Jul 28 00:53:59.735148 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.734876 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-82l8p\" (UniqueName: \"kubernetes.io/projected/49fe97ad-3adc-4b96-a594-b0b505a0cffe-kube-api-access-82l8p\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:53:59.735148 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.734915 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-2g4mg\" (UID: \"a2f4fe8c-ef6c-459b-9e82-dbd224d85599\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg" Jul 28 00:53:59.735148 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.734946 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hj7w8\" (UniqueName: \"kubernetes.io/projected/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-kube-api-access-hj7w8\") pod \"cluster-monitoring-operator-548b489cb8-2g4mg\" (UID: \"a2f4fe8c-ef6c-459b-9e82-dbd224d85599\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg" Jul 28 00:53:59.735148 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.734998 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b00b06e1-31f5-480d-81db-15a526c06b14-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-l7dwd\" (UID: \"b00b06e1-31f5-480d-81db-15a526c06b14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-l7dwd" Jul 28 00:53:59.735148 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:59.734476 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 00:53:59.735148 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.735028 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49e28997-66bd-4404-a70a-63c65cd6a4a3-trusted-ca\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.735490 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.735413 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-certificates\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.735490 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.735464 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-config-volume\") pod \"dns-default-vjmlz\" (UID: \"bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14\") " pod="openshift-dns/dns-default-vjmlz" Jul 28 00:53:59.735649 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.735501 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rf8dk\" (UniqueName: \"kubernetes.io/projected/80623db8-0901-4f5f-830d-f07ace2f6d05-kube-api-access-rf8dk\") pod \"insights-operator-5885fdb759-8h8gt\" (UID: \"80623db8-0901-4f5f-830d-f07ace2f6d05\") " pod="openshift-insights/insights-operator-5885fdb759-8h8gt" Jul 28 00:53:59.735649 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.735537 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk\" (UID: \"3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk" Jul 28 00:53:59.735649 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.735593 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80623db8-0901-4f5f-830d-f07ace2f6d05-tmp\") pod \"insights-operator-5885fdb759-8h8gt\" (UID: \"80623db8-0901-4f5f-830d-f07ace2f6d05\") " pod="openshift-insights/insights-operator-5885fdb759-8h8gt" Jul 28 00:53:59.735649 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.735625 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-metrics-certs\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:53:59.735869 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.735665 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/configmap/362e3f3f-7182-40f4-b5c1-1a1b54190669-config\") pod \"service-ca-operator-5d6c75f84f-jtg8n\" (UID: \"362e3f3f-7182-40f4-b5c1-1a1b54190669\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jtg8n" Jul 28 00:53:59.735869 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.735696 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-tmp-dir\") pod \"dns-default-vjmlz\" (UID: \"bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14\") " pod="openshift-dns/dns-default-vjmlz" Jul 28 00:53:59.735869 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.735724 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-stats-auth\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:53:59.735869 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.735757 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80623db8-0901-4f5f-830d-f07ace2f6d05-service-ca-bundle\") pod \"insights-operator-5885fdb759-8h8gt\" (UID: \"80623db8-0901-4f5f-830d-f07ace2f6d05\") " pod="openshift-insights/insights-operator-5885fdb759-8h8gt" Jul 28 00:53:59.735869 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.735787 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80623db8-0901-4f5f-830d-f07ace2f6d05-serving-cert\") pod \"insights-operator-5885fdb759-8h8gt\" (UID: \"80623db8-0901-4f5f-830d-f07ace2f6d05\") " pod="openshift-insights/insights-operator-5885fdb759-8h8gt" Jul 28 00:53:59.735869 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.735838 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-metrics-tls\") pod \"dns-default-vjmlz\" (UID: \"bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14\") " pod="openshift-dns/dns-default-vjmlz" Jul 28 00:53:59.735869 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.735867 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49fe97ad-3adc-4b96-a594-b0b505a0cffe-service-ca-bundle\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:53:59.736188 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:59.736017 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49fe97ad-3adc-4b96-a594-b0b505a0cffe-service-ca-bundle podName:49fe97ad-3adc-4b96-a594-b0b505a0cffe nodeName:}" failed. No retries permitted until 2026-07-28 00:54:00.235990949 +0000 UTC m=+37.155591627 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/49fe97ad-3adc-4b96-a594-b0b505a0cffe-service-ca-bundle") pod "router-default-5b886669c7-2wtgq" (UID: "49fe97ad-3adc-4b96-a594-b0b505a0cffe") : configmap references non-existent config key: service-ca.crt Jul 28 00:53:59.736188 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.736088 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-certificates\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.736458 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.736433 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-config-volume\") pod \"dns-default-vjmlz\" (UID: \"bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14\") " pod="openshift-dns/dns-default-vjmlz" Jul 28 00:53:59.736771 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.736749 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49e28997-66bd-4404-a70a-63c65cd6a4a3-ca-trust-extracted\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.736910 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.736529 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c-config\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk\" (UID: \"3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk" Jul 28 00:53:59.737024 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.736462 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49e28997-66bd-4404-a70a-63c65cd6a4a3-trusted-ca\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.740141 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.736844 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/80623db8-0901-4f5f-830d-f07ace2f6d05-tmp\") pod \"insights-operator-5885fdb759-8h8gt\" (UID: \"80623db8-0901-4f5f-830d-f07ace2f6d05\") " pod="openshift-insights/insights-operator-5885fdb759-8h8gt" Jul 28 00:53:59.740141 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:59.737314 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-cluster-monitoring-operator-tls podName:a2f4fe8c-ef6c-459b-9e82-dbd224d85599 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:00.237133123 +0000 UTC m=+37.156733790 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-2g4mg" (UID: "a2f4fe8c-ef6c-459b-9e82-dbd224d85599") : secret "cluster-monitoring-operator-tls" not found Jul 28 00:53:59.740141 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.737394 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/362e3f3f-7182-40f4-b5c1-1a1b54190669-config\") pod \"service-ca-operator-5d6c75f84f-jtg8n\" (UID: \"362e3f3f-7182-40f4-b5c1-1a1b54190669\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jtg8n" Jul 28 00:53:59.740141 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.737762 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-tmp-dir\") pod \"dns-default-vjmlz\" (UID: \"bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14\") " pod="openshift-dns/dns-default-vjmlz" Jul 28 00:53:59.740141 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.738162 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/configmap/21d98251-4171-4c26-ab52-9ba123ba3be9-config\") pod \"console-operator-584dcb6b54-gr7gw\" (UID: \"21d98251-4171-4c26-ab52-9ba123ba3be9\") " pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" Jul 28 00:53:59.740141 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:59.737431 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 00:53:59.740141 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:59.738585 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b00b06e1-31f5-480d-81db-15a526c06b14-samples-operator-tls podName:b00b06e1-31f5-480d-81db-15a526c06b14 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:00.238548347 +0000 UTC m=+37.158149026 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b00b06e1-31f5-480d-81db-15a526c06b14-samples-operator-tls") pod "cluster-samples-operator-6748489656-l7dwd" (UID: "b00b06e1-31f5-480d-81db-15a526c06b14") : secret "samples-operator-tls" not found Jul 28 00:53:59.740141 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.738810 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/21d98251-4171-4c26-ab52-9ba123ba3be9-trusted-ca\") pod \"console-operator-584dcb6b54-gr7gw\" (UID: \"21d98251-4171-4c26-ab52-9ba123ba3be9\") " pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" Jul 28 00:53:59.740141 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.738871 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t4glw\" (UniqueName: \"kubernetes.io/projected/d247409f-9d05-4a9d-b74f-484931e06d25-kube-api-access-t4glw\") pod \"volume-data-source-validator-549c6d54cf-7ndng\" (UID: \"d247409f-9d05-4a9d-b74f-484931e06d25\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7ndng" Jul 28 00:53:59.740141 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.738900 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ddjfs\" (UniqueName: \"kubernetes.io/projected/f63765b0-930b-4807-85d3-8447fd21dd69-kube-api-access-ddjfs\") pod \"ingress-canary-5jr64\" (UID: \"f63765b0-930b-4807-85d3-8447fd21dd69\") " pod="openshift-ingress-canary/ingress-canary-5jr64" Jul 28 00:53:59.740141 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.738914 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemetry-config\" (UniqueName: \"kubernetes.io/configmap/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-telemetry-config\") pod \"cluster-monitoring-operator-548b489cb8-2g4mg\" (UID: \"a2f4fe8c-ef6c-459b-9e82-dbd224d85599\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg" Jul 28 00:53:59.740141 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.738929 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/80623db8-0901-4f5f-830d-f07ace2f6d05-snapshots\") pod \"insights-operator-5885fdb759-8h8gt\" (UID: \"80623db8-0901-4f5f-830d-f07ace2f6d05\") " pod="openshift-insights/insights-operator-5885fdb759-8h8gt" Jul 28 00:53:59.740141 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.738960 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pwsgv\" (UniqueName: \"kubernetes.io/projected/3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c-kube-api-access-pwsgv\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk\" (UID: \"3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk" Jul 28 00:53:59.740141 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:59.738985 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 00:53:59.740141 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.738992 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lk4bx\" (UniqueName: \"kubernetes.io/projected/b00b06e1-31f5-480d-81db-15a526c06b14-kube-api-access-lk4bx\") pod \"cluster-samples-operator-6748489656-l7dwd\" (UID: \"b00b06e1-31f5-480d-81db-15a526c06b14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-l7dwd" Jul 28 00:53:59.741097 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.739030 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49e28997-66bd-4404-a70a-63c65cd6a4a3-image-registry-private-configuration\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.741097 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:59.739048 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-metrics-certs podName:49fe97ad-3adc-4b96-a594-b0b505a0cffe nodeName:}" failed. No retries permitted until 2026-07-28 00:54:00.239031096 +0000 UTC m=+37.158631773 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-metrics-certs") pod "router-default-5b886669c7-2wtgq" (UID: "49fe97ad-3adc-4b96-a594-b0b505a0cffe") : secret "router-metrics-certs-default" not found Jul 28 00:53:59.741097 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:59.739423 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:53:59.741097 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:53:59.739472 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-metrics-tls podName:bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:00.239458714 +0000 UTC m=+37.159059391 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-metrics-tls") pod "dns-default-vjmlz" (UID: "bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14") : secret "dns-default-metrics-tls" not found Jul 28 00:53:59.741097 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.739733 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"snapshots\" (UniqueName: \"kubernetes.io/empty-dir/80623db8-0901-4f5f-830d-f07ace2f6d05-snapshots\") pod \"insights-operator-5885fdb759-8h8gt\" (UID: \"80623db8-0901-4f5f-830d-f07ace2f6d05\") " pod="openshift-insights/insights-operator-5885fdb759-8h8gt" Jul 28 00:53:59.741097 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.739744 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80623db8-0901-4f5f-830d-f07ace2f6d05-service-ca-bundle\") pod \"insights-operator-5885fdb759-8h8gt\" (UID: \"80623db8-0901-4f5f-830d-f07ace2f6d05\") " pod="openshift-insights/insights-operator-5885fdb759-8h8gt" Jul 28 00:53:59.741097 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.740291 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80623db8-0901-4f5f-830d-f07ace2f6d05-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-8h8gt\" (UID: \"80623db8-0901-4f5f-830d-f07ace2f6d05\") " pod="openshift-insights/insights-operator-5885fdb759-8h8gt" Jul 28 00:53:59.741448 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.741147 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/80623db8-0901-4f5f-830d-f07ace2f6d05-trusted-ca-bundle\") pod \"insights-operator-5885fdb759-8h8gt\" (UID: \"80623db8-0901-4f5f-830d-f07ace2f6d05\") " pod="openshift-insights/insights-operator-5885fdb759-8h8gt" Jul 28 00:53:59.742943 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.741716 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/362e3f3f-7182-40f4-b5c1-1a1b54190669-serving-cert\") pod \"service-ca-operator-5d6c75f84f-jtg8n\" (UID: \"362e3f3f-7182-40f4-b5c1-1a1b54190669\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jtg8n" Jul 28 00:53:59.742943 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.741825 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c-serving-cert\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk\" (UID: \"3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk" Jul 28 00:53:59.742943 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.742350 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"stats-auth\" (UniqueName: \"kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-stats-auth\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:53:59.742943 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.742678 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49e28997-66bd-4404-a70a-63c65cd6a4a3-image-registry-private-configuration\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.743220 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.743070 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/21d98251-4171-4c26-ab52-9ba123ba3be9-serving-cert\") pod \"console-operator-584dcb6b54-gr7gw\" (UID: \"21d98251-4171-4c26-ab52-9ba123ba3be9\") " pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" Jul 28 00:53:59.744165 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.744137 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"default-certificate\" (UniqueName: \"kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-default-certificate\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:53:59.748595 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.748051 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cjzsn\" (UniqueName: \"kubernetes.io/projected/362e3f3f-7182-40f4-b5c1-1a1b54190669-kube-api-access-cjzsn\") pod \"service-ca-operator-5d6c75f84f-jtg8n\" (UID: \"362e3f3f-7182-40f4-b5c1-1a1b54190669\") " pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jtg8n" Jul 28 00:53:59.748595 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.748115 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hj7w8\" (UniqueName: \"kubernetes.io/projected/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-kube-api-access-hj7w8\") pod \"cluster-monitoring-operator-548b489cb8-2g4mg\" (UID: \"a2f4fe8c-ef6c-459b-9e82-dbd224d85599\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg" Jul 28 00:53:59.748595 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.748115 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-klsh5\" (UniqueName: \"kubernetes.io/projected/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-kube-api-access-klsh5\") pod \"dns-default-vjmlz\" (UID: \"bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14\") " pod="openshift-dns/dns-default-vjmlz" Jul 28 00:53:59.748595 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.748460 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pwsgv\" (UniqueName: \"kubernetes.io/projected/3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c-kube-api-access-pwsgv\") pod \"kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk\" (UID: \"3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c\") " pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk" Jul 28 00:53:59.748595 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.748537 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t4glw\" (UniqueName: \"kubernetes.io/projected/d247409f-9d05-4a9d-b74f-484931e06d25-kube-api-access-t4glw\") pod \"volume-data-source-validator-549c6d54cf-7ndng\" (UID: \"d247409f-9d05-4a9d-b74f-484931e06d25\") " pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7ndng" Jul 28 00:53:59.748913 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.748814 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-cert\" (UniqueName: \"kubernetes.io/secret/80623db8-0901-4f5f-830d-f07ace2f6d05-serving-cert\") pod \"insights-operator-5885fdb759-8h8gt\" (UID: \"80623db8-0901-4f5f-830d-f07ace2f6d05\") " pod="openshift-insights/insights-operator-5885fdb759-8h8gt" Jul 28 00:53:59.749240 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.749030 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-bound-sa-token\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.749674 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.749441 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rf8dk\" (UniqueName: \"kubernetes.io/projected/80623db8-0901-4f5f-830d-f07ace2f6d05-kube-api-access-rf8dk\") pod \"insights-operator-5885fdb759-8h8gt\" (UID: \"80623db8-0901-4f5f-830d-f07ace2f6d05\") " pod="openshift-insights/insights-operator-5885fdb759-8h8gt" Jul 28 00:53:59.749674 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.749623 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49e28997-66bd-4404-a70a-63c65cd6a4a3-installation-pull-secrets\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.749674 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.749663 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/f63765b0-930b-4807-85d3-8447fd21dd69-cert\") pod \"ingress-canary-5jr64\" (UID: \"f63765b0-930b-4807-85d3-8447fd21dd69\") " pod="openshift-ingress-canary/ingress-canary-5jr64" Jul 28 00:53:59.751296 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.751268 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-82l8p\" (UniqueName: \"kubernetes.io/projected/49fe97ad-3adc-4b96-a594-b0b505a0cffe-kube-api-access-82l8p\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:53:59.751559 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.751493 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-frppn\" (UniqueName: \"kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-kube-api-access-frppn\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:53:59.751559 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.751516 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28s29\" (UniqueName: \"kubernetes.io/projected/21d98251-4171-4c26-ab52-9ba123ba3be9-kube-api-access-28s29\") pod \"console-operator-584dcb6b54-gr7gw\" (UID: \"21d98251-4171-4c26-ab52-9ba123ba3be9\") " pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" Jul 28 00:53:59.752205 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.752088 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lk4bx\" (UniqueName: \"kubernetes.io/projected/b00b06e1-31f5-480d-81db-15a526c06b14-kube-api-access-lk4bx\") pod \"cluster-samples-operator-6748489656-l7dwd\" (UID: \"b00b06e1-31f5-480d-81db-15a526c06b14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-l7dwd" Jul 28 00:53:59.752725 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.752691 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ddjfs\" (UniqueName: \"kubernetes.io/projected/f63765b0-930b-4807-85d3-8447fd21dd69-kube-api-access-ddjfs\") pod \"ingress-canary-5jr64\" (UID: \"f63765b0-930b-4807-85d3-8447fd21dd69\") " pod="openshift-ingress-canary/ingress-canary-5jr64" Jul 28 00:53:59.753121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.753104 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n9r7l\" (UniqueName: \"kubernetes.io/projected/5d7d2131-ad67-4a02-bccf-0530ea749233-kube-api-access-n9r7l\") pod \"network-check-source-7d88cb55d8-xrzzl\" (UID: \"5d7d2131-ad67-4a02-bccf-0530ea749233\") " pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-xrzzl" Jul 28 00:53:59.803915 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.803883 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7ndng" Jul 28 00:53:59.806231 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.806202 2568 generic.go:356] "Generic (PLEG): container finished" podID="632dce7c-ff33-4238-84bb-c82356acc1d6" containerID="ea683b7bfde3f692b71e0881d5a87178550afc8a1943da5ae787e33cb38471ac" exitCode=0 Jul 28 00:53:59.806379 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.806260 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpt6j" event={"ID":"632dce7c-ff33-4238-84bb-c82356acc1d6","Type":"ContainerDied","Data":"ea683b7bfde3f692b71e0881d5a87178550afc8a1943da5ae787e33cb38471ac"} Jul 28 00:53:59.834023 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.833984 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-operator-5885fdb759-8h8gt" Jul 28 00:53:59.846998 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.846968 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" Jul 28 00:53:59.853605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.853529 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk" Jul 28 00:53:59.859458 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.859432 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jtg8n" Jul 28 00:53:59.869839 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.869559 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-xrzzl" Jul 28 00:53:59.873212 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:53:59.873171 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-5jr64" Jul 28 00:54:00.052671 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.052603 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7ndng"] Jul 28 00:54:00.103277 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.103230 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console-operator/console-operator-584dcb6b54-gr7gw"] Jul 28 00:54:00.109427 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.109345 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-operator-5885fdb759-8h8gt"] Jul 28 00:54:00.110436 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.110411 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk"] Jul 28 00:54:00.139294 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.139257 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-5jr64"] Jul 28 00:54:00.143241 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.143207 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jtg8n"] Jul 28 00:54:00.148230 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.148199 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-source-7d88cb55d8-xrzzl"] Jul 28 00:54:00.151431 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:54:00.151396 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3691a2f5_c43f_47ec_a5a0_3b1075e4fa7c.slice/crio-e545228d199abd1a575dbd75c982b79ad6c8f1581035526f40b1e8cea31faffb WatchSource:0}: Error finding container e545228d199abd1a575dbd75c982b79ad6c8f1581035526f40b1e8cea31faffb: Status 404 returned error can't find the container with id e545228d199abd1a575dbd75c982b79ad6c8f1581035526f40b1e8cea31faffb Jul 28 00:54:00.152362 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:54:00.152275 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod21d98251_4171_4c26_ab52_9ba123ba3be9.slice/crio-29ee9451332cfdd9df3e576a2c028e8762ad1bcdd5e07c3263d3dd82a2af387e WatchSource:0}: Error finding container 29ee9451332cfdd9df3e576a2c028e8762ad1bcdd5e07c3263d3dd82a2af387e: Status 404 returned error can't find the container with id 29ee9451332cfdd9df3e576a2c028e8762ad1bcdd5e07c3263d3dd82a2af387e Jul 28 00:54:00.243857 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.243817 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:54:00.243857 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.243861 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-2g4mg\" (UID: \"a2f4fe8c-ef6c-459b-9e82-dbd224d85599\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg" Jul 28 00:54:00.244126 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.243918 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b00b06e1-31f5-480d-81db-15a526c06b14-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-l7dwd\" (UID: \"b00b06e1-31f5-480d-81db-15a526c06b14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-l7dwd" Jul 28 00:54:00.244126 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.243944 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-metrics-certs\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:54:00.244126 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.243975 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-metrics-tls\") pod \"dns-default-vjmlz\" (UID: \"bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14\") " pod="openshift-dns/dns-default-vjmlz" Jul 28 00:54:00.244126 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.243991 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49fe97ad-3adc-4b96-a594-b0b505a0cffe-service-ca-bundle\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:54:00.244126 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:00.243996 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:54:00.244126 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:00.244024 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-779fc55d8b-xxb9x: secret "image-registry-tls" not found Jul 28 00:54:00.244126 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:00.244063 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 00:54:00.244126 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:00.244078 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 00:54:00.244126 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:00.244100 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls podName:49e28997-66bd-4404-a70a-63c65cd6a4a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:01.24407264 +0000 UTC m=+38.163673318 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls") pod "image-registry-779fc55d8b-xxb9x" (UID: "49e28997-66bd-4404-a70a-63c65cd6a4a3") : secret "image-registry-tls" not found Jul 28 00:54:00.244126 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:00.244106 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:54:00.244126 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:00.244077 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 00:54:00.244126 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:00.244125 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-cluster-monitoring-operator-tls podName:a2f4fe8c-ef6c-459b-9e82-dbd224d85599 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:01.244107144 +0000 UTC m=+38.163707829 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-2g4mg" (UID: "a2f4fe8c-ef6c-459b-9e82-dbd224d85599") : secret "cluster-monitoring-operator-tls" not found Jul 28 00:54:00.244502 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:00.244147 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-metrics-tls podName:bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:01.244134479 +0000 UTC m=+38.163735142 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-metrics-tls") pod "dns-default-vjmlz" (UID: "bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14") : secret "dns-default-metrics-tls" not found Jul 28 00:54:00.244502 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:00.244168 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-metrics-certs podName:49fe97ad-3adc-4b96-a594-b0b505a0cffe nodeName:}" failed. No retries permitted until 2026-07-28 00:54:01.244154746 +0000 UTC m=+38.163755412 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-metrics-certs") pod "router-default-5b886669c7-2wtgq" (UID: "49fe97ad-3adc-4b96-a594-b0b505a0cffe") : secret "router-metrics-certs-default" not found Jul 28 00:54:00.244502 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:00.244186 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b00b06e1-31f5-480d-81db-15a526c06b14-samples-operator-tls podName:b00b06e1-31f5-480d-81db-15a526c06b14 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:01.244177915 +0000 UTC m=+38.163778620 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b00b06e1-31f5-480d-81db-15a526c06b14-samples-operator-tls") pod "cluster-samples-operator-6748489656-l7dwd" (UID: "b00b06e1-31f5-480d-81db-15a526c06b14") : secret "samples-operator-tls" not found Jul 28 00:54:00.244502 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:00.244199 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49fe97ad-3adc-4b96-a594-b0b505a0cffe-service-ca-bundle podName:49fe97ad-3adc-4b96-a594-b0b505a0cffe nodeName:}" failed. No retries permitted until 2026-07-28 00:54:01.244191384 +0000 UTC m=+38.163792061 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/49fe97ad-3adc-4b96-a594-b0b505a0cffe-service-ca-bundle") pod "router-default-5b886669c7-2wtgq" (UID: "49fe97ad-3adc-4b96-a594-b0b505a0cffe") : configmap references non-existent config key: service-ca.crt Jul 28 00:54:00.528253 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.528199 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:54:00.528253 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.528237 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:54:00.528977 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.528199 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:54:00.530894 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.530866 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 00:54:00.531120 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.531097 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cknlx\"" Jul 28 00:54:00.531120 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.531125 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 00:54:00.531245 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.531200 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wktlp\"" Jul 28 00:54:00.813735 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.813590 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-xrzzl" event={"ID":"5d7d2131-ad67-4a02-bccf-0530ea749233","Type":"ContainerStarted","Data":"243b2e7ec0eb308d0779ca399eb16339d1e9c7f0b80653ab9b27afa8d1154c9c"} Jul 28 00:54:00.816375 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.816290 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk" event={"ID":"3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c","Type":"ContainerStarted","Data":"e545228d199abd1a575dbd75c982b79ad6c8f1581035526f40b1e8cea31faffb"} Jul 28 00:54:00.818719 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.818648 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" event={"ID":"21d98251-4171-4c26-ab52-9ba123ba3be9","Type":"ContainerStarted","Data":"29ee9451332cfdd9df3e576a2c028e8762ad1bcdd5e07c3263d3dd82a2af387e"} Jul 28 00:54:00.822183 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.822100 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5jr64" event={"ID":"f63765b0-930b-4807-85d3-8447fd21dd69","Type":"ContainerStarted","Data":"e9234b8116b61a14364c9a2fdaa2c4f5d6904c14ae23a8e829ec3fdd5c27cf25"} Jul 28 00:54:00.824157 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.824082 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jtg8n" event={"ID":"362e3f3f-7182-40f4-b5c1-1a1b54190669","Type":"ContainerStarted","Data":"e8554706959619cc29ec44a55cf52ec8ccc24785e20fdabee334abe998e73651"} Jul 28 00:54:00.826857 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.826778 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7ndng" event={"ID":"d247409f-9d05-4a9d-b74f-484931e06d25","Type":"ContainerStarted","Data":"ae30bcebad1fc0691eea741b4f69d88e125eeedf0e0ced5669f3f5c9b4cbcb5f"} Jul 28 00:54:00.837157 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.836171 2568 generic.go:356] "Generic (PLEG): container finished" podID="632dce7c-ff33-4238-84bb-c82356acc1d6" containerID="0799d4e21d9b5c8319107dbe0a7e9b516b05f1b4e69756f246f06f651ff7328f" exitCode=0 Jul 28 00:54:00.837157 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.836265 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpt6j" event={"ID":"632dce7c-ff33-4238-84bb-c82356acc1d6","Type":"ContainerDied","Data":"0799d4e21d9b5c8319107dbe0a7e9b516b05f1b4e69756f246f06f651ff7328f"} Jul 28 00:54:00.841790 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:00.841356 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-8h8gt" event={"ID":"80623db8-0901-4f5f-830d-f07ace2f6d05","Type":"ContainerStarted","Data":"3cc7495d0ac17033f5d157d1e018def9a87d36ccc73e17b93535fd7e8ab4f103"} Jul 28 00:54:01.178503 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:01.178458 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rpd2_2408ba36-e5e9-465c-8434-b17d73f6febb/konnectivity-agent/0.log" limit=1024 Jul 28 00:54:01.254238 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:01.254197 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b00b06e1-31f5-480d-81db-15a526c06b14-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-l7dwd\" (UID: \"b00b06e1-31f5-480d-81db-15a526c06b14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-l7dwd" Jul 28 00:54:01.254442 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:01.254262 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-metrics-certs\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:54:01.254442 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:01.254325 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-metrics-tls\") pod \"dns-default-vjmlz\" (UID: \"bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14\") " pod="openshift-dns/dns-default-vjmlz" Jul 28 00:54:01.254442 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:01.254352 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49fe97ad-3adc-4b96-a594-b0b505a0cffe-service-ca-bundle\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:54:01.254442 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:01.254392 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:54:01.254442 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:01.254419 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-2g4mg\" (UID: \"a2f4fe8c-ef6c-459b-9e82-dbd224d85599\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg" Jul 28 00:54:01.254742 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:01.254593 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 00:54:01.254742 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:01.254660 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-cluster-monitoring-operator-tls podName:a2f4fe8c-ef6c-459b-9e82-dbd224d85599 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:03.254641474 +0000 UTC m=+40.174242140 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-2g4mg" (UID: "a2f4fe8c-ef6c-459b-9e82-dbd224d85599") : secret "cluster-monitoring-operator-tls" not found Jul 28 00:54:01.254742 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:01.254666 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 00:54:01.254742 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:01.254730 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b00b06e1-31f5-480d-81db-15a526c06b14-samples-operator-tls podName:b00b06e1-31f5-480d-81db-15a526c06b14 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:03.254712086 +0000 UTC m=+40.174312751 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b00b06e1-31f5-480d-81db-15a526c06b14-samples-operator-tls") pod "cluster-samples-operator-6748489656-l7dwd" (UID: "b00b06e1-31f5-480d-81db-15a526c06b14") : secret "samples-operator-tls" not found Jul 28 00:54:01.254947 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:01.254798 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 00:54:01.254947 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:01.254832 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-metrics-certs podName:49fe97ad-3adc-4b96-a594-b0b505a0cffe nodeName:}" failed. No retries permitted until 2026-07-28 00:54:03.254820507 +0000 UTC m=+40.174421172 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-metrics-certs") pod "router-default-5b886669c7-2wtgq" (UID: "49fe97ad-3adc-4b96-a594-b0b505a0cffe") : secret "router-metrics-certs-default" not found Jul 28 00:54:01.254947 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:01.254901 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:54:01.254947 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:01.254913 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-779fc55d8b-xxb9x: secret "image-registry-tls" not found Jul 28 00:54:01.254947 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:01.254944 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls podName:49e28997-66bd-4404-a70a-63c65cd6a4a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:03.254933189 +0000 UTC m=+40.174533854 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls") pod "image-registry-779fc55d8b-xxb9x" (UID: "49e28997-66bd-4404-a70a-63c65cd6a4a3") : secret "image-registry-tls" not found Jul 28 00:54:01.255162 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:01.254595 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:54:01.255162 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:01.255009 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49fe97ad-3adc-4b96-a594-b0b505a0cffe-service-ca-bundle podName:49fe97ad-3adc-4b96-a594-b0b505a0cffe nodeName:}" failed. No retries permitted until 2026-07-28 00:54:03.25499962 +0000 UTC m=+40.174600284 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/49fe97ad-3adc-4b96-a594-b0b505a0cffe-service-ca-bundle") pod "router-default-5b886669c7-2wtgq" (UID: "49fe97ad-3adc-4b96-a594-b0b505a0cffe") : configmap references non-existent config key: service-ca.crt Jul 28 00:54:01.255162 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:01.255028 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-metrics-tls podName:bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:03.255019117 +0000 UTC m=+40.174619782 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-metrics-tls") pod "dns-default-vjmlz" (UID: "bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14") : secret "dns-default-metrics-tls" not found Jul 28 00:54:01.277978 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:01.277883 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rpd2_2408ba36-e5e9-465c-8434-b17d73f6febb/konnectivity-agent/0.log" limit=1024 Jul 28 00:54:01.855526 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:01.854475 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-tpt6j" event={"ID":"632dce7c-ff33-4238-84bb-c82356acc1d6","Type":"ContainerStarted","Data":"8cdbecddafb4c6fa75aeaa0ec632bf7217d567b10731840021b29679fcfdce87"} Jul 28 00:54:01.876784 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:01.876716 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-tpt6j" podStartSLOduration=9.593180922 podStartE2EDuration="38.876695554s" totalImagesPullingTime="29.283514632s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:53:23 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:54:01.876024736 +0000 UTC m=+38.795625422" watchObservedRunningTime="2026-07-28 00:54:01.876695554 +0000 UTC m=+38.796296238" Jul 28 00:54:01.998831 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:01.998770 2568 log.go:25] "Finished parsing log file, hit bytes limit" path="/var/log/pods/kube-system_konnectivity-agent-5rpd2_2408ba36-e5e9-465c-8434-b17d73f6febb/konnectivity-agent/0.log" limit=1024 Jul 28 00:54:03.276620 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:03.276561 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:54:03.276620 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:03.276624 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-2g4mg\" (UID: \"a2f4fe8c-ef6c-459b-9e82-dbd224d85599\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg" Jul 28 00:54:03.277168 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:03.276685 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b00b06e1-31f5-480d-81db-15a526c06b14-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-l7dwd\" (UID: \"b00b06e1-31f5-480d-81db-15a526c06b14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-l7dwd" Jul 28 00:54:03.277168 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:03.276711 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-metrics-certs\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:54:03.277168 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:03.276743 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-metrics-tls\") pod \"dns-default-vjmlz\" (UID: \"bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14\") " pod="openshift-dns/dns-default-vjmlz" Jul 28 00:54:03.277168 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:03.276763 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49fe97ad-3adc-4b96-a594-b0b505a0cffe-service-ca-bundle\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:54:03.277168 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:03.276774 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:54:03.277168 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:03.276803 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-779fc55d8b-xxb9x: secret "image-registry-tls" not found Jul 28 00:54:03.277168 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:03.276826 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 00:54:03.277168 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:03.276859 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 00:54:03.277168 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:03.276871 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:54:03.277168 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:03.276826 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 00:54:03.277168 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:03.276876 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls podName:49e28997-66bd-4404-a70a-63c65cd6a4a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:07.276854487 +0000 UTC m=+44.196455150 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls") pod "image-registry-779fc55d8b-xxb9x" (UID: "49e28997-66bd-4404-a70a-63c65cd6a4a3") : secret "image-registry-tls" not found Jul 28 00:54:03.277168 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:03.276953 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49fe97ad-3adc-4b96-a594-b0b505a0cffe-service-ca-bundle podName:49fe97ad-3adc-4b96-a594-b0b505a0cffe nodeName:}" failed. No retries permitted until 2026-07-28 00:54:07.2769363 +0000 UTC m=+44.196536964 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/49fe97ad-3adc-4b96-a594-b0b505a0cffe-service-ca-bundle") pod "router-default-5b886669c7-2wtgq" (UID: "49fe97ad-3adc-4b96-a594-b0b505a0cffe") : configmap references non-existent config key: service-ca.crt Jul 28 00:54:03.277168 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:03.276977 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-cluster-monitoring-operator-tls podName:a2f4fe8c-ef6c-459b-9e82-dbd224d85599 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:07.276967796 +0000 UTC m=+44.196568473 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-2g4mg" (UID: "a2f4fe8c-ef6c-459b-9e82-dbd224d85599") : secret "cluster-monitoring-operator-tls" not found Jul 28 00:54:03.277168 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:03.277007 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-metrics-certs podName:49fe97ad-3adc-4b96-a594-b0b505a0cffe nodeName:}" failed. No retries permitted until 2026-07-28 00:54:07.276998829 +0000 UTC m=+44.196599502 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-metrics-certs") pod "router-default-5b886669c7-2wtgq" (UID: "49fe97ad-3adc-4b96-a594-b0b505a0cffe") : secret "router-metrics-certs-default" not found Jul 28 00:54:03.277168 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:03.277019 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-metrics-tls podName:bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:07.277013351 +0000 UTC m=+44.196614015 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-metrics-tls") pod "dns-default-vjmlz" (UID: "bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14") : secret "dns-default-metrics-tls" not found Jul 28 00:54:03.277671 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:03.277028 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b00b06e1-31f5-480d-81db-15a526c06b14-samples-operator-tls podName:b00b06e1-31f5-480d-81db-15a526c06b14 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:07.277022912 +0000 UTC m=+44.196623578 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b00b06e1-31f5-480d-81db-15a526c06b14-samples-operator-tls") pod "cluster-samples-operator-6748489656-l7dwd" (UID: "b00b06e1-31f5-480d-81db-15a526c06b14") : secret "samples-operator-tls" not found Jul 28 00:54:07.316296 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:07.316233 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-metrics-certs\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:54:07.316831 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:07.316316 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-metrics-tls\") pod \"dns-default-vjmlz\" (UID: \"bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14\") " pod="openshift-dns/dns-default-vjmlz" Jul 28 00:54:07.316831 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:07.316345 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49fe97ad-3adc-4b96-a594-b0b505a0cffe-service-ca-bundle\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:54:07.316831 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:07.316385 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:54:07.316831 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:07.316410 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-2g4mg\" (UID: \"a2f4fe8c-ef6c-459b-9e82-dbd224d85599\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg" Jul 28 00:54:07.316831 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:07.316420 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 00:54:07.316831 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:07.316482 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:54:07.316831 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:07.316492 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-metrics-certs podName:49fe97ad-3adc-4b96-a594-b0b505a0cffe nodeName:}" failed. No retries permitted until 2026-07-28 00:54:15.316471821 +0000 UTC m=+52.236072500 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-metrics-certs") pod "router-default-5b886669c7-2wtgq" (UID: "49fe97ad-3adc-4b96-a594-b0b505a0cffe") : secret "router-metrics-certs-default" not found Jul 28 00:54:07.316831 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:07.316531 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 00:54:07.316831 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:07.316528 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:54:07.316831 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:07.316595 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-cluster-monitoring-operator-tls podName:a2f4fe8c-ef6c-459b-9e82-dbd224d85599 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:15.316558657 +0000 UTC m=+52.236159322 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-2g4mg" (UID: "a2f4fe8c-ef6c-459b-9e82-dbd224d85599") : secret "cluster-monitoring-operator-tls" not found Jul 28 00:54:07.316831 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:07.316589 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b00b06e1-31f5-480d-81db-15a526c06b14-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-l7dwd\" (UID: \"b00b06e1-31f5-480d-81db-15a526c06b14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-l7dwd" Jul 28 00:54:07.316831 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:07.316604 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-779fc55d8b-xxb9x: secret "image-registry-tls" not found Jul 28 00:54:07.316831 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:07.316616 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49fe97ad-3adc-4b96-a594-b0b505a0cffe-service-ca-bundle podName:49fe97ad-3adc-4b96-a594-b0b505a0cffe nodeName:}" failed. No retries permitted until 2026-07-28 00:54:15.316603335 +0000 UTC m=+52.236203996 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/49fe97ad-3adc-4b96-a594-b0b505a0cffe-service-ca-bundle") pod "router-default-5b886669c7-2wtgq" (UID: "49fe97ad-3adc-4b96-a594-b0b505a0cffe") : configmap references non-existent config key: service-ca.crt Jul 28 00:54:07.316831 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:07.316631 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-metrics-tls podName:bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:15.316624367 +0000 UTC m=+52.236225069 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-metrics-tls") pod "dns-default-vjmlz" (UID: "bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14") : secret "dns-default-metrics-tls" not found Jul 28 00:54:07.316831 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:07.316658 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls podName:49e28997-66bd-4404-a70a-63c65cd6a4a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:15.316641396 +0000 UTC m=+52.236242070 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls") pod "image-registry-779fc55d8b-xxb9x" (UID: "49e28997-66bd-4404-a70a-63c65cd6a4a3") : secret "image-registry-tls" not found Jul 28 00:54:07.316831 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:07.316656 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 00:54:07.317424 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:07.316712 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b00b06e1-31f5-480d-81db-15a526c06b14-samples-operator-tls podName:b00b06e1-31f5-480d-81db-15a526c06b14 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:15.316696825 +0000 UTC m=+52.236297492 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b00b06e1-31f5-480d-81db-15a526c06b14-samples-operator-tls") pod "cluster-samples-operator-6748489656-l7dwd" (UID: "b00b06e1-31f5-480d-81db-15a526c06b14") : secret "samples-operator-tls" not found Jul 28 00:54:08.876443 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:08.876405 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-xrzzl" event={"ID":"5d7d2131-ad67-4a02-bccf-0530ea749233","Type":"ContainerStarted","Data":"b3fd6f0d9e696215f25a26b53c03f341d22eb01310bdb8c72269318571d80425"} Jul 28 00:54:08.878199 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:08.878140 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk" event={"ID":"3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c","Type":"ContainerStarted","Data":"79e253ac7249f53a5a6fd49acd7e4a2b3a000036912cd29ff027bcffa1720f4f"} Jul 28 00:54:08.880215 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:08.880192 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/0.log" Jul 28 00:54:08.880345 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:08.880238 2568 generic.go:356] "Generic (PLEG): container finished" podID="21d98251-4171-4c26-ab52-9ba123ba3be9" containerID="eae568ca4dcca3a5b6fc26f4f2492aef00fe8a9cf783cafd7443bbcf9cb550d6" exitCode=255 Jul 28 00:54:08.880345 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:08.880323 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" event={"ID":"21d98251-4171-4c26-ab52-9ba123ba3be9","Type":"ContainerDied","Data":"eae568ca4dcca3a5b6fc26f4f2492aef00fe8a9cf783cafd7443bbcf9cb550d6"} Jul 28 00:54:08.880517 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:08.880499 2568 scope.go:117] "RemoveContainer" containerID="eae568ca4dcca3a5b6fc26f4f2492aef00fe8a9cf783cafd7443bbcf9cb550d6" Jul 28 00:54:08.882332 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:08.882306 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-5jr64" event={"ID":"f63765b0-930b-4807-85d3-8447fd21dd69","Type":"ContainerStarted","Data":"107b6a1436fd85e01134b973390521835c39429109c555c7d75f6f5f9ec57392"} Jul 28 00:54:08.884282 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:08.884256 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jtg8n" event={"ID":"362e3f3f-7182-40f4-b5c1-1a1b54190669","Type":"ContainerStarted","Data":"6e1698b7101ee1be3d864ecb4ddbe991b7fc6de0e9c5ff955fdbd7eabc7d3cc5"} Jul 28 00:54:08.886284 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:08.886230 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7ndng" event={"ID":"d247409f-9d05-4a9d-b74f-484931e06d25","Type":"ContainerStarted","Data":"88c23d2d97384d74949711eb6cd6ae4e91b124b6aa0a057572ff8bd2027240de"} Jul 28 00:54:08.887890 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:08.887865 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-8h8gt" event={"ID":"80623db8-0901-4f5f-830d-f07ace2f6d05","Type":"ContainerStarted","Data":"2701c6cf9399df174d82e717070853570299802cb46af39421ccbac671ea4c36"} Jul 28 00:54:08.890510 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:08.890462 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-source-7d88cb55d8-xrzzl" podStartSLOduration=16.887692076 podStartE2EDuration="24.890445012s" totalImagesPullingTime="8.002752936s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:53:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:54:08.890138063 +0000 UTC m=+45.809738751" watchObservedRunningTime="2026-07-28 00:54:08.890445012 +0000 UTC m=+45.810045698" Jul 28 00:54:08.921126 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:08.920904 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk" podStartSLOduration=17.923713423 podStartE2EDuration="25.920883317s" totalImagesPullingTime="7.997169894s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:53:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:54:08.920238581 +0000 UTC m=+45.839839257" watchObservedRunningTime="2026-07-28 00:54:08.920883317 +0000 UTC m=+45.840484004" Jul 28 00:54:08.922019 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:08.921984 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-storage-operator/volume-data-source-validator-549c6d54cf-7ndng" podStartSLOduration=23.009132166 podStartE2EDuration="30.921969306s" totalImagesPullingTime="7.91283714s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:53:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:54:08.903873125 +0000 UTC m=+45.823473811" watchObservedRunningTime="2026-07-28 00:54:08.921969306 +0000 UTC m=+45.841569994" Jul 28 00:54:08.938592 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:08.937819 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-operator-5885fdb759-8h8gt" podStartSLOduration=22.945963581 podStartE2EDuration="30.937785201s" totalImagesPullingTime="7.99182162s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:53:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:54:08.936378552 +0000 UTC m=+45.855979236" watchObservedRunningTime="2026-07-28 00:54:08.937785201 +0000 UTC m=+45.857385886" Jul 28 00:54:08.957609 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:08.957519 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jtg8n" podStartSLOduration=15.964240758999999 podStartE2EDuration="23.957493379s" totalImagesPullingTime="7.99325262s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:53:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:54:08.95535847 +0000 UTC m=+45.874959156" watchObservedRunningTime="2026-07-28 00:54:08.957493379 +0000 UTC m=+45.877094062" Jul 28 00:54:08.989714 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:08.989663 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-5jr64" podStartSLOduration=1.9942702799999998 podStartE2EDuration="9.989641334s" totalImagesPullingTime="7.995371054s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:53:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:54:08.988930583 +0000 UTC m=+45.908531268" watchObservedRunningTime="2026-07-28 00:54:08.989641334 +0000 UTC m=+45.909242018" Jul 28 00:54:09.478512 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.478461 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-f7b2z"] Jul 28 00:54:09.495479 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.495446 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-f7b2z"] Jul 28 00:54:09.495866 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.495798 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-f7b2z" Jul 28 00:54:09.498487 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.498227 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"networking-console-plugin-cert\"" Jul 28 00:54:09.498487 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.498340 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4vzv2\"" Jul 28 00:54:09.498732 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.498536 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-console\"/\"networking-console-plugin\"" Jul 28 00:54:09.539631 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.539534 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2527550a-ea54-4f32-af64-9417bd3060c0-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-f7b2z\" (UID: \"2527550a-ea54-4f32-af64-9417bd3060c0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f7b2z" Jul 28 00:54:09.539834 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.539744 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2527550a-ea54-4f32-af64-9417bd3060c0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f7b2z\" (UID: \"2527550a-ea54-4f32-af64-9417bd3060c0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f7b2z" Jul 28 00:54:09.583375 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.583330 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-74vc4"] Jul 28 00:54:09.607634 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.607560 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-74vc4"] Jul 28 00:54:09.607800 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.607721 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:09.610031 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.610005 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r566t\"" Jul 28 00:54:09.610175 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.610045 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 28 00:54:09.610175 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.610153 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 28 00:54:09.640783 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.640744 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8af8637c-823f-42b5-b67e-0cdb8f030681-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:09.640783 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.640793 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8af8637c-823f-42b5-b67e-0cdb8f030681-crio-socket\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:09.641030 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.640861 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2527550a-ea54-4f32-af64-9417bd3060c0-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-f7b2z\" (UID: \"2527550a-ea54-4f32-af64-9417bd3060c0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f7b2z" Jul 28 00:54:09.641030 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.640906 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8jvtk\" (UniqueName: \"kubernetes.io/projected/8af8637c-823f-42b5-b67e-0cdb8f030681-kube-api-access-8jvtk\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:09.641030 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.640936 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8af8637c-823f-42b5-b67e-0cdb8f030681-data-volume\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:09.641240 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.641078 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8af8637c-823f-42b5-b67e-0cdb8f030681-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:09.641240 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.641106 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2527550a-ea54-4f32-af64-9417bd3060c0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f7b2z\" (UID: \"2527550a-ea54-4f32-af64-9417bd3060c0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f7b2z" Jul 28 00:54:09.641240 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:09.641210 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 00:54:09.641390 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:09.641291 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2527550a-ea54-4f32-af64-9417bd3060c0-networking-console-plugin-cert podName:2527550a-ea54-4f32-af64-9417bd3060c0 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:10.141271914 +0000 UTC m=+47.060872580 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2527550a-ea54-4f32-af64-9417bd3060c0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-f7b2z" (UID: "2527550a-ea54-4f32-af64-9417bd3060c0") : secret "networking-console-plugin-cert" not found Jul 28 00:54:09.641758 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.641732 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"nginx-conf\" (UniqueName: \"kubernetes.io/configmap/2527550a-ea54-4f32-af64-9417bd3060c0-nginx-conf\") pod \"networking-console-plugin-74c9f884b7-f7b2z\" (UID: \"2527550a-ea54-4f32-af64-9417bd3060c0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f7b2z" Jul 28 00:54:09.683546 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.683508 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-9xsxr"] Jul 28 00:54:09.705579 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.705525 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-9xsxr"] Jul 28 00:54:09.705739 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.705665 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9xsxr" Jul 28 00:54:09.708129 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.708104 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"openshift-service-ca.crt\"" Jul 28 00:54:09.708280 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.708177 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-storage-version-migrator-sa-dockercfg-dc9r5\"" Jul 28 00:54:09.708280 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.708112 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-kube-storage-version-migrator\"/\"kube-root-ca.crt\"" Jul 28 00:54:09.741938 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.741844 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8af8637c-823f-42b5-b67e-0cdb8f030681-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:09.742122 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.741945 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5vtpz\" (UniqueName: \"kubernetes.io/projected/3153340c-02a5-4da8-8811-48db8141c02e-kube-api-access-5vtpz\") pod \"migrator-6865c9967-9xsxr\" (UID: \"3153340c-02a5-4da8-8811-48db8141c02e\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9xsxr" Jul 28 00:54:09.742122 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:09.742064 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:54:09.742122 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.742087 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8af8637c-823f-42b5-b67e-0cdb8f030681-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:09.742283 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:09.742143 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8af8637c-823f-42b5-b67e-0cdb8f030681-insights-runtime-extractor-tls podName:8af8637c-823f-42b5-b67e-0cdb8f030681 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:10.242122221 +0000 UTC m=+47.161722901 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8af8637c-823f-42b5-b67e-0cdb8f030681-insights-runtime-extractor-tls") pod "insights-runtime-extractor-74vc4" (UID: "8af8637c-823f-42b5-b67e-0cdb8f030681") : secret "insights-runtime-extractor-tls" not found Jul 28 00:54:09.742283 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:09.742197 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 00:54:09.742283 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.742230 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8af8637c-823f-42b5-b67e-0cdb8f030681-crio-socket\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:09.742283 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:09.742258 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8af8637c-823f-42b5-b67e-0cdb8f030681-kube-rbac-proxy-cm podName:8af8637c-823f-42b5-b67e-0cdb8f030681 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:10.242239602 +0000 UTC m=+47.161840281 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8af8637c-823f-42b5-b67e-0cdb8f030681-kube-rbac-proxy-cm") pod "insights-runtime-extractor-74vc4" (UID: "8af8637c-823f-42b5-b67e-0cdb8f030681") : configmap "kube-rbac-proxy" not found Jul 28 00:54:09.742460 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.742306 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/8af8637c-823f-42b5-b67e-0cdb8f030681-crio-socket\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:09.742460 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.742318 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8jvtk\" (UniqueName: \"kubernetes.io/projected/8af8637c-823f-42b5-b67e-0cdb8f030681-kube-api-access-8jvtk\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:09.742460 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.742362 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8af8637c-823f-42b5-b67e-0cdb8f030681-data-volume\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:09.742807 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.742789 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/8af8637c-823f-42b5-b67e-0cdb8f030681-data-volume\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:09.753019 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.752973 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8jvtk\" (UniqueName: \"kubernetes.io/projected/8af8637c-823f-42b5-b67e-0cdb8f030681-kube-api-access-8jvtk\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:09.843832 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.843797 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5vtpz\" (UniqueName: \"kubernetes.io/projected/3153340c-02a5-4da8-8811-48db8141c02e-kube-api-access-5vtpz\") pod \"migrator-6865c9967-9xsxr\" (UID: \"3153340c-02a5-4da8-8811-48db8141c02e\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9xsxr" Jul 28 00:54:09.847752 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.847720 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" Jul 28 00:54:09.847889 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.847784 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" Jul 28 00:54:09.851716 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.851687 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5vtpz\" (UniqueName: \"kubernetes.io/projected/3153340c-02a5-4da8-8811-48db8141c02e-kube-api-access-5vtpz\") pod \"migrator-6865c9967-9xsxr\" (UID: \"3153340c-02a5-4da8-8811-48db8141c02e\") " pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9xsxr" Jul 28 00:54:09.893697 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.893662 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 00:54:09.894223 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.894196 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/0.log" Jul 28 00:54:09.894277 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.894229 2568 generic.go:356] "Generic (PLEG): container finished" podID="21d98251-4171-4c26-ab52-9ba123ba3be9" containerID="8b0fe5159848197ca6c4966f328ee170fbb415cfb1762b5b4723761143feb624" exitCode=255 Jul 28 00:54:09.894707 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.894678 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" event={"ID":"21d98251-4171-4c26-ab52-9ba123ba3be9","Type":"ContainerDied","Data":"8b0fe5159848197ca6c4966f328ee170fbb415cfb1762b5b4723761143feb624"} Jul 28 00:54:09.894838 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.894789 2568 scope.go:117] "RemoveContainer" containerID="eae568ca4dcca3a5b6fc26f4f2492aef00fe8a9cf783cafd7443bbcf9cb550d6" Jul 28 00:54:09.895471 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:09.895275 2568 scope.go:117] "RemoveContainer" containerID="8b0fe5159848197ca6c4966f328ee170fbb415cfb1762b5b4723761143feb624" Jul 28 00:54:09.895471 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:09.895426 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-gr7gw_openshift-console-operator(21d98251-4171-4c26-ab52-9ba123ba3be9)\"" pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" podUID="21d98251-4171-4c26-ab52-9ba123ba3be9" Jul 28 00:54:10.015956 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:10.015859 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9xsxr" Jul 28 00:54:10.147727 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:10.147689 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2527550a-ea54-4f32-af64-9417bd3060c0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f7b2z\" (UID: \"2527550a-ea54-4f32-af64-9417bd3060c0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f7b2z" Jul 28 00:54:10.147917 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:10.147872 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 00:54:10.147983 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:10.147959 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2527550a-ea54-4f32-af64-9417bd3060c0-networking-console-plugin-cert podName:2527550a-ea54-4f32-af64-9417bd3060c0 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:11.147937143 +0000 UTC m=+48.067537821 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2527550a-ea54-4f32-af64-9417bd3060c0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-f7b2z" (UID: "2527550a-ea54-4f32-af64-9417bd3060c0") : secret "networking-console-plugin-cert" not found Jul 28 00:54:10.184307 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:10.184282 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-kube-storage-version-migrator/migrator-6865c9967-9xsxr"] Jul 28 00:54:10.186803 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:54:10.186771 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3153340c_02a5_4da8_8811_48db8141c02e.slice/crio-3207b24beba475659b3e920671d9922862ce7734914b08b6ddfd2d493fd4779a WatchSource:0}: Error finding container 3207b24beba475659b3e920671d9922862ce7734914b08b6ddfd2d493fd4779a: Status 404 returned error can't find the container with id 3207b24beba475659b3e920671d9922862ce7734914b08b6ddfd2d493fd4779a Jul 28 00:54:10.248790 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:10.248742 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8af8637c-823f-42b5-b67e-0cdb8f030681-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:10.248971 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:10.248845 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8af8637c-823f-42b5-b67e-0cdb8f030681-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:10.248971 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:10.248902 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 00:54:10.249043 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:10.248993 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8af8637c-823f-42b5-b67e-0cdb8f030681-kube-rbac-proxy-cm podName:8af8637c-823f-42b5-b67e-0cdb8f030681 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:11.248970854 +0000 UTC m=+48.168571519 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8af8637c-823f-42b5-b67e-0cdb8f030681-kube-rbac-proxy-cm") pod "insights-runtime-extractor-74vc4" (UID: "8af8637c-823f-42b5-b67e-0cdb8f030681") : configmap "kube-rbac-proxy" not found Jul 28 00:54:10.249043 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:10.249012 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:54:10.249111 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:10.249055 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8af8637c-823f-42b5-b67e-0cdb8f030681-insights-runtime-extractor-tls podName:8af8637c-823f-42b5-b67e-0cdb8f030681 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:11.249042897 +0000 UTC m=+48.168643566 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8af8637c-823f-42b5-b67e-0cdb8f030681-insights-runtime-extractor-tls") pod "insights-runtime-extractor-74vc4" (UID: "8af8637c-823f-42b5-b67e-0cdb8f030681") : secret "insights-runtime-extractor-tls" not found Jul 28 00:54:10.750390 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:10.750359 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mjj4c_64b5029e-0628-4bbd-b16c-1ec599f76a21/dns-node-resolver/0.log" Jul 28 00:54:10.899142 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:10.899108 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 00:54:10.899589 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:10.899505 2568 scope.go:117] "RemoveContainer" containerID="8b0fe5159848197ca6c4966f328ee170fbb415cfb1762b5b4723761143feb624" Jul 28 00:54:10.899728 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:10.899706 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="failed to \"StartContainer\" for \"console-operator\" with CrashLoopBackOff: \"back-off 10s restarting failed container=console-operator pod=console-operator-584dcb6b54-gr7gw_openshift-console-operator(21d98251-4171-4c26-ab52-9ba123ba3be9)\"" pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" podUID="21d98251-4171-4c26-ab52-9ba123ba3be9" Jul 28 00:54:10.900329 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:10.900309 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9xsxr" event={"ID":"3153340c-02a5-4da8-8811-48db8141c02e","Type":"ContainerStarted","Data":"3207b24beba475659b3e920671d9922862ce7734914b08b6ddfd2d493fd4779a"} Jul 28 00:54:11.158327 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:11.158287 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2527550a-ea54-4f32-af64-9417bd3060c0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f7b2z\" (UID: \"2527550a-ea54-4f32-af64-9417bd3060c0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f7b2z" Jul 28 00:54:11.158506 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:11.158437 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 00:54:11.158506 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:11.158502 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2527550a-ea54-4f32-af64-9417bd3060c0-networking-console-plugin-cert podName:2527550a-ea54-4f32-af64-9417bd3060c0 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:13.15848445 +0000 UTC m=+50.078085112 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2527550a-ea54-4f32-af64-9417bd3060c0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-f7b2z" (UID: "2527550a-ea54-4f32-af64-9417bd3060c0") : secret "networking-console-plugin-cert" not found Jul 28 00:54:11.259012 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:11.258965 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8af8637c-823f-42b5-b67e-0cdb8f030681-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:11.259188 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:11.259085 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 00:54:11.259188 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:11.259102 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8af8637c-823f-42b5-b67e-0cdb8f030681-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:11.259188 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:11.259157 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8af8637c-823f-42b5-b67e-0cdb8f030681-kube-rbac-proxy-cm podName:8af8637c-823f-42b5-b67e-0cdb8f030681 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:13.259139737 +0000 UTC m=+50.178740399 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8af8637c-823f-42b5-b67e-0cdb8f030681-kube-rbac-proxy-cm") pod "insights-runtime-extractor-74vc4" (UID: "8af8637c-823f-42b5-b67e-0cdb8f030681") : configmap "kube-rbac-proxy" not found Jul 28 00:54:11.259315 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:11.259224 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:54:11.259315 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:11.259285 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8af8637c-823f-42b5-b67e-0cdb8f030681-insights-runtime-extractor-tls podName:8af8637c-823f-42b5-b67e-0cdb8f030681 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:13.259267971 +0000 UTC m=+50.178868648 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8af8637c-823f-42b5-b67e-0cdb8f030681-insights-runtime-extractor-tls") pod "insights-runtime-extractor-74vc4" (UID: "8af8637c-823f-42b5-b67e-0cdb8f030681") : secret "insights-runtime-extractor-tls" not found Jul 28 00:54:11.749727 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:11.749692 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jd4kr_666b80c4-e226-4307-b25e-4f7ffd02f5b9/node-ca/0.log" Jul 28 00:54:11.905506 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:11.905474 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9xsxr" event={"ID":"3153340c-02a5-4da8-8811-48db8141c02e","Type":"ContainerStarted","Data":"b4099d4c012e9b9b01244b3cde21d64ebeb98a660f79de54e09587aa08bd7ac7"} Jul 28 00:54:12.349664 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:12.349633 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5jr64_f63765b0-930b-4807-85d3-8447fd21dd69/serve-healthcheck-canary/0.log" Jul 28 00:54:12.911194 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:12.911149 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9xsxr" event={"ID":"3153340c-02a5-4da8-8811-48db8141c02e","Type":"ContainerStarted","Data":"650ed6a0adca1df641a5e18c17ec93ba44f1018e4d1c452e223f73423afa4ed5"} Jul 28 00:54:12.926784 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:12.926731 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-kube-storage-version-migrator/migrator-6865c9967-9xsxr" podStartSLOduration=2.329342842 podStartE2EDuration="3.926712886s" totalImagesPullingTime="1.597370044s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:54:12.925554848 +0000 UTC m=+49.845155531" watchObservedRunningTime="2026-07-28 00:54:12.926712886 +0000 UTC m=+49.846313569" Jul 28 00:54:13.179871 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.179778 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2527550a-ea54-4f32-af64-9417bd3060c0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f7b2z\" (UID: \"2527550a-ea54-4f32-af64-9417bd3060c0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f7b2z" Jul 28 00:54:13.180056 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:13.179967 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 00:54:13.180137 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:13.180055 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2527550a-ea54-4f32-af64-9417bd3060c0-networking-console-plugin-cert podName:2527550a-ea54-4f32-af64-9417bd3060c0 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:17.180033556 +0000 UTC m=+54.099634231 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2527550a-ea54-4f32-af64-9417bd3060c0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-f7b2z" (UID: "2527550a-ea54-4f32-af64-9417bd3060c0") : secret "networking-console-plugin-cert" not found Jul 28 00:54:13.201726 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.201692 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-sjswh"] Jul 28 00:54:13.215856 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.215828 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-sjswh"] Jul 28 00:54:13.216013 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.215932 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-sjswh" Jul 28 00:54:13.218483 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.218452 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"service-ca-dockercfg-qg9ml\"" Jul 28 00:54:13.218483 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.218474 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"kube-root-ca.crt\"" Jul 28 00:54:13.218728 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.218452 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"signing-cabundle\"" Jul 28 00:54:13.218728 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.218453 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-service-ca\"/\"openshift-service-ca.crt\"" Jul 28 00:54:13.219358 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.219342 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-service-ca\"/\"signing-key\"" Jul 28 00:54:13.281147 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.281102 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8af8637c-823f-42b5-b67e-0cdb8f030681-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:13.281340 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.281210 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/19e5359f-2913-48af-894e-095a6f861fbd-signing-cabundle\") pod \"service-ca-658d7b7c78-sjswh\" (UID: \"19e5359f-2913-48af-894e-095a6f861fbd\") " pod="openshift-service-ca/service-ca-658d7b7c78-sjswh" Jul 28 00:54:13.281340 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.281236 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/19e5359f-2913-48af-894e-095a6f861fbd-signing-key\") pod \"service-ca-658d7b7c78-sjswh\" (UID: \"19e5359f-2913-48af-894e-095a6f861fbd\") " pod="openshift-service-ca/service-ca-658d7b7c78-sjswh" Jul 28 00:54:13.281340 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:13.281239 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:54:13.281340 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:13.281329 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8af8637c-823f-42b5-b67e-0cdb8f030681-insights-runtime-extractor-tls podName:8af8637c-823f-42b5-b67e-0cdb8f030681 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:17.281309785 +0000 UTC m=+54.200910449 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8af8637c-823f-42b5-b67e-0cdb8f030681-insights-runtime-extractor-tls") pod "insights-runtime-extractor-74vc4" (UID: "8af8637c-823f-42b5-b67e-0cdb8f030681") : secret "insights-runtime-extractor-tls" not found Jul 28 00:54:13.281544 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.281262 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jh488\" (UniqueName: \"kubernetes.io/projected/19e5359f-2913-48af-894e-095a6f861fbd-kube-api-access-jh488\") pod \"service-ca-658d7b7c78-sjswh\" (UID: \"19e5359f-2913-48af-894e-095a6f861fbd\") " pod="openshift-service-ca/service-ca-658d7b7c78-sjswh" Jul 28 00:54:13.281544 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.281431 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8af8637c-823f-42b5-b67e-0cdb8f030681-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:13.281635 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:13.281543 2568 configmap.go:193] Couldn't get configMap openshift-insights/kube-rbac-proxy: configmap "kube-rbac-proxy" not found Jul 28 00:54:13.281635 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:13.281630 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/8af8637c-823f-42b5-b67e-0cdb8f030681-kube-rbac-proxy-cm podName:8af8637c-823f-42b5-b67e-0cdb8f030681 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:17.281615578 +0000 UTC m=+54.201216240 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-rbac-proxy-cm" (UniqueName: "kubernetes.io/configmap/8af8637c-823f-42b5-b67e-0cdb8f030681-kube-rbac-proxy-cm") pod "insights-runtime-extractor-74vc4" (UID: "8af8637c-823f-42b5-b67e-0cdb8f030681") : configmap "kube-rbac-proxy" not found Jul 28 00:54:13.382770 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.382729 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/19e5359f-2913-48af-894e-095a6f861fbd-signing-cabundle\") pod \"service-ca-658d7b7c78-sjswh\" (UID: \"19e5359f-2913-48af-894e-095a6f861fbd\") " pod="openshift-service-ca/service-ca-658d7b7c78-sjswh" Jul 28 00:54:13.382770 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.382772 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/19e5359f-2913-48af-894e-095a6f861fbd-signing-key\") pod \"service-ca-658d7b7c78-sjswh\" (UID: \"19e5359f-2913-48af-894e-095a6f861fbd\") " pod="openshift-service-ca/service-ca-658d7b7c78-sjswh" Jul 28 00:54:13.383025 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.382822 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jh488\" (UniqueName: \"kubernetes.io/projected/19e5359f-2913-48af-894e-095a6f861fbd-kube-api-access-jh488\") pod \"service-ca-658d7b7c78-sjswh\" (UID: \"19e5359f-2913-48af-894e-095a6f861fbd\") " pod="openshift-service-ca/service-ca-658d7b7c78-sjswh" Jul 28 00:54:13.383418 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.383393 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-cabundle\" (UniqueName: \"kubernetes.io/configmap/19e5359f-2913-48af-894e-095a6f861fbd-signing-cabundle\") pod \"service-ca-658d7b7c78-sjswh\" (UID: \"19e5359f-2913-48af-894e-095a6f861fbd\") " pod="openshift-service-ca/service-ca-658d7b7c78-sjswh" Jul 28 00:54:13.385389 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.385363 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"signing-key\" (UniqueName: \"kubernetes.io/secret/19e5359f-2913-48af-894e-095a6f861fbd-signing-key\") pod \"service-ca-658d7b7c78-sjswh\" (UID: \"19e5359f-2913-48af-894e-095a6f861fbd\") " pod="openshift-service-ca/service-ca-658d7b7c78-sjswh" Jul 28 00:54:13.391016 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.390987 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jh488\" (UniqueName: \"kubernetes.io/projected/19e5359f-2913-48af-894e-095a6f861fbd-kube-api-access-jh488\") pod \"service-ca-658d7b7c78-sjswh\" (UID: \"19e5359f-2913-48af-894e-095a6f861fbd\") " pod="openshift-service-ca/service-ca-658d7b7c78-sjswh" Jul 28 00:54:13.525173 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.525087 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-service-ca/service-ca-658d7b7c78-sjswh" Jul 28 00:54:13.686425 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.686396 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-service-ca/service-ca-658d7b7c78-sjswh"] Jul 28 00:54:13.688766 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:54:13.688738 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19e5359f_2913_48af_894e_095a6f861fbd.slice/crio-01555e498feebe0143d857d8944a766fb1477154a9f8efecc9bccdde1adc58a0 WatchSource:0}: Error finding container 01555e498feebe0143d857d8944a766fb1477154a9f8efecc9bccdde1adc58a0: Status 404 returned error can't find the container with id 01555e498feebe0143d857d8944a766fb1477154a9f8efecc9bccdde1adc58a0 Jul 28 00:54:13.916701 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.916663 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-sjswh" event={"ID":"19e5359f-2913-48af-894e-095a6f861fbd","Type":"ContainerStarted","Data":"38830daf305a7c3a014a83f1cd277117501e1b4f4b616ea7f6fc7f461337fbe4"} Jul 28 00:54:13.917081 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.916725 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca/service-ca-658d7b7c78-sjswh" event={"ID":"19e5359f-2913-48af-894e-095a6f861fbd","Type":"ContainerStarted","Data":"01555e498feebe0143d857d8944a766fb1477154a9f8efecc9bccdde1adc58a0"} Jul 28 00:54:13.933155 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:13.933101 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-service-ca/service-ca-658d7b7c78-sjswh" podStartSLOduration=0.933082302 podStartE2EDuration="933.082302ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:54:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:54:13.932103586 +0000 UTC m=+50.851704271" watchObservedRunningTime="2026-07-28 00:54:13.933082302 +0000 UTC m=+50.852682985" Jul 28 00:54:15.400322 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:15.400281 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49fe97ad-3adc-4b96-a594-b0b505a0cffe-service-ca-bundle\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:54:15.400856 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:15.400357 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:54:15.400856 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:15.400388 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-2g4mg\" (UID: \"a2f4fe8c-ef6c-459b-9e82-dbd224d85599\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg" Jul 28 00:54:15.400856 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:15.400484 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/configmap/49fe97ad-3adc-4b96-a594-b0b505a0cffe-service-ca-bundle podName:49fe97ad-3adc-4b96-a594-b0b505a0cffe nodeName:}" failed. No retries permitted until 2026-07-28 00:54:31.400461705 +0000 UTC m=+68.320062376 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "service-ca-bundle" (UniqueName: "kubernetes.io/configmap/49fe97ad-3adc-4b96-a594-b0b505a0cffe-service-ca-bundle") pod "router-default-5b886669c7-2wtgq" (UID: "49fe97ad-3adc-4b96-a594-b0b505a0cffe") : configmap references non-existent config key: service-ca.crt Jul 28 00:54:15.400856 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:15.400556 2568 secret.go:189] Couldn't get secret openshift-monitoring/cluster-monitoring-operator-tls: secret "cluster-monitoring-operator-tls" not found Jul 28 00:54:15.400856 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:15.400589 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b00b06e1-31f5-480d-81db-15a526c06b14-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-l7dwd\" (UID: \"b00b06e1-31f5-480d-81db-15a526c06b14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-l7dwd" Jul 28 00:54:15.400856 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:15.400632 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-cluster-monitoring-operator-tls podName:a2f4fe8c-ef6c-459b-9e82-dbd224d85599 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:31.400614883 +0000 UTC m=+68.320215547 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "cluster-monitoring-operator-tls" (UniqueName: "kubernetes.io/secret/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-cluster-monitoring-operator-tls") pod "cluster-monitoring-operator-548b489cb8-2g4mg" (UID: "a2f4fe8c-ef6c-459b-9e82-dbd224d85599") : secret "cluster-monitoring-operator-tls" not found Jul 28 00:54:15.400856 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:15.400555 2568 projected.go:266] Couldn't get secret openshift-image-registry/image-registry-tls: secret "image-registry-tls" not found Jul 28 00:54:15.400856 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:15.400676 2568 secret.go:189] Couldn't get secret openshift-cluster-samples-operator/samples-operator-tls: secret "samples-operator-tls" not found Jul 28 00:54:15.400856 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:15.400690 2568 projected.go:196] Error preparing data for projected volume registry-tls for pod openshift-image-registry/image-registry-779fc55d8b-xxb9x: secret "image-registry-tls" not found Jul 28 00:54:15.400856 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:15.400719 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b00b06e1-31f5-480d-81db-15a526c06b14-samples-operator-tls podName:b00b06e1-31f5-480d-81db-15a526c06b14 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:31.400706171 +0000 UTC m=+68.320306857 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "samples-operator-tls" (UniqueName: "kubernetes.io/secret/b00b06e1-31f5-480d-81db-15a526c06b14-samples-operator-tls") pod "cluster-samples-operator-6748489656-l7dwd" (UID: "b00b06e1-31f5-480d-81db-15a526c06b14") : secret "samples-operator-tls" not found Jul 28 00:54:15.400856 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:15.400724 2568 secret.go:189] Couldn't get secret openshift-ingress/router-metrics-certs-default: secret "router-metrics-certs-default" not found Jul 28 00:54:15.400856 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:15.400747 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls podName:49e28997-66bd-4404-a70a-63c65cd6a4a3 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:31.400730308 +0000 UTC m=+68.320330990 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "registry-tls" (UniqueName: "kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls") pod "image-registry-779fc55d8b-xxb9x" (UID: "49e28997-66bd-4404-a70a-63c65cd6a4a3") : secret "image-registry-tls" not found Jul 28 00:54:15.400856 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:15.400668 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-metrics-certs\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:54:15.400856 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:15.400772 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-metrics-certs podName:49fe97ad-3adc-4b96-a594-b0b505a0cffe nodeName:}" failed. No retries permitted until 2026-07-28 00:54:31.40075979 +0000 UTC m=+68.320360452 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-metrics-certs") pod "router-default-5b886669c7-2wtgq" (UID: "49fe97ad-3adc-4b96-a594-b0b505a0cffe") : secret "router-metrics-certs-default" not found Jul 28 00:54:15.400856 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:15.400846 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-metrics-tls\") pod \"dns-default-vjmlz\" (UID: \"bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14\") " pod="openshift-dns/dns-default-vjmlz" Jul 28 00:54:15.401646 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:15.400940 2568 secret.go:189] Couldn't get secret openshift-dns/dns-default-metrics-tls: secret "dns-default-metrics-tls" not found Jul 28 00:54:15.401646 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:15.400971 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-metrics-tls podName:bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:31.400963434 +0000 UTC m=+68.320564095 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-tls" (UniqueName: "kubernetes.io/secret/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-metrics-tls") pod "dns-default-vjmlz" (UID: "bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14") : secret "dns-default-metrics-tls" not found Jul 28 00:54:17.221240 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:17.221195 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2527550a-ea54-4f32-af64-9417bd3060c0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f7b2z\" (UID: \"2527550a-ea54-4f32-af64-9417bd3060c0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f7b2z" Jul 28 00:54:17.221748 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:17.221363 2568 secret.go:189] Couldn't get secret openshift-network-console/networking-console-plugin-cert: secret "networking-console-plugin-cert" not found Jul 28 00:54:17.221748 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:17.221436 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/2527550a-ea54-4f32-af64-9417bd3060c0-networking-console-plugin-cert podName:2527550a-ea54-4f32-af64-9417bd3060c0 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:25.221418823 +0000 UTC m=+62.141019489 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "networking-console-plugin-cert" (UniqueName: "kubernetes.io/secret/2527550a-ea54-4f32-af64-9417bd3060c0-networking-console-plugin-cert") pod "networking-console-plugin-74c9f884b7-f7b2z" (UID: "2527550a-ea54-4f32-af64-9417bd3060c0") : secret "networking-console-plugin-cert" not found Jul 28 00:54:17.322587 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:17.322532 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8af8637c-823f-42b5-b67e-0cdb8f030681-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:17.322763 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:17.322681 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8af8637c-823f-42b5-b67e-0cdb8f030681-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:17.322899 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:17.322878 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:54:17.322987 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:17.322975 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8af8637c-823f-42b5-b67e-0cdb8f030681-insights-runtime-extractor-tls podName:8af8637c-823f-42b5-b67e-0cdb8f030681 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:25.322955276 +0000 UTC m=+62.242555953 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8af8637c-823f-42b5-b67e-0cdb8f030681-insights-runtime-extractor-tls") pod "insights-runtime-extractor-74vc4" (UID: "8af8637c-823f-42b5-b67e-0cdb8f030681") : secret "insights-runtime-extractor-tls" not found Jul 28 00:54:17.323122 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:17.323102 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/8af8637c-823f-42b5-b67e-0cdb8f030681-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:19.847538 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:19.847495 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" Jul 28 00:54:19.848031 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:19.847561 2568 kubelet.go:2654] "SyncLoop (probe)" probe="liveness" status="unhealthy" pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" Jul 28 00:54:19.848031 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:19.847929 2568 scope.go:117] "RemoveContainer" containerID="8b0fe5159848197ca6c4966f328ee170fbb415cfb1762b5b4723761143feb624" Jul 28 00:54:19.944050 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:19.944023 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 00:54:19.944217 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:19.944088 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" event={"ID":"21d98251-4171-4c26-ab52-9ba123ba3be9","Type":"ContainerStarted","Data":"c5147aeede7de5f113c12e79b72f07b863571ab1f290fe9c6da4336b0cb6b904"} Jul 28 00:54:19.944380 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:19.944357 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" Jul 28 00:54:19.945845 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:19.945814 2568 patch_prober.go:28] interesting pod/console-operator-584dcb6b54-gr7gw container/console-operator namespace/openshift-console-operator: Readiness probe status=failure output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused" start-of-body= Jul 28 00:54:19.945981 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:19.945858 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" podUID="21d98251-4171-4c26-ab52-9ba123ba3be9" containerName="console-operator" probeResult="failure" output="Get \"https://10.132.0.11:8443/readyz\": dial tcp 10.132.0.11:8443: connect: connection refused" Jul 28 00:54:19.962992 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:19.962932 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" podStartSLOduration=32.966418127 podStartE2EDuration="40.962914907s" totalImagesPullingTime="7.99649678s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:53:39 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:54:19.960956781 +0000 UTC m=+56.880557467" watchObservedRunningTime="2026-07-28 00:54:19.962914907 +0000 UTC m=+56.882515641" Jul 28 00:54:20.952284 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:20.952249 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console-operator/console-operator-584dcb6b54-gr7gw" Jul 28 00:54:24.810681 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:24.810645 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-j25gd" Jul 28 00:54:25.305598 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:25.305522 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2527550a-ea54-4f32-af64-9417bd3060c0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f7b2z\" (UID: \"2527550a-ea54-4f32-af64-9417bd3060c0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f7b2z" Jul 28 00:54:25.308167 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:25.308140 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"networking-console-plugin-cert\" (UniqueName: \"kubernetes.io/secret/2527550a-ea54-4f32-af64-9417bd3060c0-networking-console-plugin-cert\") pod \"networking-console-plugin-74c9f884b7-f7b2z\" (UID: \"2527550a-ea54-4f32-af64-9417bd3060c0\") " pod="openshift-network-console/networking-console-plugin-74c9f884b7-f7b2z" Jul 28 00:54:25.406684 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:25.406630 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8af8637c-823f-42b5-b67e-0cdb8f030681-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:25.406869 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:25.406806 2568 secret.go:189] Couldn't get secret openshift-insights/insights-runtime-extractor-tls: secret "insights-runtime-extractor-tls" not found Jul 28 00:54:25.406913 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:25.406876 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8af8637c-823f-42b5-b67e-0cdb8f030681-insights-runtime-extractor-tls podName:8af8637c-823f-42b5-b67e-0cdb8f030681 nodeName:}" failed. No retries permitted until 2026-07-28 00:54:41.40686018 +0000 UTC m=+78.326460841 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "insights-runtime-extractor-tls" (UniqueName: "kubernetes.io/secret/8af8637c-823f-42b5-b67e-0cdb8f030681-insights-runtime-extractor-tls") pod "insights-runtime-extractor-74vc4" (UID: "8af8637c-823f-42b5-b67e-0cdb8f030681") : secret "insights-runtime-extractor-tls" not found Jul 28 00:54:25.410748 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:25.410726 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-console\"/\"default-dockercfg-4vzv2\"" Jul 28 00:54:25.418618 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:25.418590 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-console/networking-console-plugin-74c9f884b7-f7b2z" Jul 28 00:54:25.550615 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:25.550581 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-console/networking-console-plugin-74c9f884b7-f7b2z"] Jul 28 00:54:25.553293 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:54:25.553261 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2527550a_ea54_4f32_af64_9417bd3060c0.slice/crio-b4ddeafb096a555ef8ad289b6e0ef6e0cb7c369bd87cd7bd6addf223fecc076f WatchSource:0}: Error finding container b4ddeafb096a555ef8ad289b6e0ef6e0cb7c369bd87cd7bd6addf223fecc076f: Status 404 returned error can't find the container with id b4ddeafb096a555ef8ad289b6e0ef6e0cb7c369bd87cd7bd6addf223fecc076f Jul 28 00:54:25.964145 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:25.964107 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-f7b2z" event={"ID":"2527550a-ea54-4f32-af64-9417bd3060c0","Type":"ContainerStarted","Data":"b4ddeafb096a555ef8ad289b6e0ef6e0cb7c369bd87cd7bd6addf223fecc076f"} Jul 28 00:54:26.968588 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:26.968527 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-console/networking-console-plugin-74c9f884b7-f7b2z" event={"ID":"2527550a-ea54-4f32-af64-9417bd3060c0","Type":"ContainerStarted","Data":"c950888751f849802fb50e2685c2ace648b2a9ccc5d0e067f6914e7ca35a8119"} Jul 28 00:54:26.987322 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:26.987207 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-console/networking-console-plugin-74c9f884b7-f7b2z" podStartSLOduration=16.817406153 podStartE2EDuration="17.987188275s" totalImagesPullingTime="1.169782122s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:54:09 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:54:26.986366683 +0000 UTC m=+63.905967368" watchObservedRunningTime="2026-07-28 00:54:26.987188275 +0000 UTC m=+63.906788958" Jul 28 00:54:29.246958 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:29.246918 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs\") pod \"network-metrics-daemon-26zg4\" (UID: \"0281eb31-f259-4470-acc3-5499c546004c\") " pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:54:29.249311 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:29.249288 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 28 00:54:29.260180 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:29.260151 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/0281eb31-f259-4470-acc3-5499c546004c-metrics-certs\") pod \"network-metrics-daemon-26zg4\" (UID: \"0281eb31-f259-4470-acc3-5499c546004c\") " pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:54:29.341966 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:29.341930 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-wktlp\"" Jul 28 00:54:29.348170 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:29.348132 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret\") pod \"global-pull-secret-syncer-9mbj7\" (UID: \"0b32935c-be84-4ae4-bc60-0e462f6c89f6\") " pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:54:29.348258 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:29.348233 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zltmc\" (UniqueName: \"kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc\") pod \"network-check-target-f76c6\" (UID: \"32eb3a5b-feee-4950-8a7c-7370e73c6b3c\") " pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:54:29.349777 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:29.349757 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-26zg4" Jul 28 00:54:29.350466 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:29.350446 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 28 00:54:29.351140 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:29.351122 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zltmc\" (UniqueName: \"kubernetes.io/projected/32eb3a5b-feee-4950-8a7c-7370e73c6b3c-kube-api-access-zltmc\") pod \"network-check-target-f76c6\" (UID: \"32eb3a5b-feee-4950-8a7c-7370e73c6b3c\") " pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:54:29.360793 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:29.360757 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/0b32935c-be84-4ae4-bc60-0e462f6c89f6-original-pull-secret\") pod \"global-pull-secret-syncer-9mbj7\" (UID: \"0b32935c-be84-4ae4-bc60-0e462f6c89f6\") " pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:54:29.483230 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:29.483193 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-26zg4"] Jul 28 00:54:29.485754 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:54:29.485719 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0281eb31_f259_4470_acc3_5499c546004c.slice/crio-6b5ff60f19ff431eacc83715fbc92861e1e71acda4cca90a620fd5c2dde46c75 WatchSource:0}: Error finding container 6b5ff60f19ff431eacc83715fbc92861e1e71acda4cca90a620fd5c2dde46c75: Status 404 returned error can't find the container with id 6b5ff60f19ff431eacc83715fbc92861e1e71acda4cca90a620fd5c2dde46c75 Jul 28 00:54:29.646147 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:29.646102 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-9mbj7" Jul 28 00:54:29.653590 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:29.653334 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-cknlx\"" Jul 28 00:54:29.661272 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:29.661242 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:54:29.783466 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:29.783358 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-9mbj7"] Jul 28 00:54:29.786279 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:54:29.786247 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0b32935c_be84_4ae4_bc60_0e462f6c89f6.slice/crio-37980ad6dd2f62017af00e73cf8caaca54d7f627ab7e056970ab8cb579be3a09 WatchSource:0}: Error finding container 37980ad6dd2f62017af00e73cf8caaca54d7f627ab7e056970ab8cb579be3a09: Status 404 returned error can't find the container with id 37980ad6dd2f62017af00e73cf8caaca54d7f627ab7e056970ab8cb579be3a09 Jul 28 00:54:29.802836 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:29.802804 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-f76c6"] Jul 28 00:54:29.805493 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:54:29.805467 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod32eb3a5b_feee_4950_8a7c_7370e73c6b3c.slice/crio-aead45c1998ac9153f5dc44b380ad0e33880f8ec4b438216f8f56e72f3c0adcb WatchSource:0}: Error finding container aead45c1998ac9153f5dc44b380ad0e33880f8ec4b438216f8f56e72f3c0adcb: Status 404 returned error can't find the container with id aead45c1998ac9153f5dc44b380ad0e33880f8ec4b438216f8f56e72f3c0adcb Jul 28 00:54:29.982398 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:29.981828 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f76c6" event={"ID":"32eb3a5b-feee-4950-8a7c-7370e73c6b3c","Type":"ContainerStarted","Data":"f68a9f2054001e7f01940b5aca827e537e87eb7ba5f7b960a3b06957ff8e36a3"} Jul 28 00:54:29.982398 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:29.981889 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-f76c6" event={"ID":"32eb3a5b-feee-4950-8a7c-7370e73c6b3c","Type":"ContainerStarted","Data":"aead45c1998ac9153f5dc44b380ad0e33880f8ec4b438216f8f56e72f3c0adcb"} Jul 28 00:54:29.982398 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:29.981961 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:54:29.983263 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:29.983238 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-26zg4" event={"ID":"0281eb31-f259-4470-acc3-5499c546004c","Type":"ContainerStarted","Data":"6b5ff60f19ff431eacc83715fbc92861e1e71acda4cca90a620fd5c2dde46c75"} Jul 28 00:54:29.984526 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:29.984493 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9mbj7" event={"ID":"0b32935c-be84-4ae4-bc60-0e462f6c89f6","Type":"ContainerStarted","Data":"37980ad6dd2f62017af00e73cf8caaca54d7f627ab7e056970ab8cb579be3a09"} Jul 28 00:54:29.996781 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:29.996722 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-f76c6" podStartSLOduration=66.996698714 podStartE2EDuration="1m6.996698714s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:53:23 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:54:29.994993265 +0000 UTC m=+66.914593949" watchObservedRunningTime="2026-07-28 00:54:29.996698714 +0000 UTC m=+66.916299401" Jul 28 00:54:30.991737 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:30.991701 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-26zg4" event={"ID":"0281eb31-f259-4470-acc3-5499c546004c","Type":"ContainerStarted","Data":"1c00a6ba22465d68aa00e6403f9f44bf84a41292ab420c85ba97827b0e6baf34"} Jul 28 00:54:30.992188 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:30.991768 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-26zg4" event={"ID":"0281eb31-f259-4470-acc3-5499c546004c","Type":"ContainerStarted","Data":"a8a67edf41a19433b16202ec70eaaaae47f367ca699c93327e10d70baf84d851"} Jul 28 00:54:31.009764 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.009699 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-26zg4" podStartSLOduration=67.008274608 podStartE2EDuration="1m8.00967649s" totalImagesPullingTime="1.001401882s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:53:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:54:31.00828304 +0000 UTC m=+67.927883724" watchObservedRunningTime="2026-07-28 00:54:31.00967649 +0000 UTC m=+67.929277177" Jul 28 00:54:31.474950 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.472330 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:54:31.474950 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.472383 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-2g4mg\" (UID: \"a2f4fe8c-ef6c-459b-9e82-dbd224d85599\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg" Jul 28 00:54:31.474950 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.472478 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b00b06e1-31f5-480d-81db-15a526c06b14-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-l7dwd\" (UID: \"b00b06e1-31f5-480d-81db-15a526c06b14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-l7dwd" Jul 28 00:54:31.474950 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.472528 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-metrics-certs\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:54:31.474950 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.472621 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-metrics-tls\") pod \"dns-default-vjmlz\" (UID: \"bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14\") " pod="openshift-dns/dns-default-vjmlz" Jul 28 00:54:31.474950 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.472655 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49fe97ad-3adc-4b96-a594-b0b505a0cffe-service-ca-bundle\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:54:31.474950 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.473408 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/49fe97ad-3adc-4b96-a594-b0b505a0cffe-service-ca-bundle\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:54:31.478221 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.478196 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/49fe97ad-3adc-4b96-a594-b0b505a0cffe-metrics-certs\") pod \"router-default-5b886669c7-2wtgq\" (UID: \"49fe97ad-3adc-4b96-a594-b0b505a0cffe\") " pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:54:31.478363 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.478260 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls\") pod \"image-registry-779fc55d8b-xxb9x\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:54:31.478363 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.478347 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14-metrics-tls\") pod \"dns-default-vjmlz\" (UID: \"bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14\") " pod="openshift-dns/dns-default-vjmlz" Jul 28 00:54:31.478363 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.478355 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-monitoring-operator-tls\" (UniqueName: \"kubernetes.io/secret/a2f4fe8c-ef6c-459b-9e82-dbd224d85599-cluster-monitoring-operator-tls\") pod \"cluster-monitoring-operator-548b489cb8-2g4mg\" (UID: \"a2f4fe8c-ef6c-459b-9e82-dbd224d85599\") " pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg" Jul 28 00:54:31.478530 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.478345 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"samples-operator-tls\" (UniqueName: \"kubernetes.io/secret/b00b06e1-31f5-480d-81db-15a526c06b14-samples-operator-tls\") pod \"cluster-samples-operator-6748489656-l7dwd\" (UID: \"b00b06e1-31f5-480d-81db-15a526c06b14\") " pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-l7dwd" Jul 28 00:54:31.598020 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.597979 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"router-dockercfg-27b4q\"" Jul 28 00:54:31.605903 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.605870 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:54:31.618557 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.618521 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-xbmf2\"" Jul 28 00:54:31.627117 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.627087 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:54:31.629933 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.629888 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"cluster-monitoring-operator-dockercfg-9n67c\"" Jul 28 00:54:31.638075 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.638057 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg" Jul 28 00:54:31.642593 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.642524 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-samples-operator\"/\"cluster-samples-operator-dockercfg-vbs59\"" Jul 28 00:54:31.650625 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.650552 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-l7dwd" Jul 28 00:54:31.680298 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.680269 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-w6lql\"" Jul 28 00:54:31.688650 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.688522 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-vjmlz" Jul 28 00:54:31.804254 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.804186 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/router-default-5b886669c7-2wtgq"] Jul 28 00:54:31.815623 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:54:31.815381 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod49fe97ad_3adc_4b96_a594_b0b505a0cffe.slice/crio-6ff30c6ea3e4515fbc3c2f49a3e9428d24ff3eff6d4a714658f0215d0dfcb998 WatchSource:0}: Error finding container 6ff30c6ea3e4515fbc3c2f49a3e9428d24ff3eff6d4a714658f0215d0dfcb998: Status 404 returned error can't find the container with id 6ff30c6ea3e4515fbc3c2f49a3e9428d24ff3eff6d4a714658f0215d0dfcb998 Jul 28 00:54:31.848629 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.848168 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-779fc55d8b-xxb9x"] Jul 28 00:54:31.877649 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.877521 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg"] Jul 28 00:54:31.887397 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:54:31.887351 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda2f4fe8c_ef6c_459b_9e82_dbd224d85599.slice/crio-b820cf6c593f13db3cbca3bec071dac2a926b54783a3308c29a0eb4e3b72c0c3 WatchSource:0}: Error finding container b820cf6c593f13db3cbca3bec071dac2a926b54783a3308c29a0eb4e3b72c0c3: Status 404 returned error can't find the container with id b820cf6c593f13db3cbca3bec071dac2a926b54783a3308c29a0eb4e3b72c0c3 Jul 28 00:54:31.923845 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.923810 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-vjmlz"] Jul 28 00:54:31.934247 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:54:31.934214 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd96ff2b_48b9_4ef8_a2b1_d6c40b941a14.slice/crio-3d8d8988d2e15ebb663433dc80dc6763de8535b6f659ca3a16bd1908444dbe33 WatchSource:0}: Error finding container 3d8d8988d2e15ebb663433dc80dc6763de8535b6f659ca3a16bd1908444dbe33: Status 404 returned error can't find the container with id 3d8d8988d2e15ebb663433dc80dc6763de8535b6f659ca3a16bd1908444dbe33 Jul 28 00:54:31.949093 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:31.949061 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-cluster-samples-operator/cluster-samples-operator-6748489656-l7dwd"] Jul 28 00:54:32.001244 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:32.001153 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vjmlz" event={"ID":"bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14","Type":"ContainerStarted","Data":"3d8d8988d2e15ebb663433dc80dc6763de8535b6f659ca3a16bd1908444dbe33"} Jul 28 00:54:32.003706 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:32.003640 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b886669c7-2wtgq" event={"ID":"49fe97ad-3adc-4b96-a594-b0b505a0cffe","Type":"ContainerStarted","Data":"c7aa135a35a999e25c19cff21fceb10f8ea6a98cc27182df6a9dd67753740469"} Jul 28 00:54:32.003706 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:32.003693 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/router-default-5b886669c7-2wtgq" event={"ID":"49fe97ad-3adc-4b96-a594-b0b505a0cffe","Type":"ContainerStarted","Data":"6ff30c6ea3e4515fbc3c2f49a3e9428d24ff3eff6d4a714658f0215d0dfcb998"} Jul 28 00:54:32.005369 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:32.005346 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg" event={"ID":"a2f4fe8c-ef6c-459b-9e82-dbd224d85599","Type":"ContainerStarted","Data":"b820cf6c593f13db3cbca3bec071dac2a926b54783a3308c29a0eb4e3b72c0c3"} Jul 28 00:54:32.008059 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:32.008031 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" event={"ID":"49e28997-66bd-4404-a70a-63c65cd6a4a3","Type":"ContainerStarted","Data":"ece0015be105cf20d2a697317aeb481636918245149384f10c75af3859bc9f84"} Jul 28 00:54:32.008155 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:32.008084 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" event={"ID":"49e28997-66bd-4404-a70a-63c65cd6a4a3","Type":"ContainerStarted","Data":"3b8c7ea72169757c40c16540cf09ca3481d49e74b7da77598dd49af90ccb684a"} Jul 28 00:54:32.008300 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:32.008260 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:54:32.027360 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:32.027311 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/router-default-5b886669c7-2wtgq" podStartSLOduration=54.027292581 podStartE2EDuration="54.027292581s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:53:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:54:32.025266006 +0000 UTC m=+68.944866690" watchObservedRunningTime="2026-07-28 00:54:32.027292581 +0000 UTC m=+68.946893267" Jul 28 00:54:32.043799 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:32.043737 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" podStartSLOduration=68.043717594 podStartE2EDuration="1m8.043717594s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:53:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:54:32.043543723 +0000 UTC m=+68.963144406" watchObservedRunningTime="2026-07-28 00:54:32.043717594 +0000 UTC m=+68.963318282" Jul 28 00:54:32.607138 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:32.607099 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:54:32.610380 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:32.610135 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:54:33.016631 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:33.016420 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-l7dwd" event={"ID":"b00b06e1-31f5-480d-81db-15a526c06b14","Type":"ContainerStarted","Data":"b8204c5db579ac6a59507a8e8ac7b35fbff7d8e55806f29b01c219d09c4a2bc6"} Jul 28 00:54:33.016631 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:33.016510 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:54:33.018654 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:33.018452 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/router-default-5b886669c7-2wtgq" Jul 28 00:54:36.111861 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.111828 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6c56774d9c-p829d"] Jul 28 00:54:36.134470 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.134394 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c56774d9c-p829d"] Jul 28 00:54:36.134697 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.134544 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:54:36.138897 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.138865 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 28 00:54:36.138897 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.138867 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 28 00:54:36.139117 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.139007 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 28 00:54:36.139184 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.139156 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 28 00:54:36.140064 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.140006 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 28 00:54:36.140189 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.140163 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 28 00:54:36.140594 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.140454 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-krj69\"" Jul 28 00:54:36.140594 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.140512 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 28 00:54:36.223824 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.223782 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rfbsb\" (UniqueName: \"kubernetes.io/projected/0bd6b899-f2b3-41a4-8356-7e183d87607b-kube-api-access-rfbsb\") pod \"console-6c56774d9c-p829d\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:54:36.224037 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.223839 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bd6b899-f2b3-41a4-8356-7e183d87607b-console-config\") pod \"console-6c56774d9c-p829d\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:54:36.224037 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.223866 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bd6b899-f2b3-41a4-8356-7e183d87607b-oauth-serving-cert\") pod \"console-6c56774d9c-p829d\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:54:36.224037 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.223890 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bd6b899-f2b3-41a4-8356-7e183d87607b-console-serving-cert\") pod \"console-6c56774d9c-p829d\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:54:36.224037 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.223940 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bd6b899-f2b3-41a4-8356-7e183d87607b-console-oauth-config\") pod \"console-6c56774d9c-p829d\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:54:36.224037 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.224025 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd6b899-f2b3-41a4-8356-7e183d87607b-service-ca\") pod \"console-6c56774d9c-p829d\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:54:36.324860 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.324824 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bd6b899-f2b3-41a4-8356-7e183d87607b-console-oauth-config\") pod \"console-6c56774d9c-p829d\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:54:36.325045 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.324883 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd6b899-f2b3-41a4-8356-7e183d87607b-service-ca\") pod \"console-6c56774d9c-p829d\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:54:36.325045 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.324922 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rfbsb\" (UniqueName: \"kubernetes.io/projected/0bd6b899-f2b3-41a4-8356-7e183d87607b-kube-api-access-rfbsb\") pod \"console-6c56774d9c-p829d\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:54:36.325045 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.324949 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bd6b899-f2b3-41a4-8356-7e183d87607b-console-config\") pod \"console-6c56774d9c-p829d\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:54:36.325045 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.324971 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bd6b899-f2b3-41a4-8356-7e183d87607b-oauth-serving-cert\") pod \"console-6c56774d9c-p829d\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:54:36.325250 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.325095 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bd6b899-f2b3-41a4-8356-7e183d87607b-console-serving-cert\") pod \"console-6c56774d9c-p829d\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:54:36.325680 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.325658 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bd6b899-f2b3-41a4-8356-7e183d87607b-console-config\") pod \"console-6c56774d9c-p829d\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:54:36.325800 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.325715 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bd6b899-f2b3-41a4-8356-7e183d87607b-oauth-serving-cert\") pod \"console-6c56774d9c-p829d\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:54:36.326094 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.326073 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd6b899-f2b3-41a4-8356-7e183d87607b-service-ca\") pod \"console-6c56774d9c-p829d\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:54:36.327557 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.327529 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bd6b899-f2b3-41a4-8356-7e183d87607b-console-oauth-config\") pod \"console-6c56774d9c-p829d\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:54:36.328244 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.328223 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bd6b899-f2b3-41a4-8356-7e183d87607b-console-serving-cert\") pod \"console-6c56774d9c-p829d\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:54:36.332470 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.332441 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rfbsb\" (UniqueName: \"kubernetes.io/projected/0bd6b899-f2b3-41a4-8356-7e183d87607b-kube-api-access-rfbsb\") pod \"console-6c56774d9c-p829d\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:54:36.447036 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.446948 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:54:36.968052 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:36.967053 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6c56774d9c-p829d"] Jul 28 00:54:36.971782 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:54:36.971725 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0bd6b899_f2b3_41a4_8356_7e183d87607b.slice/crio-bec4801847d9abca67de0c44557ba25ad31dfcac4fe92e1078908a6fa2c31a83 WatchSource:0}: Error finding container bec4801847d9abca67de0c44557ba25ad31dfcac4fe92e1078908a6fa2c31a83: Status 404 returned error can't find the container with id bec4801847d9abca67de0c44557ba25ad31dfcac4fe92e1078908a6fa2c31a83 Jul 28 00:54:37.040749 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:37.040639 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vjmlz" event={"ID":"bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14","Type":"ContainerStarted","Data":"23bfc24aef4d1baa6ef9bdfcde64cbe9612c18f6263eee936e3913e5202e7531"} Jul 28 00:54:37.042982 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:37.042939 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c56774d9c-p829d" event={"ID":"0bd6b899-f2b3-41a4-8356-7e183d87607b","Type":"ContainerStarted","Data":"bec4801847d9abca67de0c44557ba25ad31dfcac4fe92e1078908a6fa2c31a83"} Jul 28 00:54:37.050708 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:37.050673 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-l7dwd" event={"ID":"b00b06e1-31f5-480d-81db-15a526c06b14","Type":"ContainerStarted","Data":"f264413a53e9de572c40a23e5f8f64fc4bdc4558fbb177548f109feb7ece91a6"} Jul 28 00:54:37.053003 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:37.052967 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg" event={"ID":"a2f4fe8c-ef6c-459b-9e82-dbd224d85599","Type":"ContainerStarted","Data":"9327bcdfbc4634bc7d298691d9695a6c9ee3ccc88ad7e205319d32897bfd49b5"} Jul 28 00:54:37.091407 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:37.091342 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/cluster-monitoring-operator-548b489cb8-2g4mg" podStartSLOduration=54.156847125 podStartE2EDuration="59.091317891s" totalImagesPullingTime="4.934470766s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:53:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:54:37.0904139 +0000 UTC m=+74.010014585" watchObservedRunningTime="2026-07-28 00:54:37.091317891 +0000 UTC m=+74.010918576" Jul 28 00:54:38.061105 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:38.060973 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-vjmlz" event={"ID":"bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14","Type":"ContainerStarted","Data":"c7e4964d6fbab457c829cb7c3b6bd9880effe8c97ed9124404c390f5c73b4a97"} Jul 28 00:54:38.061105 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:38.061060 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-vjmlz" Jul 28 00:54:38.063623 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:38.063586 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-9mbj7" event={"ID":"0b32935c-be84-4ae4-bc60-0e462f6c89f6","Type":"ContainerStarted","Data":"ba3edf0e7463d0290694d58e2fcbec5303f17b66529dc128b887a0803bb3cada"} Jul 28 00:54:38.066661 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:38.066629 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-l7dwd" event={"ID":"b00b06e1-31f5-480d-81db-15a526c06b14","Type":"ContainerStarted","Data":"e96f51576666f0fbd5c67e757335738504cf1061b155d6ad861cc1b9ebe47527"} Jul 28 00:54:38.078320 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:38.078259 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-vjmlz" podStartSLOduration=34.192169914 podStartE2EDuration="39.078240003s" totalImagesPullingTime="4.886070089s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:53:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:54:38.077201786 +0000 UTC m=+74.996802472" watchObservedRunningTime="2026-07-28 00:54:38.078240003 +0000 UTC m=+74.997840681" Jul 28 00:54:38.108242 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:38.108177 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-9mbj7" podStartSLOduration=67.073879497 podStartE2EDuration="1m14.108157005s" totalImagesPullingTime="7.034277508s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:53:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:54:38.093721082 +0000 UTC m=+75.013321765" watchObservedRunningTime="2026-07-28 00:54:38.108157005 +0000 UTC m=+75.027757690" Jul 28 00:54:38.108649 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:38.108606 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-samples-operator/cluster-samples-operator-6748489656-l7dwd" podStartSLOduration=55.311515079 podStartE2EDuration="1m0.108594672s" totalImagesPullingTime="4.797079593s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:53:38 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:54:38.108086694 +0000 UTC m=+75.027687379" watchObservedRunningTime="2026-07-28 00:54:38.108594672 +0000 UTC m=+75.028195359" Jul 28 00:54:41.081584 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:41.081532 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c56774d9c-p829d" event={"ID":"0bd6b899-f2b3-41a4-8356-7e183d87607b","Type":"ContainerStarted","Data":"581a4e1ece10b05034ab61d10d2b2afccdbeda6637c00082727b977fcc758f3a"} Jul 28 00:54:41.100223 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:41.100164 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6c56774d9c-p829d" podStartSLOduration=2.008956092 podStartE2EDuration="5.100144238s" totalImagesPullingTime="3.091188146s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:54:36 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:54:41.098251554 +0000 UTC m=+78.017852242" watchObservedRunningTime="2026-07-28 00:54:41.100144238 +0000 UTC m=+78.019744921" Jul 28 00:54:41.474026 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:41.473982 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8af8637c-823f-42b5-b67e-0cdb8f030681-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:41.476583 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:41.476540 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/8af8637c-823f-42b5-b67e-0cdb8f030681-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-74vc4\" (UID: \"8af8637c-823f-42b5-b67e-0cdb8f030681\") " pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:41.722274 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:41.722236 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-r566t\"" Jul 28 00:54:41.730096 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:41.730020 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-74vc4" Jul 28 00:54:41.880532 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:41.880494 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-74vc4"] Jul 28 00:54:41.884150 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:54:41.884122 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8af8637c_823f_42b5_b67e_0cdb8f030681.slice/crio-e300853f2a40e9fd57dade359539f8e16fce34670eac1ab67596c65b405df140 WatchSource:0}: Error finding container e300853f2a40e9fd57dade359539f8e16fce34670eac1ab67596c65b405df140: Status 404 returned error can't find the container with id e300853f2a40e9fd57dade359539f8e16fce34670eac1ab67596c65b405df140 Jul 28 00:54:42.087155 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:42.087063 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-74vc4" event={"ID":"8af8637c-823f-42b5-b67e-0cdb8f030681","Type":"ContainerStarted","Data":"e300853f2a40e9fd57dade359539f8e16fce34670eac1ab67596c65b405df140"} Jul 28 00:54:46.447732 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:46.447585 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:54:46.447732 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:46.447660 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:54:46.449011 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:46.448981 2568 patch_prober.go:28] interesting pod/console-6c56774d9c-p829d container/console namespace/openshift-console: Startup probe status=failure output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" start-of-body= Jul 28 00:54:46.449112 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:46.449066 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-console/console-6c56774d9c-p829d" podUID="0bd6b899-f2b3-41a4-8356-7e183d87607b" containerName="console" probeResult="failure" output="Get \"https://10.132.0.22:8443/health\": dial tcp 10.132.0.22:8443: connect: connection refused" Jul 28 00:54:47.109026 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:47.108994 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-74vc4" event={"ID":"8af8637c-823f-42b5-b67e-0cdb8f030681","Type":"ContainerStarted","Data":"a1b5f5e6c09ce95a3b07f97bf99a7ee859408d9c0c39cc66476d96309b83e41a"} Jul 28 00:54:48.073560 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:48.073523 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-vjmlz" Jul 28 00:54:48.910937 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:48.910898 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-8995r"] Jul 28 00:54:48.919282 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:48.919248 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:48.921769 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:48.921505 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 28 00:54:48.921936 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:48.921847 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-9zh8t\"" Jul 28 00:54:48.922257 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:48.922117 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 28 00:54:48.922559 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:48.922504 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 28 00:54:48.922774 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:48.922649 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 28 00:54:49.041596 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.041538 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-sys\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.041789 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.041618 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.041789 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.041648 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-root\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.041789 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.041704 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-node-exporter-wtmp\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.041789 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.041738 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-node-exporter-textfile\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.041789 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.041768 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-node-exporter-accelerators-collector-config\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.042063 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.041812 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kn25s\" (UniqueName: \"kubernetes.io/projected/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-kube-api-access-kn25s\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.042063 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.041857 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-node-exporter-tls\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.042063 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.041885 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-metrics-client-ca\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.144060 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.143117 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-node-exporter-textfile\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.144060 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.143158 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-node-exporter-accelerators-collector-config\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.144060 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.143196 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kn25s\" (UniqueName: \"kubernetes.io/projected/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-kube-api-access-kn25s\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.144060 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.143237 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-node-exporter-tls\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.144060 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.143272 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-metrics-client-ca\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.144060 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.143302 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-sys\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.144060 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.143337 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.144060 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.143363 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-root\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.144060 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:49.143399 2568 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 28 00:54:49.144060 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.143416 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-node-exporter-wtmp\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.144060 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:54:49.143470 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-node-exporter-tls podName:ca500ac3-3b6a-4571-a4f0-463d4e13ff5e nodeName:}" failed. No retries permitted until 2026-07-28 00:54:49.643446701 +0000 UTC m=+86.563047387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-node-exporter-tls") pod "node-exporter-8995r" (UID: "ca500ac3-3b6a-4571-a4f0-463d4e13ff5e") : secret "node-exporter-tls" not found Jul 28 00:54:49.144060 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.143507 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-node-exporter-textfile\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.144060 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.143618 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-sys\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.144060 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.143641 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-node-exporter-wtmp\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.144060 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.143875 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-node-exporter-accelerators-collector-config\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.144060 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.143951 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-root\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.146068 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.144195 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-metrics-client-ca\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.158815 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.158108 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kn25s\" (UniqueName: \"kubernetes.io/projected/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-kube-api-access-kn25s\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.168330 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.168250 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.648470 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.648434 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-node-exporter-tls\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.651401 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.651370 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/ca500ac3-3b6a-4571-a4f0-463d4e13ff5e-node-exporter-tls\") pod \"node-exporter-8995r\" (UID: \"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e\") " pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:49.832788 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:49.832748 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-8995r" Jul 28 00:54:50.584045 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:54:50.584005 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca500ac3_3b6a_4571_a4f0_463d4e13ff5e.slice/crio-e9a751ff53afb6c990920f4f77f5da63a4652f02b751c492b471bbe8ebf02d7e WatchSource:0}: Error finding container e9a751ff53afb6c990920f4f77f5da63a4652f02b751c492b471bbe8ebf02d7e: Status 404 returned error can't find the container with id e9a751ff53afb6c990920f4f77f5da63a4652f02b751c492b471bbe8ebf02d7e Jul 28 00:54:51.132267 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:51.132213 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8995r" event={"ID":"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e","Type":"ContainerStarted","Data":"e9a751ff53afb6c990920f4f77f5da63a4652f02b751c492b471bbe8ebf02d7e"} Jul 28 00:54:51.134650 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:51.134609 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-74vc4" event={"ID":"8af8637c-823f-42b5-b67e-0cdb8f030681","Type":"ContainerStarted","Data":"d7ce2b002a660daa3b898a7a36e119f419d6a7a2c6c352fc3a3a4dccd04ad890"} Jul 28 00:54:51.632964 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:51.632919 2568 patch_prober.go:28] interesting pod/image-registry-779fc55d8b-xxb9x container/registry namespace/openshift-image-registry: Liveness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body={"errors":[{"code":"UNAVAILABLE","message":"service unavailable","detail":"health check failed: please see /debug/health"}]} Jul 28 00:54:51.633363 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:51.632987 2568 prober.go:120] "Probe failed" probeType="Liveness" pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" podUID="49e28997-66bd-4404-a70a-63c65cd6a4a3" containerName="registry" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 00:54:52.142045 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:52.142007 2568 generic.go:356] "Generic (PLEG): container finished" podID="ca500ac3-3b6a-4571-a4f0-463d4e13ff5e" containerID="f4ad8fc6298ebb5a8c530de66eabdb8bbaf2ce5e7ff34eca7446b1e824aea4cb" exitCode=0 Jul 28 00:54:52.142450 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:52.142097 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8995r" event={"ID":"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e","Type":"ContainerDied","Data":"f4ad8fc6298ebb5a8c530de66eabdb8bbaf2ce5e7ff34eca7446b1e824aea4cb"} Jul 28 00:54:53.022655 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:53.022624 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:54:53.149126 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:53.149075 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8995r" event={"ID":"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e","Type":"ContainerStarted","Data":"17e2cab5fba85a557051d8db7ae26664fcf6916c92ccdaf72d105dfb921855b0"} Jul 28 00:54:53.149282 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:53.149155 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-8995r" event={"ID":"ca500ac3-3b6a-4571-a4f0-463d4e13ff5e","Type":"ContainerStarted","Data":"1e7f47f4fe22aa0ba71f2ac6353c1ac9af17f85e5672305f076731fd662b1755"} Jul 28 00:54:53.166635 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:53.166550 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-8995r" podStartSLOduration=4.082664259 podStartE2EDuration="5.166525998s" totalImagesPullingTime="991.024108ms" totalInitContainerRuntime="92.837631ms" isStatefulPod=true podCreationTimestamp="2026-07-28 00:54:48 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:54:53.166151546 +0000 UTC m=+90.085752231" watchObservedRunningTime="2026-07-28 00:54:53.166525998 +0000 UTC m=+90.086126682" Jul 28 00:54:53.273067 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:53.272969 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-779fc55d8b-xxb9x"] Jul 28 00:54:53.689968 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:53.689851 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c56774d9c-p829d"] Jul 28 00:54:55.163418 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:55.163375 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-74vc4" event={"ID":"8af8637c-823f-42b5-b67e-0cdb8f030681","Type":"ContainerStarted","Data":"333eaa38a0e23500cd62e32e9cd8021c39ee57149bc1336106d058ad9c4eaab0"} Jul 28 00:54:55.194531 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:54:55.194465 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-74vc4" podStartSLOduration=33.727041522 podStartE2EDuration="46.194448904s" totalImagesPullingTime="12.467407382s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 00:54:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:54:55.192791246 +0000 UTC m=+92.112391932" watchObservedRunningTime="2026-07-28 00:54:55.194448904 +0000 UTC m=+92.114049588" Jul 28 00:55:00.994867 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:00.994824 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-f76c6" Jul 28 00:55:05.902817 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:05.902774 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-ccd77c5c6-prfvp"] Jul 28 00:55:05.910480 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:05.910449 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:05.914485 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:05.914448 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ccd77c5c6-prfvp"] Jul 28 00:55:05.919302 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:05.919261 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 28 00:55:05.996905 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:05.996853 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-console-config\") pod \"console-ccd77c5c6-prfvp\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:05.997124 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:05.997004 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-oauth-serving-cert\") pod \"console-ccd77c5c6-prfvp\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:05.997124 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:05.997070 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-service-ca\") pod \"console-ccd77c5c6-prfvp\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:05.997124 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:05.997107 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-srwvk\" (UniqueName: \"kubernetes.io/projected/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-kube-api-access-srwvk\") pod \"console-ccd77c5c6-prfvp\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:05.997253 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:05.997199 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-console-oauth-config\") pod \"console-ccd77c5c6-prfvp\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:05.997253 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:05.997236 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-trusted-ca-bundle\") pod \"console-ccd77c5c6-prfvp\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:05.997382 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:05.997269 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-console-serving-cert\") pod \"console-ccd77c5c6-prfvp\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:06.098789 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:06.098746 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-trusted-ca-bundle\") pod \"console-ccd77c5c6-prfvp\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:06.098789 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:06.098795 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-console-serving-cert\") pod \"console-ccd77c5c6-prfvp\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:06.099041 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:06.098828 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-console-config\") pod \"console-ccd77c5c6-prfvp\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:06.099041 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:06.098871 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-oauth-serving-cert\") pod \"console-ccd77c5c6-prfvp\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:06.099041 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:06.098900 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-service-ca\") pod \"console-ccd77c5c6-prfvp\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:06.099041 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:06.098932 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-srwvk\" (UniqueName: \"kubernetes.io/projected/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-kube-api-access-srwvk\") pod \"console-ccd77c5c6-prfvp\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:06.099041 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:06.098972 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-console-oauth-config\") pod \"console-ccd77c5c6-prfvp\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:06.099729 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:06.099700 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-console-config\") pod \"console-ccd77c5c6-prfvp\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:06.099855 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:06.099831 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-oauth-serving-cert\") pod \"console-ccd77c5c6-prfvp\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:06.099855 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:06.099838 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-service-ca\") pod \"console-ccd77c5c6-prfvp\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:06.100079 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:06.100055 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-trusted-ca-bundle\") pod \"console-ccd77c5c6-prfvp\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:06.101874 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:06.101853 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-console-oauth-config\") pod \"console-ccd77c5c6-prfvp\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:06.101973 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:06.101872 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-console-serving-cert\") pod \"console-ccd77c5c6-prfvp\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:06.107365 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:06.107333 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-srwvk\" (UniqueName: \"kubernetes.io/projected/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-kube-api-access-srwvk\") pod \"console-ccd77c5c6-prfvp\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:06.224313 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:06.224209 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:06.381050 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:06.381022 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-ccd77c5c6-prfvp"] Jul 28 00:55:06.383864 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:55:06.383823 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f238b36_4c9c_435b_8f28_cd1884f4ecc8.slice/crio-ca75ebf82834d5a7e10d7e9b8e9e6be267eb8afec3ef7097982489cf587f1a5a WatchSource:0}: Error finding container ca75ebf82834d5a7e10d7e9b8e9e6be267eb8afec3ef7097982489cf587f1a5a: Status 404 returned error can't find the container with id ca75ebf82834d5a7e10d7e9b8e9e6be267eb8afec3ef7097982489cf587f1a5a Jul 28 00:55:07.215179 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:07.215143 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ccd77c5c6-prfvp" event={"ID":"1f238b36-4c9c-435b-8f28-cd1884f4ecc8","Type":"ContainerStarted","Data":"fdc2427ca74c9e4b7e2e268a036e34f6315b641a9c3a9577c7630d356875d8be"} Jul 28 00:55:07.215590 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:07.215204 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ccd77c5c6-prfvp" event={"ID":"1f238b36-4c9c-435b-8f28-cd1884f4ecc8","Type":"ContainerStarted","Data":"ca75ebf82834d5a7e10d7e9b8e9e6be267eb8afec3ef7097982489cf587f1a5a"} Jul 28 00:55:07.232554 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:07.232500 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-ccd77c5c6-prfvp" podStartSLOduration=2.232483595 podStartE2EDuration="2.232483595s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:55:05 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:55:07.230530862 +0000 UTC m=+104.150131547" watchObservedRunningTime="2026-07-28 00:55:07.232483595 +0000 UTC m=+104.152084279" Jul 28 00:55:14.245019 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:14.244921 2568 generic.go:356] "Generic (PLEG): container finished" podID="3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c" containerID="79e253ac7249f53a5a6fd49acd7e4a2b3a000036912cd29ff027bcffa1720f4f" exitCode=0 Jul 28 00:55:14.245019 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:14.244999 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk" event={"ID":"3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c","Type":"ContainerDied","Data":"79e253ac7249f53a5a6fd49acd7e4a2b3a000036912cd29ff027bcffa1720f4f"} Jul 28 00:55:14.245456 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:14.245345 2568 scope.go:117] "RemoveContainer" containerID="79e253ac7249f53a5a6fd49acd7e4a2b3a000036912cd29ff027bcffa1720f4f" Jul 28 00:55:15.251234 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:15.251200 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-kube-storage-version-migrator-operator/kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk" event={"ID":"3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c","Type":"ContainerStarted","Data":"a30b461293c4464b272312663e9c26f342eaf2886289c6723db00dcc4a2dcaef"} Jul 28 00:55:16.224775 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:16.224727 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:16.224975 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:16.224804 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:16.229925 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:16.229894 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:16.260021 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:16.259987 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:55:18.295989 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.295915 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" podUID="49e28997-66bd-4404-a70a-63c65cd6a4a3" containerName="registry" containerID="cri-o://ece0015be105cf20d2a697317aeb481636918245149384f10c75af3859bc9f84" gracePeriod=30 Jul 28 00:55:18.580825 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.580733 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:55:18.615878 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.615838 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls\") pod \"49e28997-66bd-4404-a70a-63c65cd6a4a3\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " Jul 28 00:55:18.616067 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.615896 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-frppn\" (UniqueName: \"kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-kube-api-access-frppn\") pod \"49e28997-66bd-4404-a70a-63c65cd6a4a3\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " Jul 28 00:55:18.616067 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.615926 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49e28997-66bd-4404-a70a-63c65cd6a4a3-installation-pull-secrets\") pod \"49e28997-66bd-4404-a70a-63c65cd6a4a3\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " Jul 28 00:55:18.616067 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.615950 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-bound-sa-token\") pod \"49e28997-66bd-4404-a70a-63c65cd6a4a3\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " Jul 28 00:55:18.616067 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.615967 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-certificates\") pod \"49e28997-66bd-4404-a70a-63c65cd6a4a3\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " Jul 28 00:55:18.616067 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.616014 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49e28997-66bd-4404-a70a-63c65cd6a4a3-ca-trust-extracted\") pod \"49e28997-66bd-4404-a70a-63c65cd6a4a3\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " Jul 28 00:55:18.616067 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.616046 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49e28997-66bd-4404-a70a-63c65cd6a4a3-image-registry-private-configuration\") pod \"49e28997-66bd-4404-a70a-63c65cd6a4a3\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " Jul 28 00:55:18.616376 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.616079 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49e28997-66bd-4404-a70a-63c65cd6a4a3-trusted-ca\") pod \"49e28997-66bd-4404-a70a-63c65cd6a4a3\" (UID: \"49e28997-66bd-4404-a70a-63c65cd6a4a3\") " Jul 28 00:55:18.617101 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.616961 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-certificates" (OuterVolumeSpecName: "registry-certificates") pod "49e28997-66bd-4404-a70a-63c65cd6a4a3" (UID: "49e28997-66bd-4404-a70a-63c65cd6a4a3"). InnerVolumeSpecName "registry-certificates". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:55:18.618162 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.618127 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/49e28997-66bd-4404-a70a-63c65cd6a4a3-trusted-ca" (OuterVolumeSpecName: "trusted-ca") pod "49e28997-66bd-4404-a70a-63c65cd6a4a3" (UID: "49e28997-66bd-4404-a70a-63c65cd6a4a3"). InnerVolumeSpecName "trusted-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:55:18.619102 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.619058 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls" (OuterVolumeSpecName: "registry-tls") pod "49e28997-66bd-4404-a70a-63c65cd6a4a3" (UID: "49e28997-66bd-4404-a70a-63c65cd6a4a3"). InnerVolumeSpecName "registry-tls". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:55:18.619364 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.619318 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-bound-sa-token" (OuterVolumeSpecName: "bound-sa-token") pod "49e28997-66bd-4404-a70a-63c65cd6a4a3" (UID: "49e28997-66bd-4404-a70a-63c65cd6a4a3"). InnerVolumeSpecName "bound-sa-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:55:18.619618 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.619557 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-kube-api-access-frppn" (OuterVolumeSpecName: "kube-api-access-frppn") pod "49e28997-66bd-4404-a70a-63c65cd6a4a3" (UID: "49e28997-66bd-4404-a70a-63c65cd6a4a3"). InnerVolumeSpecName "kube-api-access-frppn". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:55:18.619901 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.619866 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49e28997-66bd-4404-a70a-63c65cd6a4a3-image-registry-private-configuration" (OuterVolumeSpecName: "image-registry-private-configuration") pod "49e28997-66bd-4404-a70a-63c65cd6a4a3" (UID: "49e28997-66bd-4404-a70a-63c65cd6a4a3"). InnerVolumeSpecName "image-registry-private-configuration". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:55:18.620450 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.620428 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/49e28997-66bd-4404-a70a-63c65cd6a4a3-installation-pull-secrets" (OuterVolumeSpecName: "installation-pull-secrets") pod "49e28997-66bd-4404-a70a-63c65cd6a4a3" (UID: "49e28997-66bd-4404-a70a-63c65cd6a4a3"). InnerVolumeSpecName "installation-pull-secrets". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:55:18.625738 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.625694 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/49e28997-66bd-4404-a70a-63c65cd6a4a3-ca-trust-extracted" (OuterVolumeSpecName: "ca-trust-extracted") pod "49e28997-66bd-4404-a70a-63c65cd6a4a3" (UID: "49e28997-66bd-4404-a70a-63c65cd6a4a3"). InnerVolumeSpecName "ca-trust-extracted". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:55:18.713936 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.713885 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-6c56774d9c-p829d" podUID="0bd6b899-f2b3-41a4-8356-7e183d87607b" containerName="console" containerID="cri-o://581a4e1ece10b05034ab61d10d2b2afccdbeda6637c00082727b977fcc758f3a" gracePeriod=15 Jul 28 00:55:18.717738 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.717704 2568 reconciler_common.go:299] "Volume detached for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-tls\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:55:18.717738 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.717735 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-frppn\" (UniqueName: \"kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-kube-api-access-frppn\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:55:18.717916 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.717747 2568 reconciler_common.go:299] "Volume detached for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/49e28997-66bd-4404-a70a-63c65cd6a4a3-installation-pull-secrets\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:55:18.717916 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.717757 2568 reconciler_common.go:299] "Volume detached for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/49e28997-66bd-4404-a70a-63c65cd6a4a3-bound-sa-token\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:55:18.717916 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.717766 2568 reconciler_common.go:299] "Volume detached for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/49e28997-66bd-4404-a70a-63c65cd6a4a3-registry-certificates\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:55:18.717916 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.717774 2568 reconciler_common.go:299] "Volume detached for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/49e28997-66bd-4404-a70a-63c65cd6a4a3-ca-trust-extracted\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:55:18.717916 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.717784 2568 reconciler_common.go:299] "Volume detached for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/49e28997-66bd-4404-a70a-63c65cd6a4a3-image-registry-private-configuration\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:55:18.717916 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:18.717794 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/49e28997-66bd-4404-a70a-63c65cd6a4a3-trusted-ca\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:55:19.026820 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.026782 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:55:19.121377 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.121275 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bd6b899-f2b3-41a4-8356-7e183d87607b-console-oauth-config\") pod \"0bd6b899-f2b3-41a4-8356-7e183d87607b\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " Jul 28 00:55:19.121377 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.121321 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bd6b899-f2b3-41a4-8356-7e183d87607b-console-config\") pod \"0bd6b899-f2b3-41a4-8356-7e183d87607b\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " Jul 28 00:55:19.121377 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.121359 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bd6b899-f2b3-41a4-8356-7e183d87607b-console-serving-cert\") pod \"0bd6b899-f2b3-41a4-8356-7e183d87607b\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " Jul 28 00:55:19.121688 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.121388 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bd6b899-f2b3-41a4-8356-7e183d87607b-oauth-serving-cert\") pod \"0bd6b899-f2b3-41a4-8356-7e183d87607b\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " Jul 28 00:55:19.121688 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.121419 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd6b899-f2b3-41a4-8356-7e183d87607b-service-ca\") pod \"0bd6b899-f2b3-41a4-8356-7e183d87607b\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " Jul 28 00:55:19.121688 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.121439 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-rfbsb\" (UniqueName: \"kubernetes.io/projected/0bd6b899-f2b3-41a4-8356-7e183d87607b-kube-api-access-rfbsb\") pod \"0bd6b899-f2b3-41a4-8356-7e183d87607b\" (UID: \"0bd6b899-f2b3-41a4-8356-7e183d87607b\") " Jul 28 00:55:19.121840 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.121743 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bd6b899-f2b3-41a4-8356-7e183d87607b-console-config" (OuterVolumeSpecName: "console-config") pod "0bd6b899-f2b3-41a4-8356-7e183d87607b" (UID: "0bd6b899-f2b3-41a4-8356-7e183d87607b"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:55:19.121902 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.121860 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bd6b899-f2b3-41a4-8356-7e183d87607b-service-ca" (OuterVolumeSpecName: "service-ca") pod "0bd6b899-f2b3-41a4-8356-7e183d87607b" (UID: "0bd6b899-f2b3-41a4-8356-7e183d87607b"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:55:19.121985 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.121955 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/0bd6b899-f2b3-41a4-8356-7e183d87607b-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "0bd6b899-f2b3-41a4-8356-7e183d87607b" (UID: "0bd6b899-f2b3-41a4-8356-7e183d87607b"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:55:19.124072 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.124043 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bd6b899-f2b3-41a4-8356-7e183d87607b-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "0bd6b899-f2b3-41a4-8356-7e183d87607b" (UID: "0bd6b899-f2b3-41a4-8356-7e183d87607b"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:55:19.124072 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.124050 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0bd6b899-f2b3-41a4-8356-7e183d87607b-kube-api-access-rfbsb" (OuterVolumeSpecName: "kube-api-access-rfbsb") pod "0bd6b899-f2b3-41a4-8356-7e183d87607b" (UID: "0bd6b899-f2b3-41a4-8356-7e183d87607b"). InnerVolumeSpecName "kube-api-access-rfbsb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:55:19.124228 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.124099 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/0bd6b899-f2b3-41a4-8356-7e183d87607b-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "0bd6b899-f2b3-41a4-8356-7e183d87607b" (UID: "0bd6b899-f2b3-41a4-8356-7e183d87607b"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:55:19.223094 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.223050 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/0bd6b899-f2b3-41a4-8356-7e183d87607b-console-oauth-config\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:55:19.223094 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.223087 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/0bd6b899-f2b3-41a4-8356-7e183d87607b-console-config\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:55:19.223094 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.223097 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/0bd6b899-f2b3-41a4-8356-7e183d87607b-console-serving-cert\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:55:19.223352 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.223107 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/0bd6b899-f2b3-41a4-8356-7e183d87607b-oauth-serving-cert\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:55:19.223352 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.223119 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/0bd6b899-f2b3-41a4-8356-7e183d87607b-service-ca\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:55:19.223352 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.223127 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-rfbsb\" (UniqueName: \"kubernetes.io/projected/0bd6b899-f2b3-41a4-8356-7e183d87607b-kube-api-access-rfbsb\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:55:19.270392 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.270358 2568 generic.go:356] "Generic (PLEG): container finished" podID="49e28997-66bd-4404-a70a-63c65cd6a4a3" containerID="ece0015be105cf20d2a697317aeb481636918245149384f10c75af3859bc9f84" exitCode=0 Jul 28 00:55:19.270648 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.270408 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" Jul 28 00:55:19.270648 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.270461 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" event={"ID":"49e28997-66bd-4404-a70a-63c65cd6a4a3","Type":"ContainerDied","Data":"ece0015be105cf20d2a697317aeb481636918245149384f10c75af3859bc9f84"} Jul 28 00:55:19.270648 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.270515 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-779fc55d8b-xxb9x" event={"ID":"49e28997-66bd-4404-a70a-63c65cd6a4a3","Type":"ContainerDied","Data":"3b8c7ea72169757c40c16540cf09ca3481d49e74b7da77598dd49af90ccb684a"} Jul 28 00:55:19.270648 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.270539 2568 scope.go:117] "RemoveContainer" containerID="ece0015be105cf20d2a697317aeb481636918245149384f10c75af3859bc9f84" Jul 28 00:55:19.272092 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.272062 2568 generic.go:356] "Generic (PLEG): container finished" podID="0bd6b899-f2b3-41a4-8356-7e183d87607b" containerID="581a4e1ece10b05034ab61d10d2b2afccdbeda6637c00082727b977fcc758f3a" exitCode=0 Jul 28 00:55:19.272221 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.272098 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c56774d9c-p829d" event={"ID":"0bd6b899-f2b3-41a4-8356-7e183d87607b","Type":"ContainerDied","Data":"581a4e1ece10b05034ab61d10d2b2afccdbeda6637c00082727b977fcc758f3a"} Jul 28 00:55:19.272221 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.272113 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6c56774d9c-p829d" Jul 28 00:55:19.272221 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.272155 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6c56774d9c-p829d" event={"ID":"0bd6b899-f2b3-41a4-8356-7e183d87607b","Type":"ContainerDied","Data":"bec4801847d9abca67de0c44557ba25ad31dfcac4fe92e1078908a6fa2c31a83"} Jul 28 00:55:19.282530 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.282315 2568 scope.go:117] "RemoveContainer" containerID="ece0015be105cf20d2a697317aeb481636918245149384f10c75af3859bc9f84" Jul 28 00:55:19.282913 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:55:19.282889 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ece0015be105cf20d2a697317aeb481636918245149384f10c75af3859bc9f84\": container with ID starting with ece0015be105cf20d2a697317aeb481636918245149384f10c75af3859bc9f84 not found: ID does not exist" containerID="ece0015be105cf20d2a697317aeb481636918245149384f10c75af3859bc9f84" Jul 28 00:55:19.282987 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.282922 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ece0015be105cf20d2a697317aeb481636918245149384f10c75af3859bc9f84"} err="failed to get container status \"ece0015be105cf20d2a697317aeb481636918245149384f10c75af3859bc9f84\": rpc error: code = NotFound desc = could not find container \"ece0015be105cf20d2a697317aeb481636918245149384f10c75af3859bc9f84\": container with ID starting with ece0015be105cf20d2a697317aeb481636918245149384f10c75af3859bc9f84 not found: ID does not exist" Jul 28 00:55:19.282987 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.282959 2568 scope.go:117] "RemoveContainer" containerID="581a4e1ece10b05034ab61d10d2b2afccdbeda6637c00082727b977fcc758f3a" Jul 28 00:55:19.292351 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.292330 2568 scope.go:117] "RemoveContainer" containerID="581a4e1ece10b05034ab61d10d2b2afccdbeda6637c00082727b977fcc758f3a" Jul 28 00:55:19.292698 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:55:19.292678 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"581a4e1ece10b05034ab61d10d2b2afccdbeda6637c00082727b977fcc758f3a\": container with ID starting with 581a4e1ece10b05034ab61d10d2b2afccdbeda6637c00082727b977fcc758f3a not found: ID does not exist" containerID="581a4e1ece10b05034ab61d10d2b2afccdbeda6637c00082727b977fcc758f3a" Jul 28 00:55:19.292762 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.292707 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"581a4e1ece10b05034ab61d10d2b2afccdbeda6637c00082727b977fcc758f3a"} err="failed to get container status \"581a4e1ece10b05034ab61d10d2b2afccdbeda6637c00082727b977fcc758f3a\": rpc error: code = NotFound desc = could not find container \"581a4e1ece10b05034ab61d10d2b2afccdbeda6637c00082727b977fcc758f3a\": container with ID starting with 581a4e1ece10b05034ab61d10d2b2afccdbeda6637c00082727b977fcc758f3a not found: ID does not exist" Jul 28 00:55:19.301321 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.301290 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-image-registry/image-registry-779fc55d8b-xxb9x"] Jul 28 00:55:19.309686 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.309653 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-image-registry/image-registry-779fc55d8b-xxb9x"] Jul 28 00:55:19.319844 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.319811 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-6c56774d9c-p829d"] Jul 28 00:55:19.327605 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.327548 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-6c56774d9c-p829d"] Jul 28 00:55:19.532837 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.532804 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0bd6b899-f2b3-41a4-8356-7e183d87607b" path="/var/lib/kubelet/pods/0bd6b899-f2b3-41a4-8356-7e183d87607b/volumes" Jul 28 00:55:19.533225 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:19.533212 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="49e28997-66bd-4404-a70a-63c65cd6a4a3" path="/var/lib/kubelet/pods/49e28997-66bd-4404-a70a-63c65cd6a4a3/volumes" Jul 28 00:55:20.279511 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:20.279476 2568 generic.go:356] "Generic (PLEG): container finished" podID="362e3f3f-7182-40f4-b5c1-1a1b54190669" containerID="6e1698b7101ee1be3d864ecb4ddbe991b7fc6de0e9c5ff955fdbd7eabc7d3cc5" exitCode=0 Jul 28 00:55:20.279711 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:20.279548 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jtg8n" event={"ID":"362e3f3f-7182-40f4-b5c1-1a1b54190669","Type":"ContainerDied","Data":"6e1698b7101ee1be3d864ecb4ddbe991b7fc6de0e9c5ff955fdbd7eabc7d3cc5"} Jul 28 00:55:20.279933 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:20.279917 2568 scope.go:117] "RemoveContainer" containerID="6e1698b7101ee1be3d864ecb4ddbe991b7fc6de0e9c5ff955fdbd7eabc7d3cc5" Jul 28 00:55:21.285659 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:21.285627 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-service-ca-operator/service-ca-operator-5d6c75f84f-jtg8n" event={"ID":"362e3f3f-7182-40f4-b5c1-1a1b54190669","Type":"ContainerStarted","Data":"a53a1ed0ebebf5755f8a355675126fd17da484ec6d74cc4f319acc5e18c600b5"} Jul 28 00:55:39.368029 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:39.367993 2568 generic.go:356] "Generic (PLEG): container finished" podID="80623db8-0901-4f5f-830d-f07ace2f6d05" containerID="2701c6cf9399df174d82e717070853570299802cb46af39421ccbac671ea4c36" exitCode=0 Jul 28 00:55:39.368603 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:39.368077 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-8h8gt" event={"ID":"80623db8-0901-4f5f-830d-f07ace2f6d05","Type":"ContainerDied","Data":"2701c6cf9399df174d82e717070853570299802cb46af39421ccbac671ea4c36"} Jul 28 00:55:39.368603 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:39.368549 2568 scope.go:117] "RemoveContainer" containerID="2701c6cf9399df174d82e717070853570299802cb46af39421ccbac671ea4c36" Jul 28 00:55:40.373737 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:55:40.373698 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-operator-5885fdb759-8h8gt" event={"ID":"80623db8-0901-4f5f-830d-f07ace2f6d05","Type":"ContainerStarted","Data":"f575fa51ad455ec386307115a95d224a8cf07ff5f6a9c721bcc5871aa7649dce"} Jul 28 00:56:20.411905 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.411814 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-896d47fb7-69wkg"] Jul 28 00:56:20.412373 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.412115 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0bd6b899-f2b3-41a4-8356-7e183d87607b" containerName="console" Jul 28 00:56:20.412373 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.412128 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0bd6b899-f2b3-41a4-8356-7e183d87607b" containerName="console" Jul 28 00:56:20.412373 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.412140 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="49e28997-66bd-4404-a70a-63c65cd6a4a3" containerName="registry" Jul 28 00:56:20.412373 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.412146 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="49e28997-66bd-4404-a70a-63c65cd6a4a3" containerName="registry" Jul 28 00:56:20.412373 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.412192 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="49e28997-66bd-4404-a70a-63c65cd6a4a3" containerName="registry" Jul 28 00:56:20.412373 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.412204 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0bd6b899-f2b3-41a4-8356-7e183d87607b" containerName="console" Jul 28 00:56:20.415184 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.415155 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.420843 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.420809 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e808158a-821c-4ead-8d85-1e753a225c66-console-oauth-config\") pod \"console-896d47fb7-69wkg\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.421025 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.420848 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-service-ca\") pod \"console-896d47fb7-69wkg\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.421025 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.420889 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-trusted-ca-bundle\") pod \"console-896d47fb7-69wkg\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.421025 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.420931 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-oauth-serving-cert\") pod \"console-896d47fb7-69wkg\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.421025 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.420973 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-console-config\") pod \"console-896d47fb7-69wkg\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.421226 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.421038 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e808158a-821c-4ead-8d85-1e753a225c66-console-serving-cert\") pod \"console-896d47fb7-69wkg\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.421226 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.421067 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c257d\" (UniqueName: \"kubernetes.io/projected/e808158a-821c-4ead-8d85-1e753a225c66-kube-api-access-c257d\") pod \"console-896d47fb7-69wkg\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.426267 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.426235 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-896d47fb7-69wkg"] Jul 28 00:56:20.522099 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.522051 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-trusted-ca-bundle\") pod \"console-896d47fb7-69wkg\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.522099 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.522095 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-oauth-serving-cert\") pod \"console-896d47fb7-69wkg\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.522362 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.522117 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-console-config\") pod \"console-896d47fb7-69wkg\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.522362 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.522144 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e808158a-821c-4ead-8d85-1e753a225c66-console-serving-cert\") pod \"console-896d47fb7-69wkg\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.522362 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.522167 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c257d\" (UniqueName: \"kubernetes.io/projected/e808158a-821c-4ead-8d85-1e753a225c66-kube-api-access-c257d\") pod \"console-896d47fb7-69wkg\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.522362 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.522216 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e808158a-821c-4ead-8d85-1e753a225c66-console-oauth-config\") pod \"console-896d47fb7-69wkg\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.522362 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.522241 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-service-ca\") pod \"console-896d47fb7-69wkg\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.522910 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.522885 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-oauth-serving-cert\") pod \"console-896d47fb7-69wkg\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.523093 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.523066 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-console-config\") pod \"console-896d47fb7-69wkg\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.523152 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.523102 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-trusted-ca-bundle\") pod \"console-896d47fb7-69wkg\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.523304 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.523281 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-service-ca\") pod \"console-896d47fb7-69wkg\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.524873 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.524845 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e808158a-821c-4ead-8d85-1e753a225c66-console-oauth-config\") pod \"console-896d47fb7-69wkg\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.525028 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.525008 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e808158a-821c-4ead-8d85-1e753a225c66-console-serving-cert\") pod \"console-896d47fb7-69wkg\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.531023 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.530990 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c257d\" (UniqueName: \"kubernetes.io/projected/e808158a-821c-4ead-8d85-1e753a225c66-kube-api-access-c257d\") pod \"console-896d47fb7-69wkg\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.726418 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.726310 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:20.874249 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:20.874224 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-896d47fb7-69wkg"] Jul 28 00:56:20.876614 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:56:20.876579 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode808158a_821c_4ead_8d85_1e753a225c66.slice/crio-7b3796508e4c08baf8c0c6cd1ef8a0cf68e9cf969aed9c085f01d763949cc2eb WatchSource:0}: Error finding container 7b3796508e4c08baf8c0c6cd1ef8a0cf68e9cf969aed9c085f01d763949cc2eb: Status 404 returned error can't find the container with id 7b3796508e4c08baf8c0c6cd1ef8a0cf68e9cf969aed9c085f01d763949cc2eb Jul 28 00:56:21.537296 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:21.537257 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-896d47fb7-69wkg" event={"ID":"e808158a-821c-4ead-8d85-1e753a225c66","Type":"ContainerStarted","Data":"2e0b1a39cc14d9f2ee9deb6f5126fc3fd491ea92cea8e8f29ba3e4dfe5d83012"} Jul 28 00:56:21.537742 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:21.537320 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-896d47fb7-69wkg" event={"ID":"e808158a-821c-4ead-8d85-1e753a225c66","Type":"ContainerStarted","Data":"7b3796508e4c08baf8c0c6cd1ef8a0cf68e9cf969aed9c085f01d763949cc2eb"} Jul 28 00:56:21.555748 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:21.555687 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-896d47fb7-69wkg" podStartSLOduration=1.5556668409999999 podStartE2EDuration="1.555666841s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:56:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:56:21.553881737 +0000 UTC m=+178.473482422" watchObservedRunningTime="2026-07-28 00:56:21.555666841 +0000 UTC m=+178.475267524" Jul 28 00:56:30.727018 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:30.726978 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:30.727496 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:30.727041 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:30.732083 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:30.732055 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:31.577195 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:31.577165 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-896d47fb7-69wkg" Jul 28 00:56:31.620658 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:31.620625 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-ccd77c5c6-prfvp"] Jul 28 00:56:49.938634 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:49.938577 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f"] Jul 28 00:56:49.942130 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:49.942110 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f" Jul 28 00:56:49.944425 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:49.944395 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 28 00:56:49.945391 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:49.945348 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 28 00:56:49.945391 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:49.945350 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-szdkx\"" Jul 28 00:56:49.949950 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:49.949926 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f"] Jul 28 00:56:50.073614 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:50.073548 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f\" (UID: \"6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f" Jul 28 00:56:50.073806 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:50.073622 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f\" (UID: \"6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f" Jul 28 00:56:50.073806 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:50.073715 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ctwph\" (UniqueName: \"kubernetes.io/projected/6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb-kube-api-access-ctwph\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f\" (UID: \"6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f" Jul 28 00:56:50.174922 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:50.174874 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f\" (UID: \"6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f" Jul 28 00:56:50.174922 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:50.174926 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f\" (UID: \"6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f" Jul 28 00:56:50.175162 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:50.174970 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ctwph\" (UniqueName: \"kubernetes.io/projected/6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb-kube-api-access-ctwph\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f\" (UID: \"6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f" Jul 28 00:56:50.175366 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:50.175344 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f\" (UID: \"6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f" Jul 28 00:56:50.175366 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:50.175354 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f\" (UID: \"6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f" Jul 28 00:56:50.183475 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:50.183442 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ctwph\" (UniqueName: \"kubernetes.io/projected/6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb-kube-api-access-ctwph\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f\" (UID: \"6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f" Jul 28 00:56:50.253558 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:50.253464 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f" Jul 28 00:56:50.395644 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:50.395589 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f"] Jul 28 00:56:50.398443 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:56:50.398413 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6af71b0c_6bc3_42ea_92e9_b830aa9a5bdb.slice/crio-1ece1f04e0440e455e17d3eada7b131d42cb6978b4212cb6f71733da85279208 WatchSource:0}: Error finding container 1ece1f04e0440e455e17d3eada7b131d42cb6978b4212cb6f71733da85279208: Status 404 returned error can't find the container with id 1ece1f04e0440e455e17d3eada7b131d42cb6978b4212cb6f71733da85279208 Jul 28 00:56:50.653743 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:50.653694 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f" event={"ID":"6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb","Type":"ContainerStarted","Data":"1ece1f04e0440e455e17d3eada7b131d42cb6978b4212cb6f71733da85279208"} Jul 28 00:56:56.644554 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:56.644501 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-ccd77c5c6-prfvp" podUID="1f238b36-4c9c-435b-8f28-cd1884f4ecc8" containerName="console" containerID="cri-o://fdc2427ca74c9e4b7e2e268a036e34f6315b641a9c3a9577c7630d356875d8be" gracePeriod=15 Jul 28 00:56:57.230035 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.230005 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:56:57.343331 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.343232 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-console-oauth-config\") pod \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " Jul 28 00:56:57.343331 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.343296 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-console-config\") pod \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " Jul 28 00:56:57.343331 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.343328 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-srwvk\" (UniqueName: \"kubernetes.io/projected/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-kube-api-access-srwvk\") pod \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " Jul 28 00:56:57.343641 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.343367 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-console-serving-cert\") pod \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " Jul 28 00:56:57.343641 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.343414 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-service-ca\") pod \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " Jul 28 00:56:57.343641 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.343461 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-trusted-ca-bundle\") pod \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " Jul 28 00:56:57.343641 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.343490 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-oauth-serving-cert\") pod \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\" (UID: \"1f238b36-4c9c-435b-8f28-cd1884f4ecc8\") " Jul 28 00:56:57.343850 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.343811 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-console-config" (OuterVolumeSpecName: "console-config") pod "1f238b36-4c9c-435b-8f28-cd1884f4ecc8" (UID: "1f238b36-4c9c-435b-8f28-cd1884f4ecc8"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:56:57.343914 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.343872 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-service-ca" (OuterVolumeSpecName: "service-ca") pod "1f238b36-4c9c-435b-8f28-cd1884f4ecc8" (UID: "1f238b36-4c9c-435b-8f28-cd1884f4ecc8"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:56:57.344021 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.343997 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1f238b36-4c9c-435b-8f28-cd1884f4ecc8" (UID: "1f238b36-4c9c-435b-8f28-cd1884f4ecc8"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:56:57.344102 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.344056 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1f238b36-4c9c-435b-8f28-cd1884f4ecc8" (UID: "1f238b36-4c9c-435b-8f28-cd1884f4ecc8"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 00:56:57.345816 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.345789 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1f238b36-4c9c-435b-8f28-cd1884f4ecc8" (UID: "1f238b36-4c9c-435b-8f28-cd1884f4ecc8"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:56:57.345816 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.345804 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1f238b36-4c9c-435b-8f28-cd1884f4ecc8" (UID: "1f238b36-4c9c-435b-8f28-cd1884f4ecc8"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 00:56:57.345961 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.345851 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-kube-api-access-srwvk" (OuterVolumeSpecName: "kube-api-access-srwvk") pod "1f238b36-4c9c-435b-8f28-cd1884f4ecc8" (UID: "1f238b36-4c9c-435b-8f28-cd1884f4ecc8"). InnerVolumeSpecName "kube-api-access-srwvk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:56:57.444175 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.444131 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-srwvk\" (UniqueName: \"kubernetes.io/projected/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-kube-api-access-srwvk\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:56:57.444175 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.444162 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-console-serving-cert\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:56:57.444175 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.444171 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-service-ca\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:56:57.444175 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.444181 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-trusted-ca-bundle\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:56:57.444175 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.444189 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-oauth-serving-cert\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:56:57.444460 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.444198 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-console-oauth-config\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:56:57.444460 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.444206 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1f238b36-4c9c-435b-8f28-cd1884f4ecc8-console-config\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:56:57.684995 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.684958 2568 generic.go:356] "Generic (PLEG): container finished" podID="1f238b36-4c9c-435b-8f28-cd1884f4ecc8" containerID="fdc2427ca74c9e4b7e2e268a036e34f6315b641a9c3a9577c7630d356875d8be" exitCode=0 Jul 28 00:56:57.685477 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.685009 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-ccd77c5c6-prfvp" Jul 28 00:56:57.685477 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.685047 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ccd77c5c6-prfvp" event={"ID":"1f238b36-4c9c-435b-8f28-cd1884f4ecc8","Type":"ContainerDied","Data":"fdc2427ca74c9e4b7e2e268a036e34f6315b641a9c3a9577c7630d356875d8be"} Jul 28 00:56:57.685477 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.685099 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-ccd77c5c6-prfvp" event={"ID":"1f238b36-4c9c-435b-8f28-cd1884f4ecc8","Type":"ContainerDied","Data":"ca75ebf82834d5a7e10d7e9b8e9e6be267eb8afec3ef7097982489cf587f1a5a"} Jul 28 00:56:57.685477 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.685126 2568 scope.go:117] "RemoveContainer" containerID="fdc2427ca74c9e4b7e2e268a036e34f6315b641a9c3a9577c7630d356875d8be" Jul 28 00:56:57.686921 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.686895 2568 generic.go:356] "Generic (PLEG): container finished" podID="6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb" containerID="261f74698de90f774348bd3641b54400f4585f5b18952dc86988581cdc21ac2a" exitCode=0 Jul 28 00:56:57.687051 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.686980 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f" event={"ID":"6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb","Type":"ContainerDied","Data":"261f74698de90f774348bd3641b54400f4585f5b18952dc86988581cdc21ac2a"} Jul 28 00:56:57.694397 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.694372 2568 scope.go:117] "RemoveContainer" containerID="fdc2427ca74c9e4b7e2e268a036e34f6315b641a9c3a9577c7630d356875d8be" Jul 28 00:56:57.694752 ip-10-0-132-44 kubenswrapper[2568]: E0728 00:56:57.694729 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fdc2427ca74c9e4b7e2e268a036e34f6315b641a9c3a9577c7630d356875d8be\": container with ID starting with fdc2427ca74c9e4b7e2e268a036e34f6315b641a9c3a9577c7630d356875d8be not found: ID does not exist" containerID="fdc2427ca74c9e4b7e2e268a036e34f6315b641a9c3a9577c7630d356875d8be" Jul 28 00:56:57.694826 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.694762 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fdc2427ca74c9e4b7e2e268a036e34f6315b641a9c3a9577c7630d356875d8be"} err="failed to get container status \"fdc2427ca74c9e4b7e2e268a036e34f6315b641a9c3a9577c7630d356875d8be\": rpc error: code = NotFound desc = could not find container \"fdc2427ca74c9e4b7e2e268a036e34f6315b641a9c3a9577c7630d356875d8be\": container with ID starting with fdc2427ca74c9e4b7e2e268a036e34f6315b641a9c3a9577c7630d356875d8be not found: ID does not exist" Jul 28 00:56:57.714040 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.714001 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-ccd77c5c6-prfvp"] Jul 28 00:56:57.717537 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:57.717503 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-ccd77c5c6-prfvp"] Jul 28 00:56:59.534237 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:56:59.534199 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f238b36-4c9c-435b-8f28-cd1884f4ecc8" path="/var/lib/kubelet/pods/1f238b36-4c9c-435b-8f28-cd1884f4ecc8/volumes" Jul 28 00:57:00.703930 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:00.703891 2568 generic.go:356] "Generic (PLEG): container finished" podID="6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb" containerID="03cfdb25c396e4a15df9f7bb78ab99de7e66b137668fc51b37fa4829d8e24a2d" exitCode=0 Jul 28 00:57:00.704369 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:00.703981 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f" event={"ID":"6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb","Type":"ContainerDied","Data":"03cfdb25c396e4a15df9f7bb78ab99de7e66b137668fc51b37fa4829d8e24a2d"} Jul 28 00:57:08.741925 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:08.741881 2568 generic.go:356] "Generic (PLEG): container finished" podID="6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb" containerID="8d418211fb5130a6ee29741029e643128835b9c8105597ff4c33fa1528f1ef8a" exitCode=0 Jul 28 00:57:08.742310 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:08.741954 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f" event={"ID":"6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb","Type":"ContainerDied","Data":"8d418211fb5130a6ee29741029e643128835b9c8105597ff4c33fa1528f1ef8a"} Jul 28 00:57:09.877247 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:09.877220 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f" Jul 28 00:57:10.053321 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:10.053225 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ctwph\" (UniqueName: \"kubernetes.io/projected/6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb-kube-api-access-ctwph\") pod \"6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb\" (UID: \"6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb\") " Jul 28 00:57:10.053321 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:10.053276 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb-util\") pod \"6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb\" (UID: \"6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb\") " Jul 28 00:57:10.053512 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:10.053336 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb-bundle\") pod \"6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb\" (UID: \"6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb\") " Jul 28 00:57:10.054070 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:10.054036 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb-bundle" (OuterVolumeSpecName: "bundle") pod "6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb" (UID: "6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:57:10.055721 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:10.055693 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb-kube-api-access-ctwph" (OuterVolumeSpecName: "kube-api-access-ctwph") pod "6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb" (UID: "6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb"). InnerVolumeSpecName "kube-api-access-ctwph". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:57:10.059030 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:10.059005 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb-util" (OuterVolumeSpecName: "util") pod "6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb" (UID: "6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:57:10.154730 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:10.154681 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ctwph\" (UniqueName: \"kubernetes.io/projected/6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb-kube-api-access-ctwph\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:57:10.154730 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:10.154727 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb-util\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:57:10.154730 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:10.154739 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb-bundle\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:57:10.751828 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:10.751792 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f" Jul 28 00:57:10.752013 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:10.751786 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540ts55f" event={"ID":"6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb","Type":"ContainerDied","Data":"1ece1f04e0440e455e17d3eada7b131d42cb6978b4212cb6f71733da85279208"} Jul 28 00:57:10.752013 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:10.751930 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="1ece1f04e0440e455e17d3eada7b131d42cb6978b4212cb6f71733da85279208" Jul 28 00:57:18.098592 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.097050 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s24nl"] Jul 28 00:57:18.098592 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.097713 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb" containerName="extract" Jul 28 00:57:18.098592 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.097736 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb" containerName="extract" Jul 28 00:57:18.098592 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.097763 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f238b36-4c9c-435b-8f28-cd1884f4ecc8" containerName="console" Jul 28 00:57:18.098592 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.097772 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f238b36-4c9c-435b-8f28-cd1884f4ecc8" containerName="console" Jul 28 00:57:18.098592 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.097783 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb" containerName="util" Jul 28 00:57:18.098592 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.097792 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb" containerName="util" Jul 28 00:57:18.098592 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.097814 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb" containerName="pull" Jul 28 00:57:18.098592 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.097822 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb" containerName="pull" Jul 28 00:57:18.098592 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.097946 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f238b36-4c9c-435b-8f28-cd1884f4ecc8" containerName="console" Jul 28 00:57:18.098592 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.097962 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6af71b0c-6bc3-42ea-92e9-b830aa9a5bdb" containerName="extract" Jul 28 00:57:18.135702 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.135659 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s24nl"] Jul 28 00:57:18.135880 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.135791 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s24nl" Jul 28 00:57:18.138748 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.138720 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-pvkw5\"" Jul 28 00:57:18.138908 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.138759 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 28 00:57:18.138908 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.138720 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:57:18.323028 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.322990 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nv6xq\" (UniqueName: \"kubernetes.io/projected/ae8475e8-553b-4b4a-87e9-ba0483c2c0ff-kube-api-access-nv6xq\") pod \"cert-manager-operator-controller-manager-55c444bf86-s24nl\" (UID: \"ae8475e8-553b-4b4a-87e9-ba0483c2c0ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s24nl" Jul 28 00:57:18.323028 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.323034 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae8475e8-553b-4b4a-87e9-ba0483c2c0ff-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-s24nl\" (UID: \"ae8475e8-553b-4b4a-87e9-ba0483c2c0ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s24nl" Jul 28 00:57:18.424370 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.424333 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nv6xq\" (UniqueName: \"kubernetes.io/projected/ae8475e8-553b-4b4a-87e9-ba0483c2c0ff-kube-api-access-nv6xq\") pod \"cert-manager-operator-controller-manager-55c444bf86-s24nl\" (UID: \"ae8475e8-553b-4b4a-87e9-ba0483c2c0ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s24nl" Jul 28 00:57:18.424370 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.424373 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae8475e8-553b-4b4a-87e9-ba0483c2c0ff-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-s24nl\" (UID: \"ae8475e8-553b-4b4a-87e9-ba0483c2c0ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s24nl" Jul 28 00:57:18.424742 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.424726 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ae8475e8-553b-4b4a-87e9-ba0483c2c0ff-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-s24nl\" (UID: \"ae8475e8-553b-4b4a-87e9-ba0483c2c0ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s24nl" Jul 28 00:57:18.433868 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.433837 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nv6xq\" (UniqueName: \"kubernetes.io/projected/ae8475e8-553b-4b4a-87e9-ba0483c2c0ff-kube-api-access-nv6xq\") pod \"cert-manager-operator-controller-manager-55c444bf86-s24nl\" (UID: \"ae8475e8-553b-4b4a-87e9-ba0483c2c0ff\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s24nl" Jul 28 00:57:18.445726 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.445692 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s24nl" Jul 28 00:57:18.612496 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.612463 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s24nl"] Jul 28 00:57:18.616526 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:57:18.616495 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae8475e8_553b_4b4a_87e9_ba0483c2c0ff.slice/crio-651945ad821e1d57211a26661dcb6f90967cb9e1ad8b221839b6b6265acc3a05 WatchSource:0}: Error finding container 651945ad821e1d57211a26661dcb6f90967cb9e1ad8b221839b6b6265acc3a05: Status 404 returned error can't find the container with id 651945ad821e1d57211a26661dcb6f90967cb9e1ad8b221839b6b6265acc3a05 Jul 28 00:57:18.789100 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:18.789003 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s24nl" event={"ID":"ae8475e8-553b-4b4a-87e9-ba0483c2c0ff","Type":"ContainerStarted","Data":"651945ad821e1d57211a26661dcb6f90967cb9e1ad8b221839b6b6265acc3a05"} Jul 28 00:57:20.800518 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:20.800486 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s24nl" event={"ID":"ae8475e8-553b-4b4a-87e9-ba0483c2c0ff","Type":"ContainerStarted","Data":"bb02886632642f266c8425d0c4aa34aa3263959b1b0db115dabf6b2bbcdcd7f9"} Jul 28 00:57:20.824999 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:20.824935 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-s24nl" podStartSLOduration=1.117436562 podStartE2EDuration="2.824917187s" totalImagesPullingTime="1.707480625s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:57:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:57:20.824340219 +0000 UTC m=+237.743940903" watchObservedRunningTime="2026-07-28 00:57:20.824917187 +0000 UTC m=+237.744517941" Jul 28 00:57:22.217527 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:22.217488 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx"] Jul 28 00:57:22.219866 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:22.219846 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx" Jul 28 00:57:22.222472 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:22.222452 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-szdkx\"" Jul 28 00:57:22.222631 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:22.222452 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 28 00:57:22.223346 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:22.223322 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 28 00:57:22.230533 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:22.230503 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx"] Jul 28 00:57:22.256993 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:22.256882 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cxdwd\" (UniqueName: \"kubernetes.io/projected/20e7819b-ec14-4610-9760-3fa6dce1ef44-kube-api-access-cxdwd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx\" (UID: \"20e7819b-ec14-4610-9760-3fa6dce1ef44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx" Jul 28 00:57:22.257241 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:22.257044 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20e7819b-ec14-4610-9760-3fa6dce1ef44-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx\" (UID: \"20e7819b-ec14-4610-9760-3fa6dce1ef44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx" Jul 28 00:57:22.257241 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:22.257076 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20e7819b-ec14-4610-9760-3fa6dce1ef44-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx\" (UID: \"20e7819b-ec14-4610-9760-3fa6dce1ef44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx" Jul 28 00:57:22.358088 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:22.358040 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cxdwd\" (UniqueName: \"kubernetes.io/projected/20e7819b-ec14-4610-9760-3fa6dce1ef44-kube-api-access-cxdwd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx\" (UID: \"20e7819b-ec14-4610-9760-3fa6dce1ef44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx" Jul 28 00:57:22.358301 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:22.358117 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20e7819b-ec14-4610-9760-3fa6dce1ef44-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx\" (UID: \"20e7819b-ec14-4610-9760-3fa6dce1ef44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx" Jul 28 00:57:22.358301 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:22.358146 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20e7819b-ec14-4610-9760-3fa6dce1ef44-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx\" (UID: \"20e7819b-ec14-4610-9760-3fa6dce1ef44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx" Jul 28 00:57:22.358537 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:22.358514 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20e7819b-ec14-4610-9760-3fa6dce1ef44-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx\" (UID: \"20e7819b-ec14-4610-9760-3fa6dce1ef44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx" Jul 28 00:57:22.358662 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:22.358556 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20e7819b-ec14-4610-9760-3fa6dce1ef44-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx\" (UID: \"20e7819b-ec14-4610-9760-3fa6dce1ef44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx" Jul 28 00:57:22.370115 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:22.370079 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cxdwd\" (UniqueName: \"kubernetes.io/projected/20e7819b-ec14-4610-9760-3fa6dce1ef44-kube-api-access-cxdwd\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx\" (UID: \"20e7819b-ec14-4610-9760-3fa6dce1ef44\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx" Jul 28 00:57:22.530125 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:22.530030 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx" Jul 28 00:57:22.681526 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:22.681358 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx"] Jul 28 00:57:22.684149 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:57:22.684119 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod20e7819b_ec14_4610_9760_3fa6dce1ef44.slice/crio-111f37dadbf93efa8786b56adc25e71d0c9e0e544920d1fa4d774570e9492270 WatchSource:0}: Error finding container 111f37dadbf93efa8786b56adc25e71d0c9e0e544920d1fa4d774570e9492270: Status 404 returned error can't find the container with id 111f37dadbf93efa8786b56adc25e71d0c9e0e544920d1fa4d774570e9492270 Jul 28 00:57:22.810941 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:22.810905 2568 generic.go:356] "Generic (PLEG): container finished" podID="20e7819b-ec14-4610-9760-3fa6dce1ef44" containerID="6cd4fdf8257a46cdaf7cf8e6fe8498728cb647bc834bf402189ba8041d8f5303" exitCode=0 Jul 28 00:57:22.811117 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:22.810989 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx" event={"ID":"20e7819b-ec14-4610-9760-3fa6dce1ef44","Type":"ContainerDied","Data":"6cd4fdf8257a46cdaf7cf8e6fe8498728cb647bc834bf402189ba8041d8f5303"} Jul 28 00:57:22.811117 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:22.811049 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx" event={"ID":"20e7819b-ec14-4610-9760-3fa6dce1ef44","Type":"ContainerStarted","Data":"111f37dadbf93efa8786b56adc25e71d0c9e0e544920d1fa4d774570e9492270"} Jul 28 00:57:24.743522 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:24.743486 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wcn7d"] Jul 28 00:57:24.747590 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:24.747549 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wcn7d" Jul 28 00:57:24.750014 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:24.749969 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-9xwqh\"" Jul 28 00:57:24.750014 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:24.749968 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 28 00:57:24.750789 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:24.750773 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 28 00:57:24.757150 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:24.757123 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wcn7d"] Jul 28 00:57:24.781193 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:24.781150 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97d5c122-ca16-461d-a5ae-2f4bff74daa4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wcn7d\" (UID: \"97d5c122-ca16-461d-a5ae-2f4bff74daa4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wcn7d" Jul 28 00:57:24.781394 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:24.781205 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-slnx2\" (UniqueName: \"kubernetes.io/projected/97d5c122-ca16-461d-a5ae-2f4bff74daa4-kube-api-access-slnx2\") pod \"cert-manager-cainjector-559cdd8c87-wcn7d\" (UID: \"97d5c122-ca16-461d-a5ae-2f4bff74daa4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wcn7d" Jul 28 00:57:24.823517 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:24.823477 2568 generic.go:356] "Generic (PLEG): container finished" podID="20e7819b-ec14-4610-9760-3fa6dce1ef44" containerID="3e6ed2c8e4694532a974e5996330fd174c564dc2b3fd928cfd54700d2d38432a" exitCode=0 Jul 28 00:57:24.823695 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:24.823555 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx" event={"ID":"20e7819b-ec14-4610-9760-3fa6dce1ef44","Type":"ContainerDied","Data":"3e6ed2c8e4694532a974e5996330fd174c564dc2b3fd928cfd54700d2d38432a"} Jul 28 00:57:24.882009 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:24.881958 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97d5c122-ca16-461d-a5ae-2f4bff74daa4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wcn7d\" (UID: \"97d5c122-ca16-461d-a5ae-2f4bff74daa4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wcn7d" Jul 28 00:57:24.882009 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:24.882005 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-slnx2\" (UniqueName: \"kubernetes.io/projected/97d5c122-ca16-461d-a5ae-2f4bff74daa4-kube-api-access-slnx2\") pod \"cert-manager-cainjector-559cdd8c87-wcn7d\" (UID: \"97d5c122-ca16-461d-a5ae-2f4bff74daa4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wcn7d" Jul 28 00:57:24.890519 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:24.890489 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/97d5c122-ca16-461d-a5ae-2f4bff74daa4-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-wcn7d\" (UID: \"97d5c122-ca16-461d-a5ae-2f4bff74daa4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wcn7d" Jul 28 00:57:24.890671 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:24.890617 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-slnx2\" (UniqueName: \"kubernetes.io/projected/97d5c122-ca16-461d-a5ae-2f4bff74daa4-kube-api-access-slnx2\") pod \"cert-manager-cainjector-559cdd8c87-wcn7d\" (UID: \"97d5c122-ca16-461d-a5ae-2f4bff74daa4\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-wcn7d" Jul 28 00:57:25.067747 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:25.067704 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wcn7d" Jul 28 00:57:25.210848 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:25.210820 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-wcn7d"] Jul 28 00:57:25.213428 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:57:25.213402 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod97d5c122_ca16_461d_a5ae_2f4bff74daa4.slice/crio-b76dbe21f570cf2261e414afe09cca002e091b779784aa33a60053610bfd64b3 WatchSource:0}: Error finding container b76dbe21f570cf2261e414afe09cca002e091b779784aa33a60053610bfd64b3: Status 404 returned error can't find the container with id b76dbe21f570cf2261e414afe09cca002e091b779784aa33a60053610bfd64b3 Jul 28 00:57:25.835124 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:25.835079 2568 generic.go:356] "Generic (PLEG): container finished" podID="20e7819b-ec14-4610-9760-3fa6dce1ef44" containerID="0c0f00b439dcef5fba8af2d5afa962b7bfcedcd20f2916b06680a6dd7051f0d3" exitCode=0 Jul 28 00:57:25.835594 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:25.835167 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx" event={"ID":"20e7819b-ec14-4610-9760-3fa6dce1ef44","Type":"ContainerDied","Data":"0c0f00b439dcef5fba8af2d5afa962b7bfcedcd20f2916b06680a6dd7051f0d3"} Jul 28 00:57:25.836501 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:25.836473 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wcn7d" event={"ID":"97d5c122-ca16-461d-a5ae-2f4bff74daa4","Type":"ContainerStarted","Data":"b76dbe21f570cf2261e414afe09cca002e091b779784aa33a60053610bfd64b3"} Jul 28 00:57:26.985077 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:26.985039 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx" Jul 28 00:57:26.998963 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:26.998928 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20e7819b-ec14-4610-9760-3fa6dce1ef44-bundle\") pod \"20e7819b-ec14-4610-9760-3fa6dce1ef44\" (UID: \"20e7819b-ec14-4610-9760-3fa6dce1ef44\") " Jul 28 00:57:26.999152 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:26.998999 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cxdwd\" (UniqueName: \"kubernetes.io/projected/20e7819b-ec14-4610-9760-3fa6dce1ef44-kube-api-access-cxdwd\") pod \"20e7819b-ec14-4610-9760-3fa6dce1ef44\" (UID: \"20e7819b-ec14-4610-9760-3fa6dce1ef44\") " Jul 28 00:57:26.999152 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:26.999065 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20e7819b-ec14-4610-9760-3fa6dce1ef44-util\") pod \"20e7819b-ec14-4610-9760-3fa6dce1ef44\" (UID: \"20e7819b-ec14-4610-9760-3fa6dce1ef44\") " Jul 28 00:57:26.999532 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:26.999494 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20e7819b-ec14-4610-9760-3fa6dce1ef44-bundle" (OuterVolumeSpecName: "bundle") pod "20e7819b-ec14-4610-9760-3fa6dce1ef44" (UID: "20e7819b-ec14-4610-9760-3fa6dce1ef44"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:57:27.001637 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:27.001605 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/20e7819b-ec14-4610-9760-3fa6dce1ef44-kube-api-access-cxdwd" (OuterVolumeSpecName: "kube-api-access-cxdwd") pod "20e7819b-ec14-4610-9760-3fa6dce1ef44" (UID: "20e7819b-ec14-4610-9760-3fa6dce1ef44"). InnerVolumeSpecName "kube-api-access-cxdwd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:57:27.007294 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:27.007195 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/20e7819b-ec14-4610-9760-3fa6dce1ef44-util" (OuterVolumeSpecName: "util") pod "20e7819b-ec14-4610-9760-3fa6dce1ef44" (UID: "20e7819b-ec14-4610-9760-3fa6dce1ef44"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:57:27.100810 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:27.100720 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/20e7819b-ec14-4610-9760-3fa6dce1ef44-bundle\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:57:27.100810 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:27.100757 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cxdwd\" (UniqueName: \"kubernetes.io/projected/20e7819b-ec14-4610-9760-3fa6dce1ef44-kube-api-access-cxdwd\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:57:27.100810 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:27.100771 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/20e7819b-ec14-4610-9760-3fa6dce1ef44-util\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:57:27.848860 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:27.848775 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx" event={"ID":"20e7819b-ec14-4610-9760-3fa6dce1ef44","Type":"ContainerDied","Data":"111f37dadbf93efa8786b56adc25e71d0c9e0e544920d1fa4d774570e9492270"} Jul 28 00:57:27.848860 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:27.848823 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fhztsx" Jul 28 00:57:27.848860 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:27.848837 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="111f37dadbf93efa8786b56adc25e71d0c9e0e544920d1fa4d774570e9492270" Jul 28 00:57:28.855925 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:28.855886 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wcn7d" event={"ID":"97d5c122-ca16-461d-a5ae-2f4bff74daa4","Type":"ContainerStarted","Data":"0e73c2a5234f5b140ca989dd04cab192e18597bc9466f26bc5eee2607fe63c9e"} Jul 28 00:57:28.873358 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:28.873286 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-wcn7d" podStartSLOduration=1.559176559 podStartE2EDuration="4.873260517s" totalImagesPullingTime="3.314083958s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:57:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:57:28.872046779 +0000 UTC m=+245.791647463" watchObservedRunningTime="2026-07-28 00:57:28.873260517 +0000 UTC m=+245.792861203" Jul 28 00:57:41.466108 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.466067 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj"] Jul 28 00:57:41.466615 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.466361 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20e7819b-ec14-4610-9760-3fa6dce1ef44" containerName="pull" Jul 28 00:57:41.466615 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.466371 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="20e7819b-ec14-4610-9760-3fa6dce1ef44" containerName="pull" Jul 28 00:57:41.466615 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.466382 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20e7819b-ec14-4610-9760-3fa6dce1ef44" containerName="util" Jul 28 00:57:41.466615 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.466388 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="20e7819b-ec14-4610-9760-3fa6dce1ef44" containerName="util" Jul 28 00:57:41.466615 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.466428 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="20e7819b-ec14-4610-9760-3fa6dce1ef44" containerName="extract" Jul 28 00:57:41.466615 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.466434 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="20e7819b-ec14-4610-9760-3fa6dce1ef44" containerName="extract" Jul 28 00:57:41.466615 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.466477 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="20e7819b-ec14-4610-9760-3fa6dce1ef44" containerName="extract" Jul 28 00:57:41.469076 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.469053 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj" Jul 28 00:57:41.471552 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.471524 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 28 00:57:41.472416 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.472394 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 28 00:57:41.472635 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.472468 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-szdkx\"" Jul 28 00:57:41.476901 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.476867 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj"] Jul 28 00:57:41.532466 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.532429 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e6ae941-5acd-4624-bc74-e21f24797acf-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj\" (UID: \"5e6ae941-5acd-4624-bc74-e21f24797acf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj" Jul 28 00:57:41.532466 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.532466 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e6ae941-5acd-4624-bc74-e21f24797acf-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj\" (UID: \"5e6ae941-5acd-4624-bc74-e21f24797acf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj" Jul 28 00:57:41.532708 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.532500 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5hzjw\" (UniqueName: \"kubernetes.io/projected/5e6ae941-5acd-4624-bc74-e21f24797acf-kube-api-access-5hzjw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj\" (UID: \"5e6ae941-5acd-4624-bc74-e21f24797acf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj" Jul 28 00:57:41.633129 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.633076 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5hzjw\" (UniqueName: \"kubernetes.io/projected/5e6ae941-5acd-4624-bc74-e21f24797acf-kube-api-access-5hzjw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj\" (UID: \"5e6ae941-5acd-4624-bc74-e21f24797acf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj" Jul 28 00:57:41.633358 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.633176 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e6ae941-5acd-4624-bc74-e21f24797acf-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj\" (UID: \"5e6ae941-5acd-4624-bc74-e21f24797acf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj" Jul 28 00:57:41.633358 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.633196 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e6ae941-5acd-4624-bc74-e21f24797acf-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj\" (UID: \"5e6ae941-5acd-4624-bc74-e21f24797acf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj" Jul 28 00:57:41.633547 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.633531 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e6ae941-5acd-4624-bc74-e21f24797acf-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj\" (UID: \"5e6ae941-5acd-4624-bc74-e21f24797acf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj" Jul 28 00:57:41.633635 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.633617 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e6ae941-5acd-4624-bc74-e21f24797acf-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj\" (UID: \"5e6ae941-5acd-4624-bc74-e21f24797acf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj" Jul 28 00:57:41.641058 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.641030 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5hzjw\" (UniqueName: \"kubernetes.io/projected/5e6ae941-5acd-4624-bc74-e21f24797acf-kube-api-access-5hzjw\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj\" (UID: \"5e6ae941-5acd-4624-bc74-e21f24797acf\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj" Jul 28 00:57:41.780382 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.780289 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj" Jul 28 00:57:41.924904 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:41.924874 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj"] Jul 28 00:57:41.927845 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:57:41.927811 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e6ae941_5acd_4624_bc74_e21f24797acf.slice/crio-a7fdbc8e49dc4ef505b6dee1ee39bdbcb16422ec25257a44f0029a0036ae5e82 WatchSource:0}: Error finding container a7fdbc8e49dc4ef505b6dee1ee39bdbcb16422ec25257a44f0029a0036ae5e82: Status 404 returned error can't find the container with id a7fdbc8e49dc4ef505b6dee1ee39bdbcb16422ec25257a44f0029a0036ae5e82 Jul 28 00:57:42.923074 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:42.922984 2568 generic.go:356] "Generic (PLEG): container finished" podID="5e6ae941-5acd-4624-bc74-e21f24797acf" containerID="3495e053cea6823f25282a71899da830e9b513655887c530df8f3c478295130d" exitCode=0 Jul 28 00:57:42.923445 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:42.923072 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj" event={"ID":"5e6ae941-5acd-4624-bc74-e21f24797acf","Type":"ContainerDied","Data":"3495e053cea6823f25282a71899da830e9b513655887c530df8f3c478295130d"} Jul 28 00:57:42.923445 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:42.923120 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj" event={"ID":"5e6ae941-5acd-4624-bc74-e21f24797acf","Type":"ContainerStarted","Data":"a7fdbc8e49dc4ef505b6dee1ee39bdbcb16422ec25257a44f0029a0036ae5e82"} Jul 28 00:57:43.018754 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:43.018720 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-55b4d954d5-j6frb"] Jul 28 00:57:43.020846 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:43.020824 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-j6frb" Jul 28 00:57:43.023742 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:43.023716 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-dockercfg-x96vx\"" Jul 28 00:57:43.036122 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:43.036080 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-j6frb"] Jul 28 00:57:43.146402 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:43.146361 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wzd9r\" (UniqueName: \"kubernetes.io/projected/6661337e-6c58-4a6d-8b8d-e6703f78a6f3-kube-api-access-wzd9r\") pod \"cert-manager-55b4d954d5-j6frb\" (UID: \"6661337e-6c58-4a6d-8b8d-e6703f78a6f3\") " pod="cert-manager/cert-manager-55b4d954d5-j6frb" Jul 28 00:57:43.146625 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:43.146434 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6661337e-6c58-4a6d-8b8d-e6703f78a6f3-bound-sa-token\") pod \"cert-manager-55b4d954d5-j6frb\" (UID: \"6661337e-6c58-4a6d-8b8d-e6703f78a6f3\") " pod="cert-manager/cert-manager-55b4d954d5-j6frb" Jul 28 00:57:43.246987 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:43.246891 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wzd9r\" (UniqueName: \"kubernetes.io/projected/6661337e-6c58-4a6d-8b8d-e6703f78a6f3-kube-api-access-wzd9r\") pod \"cert-manager-55b4d954d5-j6frb\" (UID: \"6661337e-6c58-4a6d-8b8d-e6703f78a6f3\") " pod="cert-manager/cert-manager-55b4d954d5-j6frb" Jul 28 00:57:43.246987 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:43.246961 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6661337e-6c58-4a6d-8b8d-e6703f78a6f3-bound-sa-token\") pod \"cert-manager-55b4d954d5-j6frb\" (UID: \"6661337e-6c58-4a6d-8b8d-e6703f78a6f3\") " pod="cert-manager/cert-manager-55b4d954d5-j6frb" Jul 28 00:57:43.255817 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:43.255774 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/6661337e-6c58-4a6d-8b8d-e6703f78a6f3-bound-sa-token\") pod \"cert-manager-55b4d954d5-j6frb\" (UID: \"6661337e-6c58-4a6d-8b8d-e6703f78a6f3\") " pod="cert-manager/cert-manager-55b4d954d5-j6frb" Jul 28 00:57:43.255999 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:43.255936 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wzd9r\" (UniqueName: \"kubernetes.io/projected/6661337e-6c58-4a6d-8b8d-e6703f78a6f3-kube-api-access-wzd9r\") pod \"cert-manager-55b4d954d5-j6frb\" (UID: \"6661337e-6c58-4a6d-8b8d-e6703f78a6f3\") " pod="cert-manager/cert-manager-55b4d954d5-j6frb" Jul 28 00:57:43.331096 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:43.331056 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-55b4d954d5-j6frb" Jul 28 00:57:43.534143 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:43.534117 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-55b4d954d5-j6frb"] Jul 28 00:57:43.563842 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:57:43.563800 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6661337e_6c58_4a6d_8b8d_e6703f78a6f3.slice/crio-e119c9760d60c359a6d534dae47150c20404977f70866a049f07627a10a7a8e9 WatchSource:0}: Error finding container e119c9760d60c359a6d534dae47150c20404977f70866a049f07627a10a7a8e9: Status 404 returned error can't find the container with id e119c9760d60c359a6d534dae47150c20404977f70866a049f07627a10a7a8e9 Jul 28 00:57:43.929472 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:43.929429 2568 generic.go:356] "Generic (PLEG): container finished" podID="5e6ae941-5acd-4624-bc74-e21f24797acf" containerID="9bb6f81c3768137bec2a03ef8440631d4332492404caf79a8203ccc0c99a6744" exitCode=0 Jul 28 00:57:43.929938 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:43.929517 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj" event={"ID":"5e6ae941-5acd-4624-bc74-e21f24797acf","Type":"ContainerDied","Data":"9bb6f81c3768137bec2a03ef8440631d4332492404caf79a8203ccc0c99a6744"} Jul 28 00:57:43.931341 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:43.931311 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-j6frb" event={"ID":"6661337e-6c58-4a6d-8b8d-e6703f78a6f3","Type":"ContainerStarted","Data":"a06d6c173fc296e4e160880a3a73d08aa1b6c9caacfd1932780c9f9acce43879"} Jul 28 00:57:43.931460 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:43.931358 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-55b4d954d5-j6frb" event={"ID":"6661337e-6c58-4a6d-8b8d-e6703f78a6f3","Type":"ContainerStarted","Data":"e119c9760d60c359a6d534dae47150c20404977f70866a049f07627a10a7a8e9"} Jul 28 00:57:43.982053 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:43.981997 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-55b4d954d5-j6frb" podStartSLOduration=0.981973435 podStartE2EDuration="981.973435ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:57:43 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:57:43.980597388 +0000 UTC m=+260.900198092" watchObservedRunningTime="2026-07-28 00:57:43.981973435 +0000 UTC m=+260.901574119" Jul 28 00:57:44.938429 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:44.938394 2568 generic.go:356] "Generic (PLEG): container finished" podID="5e6ae941-5acd-4624-bc74-e21f24797acf" containerID="c14a5059eea0a16bdd2460984ab832347fbbc541ad474f29213aa5f0ce53c9a9" exitCode=0 Jul 28 00:57:44.938921 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:44.938489 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj" event={"ID":"5e6ae941-5acd-4624-bc74-e21f24797acf","Type":"ContainerDied","Data":"c14a5059eea0a16bdd2460984ab832347fbbc541ad474f29213aa5f0ce53c9a9"} Jul 28 00:57:46.084047 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:46.084012 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj" Jul 28 00:57:46.175000 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:46.174955 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e6ae941-5acd-4624-bc74-e21f24797acf-bundle\") pod \"5e6ae941-5acd-4624-bc74-e21f24797acf\" (UID: \"5e6ae941-5acd-4624-bc74-e21f24797acf\") " Jul 28 00:57:46.175000 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:46.175001 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e6ae941-5acd-4624-bc74-e21f24797acf-util\") pod \"5e6ae941-5acd-4624-bc74-e21f24797acf\" (UID: \"5e6ae941-5acd-4624-bc74-e21f24797acf\") " Jul 28 00:57:46.175222 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:46.175076 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5hzjw\" (UniqueName: \"kubernetes.io/projected/5e6ae941-5acd-4624-bc74-e21f24797acf-kube-api-access-5hzjw\") pod \"5e6ae941-5acd-4624-bc74-e21f24797acf\" (UID: \"5e6ae941-5acd-4624-bc74-e21f24797acf\") " Jul 28 00:57:46.175736 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:46.175708 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e6ae941-5acd-4624-bc74-e21f24797acf-bundle" (OuterVolumeSpecName: "bundle") pod "5e6ae941-5acd-4624-bc74-e21f24797acf" (UID: "5e6ae941-5acd-4624-bc74-e21f24797acf"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:57:46.177448 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:46.177415 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e6ae941-5acd-4624-bc74-e21f24797acf-kube-api-access-5hzjw" (OuterVolumeSpecName: "kube-api-access-5hzjw") pod "5e6ae941-5acd-4624-bc74-e21f24797acf" (UID: "5e6ae941-5acd-4624-bc74-e21f24797acf"). InnerVolumeSpecName "kube-api-access-5hzjw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:57:46.181271 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:46.181231 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e6ae941-5acd-4624-bc74-e21f24797acf-util" (OuterVolumeSpecName: "util") pod "5e6ae941-5acd-4624-bc74-e21f24797acf" (UID: "5e6ae941-5acd-4624-bc74-e21f24797acf"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:57:46.275811 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:46.275705 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/5e6ae941-5acd-4624-bc74-e21f24797acf-bundle\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:57:46.275811 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:46.275743 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/5e6ae941-5acd-4624-bc74-e21f24797acf-util\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:57:46.275811 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:46.275760 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5hzjw\" (UniqueName: \"kubernetes.io/projected/5e6ae941-5acd-4624-bc74-e21f24797acf-kube-api-access-5hzjw\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:57:46.949734 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:46.949699 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj" Jul 28 00:57:46.949734 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:46.949709 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afxgjxj" event={"ID":"5e6ae941-5acd-4624-bc74-e21f24797acf","Type":"ContainerDied","Data":"a7fdbc8e49dc4ef505b6dee1ee39bdbcb16422ec25257a44f0029a0036ae5e82"} Jul 28 00:57:46.949944 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:46.949759 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a7fdbc8e49dc4ef505b6dee1ee39bdbcb16422ec25257a44f0029a0036ae5e82" Jul 28 00:57:56.628607 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.628551 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4"] Jul 28 00:57:56.629152 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.629012 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e6ae941-5acd-4624-bc74-e21f24797acf" containerName="extract" Jul 28 00:57:56.629152 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.629030 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e6ae941-5acd-4624-bc74-e21f24797acf" containerName="extract" Jul 28 00:57:56.629152 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.629049 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e6ae941-5acd-4624-bc74-e21f24797acf" containerName="pull" Jul 28 00:57:56.629152 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.629058 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e6ae941-5acd-4624-bc74-e21f24797acf" containerName="pull" Jul 28 00:57:56.629152 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.629076 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e6ae941-5acd-4624-bc74-e21f24797acf" containerName="util" Jul 28 00:57:56.629152 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.629084 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e6ae941-5acd-4624-bc74-e21f24797acf" containerName="util" Jul 28 00:57:56.629523 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.629166 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e6ae941-5acd-4624-bc74-e21f24797acf" containerName="extract" Jul 28 00:57:56.635176 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.635149 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" Jul 28 00:57:56.638114 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.638088 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 28 00:57:56.638767 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.638645 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 28 00:57:56.638767 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.638700 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-cm2gp\"" Jul 28 00:57:56.638767 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.638713 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 28 00:57:56.639098 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.638933 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 28 00:57:56.645663 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.645633 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4"] Jul 28 00:57:56.766020 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.765984 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/705070e0-bce3-4b32-86c9-e4e3b1cb04ac-manifests\") pod \"opendatahub-operator-controller-manager-6549c9954f-4q5q4\" (UID: \"705070e0-bce3-4b32-86c9-e4e3b1cb04ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" Jul 28 00:57:56.766215 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.766049 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/705070e0-bce3-4b32-86c9-e4e3b1cb04ac-webhook-cert\") pod \"opendatahub-operator-controller-manager-6549c9954f-4q5q4\" (UID: \"705070e0-bce3-4b32-86c9-e4e3b1cb04ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" Jul 28 00:57:56.766215 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.766116 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/705070e0-bce3-4b32-86c9-e4e3b1cb04ac-tmp\") pod \"opendatahub-operator-controller-manager-6549c9954f-4q5q4\" (UID: \"705070e0-bce3-4b32-86c9-e4e3b1cb04ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" Jul 28 00:57:56.766215 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.766163 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/705070e0-bce3-4b32-86c9-e4e3b1cb04ac-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6549c9954f-4q5q4\" (UID: \"705070e0-bce3-4b32-86c9-e4e3b1cb04ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" Jul 28 00:57:56.766215 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.766187 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-prsnw\" (UniqueName: \"kubernetes.io/projected/705070e0-bce3-4b32-86c9-e4e3b1cb04ac-kube-api-access-prsnw\") pod \"opendatahub-operator-controller-manager-6549c9954f-4q5q4\" (UID: \"705070e0-bce3-4b32-86c9-e4e3b1cb04ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" Jul 28 00:57:56.867295 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.867252 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/705070e0-bce3-4b32-86c9-e4e3b1cb04ac-tmp\") pod \"opendatahub-operator-controller-manager-6549c9954f-4q5q4\" (UID: \"705070e0-bce3-4b32-86c9-e4e3b1cb04ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" Jul 28 00:57:56.867295 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.867297 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/705070e0-bce3-4b32-86c9-e4e3b1cb04ac-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6549c9954f-4q5q4\" (UID: \"705070e0-bce3-4b32-86c9-e4e3b1cb04ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" Jul 28 00:57:56.867552 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.867314 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-prsnw\" (UniqueName: \"kubernetes.io/projected/705070e0-bce3-4b32-86c9-e4e3b1cb04ac-kube-api-access-prsnw\") pod \"opendatahub-operator-controller-manager-6549c9954f-4q5q4\" (UID: \"705070e0-bce3-4b32-86c9-e4e3b1cb04ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" Jul 28 00:57:56.867552 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.867338 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/705070e0-bce3-4b32-86c9-e4e3b1cb04ac-manifests\") pod \"opendatahub-operator-controller-manager-6549c9954f-4q5q4\" (UID: \"705070e0-bce3-4b32-86c9-e4e3b1cb04ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" Jul 28 00:57:56.867711 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.867545 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/705070e0-bce3-4b32-86c9-e4e3b1cb04ac-webhook-cert\") pod \"opendatahub-operator-controller-manager-6549c9954f-4q5q4\" (UID: \"705070e0-bce3-4b32-86c9-e4e3b1cb04ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" Jul 28 00:57:56.867808 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.867778 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/705070e0-bce3-4b32-86c9-e4e3b1cb04ac-manifests\") pod \"opendatahub-operator-controller-manager-6549c9954f-4q5q4\" (UID: \"705070e0-bce3-4b32-86c9-e4e3b1cb04ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" Jul 28 00:57:56.870138 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.870113 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/705070e0-bce3-4b32-86c9-e4e3b1cb04ac-tmp\") pod \"opendatahub-operator-controller-manager-6549c9954f-4q5q4\" (UID: \"705070e0-bce3-4b32-86c9-e4e3b1cb04ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" Jul 28 00:57:56.870307 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.870283 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/705070e0-bce3-4b32-86c9-e4e3b1cb04ac-webhook-cert\") pod \"opendatahub-operator-controller-manager-6549c9954f-4q5q4\" (UID: \"705070e0-bce3-4b32-86c9-e4e3b1cb04ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" Jul 28 00:57:56.870378 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.870283 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/705070e0-bce3-4b32-86c9-e4e3b1cb04ac-apiservice-cert\") pod \"opendatahub-operator-controller-manager-6549c9954f-4q5q4\" (UID: \"705070e0-bce3-4b32-86c9-e4e3b1cb04ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" Jul 28 00:57:56.875350 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.875320 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-prsnw\" (UniqueName: \"kubernetes.io/projected/705070e0-bce3-4b32-86c9-e4e3b1cb04ac-kube-api-access-prsnw\") pod \"opendatahub-operator-controller-manager-6549c9954f-4q5q4\" (UID: \"705070e0-bce3-4b32-86c9-e4e3b1cb04ac\") " pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" Jul 28 00:57:56.947642 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:56.947526 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" Jul 28 00:57:57.107089 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:57.107062 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4"] Jul 28 00:57:57.109534 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:57:57.109489 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod705070e0_bce3_4b32_86c9_e4e3b1cb04ac.slice/crio-2bb6054210333785d03301a955be4c277d77958a7676ccc4f498b87ede9736c3 WatchSource:0}: Error finding container 2bb6054210333785d03301a955be4c277d77958a7676ccc4f498b87ede9736c3: Status 404 returned error can't find the container with id 2bb6054210333785d03301a955be4c277d77958a7676ccc4f498b87ede9736c3 Jul 28 00:57:58.003134 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:57:58.003093 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" event={"ID":"705070e0-bce3-4b32-86c9-e4e3b1cb04ac","Type":"ContainerStarted","Data":"2bb6054210333785d03301a955be4c277d77958a7676ccc4f498b87ede9736c3"} Jul 28 00:58:01.020941 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:01.020905 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" event={"ID":"705070e0-bce3-4b32-86c9-e4e3b1cb04ac","Type":"ContainerStarted","Data":"6c7c9db336823b23ae959234740bcc641d995f9e94a281d0f216354dfe531039"} Jul 28 00:58:02.029683 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:02.029646 2568 generic.go:356] "Generic (PLEG): container finished" podID="705070e0-bce3-4b32-86c9-e4e3b1cb04ac" containerID="6c7c9db336823b23ae959234740bcc641d995f9e94a281d0f216354dfe531039" exitCode=0 Jul 28 00:58:02.030158 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:02.029742 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" event={"ID":"705070e0-bce3-4b32-86c9-e4e3b1cb04ac","Type":"ContainerDied","Data":"6c7c9db336823b23ae959234740bcc641d995f9e94a281d0f216354dfe531039"} Jul 28 00:58:03.035960 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:03.035875 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" event={"ID":"705070e0-bce3-4b32-86c9-e4e3b1cb04ac","Type":"ContainerStarted","Data":"bfcb8c24eaabd1d884a3e1449b4039fa33d3d931128653b9d0247000f153c345"} Jul 28 00:58:03.036342 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:03.036094 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" Jul 28 00:58:03.060323 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:03.060270 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" podStartSLOduration=2.715545102 podStartE2EDuration="7.060253863s" totalImagesPullingTime="3.268658724s" totalInitContainerRuntime="1.076050037s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:57:56 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:58:03.05823191 +0000 UTC m=+279.977832596" watchObservedRunningTime="2026-07-28 00:58:03.060253863 +0000 UTC m=+279.979854549" Jul 28 00:58:13.862110 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:13.862070 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/lws-controller-manager-6478f6f65f-rmw67"] Jul 28 00:58:13.865062 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:13.865040 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6478f6f65f-rmw67" Jul 28 00:58:13.867541 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:13.867511 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"lws-manager-config\"" Jul 28 00:58:13.868580 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:13.868548 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"metrics-server-cert\"" Jul 28 00:58:13.868688 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:13.868556 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 28 00:58:13.868688 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:13.868556 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"lws-controller-manager-dockercfg-84b42\"" Jul 28 00:58:13.868688 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:13.868634 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"webhook-server-cert\"" Jul 28 00:58:13.868688 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:13.868549 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 28 00:58:13.876601 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:13.876547 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6478f6f65f-rmw67"] Jul 28 00:58:13.905026 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:13.904975 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/db3a8f7b-21fe-4bfb-976a-898f01a9498a-metrics-cert\") pod \"lws-controller-manager-6478f6f65f-rmw67\" (UID: \"db3a8f7b-21fe-4bfb-976a-898f01a9498a\") " pod="openshift-lws-operator/lws-controller-manager-6478f6f65f-rmw67" Jul 28 00:58:13.905234 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:13.905034 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j978\" (UniqueName: \"kubernetes.io/projected/db3a8f7b-21fe-4bfb-976a-898f01a9498a-kube-api-access-8j978\") pod \"lws-controller-manager-6478f6f65f-rmw67\" (UID: \"db3a8f7b-21fe-4bfb-976a-898f01a9498a\") " pod="openshift-lws-operator/lws-controller-manager-6478f6f65f-rmw67" Jul 28 00:58:13.905234 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:13.905065 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/db3a8f7b-21fe-4bfb-976a-898f01a9498a-manager-config\") pod \"lws-controller-manager-6478f6f65f-rmw67\" (UID: \"db3a8f7b-21fe-4bfb-976a-898f01a9498a\") " pod="openshift-lws-operator/lws-controller-manager-6478f6f65f-rmw67" Jul 28 00:58:13.905234 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:13.905128 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db3a8f7b-21fe-4bfb-976a-898f01a9498a-cert\") pod \"lws-controller-manager-6478f6f65f-rmw67\" (UID: \"db3a8f7b-21fe-4bfb-976a-898f01a9498a\") " pod="openshift-lws-operator/lws-controller-manager-6478f6f65f-rmw67" Jul 28 00:58:14.005525 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:14.005481 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/db3a8f7b-21fe-4bfb-976a-898f01a9498a-metrics-cert\") pod \"lws-controller-manager-6478f6f65f-rmw67\" (UID: \"db3a8f7b-21fe-4bfb-976a-898f01a9498a\") " pod="openshift-lws-operator/lws-controller-manager-6478f6f65f-rmw67" Jul 28 00:58:14.005771 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:14.005533 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j978\" (UniqueName: \"kubernetes.io/projected/db3a8f7b-21fe-4bfb-976a-898f01a9498a-kube-api-access-8j978\") pod \"lws-controller-manager-6478f6f65f-rmw67\" (UID: \"db3a8f7b-21fe-4bfb-976a-898f01a9498a\") " pod="openshift-lws-operator/lws-controller-manager-6478f6f65f-rmw67" Jul 28 00:58:14.005771 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:14.005560 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/db3a8f7b-21fe-4bfb-976a-898f01a9498a-manager-config\") pod \"lws-controller-manager-6478f6f65f-rmw67\" (UID: \"db3a8f7b-21fe-4bfb-976a-898f01a9498a\") " pod="openshift-lws-operator/lws-controller-manager-6478f6f65f-rmw67" Jul 28 00:58:14.005771 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:14.005656 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db3a8f7b-21fe-4bfb-976a-898f01a9498a-cert\") pod \"lws-controller-manager-6478f6f65f-rmw67\" (UID: \"db3a8f7b-21fe-4bfb-976a-898f01a9498a\") " pod="openshift-lws-operator/lws-controller-manager-6478f6f65f-rmw67" Jul 28 00:58:14.006291 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:14.006268 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manager-config\" (UniqueName: \"kubernetes.io/configmap/db3a8f7b-21fe-4bfb-976a-898f01a9498a-manager-config\") pod \"lws-controller-manager-6478f6f65f-rmw67\" (UID: \"db3a8f7b-21fe-4bfb-976a-898f01a9498a\") " pod="openshift-lws-operator/lws-controller-manager-6478f6f65f-rmw67" Jul 28 00:58:14.008267 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:14.008239 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-cert\" (UniqueName: \"kubernetes.io/secret/db3a8f7b-21fe-4bfb-976a-898f01a9498a-metrics-cert\") pod \"lws-controller-manager-6478f6f65f-rmw67\" (UID: \"db3a8f7b-21fe-4bfb-976a-898f01a9498a\") " pod="openshift-lws-operator/lws-controller-manager-6478f6f65f-rmw67" Jul 28 00:58:14.008267 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:14.008263 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/db3a8f7b-21fe-4bfb-976a-898f01a9498a-cert\") pod \"lws-controller-manager-6478f6f65f-rmw67\" (UID: \"db3a8f7b-21fe-4bfb-976a-898f01a9498a\") " pod="openshift-lws-operator/lws-controller-manager-6478f6f65f-rmw67" Jul 28 00:58:14.013343 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:14.013310 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j978\" (UniqueName: \"kubernetes.io/projected/db3a8f7b-21fe-4bfb-976a-898f01a9498a-kube-api-access-8j978\") pod \"lws-controller-manager-6478f6f65f-rmw67\" (UID: \"db3a8f7b-21fe-4bfb-976a-898f01a9498a\") " pod="openshift-lws-operator/lws-controller-manager-6478f6f65f-rmw67" Jul 28 00:58:14.043240 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:14.043208 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-6549c9954f-4q5q4" Jul 28 00:58:14.175776 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:14.175669 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/lws-controller-manager-6478f6f65f-rmw67" Jul 28 00:58:14.320836 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:14.320809 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/lws-controller-manager-6478f6f65f-rmw67"] Jul 28 00:58:14.323653 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:58:14.323619 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddb3a8f7b_21fe_4bfb_976a_898f01a9498a.slice/crio-a65ddc3d44844958f62a19bc399c5dd7b6758159673adfec5f252204e3e17553 WatchSource:0}: Error finding container a65ddc3d44844958f62a19bc399c5dd7b6758159673adfec5f252204e3e17553: Status 404 returned error can't find the container with id a65ddc3d44844958f62a19bc399c5dd7b6758159673adfec5f252204e3e17553 Jul 28 00:58:15.094583 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:15.094510 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6478f6f65f-rmw67" event={"ID":"db3a8f7b-21fe-4bfb-976a-898f01a9498a","Type":"ContainerStarted","Data":"a65ddc3d44844958f62a19bc399c5dd7b6758159673adfec5f252204e3e17553"} Jul 28 00:58:16.101046 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:16.101005 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/lws-controller-manager-6478f6f65f-rmw67" event={"ID":"db3a8f7b-21fe-4bfb-976a-898f01a9498a","Type":"ContainerStarted","Data":"e6c53f464d3e3a48dbdb0934dbd2eaef01e190678ef1b1f35e2fba7c92a1b32f"} Jul 28 00:58:16.101511 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:16.101095 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-lws-operator/lws-controller-manager-6478f6f65f-rmw67" Jul 28 00:58:16.137220 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:16.137163 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/lws-controller-manager-6478f6f65f-rmw67" podStartSLOduration=1.567944515 podStartE2EDuration="3.137145082s" totalImagesPullingTime="1.569200567s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:58:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:58:16.13604786 +0000 UTC m=+293.055648546" watchObservedRunningTime="2026-07-28 00:58:16.137145082 +0000 UTC m=+293.056745766" Jul 28 00:58:17.680773 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:17.680727 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-c7b2p"] Jul 28 00:58:17.684252 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:17.684227 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-c7b2p" Jul 28 00:58:17.686849 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:17.686819 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 28 00:58:17.687444 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:17.687428 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-7l44l\"" Jul 28 00:58:17.702068 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:17.702033 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-c7b2p"] Jul 28 00:58:17.738347 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:17.738303 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de75647f-1495-4cea-92e0-756b660541db-tls-certs\") pod \"model-serving-api-54d89bd5fc-c7b2p\" (UID: \"de75647f-1495-4cea-92e0-756b660541db\") " pod="opendatahub/model-serving-api-54d89bd5fc-c7b2p" Jul 28 00:58:17.738527 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:17.738355 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dhtz2\" (UniqueName: \"kubernetes.io/projected/de75647f-1495-4cea-92e0-756b660541db-kube-api-access-dhtz2\") pod \"model-serving-api-54d89bd5fc-c7b2p\" (UID: \"de75647f-1495-4cea-92e0-756b660541db\") " pod="opendatahub/model-serving-api-54d89bd5fc-c7b2p" Jul 28 00:58:17.839020 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:17.838979 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dhtz2\" (UniqueName: \"kubernetes.io/projected/de75647f-1495-4cea-92e0-756b660541db-kube-api-access-dhtz2\") pod \"model-serving-api-54d89bd5fc-c7b2p\" (UID: \"de75647f-1495-4cea-92e0-756b660541db\") " pod="opendatahub/model-serving-api-54d89bd5fc-c7b2p" Jul 28 00:58:17.839196 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:17.839067 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de75647f-1495-4cea-92e0-756b660541db-tls-certs\") pod \"model-serving-api-54d89bd5fc-c7b2p\" (UID: \"de75647f-1495-4cea-92e0-756b660541db\") " pod="opendatahub/model-serving-api-54d89bd5fc-c7b2p" Jul 28 00:58:17.841983 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:17.841953 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/de75647f-1495-4cea-92e0-756b660541db-tls-certs\") pod \"model-serving-api-54d89bd5fc-c7b2p\" (UID: \"de75647f-1495-4cea-92e0-756b660541db\") " pod="opendatahub/model-serving-api-54d89bd5fc-c7b2p" Jul 28 00:58:17.855118 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:17.855077 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dhtz2\" (UniqueName: \"kubernetes.io/projected/de75647f-1495-4cea-92e0-756b660541db-kube-api-access-dhtz2\") pod \"model-serving-api-54d89bd5fc-c7b2p\" (UID: \"de75647f-1495-4cea-92e0-756b660541db\") " pod="opendatahub/model-serving-api-54d89bd5fc-c7b2p" Jul 28 00:58:17.995466 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:17.995367 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-c7b2p" Jul 28 00:58:18.139971 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:18.139944 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-c7b2p"] Jul 28 00:58:18.142320 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:58:18.142289 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podde75647f_1495_4cea_92e0_756b660541db.slice/crio-0151b3bcb1380cd98b2a39ef3593f3d63524a2c1e903e0a892814dd96a9b9b14 WatchSource:0}: Error finding container 0151b3bcb1380cd98b2a39ef3593f3d63524a2c1e903e0a892814dd96a9b9b14: Status 404 returned error can't find the container with id 0151b3bcb1380cd98b2a39ef3593f3d63524a2c1e903e0a892814dd96a9b9b14 Jul 28 00:58:19.119993 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:19.119957 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-c7b2p" event={"ID":"de75647f-1495-4cea-92e0-756b660541db","Type":"ContainerStarted","Data":"0151b3bcb1380cd98b2a39ef3593f3d63524a2c1e903e0a892814dd96a9b9b14"} Jul 28 00:58:20.125711 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:20.125665 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-c7b2p" event={"ID":"de75647f-1495-4cea-92e0-756b660541db","Type":"ContainerStarted","Data":"abfd399b9dbf727be41438fb84894ca18632e69612a93946d16c8353e10f1d1a"} Jul 28 00:58:20.126142 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:20.125783 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-c7b2p" Jul 28 00:58:20.144216 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:20.144154 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-c7b2p" podStartSLOduration=1.558511217 podStartE2EDuration="3.144136317s" totalImagesPullingTime="1.5856251s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:58:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:58:20.142346883 +0000 UTC m=+297.061947566" watchObservedRunningTime="2026-07-28 00:58:20.144136317 +0000 UTC m=+297.063737000" Jul 28 00:58:23.459119 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:23.459091 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 00:58:23.466470 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:23.466439 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 00:58:23.470318 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:23.470290 2568 kubelet.go:1648] "Image garbage collection succeeded" Jul 28 00:58:23.914935 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:23.914895 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc"] Jul 28 00:58:23.919539 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:23.919511 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:23.923450 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:23.923423 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 28 00:58:23.923671 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:23.923654 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-2l5g2\"" Jul 28 00:58:23.932401 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:23.932368 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc"] Jul 28 00:58:23.991205 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:23.991163 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-m9twl\" (UniqueName: \"kubernetes.io/projected/5ecc800e-53fa-4447-8c4f-2ddf23667ada-kube-api-access-m9twl\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:23.991205 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:23.991205 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ecc800e-53fa-4447-8c4f-2ddf23667ada-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:23.991489 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:23.991232 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ecc800e-53fa-4447-8c4f-2ddf23667ada-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:23.991489 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:23.991320 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ecc800e-53fa-4447-8c4f-2ddf23667ada-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:23.991489 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:23.991369 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ecc800e-53fa-4447-8c4f-2ddf23667ada-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:23.991489 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:23.991462 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ecc800e-53fa-4447-8c4f-2ddf23667ada-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:23.991710 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:23.991491 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecc800e-53fa-4447-8c4f-2ddf23667ada-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:23.991710 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:23.991524 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ecc800e-53fa-4447-8c4f-2ddf23667ada-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:23.991710 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:23.991594 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecc800e-53fa-4447-8c4f-2ddf23667ada-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:24.092063 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:24.092023 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ecc800e-53fa-4447-8c4f-2ddf23667ada-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:24.092275 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:24.092084 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ecc800e-53fa-4447-8c4f-2ddf23667ada-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:24.092275 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:24.092113 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecc800e-53fa-4447-8c4f-2ddf23667ada-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:24.092275 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:24.092138 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ecc800e-53fa-4447-8c4f-2ddf23667ada-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:24.092275 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:24.092161 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecc800e-53fa-4447-8c4f-2ddf23667ada-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:24.092275 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:24.092203 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-m9twl\" (UniqueName: \"kubernetes.io/projected/5ecc800e-53fa-4447-8c4f-2ddf23667ada-kube-api-access-m9twl\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:24.092275 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:24.092233 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ecc800e-53fa-4447-8c4f-2ddf23667ada-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:24.092275 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:24.092267 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ecc800e-53fa-4447-8c4f-2ddf23667ada-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:24.092684 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:24.092301 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ecc800e-53fa-4447-8c4f-2ddf23667ada-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:24.092684 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:24.092533 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5ecc800e-53fa-4447-8c4f-2ddf23667ada-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:24.092684 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:24.092593 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecc800e-53fa-4447-8c4f-2ddf23667ada-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:24.092834 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:24.092712 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5ecc800e-53fa-4447-8c4f-2ddf23667ada-istio-data\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:24.092834 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:24.092794 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5ecc800e-53fa-4447-8c4f-2ddf23667ada-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:24.093241 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:24.093211 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5ecc800e-53fa-4447-8c4f-2ddf23667ada-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:24.095022 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:24.094998 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5ecc800e-53fa-4447-8c4f-2ddf23667ada-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:24.095155 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:24.095120 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5ecc800e-53fa-4447-8c4f-2ddf23667ada-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:24.111579 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:24.111528 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-m9twl\" (UniqueName: \"kubernetes.io/projected/5ecc800e-53fa-4447-8c4f-2ddf23667ada-kube-api-access-m9twl\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:24.116036 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:24.116006 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5ecc800e-53fa-4447-8c4f-2ddf23667ada-istio-token\") pod \"data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc\" (UID: \"5ecc800e-53fa-4447-8c4f-2ddf23667ada\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:24.231913 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:24.231809 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:24.406178 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:24.406096 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc"] Jul 28 00:58:24.408683 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:58:24.408648 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5ecc800e_53fa_4447_8c4f_2ddf23667ada.slice/crio-2af02316284cad0185e0528f56750440a485c45f2b0924626df90005bf943d4e WatchSource:0}: Error finding container 2af02316284cad0185e0528f56750440a485c45f2b0924626df90005bf943d4e: Status 404 returned error can't find the container with id 2af02316284cad0185e0528f56750440a485c45f2b0924626df90005bf943d4e Jul 28 00:58:25.151883 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:25.151811 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" event={"ID":"5ecc800e-53fa-4447-8c4f-2ddf23667ada","Type":"ContainerStarted","Data":"2af02316284cad0185e0528f56750440a485c45f2b0924626df90005bf943d4e"} Jul 28 00:58:26.555436 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:26.555394 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-smgdt"] Jul 28 00:58:26.563187 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:26.563149 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smgdt" Jul 28 00:58:26.567165 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:26.567113 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 28 00:58:26.567165 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:26.567163 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-jd86m\"" Jul 28 00:58:26.568693 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:26.568650 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-smgdt"] Jul 28 00:58:26.618492 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:26.618455 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71086811-684d-487b-bf40-c0c1b0f89447-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-smgdt\" (UID: \"71086811-684d-487b-bf40-c0c1b0f89447\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smgdt" Jul 28 00:58:26.618731 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:26.618700 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cmfj6\" (UniqueName: \"kubernetes.io/projected/71086811-684d-487b-bf40-c0c1b0f89447-kube-api-access-cmfj6\") pod \"llmisvc-controller-manager-777c6bd7d5-smgdt\" (UID: \"71086811-684d-487b-bf40-c0c1b0f89447\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smgdt" Jul 28 00:58:26.720294 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:26.720254 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cmfj6\" (UniqueName: \"kubernetes.io/projected/71086811-684d-487b-bf40-c0c1b0f89447-kube-api-access-cmfj6\") pod \"llmisvc-controller-manager-777c6bd7d5-smgdt\" (UID: \"71086811-684d-487b-bf40-c0c1b0f89447\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smgdt" Jul 28 00:58:26.720527 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:26.720308 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71086811-684d-487b-bf40-c0c1b0f89447-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-smgdt\" (UID: \"71086811-684d-487b-bf40-c0c1b0f89447\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smgdt" Jul 28 00:58:26.723393 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:26.723362 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/71086811-684d-487b-bf40-c0c1b0f89447-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-smgdt\" (UID: \"71086811-684d-487b-bf40-c0c1b0f89447\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smgdt" Jul 28 00:58:26.736553 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:26.736519 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cmfj6\" (UniqueName: \"kubernetes.io/projected/71086811-684d-487b-bf40-c0c1b0f89447-kube-api-access-cmfj6\") pod \"llmisvc-controller-manager-777c6bd7d5-smgdt\" (UID: \"71086811-684d-487b-bf40-c0c1b0f89447\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smgdt" Jul 28 00:58:26.879085 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:26.879045 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smgdt" Jul 28 00:58:27.123591 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:27.108501 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-lws-operator/lws-controller-manager-6478f6f65f-rmw67" Jul 28 00:58:27.398160 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:27.398108 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 00:58:27.398307 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:27.398224 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 00:58:27.398307 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:27.398279 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 00:58:27.480980 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:27.480951 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-smgdt"] Jul 28 00:58:27.482910 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:58:27.482879 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod71086811_684d_487b_bf40_c0c1b0f89447.slice/crio-63cf56da9590e171a75ed966d233403bad0b134832d8991cc1ad945f679a6c48 WatchSource:0}: Error finding container 63cf56da9590e171a75ed966d233403bad0b134832d8991cc1ad945f679a6c48: Status 404 returned error can't find the container with id 63cf56da9590e171a75ed966d233403bad0b134832d8991cc1ad945f679a6c48 Jul 28 00:58:27.484327 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:27.484310 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 00:58:28.171410 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:28.171373 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" event={"ID":"5ecc800e-53fa-4447-8c4f-2ddf23667ada","Type":"ContainerStarted","Data":"84884326af3a26036c58d2e1e94b1debc145eee6136f8b4f55efcd37276a222e"} Jul 28 00:58:28.173003 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:28.172972 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smgdt" event={"ID":"71086811-684d-487b-bf40-c0c1b0f89447","Type":"ContainerStarted","Data":"63cf56da9590e171a75ed966d233403bad0b134832d8991cc1ad945f679a6c48"} Jul 28 00:58:28.193828 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:28.193770 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" podStartSLOduration=2.207370762 podStartE2EDuration="5.193751492s" totalImagesPullingTime="2.98638073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:58:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:58:28.192610775 +0000 UTC m=+305.112211460" watchObservedRunningTime="2026-07-28 00:58:28.193751492 +0000 UTC m=+305.113352175" Jul 28 00:58:28.232377 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:28.232334 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:28.237737 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:28.237702 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:29.178811 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:29.178777 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:29.179926 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:29.179909 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc" Jul 28 00:58:31.134913 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:31.134885 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-c7b2p" Jul 28 00:58:31.191204 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:31.191168 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smgdt" event={"ID":"71086811-684d-487b-bf40-c0c1b0f89447","Type":"ContainerStarted","Data":"c7c8d944cd3a41d1a02f12d2cbaac4a2b7ba031bcd464d6415e1815d81a4043a"} Jul 28 00:58:31.191402 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:31.191317 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smgdt" Jul 28 00:58:31.206723 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:58:31.206661 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smgdt" podStartSLOduration=2.194481537 podStartE2EDuration="5.206640554s" totalImagesPullingTime="3.012159017s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:58:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:58:31.205506458 +0000 UTC m=+308.125107155" watchObservedRunningTime="2026-07-28 00:58:31.206640554 +0000 UTC m=+308.126241245" Jul 28 00:59:02.198453 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:02.198417 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-smgdt" Jul 28 00:59:17.750320 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:17.750226 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lw5hf"] Jul 28 00:59:17.752547 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:17.752528 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lw5hf" Jul 28 00:59:17.754851 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:17.754822 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 28 00:59:17.754994 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:17.754970 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 28 00:59:17.755748 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:17.755726 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-2pxbs\"" Jul 28 00:59:17.760603 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:17.760171 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lw5hf"] Jul 28 00:59:17.769586 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:17.769527 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mfqsc\" (UniqueName: \"kubernetes.io/projected/01396ba2-7de9-41a0-b7a4-0c3351d11cdf-kube-api-access-mfqsc\") pod \"kuadrant-operator-catalog-lw5hf\" (UID: \"01396ba2-7de9-41a0-b7a4-0c3351d11cdf\") " pod="kuadrant-system/kuadrant-operator-catalog-lw5hf" Jul 28 00:59:17.870977 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:17.870931 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mfqsc\" (UniqueName: \"kubernetes.io/projected/01396ba2-7de9-41a0-b7a4-0c3351d11cdf-kube-api-access-mfqsc\") pod \"kuadrant-operator-catalog-lw5hf\" (UID: \"01396ba2-7de9-41a0-b7a4-0c3351d11cdf\") " pod="kuadrant-system/kuadrant-operator-catalog-lw5hf" Jul 28 00:59:17.879413 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:17.879378 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mfqsc\" (UniqueName: \"kubernetes.io/projected/01396ba2-7de9-41a0-b7a4-0c3351d11cdf-kube-api-access-mfqsc\") pod \"kuadrant-operator-catalog-lw5hf\" (UID: \"01396ba2-7de9-41a0-b7a4-0c3351d11cdf\") " pod="kuadrant-system/kuadrant-operator-catalog-lw5hf" Jul 28 00:59:18.063519 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:18.063419 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-lw5hf" Jul 28 00:59:18.214534 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:18.214503 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-lw5hf"] Jul 28 00:59:18.217092 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:59:18.217061 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod01396ba2_7de9_41a0_b7a4_0c3351d11cdf.slice/crio-a3bb73b77471aea91625bc752714ce80331f466d170ebae6a4d365c5bbfede49 WatchSource:0}: Error finding container a3bb73b77471aea91625bc752714ce80331f466d170ebae6a4d365c5bbfede49: Status 404 returned error can't find the container with id a3bb73b77471aea91625bc752714ce80331f466d170ebae6a4d365c5bbfede49 Jul 28 00:59:18.416903 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:18.416849 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lw5hf" event={"ID":"01396ba2-7de9-41a0-b7a4-0c3351d11cdf","Type":"ContainerStarted","Data":"a3bb73b77471aea91625bc752714ce80331f466d170ebae6a4d365c5bbfede49"} Jul 28 00:59:20.429121 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:20.429081 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-lw5hf" event={"ID":"01396ba2-7de9-41a0-b7a4-0c3351d11cdf","Type":"ContainerStarted","Data":"38ed2db704305e51d0e9ba7d3dcdc36b11dbfc90310ef305a893d55af8f407a4"} Jul 28 00:59:20.444365 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:20.444294 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-lw5hf" podStartSLOduration=1.339450965 podStartE2EDuration="3.444270168s" totalImagesPullingTime="2.104819203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:59:17 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 00:59:20.442941162 +0000 UTC m=+357.362541847" watchObservedRunningTime="2026-07-28 00:59:20.444270168 +0000 UTC m=+357.363870853" Jul 28 00:59:28.064482 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:28.064436 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kuadrant-system/kuadrant-operator-catalog-lw5hf" Jul 28 00:59:28.064935 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:28.064521 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-catalog-lw5hf" Jul 28 00:59:28.087406 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:28.087375 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kuadrant-system/kuadrant-operator-catalog-lw5hf" Jul 28 00:59:28.492433 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:28.492389 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-catalog-lw5hf" Jul 28 00:59:32.781615 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:32.781555 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd"] Jul 28 00:59:32.786581 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:32.786530 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd" Jul 28 00:59:32.790666 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:32.790631 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vq2f5\"" Jul 28 00:59:32.792625 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:32.792589 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd"] Jul 28 00:59:32.912767 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:32.912724 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/805a0698-5ad7-44f4-b9e6-660bf1cd4621-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd\" (UID: \"805a0698-5ad7-44f4-b9e6-660bf1cd4621\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd" Jul 28 00:59:32.912982 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:32.912776 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/805a0698-5ad7-44f4-b9e6-660bf1cd4621-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd\" (UID: \"805a0698-5ad7-44f4-b9e6-660bf1cd4621\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd" Jul 28 00:59:32.912982 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:32.912900 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n8kxz\" (UniqueName: \"kubernetes.io/projected/805a0698-5ad7-44f4-b9e6-660bf1cd4621-kube-api-access-n8kxz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd\" (UID: \"805a0698-5ad7-44f4-b9e6-660bf1cd4621\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd" Jul 28 00:59:33.014413 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.014365 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n8kxz\" (UniqueName: \"kubernetes.io/projected/805a0698-5ad7-44f4-b9e6-660bf1cd4621-kube-api-access-n8kxz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd\" (UID: \"805a0698-5ad7-44f4-b9e6-660bf1cd4621\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd" Jul 28 00:59:33.014762 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.014445 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/805a0698-5ad7-44f4-b9e6-660bf1cd4621-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd\" (UID: \"805a0698-5ad7-44f4-b9e6-660bf1cd4621\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd" Jul 28 00:59:33.014762 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.014489 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/805a0698-5ad7-44f4-b9e6-660bf1cd4621-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd\" (UID: \"805a0698-5ad7-44f4-b9e6-660bf1cd4621\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd" Jul 28 00:59:33.014900 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.014815 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/805a0698-5ad7-44f4-b9e6-660bf1cd4621-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd\" (UID: \"805a0698-5ad7-44f4-b9e6-660bf1cd4621\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd" Jul 28 00:59:33.014900 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.014868 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/805a0698-5ad7-44f4-b9e6-660bf1cd4621-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd\" (UID: \"805a0698-5ad7-44f4-b9e6-660bf1cd4621\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd" Jul 28 00:59:33.022548 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.022511 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n8kxz\" (UniqueName: \"kubernetes.io/projected/805a0698-5ad7-44f4-b9e6-660bf1cd4621-kube-api-access-n8kxz\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd\" (UID: \"805a0698-5ad7-44f4-b9e6-660bf1cd4621\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd" Jul 28 00:59:33.101089 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.100994 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd" Jul 28 00:59:33.249263 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.249234 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd"] Jul 28 00:59:33.251434 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:59:33.251397 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod805a0698_5ad7_44f4_b9e6_660bf1cd4621.slice/crio-33ce254962b4bb91f11c9d0b32a360469d4b03f89cc5b602b03cfee03f27caa1 WatchSource:0}: Error finding container 33ce254962b4bb91f11c9d0b32a360469d4b03f89cc5b602b03cfee03f27caa1: Status 404 returned error can't find the container with id 33ce254962b4bb91f11c9d0b32a360469d4b03f89cc5b602b03cfee03f27caa1 Jul 28 00:59:33.378008 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.377968 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj"] Jul 28 00:59:33.381473 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.381452 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj" Jul 28 00:59:33.388686 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.388650 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj"] Jul 28 00:59:33.496450 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.496412 2568 generic.go:356] "Generic (PLEG): container finished" podID="805a0698-5ad7-44f4-b9e6-660bf1cd4621" containerID="0a4cce100a3948faee01a0df3d9b0d617b044a912b95314e87b1b1f487cac928" exitCode=0 Jul 28 00:59:33.496661 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.496490 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd" event={"ID":"805a0698-5ad7-44f4-b9e6-660bf1cd4621","Type":"ContainerDied","Data":"0a4cce100a3948faee01a0df3d9b0d617b044a912b95314e87b1b1f487cac928"} Jul 28 00:59:33.496661 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.496609 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd" event={"ID":"805a0698-5ad7-44f4-b9e6-660bf1cd4621","Type":"ContainerStarted","Data":"33ce254962b4bb91f11c9d0b32a360469d4b03f89cc5b602b03cfee03f27caa1"} Jul 28 00:59:33.519273 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.519229 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mjtlh\" (UniqueName: \"kubernetes.io/projected/ef340466-7fcb-42f4-b75a-0a9d763afffd-kube-api-access-mjtlh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj\" (UID: \"ef340466-7fcb-42f4-b75a-0a9d763afffd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj" Jul 28 00:59:33.519273 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.519274 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef340466-7fcb-42f4-b75a-0a9d763afffd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj\" (UID: \"ef340466-7fcb-42f4-b75a-0a9d763afffd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj" Jul 28 00:59:33.519492 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.519302 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef340466-7fcb-42f4-b75a-0a9d763afffd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj\" (UID: \"ef340466-7fcb-42f4-b75a-0a9d763afffd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj" Jul 28 00:59:33.620176 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.620082 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mjtlh\" (UniqueName: \"kubernetes.io/projected/ef340466-7fcb-42f4-b75a-0a9d763afffd-kube-api-access-mjtlh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj\" (UID: \"ef340466-7fcb-42f4-b75a-0a9d763afffd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj" Jul 28 00:59:33.620176 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.620125 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef340466-7fcb-42f4-b75a-0a9d763afffd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj\" (UID: \"ef340466-7fcb-42f4-b75a-0a9d763afffd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj" Jul 28 00:59:33.620176 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.620167 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef340466-7fcb-42f4-b75a-0a9d763afffd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj\" (UID: \"ef340466-7fcb-42f4-b75a-0a9d763afffd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj" Jul 28 00:59:33.620621 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.620586 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef340466-7fcb-42f4-b75a-0a9d763afffd-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj\" (UID: \"ef340466-7fcb-42f4-b75a-0a9d763afffd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj" Jul 28 00:59:33.620621 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.620606 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef340466-7fcb-42f4-b75a-0a9d763afffd-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj\" (UID: \"ef340466-7fcb-42f4-b75a-0a9d763afffd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj" Jul 28 00:59:33.629348 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.629315 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mjtlh\" (UniqueName: \"kubernetes.io/projected/ef340466-7fcb-42f4-b75a-0a9d763afffd-kube-api-access-mjtlh\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj\" (UID: \"ef340466-7fcb-42f4-b75a-0a9d763afffd\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj" Jul 28 00:59:33.734484 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.734445 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj" Jul 28 00:59:33.777449 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.777400 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz"] Jul 28 00:59:33.782583 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.782535 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz" Jul 28 00:59:33.791316 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.791095 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz"] Jul 28 00:59:33.884009 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.883981 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj"] Jul 28 00:59:33.885587 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:59:33.885545 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podef340466_7fcb_42f4_b75a_0a9d763afffd.slice/crio-344d1f5f77000e2c6411155ad22fbe5e81de7b5770689cf8d826ac942e35b037 WatchSource:0}: Error finding container 344d1f5f77000e2c6411155ad22fbe5e81de7b5770689cf8d826ac942e35b037: Status 404 returned error can't find the container with id 344d1f5f77000e2c6411155ad22fbe5e81de7b5770689cf8d826ac942e35b037 Jul 28 00:59:33.922966 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.922937 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2w7rj\" (UniqueName: \"kubernetes.io/projected/fbc5d13d-5d8a-46ff-9fc2-e92a3d721725-kube-api-access-2w7rj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz\" (UID: \"fbc5d13d-5d8a-46ff-9fc2-e92a3d721725\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz" Jul 28 00:59:33.923123 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.922986 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbc5d13d-5d8a-46ff-9fc2-e92a3d721725-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz\" (UID: \"fbc5d13d-5d8a-46ff-9fc2-e92a3d721725\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz" Jul 28 00:59:33.923177 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:33.923132 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbc5d13d-5d8a-46ff-9fc2-e92a3d721725-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz\" (UID: \"fbc5d13d-5d8a-46ff-9fc2-e92a3d721725\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz" Jul 28 00:59:34.023908 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.023866 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbc5d13d-5d8a-46ff-9fc2-e92a3d721725-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz\" (UID: \"fbc5d13d-5d8a-46ff-9fc2-e92a3d721725\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz" Jul 28 00:59:34.024098 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.023950 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2w7rj\" (UniqueName: \"kubernetes.io/projected/fbc5d13d-5d8a-46ff-9fc2-e92a3d721725-kube-api-access-2w7rj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz\" (UID: \"fbc5d13d-5d8a-46ff-9fc2-e92a3d721725\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz" Jul 28 00:59:34.024098 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.023982 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbc5d13d-5d8a-46ff-9fc2-e92a3d721725-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz\" (UID: \"fbc5d13d-5d8a-46ff-9fc2-e92a3d721725\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz" Jul 28 00:59:34.024277 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.024258 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbc5d13d-5d8a-46ff-9fc2-e92a3d721725-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz\" (UID: \"fbc5d13d-5d8a-46ff-9fc2-e92a3d721725\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz" Jul 28 00:59:34.024316 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.024289 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbc5d13d-5d8a-46ff-9fc2-e92a3d721725-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz\" (UID: \"fbc5d13d-5d8a-46ff-9fc2-e92a3d721725\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz" Jul 28 00:59:34.032128 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.032098 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2w7rj\" (UniqueName: \"kubernetes.io/projected/fbc5d13d-5d8a-46ff-9fc2-e92a3d721725-kube-api-access-2w7rj\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz\" (UID: \"fbc5d13d-5d8a-46ff-9fc2-e92a3d721725\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz" Jul 28 00:59:34.098912 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.098873 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz" Jul 28 00:59:34.245786 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.245702 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz"] Jul 28 00:59:34.367222 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:59:34.367172 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfbc5d13d_5d8a_46ff_9fc2_e92a3d721725.slice/crio-bbf6c5effdb5cdd484a4ca80ace9031a67c6ee88e2097bff9d67110d5e9815b1 WatchSource:0}: Error finding container bbf6c5effdb5cdd484a4ca80ace9031a67c6ee88e2097bff9d67110d5e9815b1: Status 404 returned error can't find the container with id bbf6c5effdb5cdd484a4ca80ace9031a67c6ee88e2097bff9d67110d5e9815b1 Jul 28 00:59:34.384343 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.384316 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9"] Jul 28 00:59:34.387827 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.387804 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9" Jul 28 00:59:34.398394 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.398360 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9"] Jul 28 00:59:34.503163 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.503128 2568 generic.go:356] "Generic (PLEG): container finished" podID="ef340466-7fcb-42f4-b75a-0a9d763afffd" containerID="b2e1e43dbdef7121904d6952fc49a2e1c118854968cad9888e79e5b794087530" exitCode=0 Jul 28 00:59:34.503334 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.503234 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj" event={"ID":"ef340466-7fcb-42f4-b75a-0a9d763afffd","Type":"ContainerDied","Data":"b2e1e43dbdef7121904d6952fc49a2e1c118854968cad9888e79e5b794087530"} Jul 28 00:59:34.503334 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.503285 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj" event={"ID":"ef340466-7fcb-42f4-b75a-0a9d763afffd","Type":"ContainerStarted","Data":"344d1f5f77000e2c6411155ad22fbe5e81de7b5770689cf8d826ac942e35b037"} Jul 28 00:59:34.505467 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.505434 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd" event={"ID":"805a0698-5ad7-44f4-b9e6-660bf1cd4621","Type":"ContainerStarted","Data":"82b4aeefd6be1ce2579c1f162ddeafced30bbe34fb7084efc5639c12383e5c5f"} Jul 28 00:59:34.507124 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.507096 2568 generic.go:356] "Generic (PLEG): container finished" podID="fbc5d13d-5d8a-46ff-9fc2-e92a3d721725" containerID="9097ab0b5d7660023df603b5a4572eef16d0bfc8e4395170a705946680f10db8" exitCode=0 Jul 28 00:59:34.507228 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.507165 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz" event={"ID":"fbc5d13d-5d8a-46ff-9fc2-e92a3d721725","Type":"ContainerDied","Data":"9097ab0b5d7660023df603b5a4572eef16d0bfc8e4395170a705946680f10db8"} Jul 28 00:59:34.507228 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.507219 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz" event={"ID":"fbc5d13d-5d8a-46ff-9fc2-e92a3d721725","Type":"ContainerStarted","Data":"bbf6c5effdb5cdd484a4ca80ace9031a67c6ee88e2097bff9d67110d5e9815b1"} Jul 28 00:59:34.528934 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.528898 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/911faba6-b46e-4116-b600-9745dcdb22c0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9\" (UID: \"911faba6-b46e-4116-b600-9745dcdb22c0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9" Jul 28 00:59:34.529079 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.528960 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/911faba6-b46e-4116-b600-9745dcdb22c0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9\" (UID: \"911faba6-b46e-4116-b600-9745dcdb22c0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9" Jul 28 00:59:34.529079 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.529043 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6dcx2\" (UniqueName: \"kubernetes.io/projected/911faba6-b46e-4116-b600-9745dcdb22c0-kube-api-access-6dcx2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9\" (UID: \"911faba6-b46e-4116-b600-9745dcdb22c0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9" Jul 28 00:59:34.629750 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.629716 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/911faba6-b46e-4116-b600-9745dcdb22c0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9\" (UID: \"911faba6-b46e-4116-b600-9745dcdb22c0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9" Jul 28 00:59:34.629904 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.629791 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/911faba6-b46e-4116-b600-9745dcdb22c0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9\" (UID: \"911faba6-b46e-4116-b600-9745dcdb22c0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9" Jul 28 00:59:34.629904 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.629885 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6dcx2\" (UniqueName: \"kubernetes.io/projected/911faba6-b46e-4116-b600-9745dcdb22c0-kube-api-access-6dcx2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9\" (UID: \"911faba6-b46e-4116-b600-9745dcdb22c0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9" Jul 28 00:59:34.630159 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.630130 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/911faba6-b46e-4116-b600-9745dcdb22c0-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9\" (UID: \"911faba6-b46e-4116-b600-9745dcdb22c0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9" Jul 28 00:59:34.630427 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.630404 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/911faba6-b46e-4116-b600-9745dcdb22c0-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9\" (UID: \"911faba6-b46e-4116-b600-9745dcdb22c0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9" Jul 28 00:59:34.637631 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.637604 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6dcx2\" (UniqueName: \"kubernetes.io/projected/911faba6-b46e-4116-b600-9745dcdb22c0-kube-api-access-6dcx2\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9\" (UID: \"911faba6-b46e-4116-b600-9745dcdb22c0\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9" Jul 28 00:59:34.713635 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.713600 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9" Jul 28 00:59:34.863296 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:34.863269 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9"] Jul 28 00:59:34.864796 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:59:34.864771 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod911faba6_b46e_4116_b600_9745dcdb22c0.slice/crio-fdf1a4950653f5d07154367e569c53bae2709f28b06c9fddb830e6e35b257c31 WatchSource:0}: Error finding container fdf1a4950653f5d07154367e569c53bae2709f28b06c9fddb830e6e35b257c31: Status 404 returned error can't find the container with id fdf1a4950653f5d07154367e569c53bae2709f28b06c9fddb830e6e35b257c31 Jul 28 00:59:35.514402 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:35.514301 2568 generic.go:356] "Generic (PLEG): container finished" podID="fbc5d13d-5d8a-46ff-9fc2-e92a3d721725" containerID="b225db010a4f056e7bc5c2c314bccf706b4a777e827122655c20505506ca3177" exitCode=0 Jul 28 00:59:35.514618 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:35.514474 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz" event={"ID":"fbc5d13d-5d8a-46ff-9fc2-e92a3d721725","Type":"ContainerDied","Data":"b225db010a4f056e7bc5c2c314bccf706b4a777e827122655c20505506ca3177"} Jul 28 00:59:35.516270 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:35.516241 2568 generic.go:356] "Generic (PLEG): container finished" podID="911faba6-b46e-4116-b600-9745dcdb22c0" containerID="4bc87266d3ebcc438a56bee802d8560e35c8cb8f3341ed2a3361393e4d76a084" exitCode=0 Jul 28 00:59:35.516389 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:35.516330 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9" event={"ID":"911faba6-b46e-4116-b600-9745dcdb22c0","Type":"ContainerDied","Data":"4bc87266d3ebcc438a56bee802d8560e35c8cb8f3341ed2a3361393e4d76a084"} Jul 28 00:59:35.516443 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:35.516384 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9" event={"ID":"911faba6-b46e-4116-b600-9745dcdb22c0","Type":"ContainerStarted","Data":"fdf1a4950653f5d07154367e569c53bae2709f28b06c9fddb830e6e35b257c31"} Jul 28 00:59:35.519691 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:35.519082 2568 generic.go:356] "Generic (PLEG): container finished" podID="ef340466-7fcb-42f4-b75a-0a9d763afffd" containerID="f724da05810e6abf7dd1a702f8698b690e4d7170ec104c4e9c21d29b8065cb55" exitCode=0 Jul 28 00:59:35.519691 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:35.519239 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj" event={"ID":"ef340466-7fcb-42f4-b75a-0a9d763afffd","Type":"ContainerDied","Data":"f724da05810e6abf7dd1a702f8698b690e4d7170ec104c4e9c21d29b8065cb55"} Jul 28 00:59:35.526299 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:35.526271 2568 generic.go:356] "Generic (PLEG): container finished" podID="805a0698-5ad7-44f4-b9e6-660bf1cd4621" containerID="82b4aeefd6be1ce2579c1f162ddeafced30bbe34fb7084efc5639c12383e5c5f" exitCode=0 Jul 28 00:59:35.526299 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:35.526299 2568 generic.go:356] "Generic (PLEG): container finished" podID="805a0698-5ad7-44f4-b9e6-660bf1cd4621" containerID="bb3cdfd154f633b2aa73a9ac4b56215d52a8f70fba4e1b47cf6f0027167a7724" exitCode=0 Jul 28 00:59:35.526449 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:35.526324 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd" event={"ID":"805a0698-5ad7-44f4-b9e6-660bf1cd4621","Type":"ContainerDied","Data":"82b4aeefd6be1ce2579c1f162ddeafced30bbe34fb7084efc5639c12383e5c5f"} Jul 28 00:59:35.526449 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:35.526363 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd" event={"ID":"805a0698-5ad7-44f4-b9e6-660bf1cd4621","Type":"ContainerDied","Data":"bb3cdfd154f633b2aa73a9ac4b56215d52a8f70fba4e1b47cf6f0027167a7724"} Jul 28 00:59:36.533863 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:36.533755 2568 generic.go:356] "Generic (PLEG): container finished" podID="fbc5d13d-5d8a-46ff-9fc2-e92a3d721725" containerID="88ab34e7fe3648870a810fbb9f8bcbd47db46c0c8938a27665443f0ec3ce308e" exitCode=0 Jul 28 00:59:36.533863 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:36.533823 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz" event={"ID":"fbc5d13d-5d8a-46ff-9fc2-e92a3d721725","Type":"ContainerDied","Data":"88ab34e7fe3648870a810fbb9f8bcbd47db46c0c8938a27665443f0ec3ce308e"} Jul 28 00:59:36.535790 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:36.535758 2568 generic.go:356] "Generic (PLEG): container finished" podID="911faba6-b46e-4116-b600-9745dcdb22c0" containerID="8eff088609c320b7eb3d0776cab68261c4555e356108f6a03a5d8dd86a262d5e" exitCode=0 Jul 28 00:59:36.535945 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:36.535807 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9" event={"ID":"911faba6-b46e-4116-b600-9745dcdb22c0","Type":"ContainerDied","Data":"8eff088609c320b7eb3d0776cab68261c4555e356108f6a03a5d8dd86a262d5e"} Jul 28 00:59:36.538326 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:36.538301 2568 generic.go:356] "Generic (PLEG): container finished" podID="ef340466-7fcb-42f4-b75a-0a9d763afffd" containerID="a4da63a5b5b1cea5043b627c12e4bc4ac3ce0135cf631eed51609e0fd1a1b8eb" exitCode=0 Jul 28 00:59:36.538425 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:36.538376 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj" event={"ID":"ef340466-7fcb-42f4-b75a-0a9d763afffd","Type":"ContainerDied","Data":"a4da63a5b5b1cea5043b627c12e4bc4ac3ce0135cf631eed51609e0fd1a1b8eb"} Jul 28 00:59:36.681706 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:36.681671 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd" Jul 28 00:59:36.749382 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:36.749346 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/805a0698-5ad7-44f4-b9e6-660bf1cd4621-bundle\") pod \"805a0698-5ad7-44f4-b9e6-660bf1cd4621\" (UID: \"805a0698-5ad7-44f4-b9e6-660bf1cd4621\") " Jul 28 00:59:36.749606 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:36.749407 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n8kxz\" (UniqueName: \"kubernetes.io/projected/805a0698-5ad7-44f4-b9e6-660bf1cd4621-kube-api-access-n8kxz\") pod \"805a0698-5ad7-44f4-b9e6-660bf1cd4621\" (UID: \"805a0698-5ad7-44f4-b9e6-660bf1cd4621\") " Jul 28 00:59:36.749606 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:36.749465 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/805a0698-5ad7-44f4-b9e6-660bf1cd4621-util\") pod \"805a0698-5ad7-44f4-b9e6-660bf1cd4621\" (UID: \"805a0698-5ad7-44f4-b9e6-660bf1cd4621\") " Jul 28 00:59:36.750040 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:36.750010 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/805a0698-5ad7-44f4-b9e6-660bf1cd4621-bundle" (OuterVolumeSpecName: "bundle") pod "805a0698-5ad7-44f4-b9e6-660bf1cd4621" (UID: "805a0698-5ad7-44f4-b9e6-660bf1cd4621"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:59:36.752052 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:36.752026 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/805a0698-5ad7-44f4-b9e6-660bf1cd4621-kube-api-access-n8kxz" (OuterVolumeSpecName: "kube-api-access-n8kxz") pod "805a0698-5ad7-44f4-b9e6-660bf1cd4621" (UID: "805a0698-5ad7-44f4-b9e6-660bf1cd4621"). InnerVolumeSpecName "kube-api-access-n8kxz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:59:36.755241 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:36.755213 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/805a0698-5ad7-44f4-b9e6-660bf1cd4621-util" (OuterVolumeSpecName: "util") pod "805a0698-5ad7-44f4-b9e6-660bf1cd4621" (UID: "805a0698-5ad7-44f4-b9e6-660bf1cd4621"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:59:36.850874 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:36.850779 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/805a0698-5ad7-44f4-b9e6-660bf1cd4621-util\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:59:36.850874 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:36.850815 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/805a0698-5ad7-44f4-b9e6-660bf1cd4621-bundle\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:59:36.850874 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:36.850825 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n8kxz\" (UniqueName: \"kubernetes.io/projected/805a0698-5ad7-44f4-b9e6-660bf1cd4621-kube-api-access-n8kxz\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:59:37.545409 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.545377 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd" Jul 28 00:59:37.545409 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.545401 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd" event={"ID":"805a0698-5ad7-44f4-b9e6-660bf1cd4621","Type":"ContainerDied","Data":"33ce254962b4bb91f11c9d0b32a360469d4b03f89cc5b602b03cfee03f27caa1"} Jul 28 00:59:37.545903 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.545452 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="33ce254962b4bb91f11c9d0b32a360469d4b03f89cc5b602b03cfee03f27caa1" Jul 28 00:59:37.547935 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.547903 2568 generic.go:356] "Generic (PLEG): container finished" podID="911faba6-b46e-4116-b600-9745dcdb22c0" containerID="5cf382dbe41ea3b84e36ec64a9dbeb117182081bff0852d2f4469ac6851b80ea" exitCode=0 Jul 28 00:59:37.548096 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.547942 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9" event={"ID":"911faba6-b46e-4116-b600-9745dcdb22c0","Type":"ContainerDied","Data":"5cf382dbe41ea3b84e36ec64a9dbeb117182081bff0852d2f4469ac6851b80ea"} Jul 28 00:59:37.720028 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.719995 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz" Jul 28 00:59:37.722850 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.722825 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj" Jul 28 00:59:37.860413 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.860376 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef340466-7fcb-42f4-b75a-0a9d763afffd-util\") pod \"ef340466-7fcb-42f4-b75a-0a9d763afffd\" (UID: \"ef340466-7fcb-42f4-b75a-0a9d763afffd\") " Jul 28 00:59:37.860632 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.860430 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef340466-7fcb-42f4-b75a-0a9d763afffd-bundle\") pod \"ef340466-7fcb-42f4-b75a-0a9d763afffd\" (UID: \"ef340466-7fcb-42f4-b75a-0a9d763afffd\") " Jul 28 00:59:37.860632 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.860451 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbc5d13d-5d8a-46ff-9fc2-e92a3d721725-util\") pod \"fbc5d13d-5d8a-46ff-9fc2-e92a3d721725\" (UID: \"fbc5d13d-5d8a-46ff-9fc2-e92a3d721725\") " Jul 28 00:59:37.860632 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.860509 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2w7rj\" (UniqueName: \"kubernetes.io/projected/fbc5d13d-5d8a-46ff-9fc2-e92a3d721725-kube-api-access-2w7rj\") pod \"fbc5d13d-5d8a-46ff-9fc2-e92a3d721725\" (UID: \"fbc5d13d-5d8a-46ff-9fc2-e92a3d721725\") " Jul 28 00:59:37.860632 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.860594 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbc5d13d-5d8a-46ff-9fc2-e92a3d721725-bundle\") pod \"fbc5d13d-5d8a-46ff-9fc2-e92a3d721725\" (UID: \"fbc5d13d-5d8a-46ff-9fc2-e92a3d721725\") " Jul 28 00:59:37.860632 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.860623 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mjtlh\" (UniqueName: \"kubernetes.io/projected/ef340466-7fcb-42f4-b75a-0a9d763afffd-kube-api-access-mjtlh\") pod \"ef340466-7fcb-42f4-b75a-0a9d763afffd\" (UID: \"ef340466-7fcb-42f4-b75a-0a9d763afffd\") " Jul 28 00:59:37.861101 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.861071 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef340466-7fcb-42f4-b75a-0a9d763afffd-bundle" (OuterVolumeSpecName: "bundle") pod "ef340466-7fcb-42f4-b75a-0a9d763afffd" (UID: "ef340466-7fcb-42f4-b75a-0a9d763afffd"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:59:37.861536 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.861505 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbc5d13d-5d8a-46ff-9fc2-e92a3d721725-bundle" (OuterVolumeSpecName: "bundle") pod "fbc5d13d-5d8a-46ff-9fc2-e92a3d721725" (UID: "fbc5d13d-5d8a-46ff-9fc2-e92a3d721725"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:59:37.863196 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.863160 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ef340466-7fcb-42f4-b75a-0a9d763afffd-kube-api-access-mjtlh" (OuterVolumeSpecName: "kube-api-access-mjtlh") pod "ef340466-7fcb-42f4-b75a-0a9d763afffd" (UID: "ef340466-7fcb-42f4-b75a-0a9d763afffd"). InnerVolumeSpecName "kube-api-access-mjtlh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:59:37.863327 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.863257 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fbc5d13d-5d8a-46ff-9fc2-e92a3d721725-kube-api-access-2w7rj" (OuterVolumeSpecName: "kube-api-access-2w7rj") pod "fbc5d13d-5d8a-46ff-9fc2-e92a3d721725" (UID: "fbc5d13d-5d8a-46ff-9fc2-e92a3d721725"). InnerVolumeSpecName "kube-api-access-2w7rj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:59:37.866236 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.866183 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ef340466-7fcb-42f4-b75a-0a9d763afffd-util" (OuterVolumeSpecName: "util") pod "ef340466-7fcb-42f4-b75a-0a9d763afffd" (UID: "ef340466-7fcb-42f4-b75a-0a9d763afffd"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:59:37.867276 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.867247 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fbc5d13d-5d8a-46ff-9fc2-e92a3d721725-util" (OuterVolumeSpecName: "util") pod "fbc5d13d-5d8a-46ff-9fc2-e92a3d721725" (UID: "fbc5d13d-5d8a-46ff-9fc2-e92a3d721725"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:59:37.961737 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.961694 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/fbc5d13d-5d8a-46ff-9fc2-e92a3d721725-bundle\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:59:37.961737 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.961728 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mjtlh\" (UniqueName: \"kubernetes.io/projected/ef340466-7fcb-42f4-b75a-0a9d763afffd-kube-api-access-mjtlh\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:59:37.961737 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.961737 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ef340466-7fcb-42f4-b75a-0a9d763afffd-util\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:59:37.961737 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.961746 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ef340466-7fcb-42f4-b75a-0a9d763afffd-bundle\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:59:37.962068 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.961754 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/fbc5d13d-5d8a-46ff-9fc2-e92a3d721725-util\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:59:37.962068 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:37.961764 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2w7rj\" (UniqueName: \"kubernetes.io/projected/fbc5d13d-5d8a-46ff-9fc2-e92a3d721725-kube-api-access-2w7rj\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:59:38.561252 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:38.561217 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz" Jul 28 00:59:38.561252 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:38.561243 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz" event={"ID":"fbc5d13d-5d8a-46ff-9fc2-e92a3d721725","Type":"ContainerDied","Data":"bbf6c5effdb5cdd484a4ca80ace9031a67c6ee88e2097bff9d67110d5e9815b1"} Jul 28 00:59:38.561802 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:38.561329 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bbf6c5effdb5cdd484a4ca80ace9031a67c6ee88e2097bff9d67110d5e9815b1" Jul 28 00:59:38.563393 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:38.563369 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj" Jul 28 00:59:38.563578 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:38.563395 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj" event={"ID":"ef340466-7fcb-42f4-b75a-0a9d763afffd","Type":"ContainerDied","Data":"344d1f5f77000e2c6411155ad22fbe5e81de7b5770689cf8d826ac942e35b037"} Jul 28 00:59:38.563578 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:38.563443 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="344d1f5f77000e2c6411155ad22fbe5e81de7b5770689cf8d826ac942e35b037" Jul 28 00:59:38.705989 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:38.705958 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9" Jul 28 00:59:38.869447 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:38.869408 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/911faba6-b46e-4116-b600-9745dcdb22c0-util\") pod \"911faba6-b46e-4116-b600-9745dcdb22c0\" (UID: \"911faba6-b46e-4116-b600-9745dcdb22c0\") " Jul 28 00:59:38.869645 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:38.869468 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6dcx2\" (UniqueName: \"kubernetes.io/projected/911faba6-b46e-4116-b600-9745dcdb22c0-kube-api-access-6dcx2\") pod \"911faba6-b46e-4116-b600-9745dcdb22c0\" (UID: \"911faba6-b46e-4116-b600-9745dcdb22c0\") " Jul 28 00:59:38.869645 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:38.869532 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/911faba6-b46e-4116-b600-9745dcdb22c0-bundle\") pod \"911faba6-b46e-4116-b600-9745dcdb22c0\" (UID: \"911faba6-b46e-4116-b600-9745dcdb22c0\") " Jul 28 00:59:38.870020 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:38.869986 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/911faba6-b46e-4116-b600-9745dcdb22c0-bundle" (OuterVolumeSpecName: "bundle") pod "911faba6-b46e-4116-b600-9745dcdb22c0" (UID: "911faba6-b46e-4116-b600-9745dcdb22c0"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:59:38.871993 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:38.871968 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/911faba6-b46e-4116-b600-9745dcdb22c0-kube-api-access-6dcx2" (OuterVolumeSpecName: "kube-api-access-6dcx2") pod "911faba6-b46e-4116-b600-9745dcdb22c0" (UID: "911faba6-b46e-4116-b600-9745dcdb22c0"). InnerVolumeSpecName "kube-api-access-6dcx2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 00:59:38.875291 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:38.875262 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/911faba6-b46e-4116-b600-9745dcdb22c0-util" (OuterVolumeSpecName: "util") pod "911faba6-b46e-4116-b600-9745dcdb22c0" (UID: "911faba6-b46e-4116-b600-9745dcdb22c0"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 00:59:38.970274 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:38.970218 2568 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/911faba6-b46e-4116-b600-9745dcdb22c0-util\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:59:38.970274 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:38.970265 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6dcx2\" (UniqueName: \"kubernetes.io/projected/911faba6-b46e-4116-b600-9745dcdb22c0-kube-api-access-6dcx2\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:59:38.970274 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:38.970277 2568 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/911faba6-b46e-4116-b600-9745dcdb22c0-bundle\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 00:59:39.570811 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:39.570772 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9" event={"ID":"911faba6-b46e-4116-b600-9745dcdb22c0","Type":"ContainerDied","Data":"fdf1a4950653f5d07154367e569c53bae2709f28b06c9fddb830e6e35b257c31"} Jul 28 00:59:39.570811 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:39.570804 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9" Jul 28 00:59:39.571244 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:39.570836 2568 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="fdf1a4950653f5d07154367e569c53bae2709f28b06c9fddb830e6e35b257c31" Jul 28 00:59:54.311797 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.311758 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5"] Jul 28 00:59:54.312205 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312117 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="911faba6-b46e-4116-b600-9745dcdb22c0" containerName="util" Jul 28 00:59:54.312205 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312130 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="911faba6-b46e-4116-b600-9745dcdb22c0" containerName="util" Jul 28 00:59:54.312205 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312142 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef340466-7fcb-42f4-b75a-0a9d763afffd" containerName="extract" Jul 28 00:59:54.312205 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312147 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef340466-7fcb-42f4-b75a-0a9d763afffd" containerName="extract" Jul 28 00:59:54.312205 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312153 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="805a0698-5ad7-44f4-b9e6-660bf1cd4621" containerName="pull" Jul 28 00:59:54.312205 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312159 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="805a0698-5ad7-44f4-b9e6-660bf1cd4621" containerName="pull" Jul 28 00:59:54.312205 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312171 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef340466-7fcb-42f4-b75a-0a9d763afffd" containerName="pull" Jul 28 00:59:54.312205 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312176 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef340466-7fcb-42f4-b75a-0a9d763afffd" containerName="pull" Jul 28 00:59:54.312205 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312182 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="911faba6-b46e-4116-b600-9745dcdb22c0" containerName="pull" Jul 28 00:59:54.312205 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312187 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="911faba6-b46e-4116-b600-9745dcdb22c0" containerName="pull" Jul 28 00:59:54.312205 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312192 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="805a0698-5ad7-44f4-b9e6-660bf1cd4621" containerName="util" Jul 28 00:59:54.312205 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312199 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="805a0698-5ad7-44f4-b9e6-660bf1cd4621" containerName="util" Jul 28 00:59:54.312205 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312205 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbc5d13d-5d8a-46ff-9fc2-e92a3d721725" containerName="util" Jul 28 00:59:54.312205 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312210 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbc5d13d-5d8a-46ff-9fc2-e92a3d721725" containerName="util" Jul 28 00:59:54.312645 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312217 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="805a0698-5ad7-44f4-b9e6-660bf1cd4621" containerName="extract" Jul 28 00:59:54.312645 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312222 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="805a0698-5ad7-44f4-b9e6-660bf1cd4621" containerName="extract" Jul 28 00:59:54.312645 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312228 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbc5d13d-5d8a-46ff-9fc2-e92a3d721725" containerName="extract" Jul 28 00:59:54.312645 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312234 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbc5d13d-5d8a-46ff-9fc2-e92a3d721725" containerName="extract" Jul 28 00:59:54.312645 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312239 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="911faba6-b46e-4116-b600-9745dcdb22c0" containerName="extract" Jul 28 00:59:54.312645 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312246 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="911faba6-b46e-4116-b600-9745dcdb22c0" containerName="extract" Jul 28 00:59:54.312645 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312255 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ef340466-7fcb-42f4-b75a-0a9d763afffd" containerName="util" Jul 28 00:59:54.312645 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312260 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ef340466-7fcb-42f4-b75a-0a9d763afffd" containerName="util" Jul 28 00:59:54.312645 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312266 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fbc5d13d-5d8a-46ff-9fc2-e92a3d721725" containerName="pull" Jul 28 00:59:54.312645 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312271 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fbc5d13d-5d8a-46ff-9fc2-e92a3d721725" containerName="pull" Jul 28 00:59:54.312645 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312322 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fbc5d13d-5d8a-46ff-9fc2-e92a3d721725" containerName="extract" Jul 28 00:59:54.312645 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312330 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="805a0698-5ad7-44f4-b9e6-660bf1cd4621" containerName="extract" Jul 28 00:59:54.312645 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312336 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="911faba6-b46e-4116-b600-9745dcdb22c0" containerName="extract" Jul 28 00:59:54.312645 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.312342 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ef340466-7fcb-42f4-b75a-0a9d763afffd" containerName="extract" Jul 28 00:59:54.317409 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.317385 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5" Jul 28 00:59:54.320200 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.320164 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-t94kv\"" Jul 28 00:59:54.328426 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.328378 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5"] Jul 28 00:59:54.412075 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.412038 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f6a9825-9a16-466f-9429-f9089a60b4da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7cdc5\" (UID: \"1f6a9825-9a16-466f-9429-f9089a60b4da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5" Jul 28 00:59:54.412246 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.412104 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qw66z\" (UniqueName: \"kubernetes.io/projected/1f6a9825-9a16-466f-9429-f9089a60b4da-kube-api-access-qw66z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7cdc5\" (UID: \"1f6a9825-9a16-466f-9429-f9089a60b4da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5" Jul 28 00:59:54.512502 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.512451 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f6a9825-9a16-466f-9429-f9089a60b4da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7cdc5\" (UID: \"1f6a9825-9a16-466f-9429-f9089a60b4da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5" Jul 28 00:59:54.512715 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.512520 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qw66z\" (UniqueName: \"kubernetes.io/projected/1f6a9825-9a16-466f-9429-f9089a60b4da-kube-api-access-qw66z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7cdc5\" (UID: \"1f6a9825-9a16-466f-9429-f9089a60b4da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5" Jul 28 00:59:54.512869 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.512845 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f6a9825-9a16-466f-9429-f9089a60b4da-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7cdc5\" (UID: \"1f6a9825-9a16-466f-9429-f9089a60b4da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5" Jul 28 00:59:54.520727 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.520699 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qw66z\" (UniqueName: \"kubernetes.io/projected/1f6a9825-9a16-466f-9429-f9089a60b4da-kube-api-access-qw66z\") pod \"kuadrant-operator-controller-manager-8684c9ff49-7cdc5\" (UID: \"1f6a9825-9a16-466f-9429-f9089a60b4da\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5" Jul 28 00:59:54.630406 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.630363 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5" Jul 28 00:59:54.788035 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:54.787824 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5"] Jul 28 00:59:54.791081 ip-10-0-132-44 kubenswrapper[2568]: W0728 00:59:54.791045 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1f6a9825_9a16_466f_9429_f9089a60b4da.slice/crio-46e80a4769d6ca0502e690a4601bdbb6e9dd6879a6853fd4f70eede72fdf5ab5 WatchSource:0}: Error finding container 46e80a4769d6ca0502e690a4601bdbb6e9dd6879a6853fd4f70eede72fdf5ab5: Status 404 returned error can't find the container with id 46e80a4769d6ca0502e690a4601bdbb6e9dd6879a6853fd4f70eede72fdf5ab5 Jul 28 00:59:55.660796 ip-10-0-132-44 kubenswrapper[2568]: I0728 00:59:55.660755 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5" event={"ID":"1f6a9825-9a16-466f-9429-f9089a60b4da","Type":"ContainerStarted","Data":"46e80a4769d6ca0502e690a4601bdbb6e9dd6879a6853fd4f70eede72fdf5ab5"} Jul 28 01:00:00.692930 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:00.692889 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5" event={"ID":"1f6a9825-9a16-466f-9429-f9089a60b4da","Type":"ContainerStarted","Data":"8ebafd2eb6dc6644cb4a93d241cd223e2b2926e69e3c775a67cfe1a2e1335c90"} Jul 28 01:00:00.693387 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:00.693090 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5" Jul 28 01:00:00.729626 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:00.729545 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5" podStartSLOduration=1.358798478 podStartE2EDuration="6.729525991s" totalImagesPullingTime="5.370727513s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 00:59:54 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:00:00.725940837 +0000 UTC m=+397.645541521" watchObservedRunningTime="2026-07-28 01:00:00.729525991 +0000 UTC m=+397.649126676" Jul 28 01:00:11.701430 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:11.701397 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5" Jul 28 01:00:12.794139 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:12.794097 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d68fd"] Jul 28 01:00:12.799950 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:12.799918 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d68fd" Jul 28 01:00:12.808950 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:12.808920 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d68fd"] Jul 28 01:00:12.884310 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:12.884237 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6740eca6-bd9f-4625-954b-0cf3d1fe77d4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-d68fd\" (UID: \"6740eca6-bd9f-4625-954b-0cf3d1fe77d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d68fd" Jul 28 01:00:12.884516 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:12.884354 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzhqk\" (UniqueName: \"kubernetes.io/projected/6740eca6-bd9f-4625-954b-0cf3d1fe77d4-kube-api-access-nzhqk\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-d68fd\" (UID: \"6740eca6-bd9f-4625-954b-0cf3d1fe77d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d68fd" Jul 28 01:00:12.985783 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:12.985737 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzhqk\" (UniqueName: \"kubernetes.io/projected/6740eca6-bd9f-4625-954b-0cf3d1fe77d4-kube-api-access-nzhqk\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-d68fd\" (UID: \"6740eca6-bd9f-4625-954b-0cf3d1fe77d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d68fd" Jul 28 01:00:12.985974 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:12.985823 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6740eca6-bd9f-4625-954b-0cf3d1fe77d4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-d68fd\" (UID: \"6740eca6-bd9f-4625-954b-0cf3d1fe77d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d68fd" Jul 28 01:00:12.986169 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:12.986152 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6740eca6-bd9f-4625-954b-0cf3d1fe77d4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-d68fd\" (UID: \"6740eca6-bd9f-4625-954b-0cf3d1fe77d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d68fd" Jul 28 01:00:12.995131 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:12.995103 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzhqk\" (UniqueName: \"kubernetes.io/projected/6740eca6-bd9f-4625-954b-0cf3d1fe77d4-kube-api-access-nzhqk\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-d68fd\" (UID: \"6740eca6-bd9f-4625-954b-0cf3d1fe77d4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d68fd" Jul 28 01:00:13.113158 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.113120 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d68fd" Jul 28 01:00:13.270316 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.270268 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d68fd"] Jul 28 01:00:13.273717 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:00:13.273688 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6740eca6_bd9f_4625_954b_0cf3d1fe77d4.slice/crio-1bbbe44f397b3d7c3a18badd61722ef682204f39be4b3ccb5198e19c786523f1 WatchSource:0}: Error finding container 1bbbe44f397b3d7c3a18badd61722ef682204f39be4b3ccb5198e19c786523f1: Status 404 returned error can't find the container with id 1bbbe44f397b3d7c3a18badd61722ef682204f39be4b3ccb5198e19c786523f1 Jul 28 01:00:13.406750 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.406706 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d68fd"] Jul 28 01:00:13.413074 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.413040 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d68fd"] Jul 28 01:00:13.422653 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.422606 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5"] Jul 28 01:00:13.422867 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.422837 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5" podUID="1f6a9825-9a16-466f-9429-f9089a60b4da" containerName="manager" containerID="cri-o://8ebafd2eb6dc6644cb4a93d241cd223e2b2926e69e3c775a67cfe1a2e1335c90" gracePeriod=2 Jul 28 01:00:13.425044 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:00:13.424997 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7cdc5\" is forbidden: User \"system:node:ip-10-0-132-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-44.ec2.internal' and this object" podUID="1f6a9825-9a16-466f-9429-f9089a60b4da" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5" Jul 28 01:00:13.427262 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.427217 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh"] Jul 28 01:00:13.428046 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.428021 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6740eca6-bd9f-4625-954b-0cf3d1fe77d4" containerName="manager" Jul 28 01:00:13.428046 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.428046 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="6740eca6-bd9f-4625-954b-0cf3d1fe77d4" containerName="manager" Jul 28 01:00:13.428221 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.428118 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="6740eca6-bd9f-4625-954b-0cf3d1fe77d4" containerName="manager" Jul 28 01:00:13.432147 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.432105 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5"] Jul 28 01:00:13.432291 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.432223 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh" Jul 28 01:00:13.434368 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:00:13.434333 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7cdc5\" is forbidden: User \"system:node:ip-10-0-132-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-44.ec2.internal' and this object" podUID="1f6a9825-9a16-466f-9429-f9089a60b4da" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5" Jul 28 01:00:13.445733 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.445697 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh"] Jul 28 01:00:13.449045 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.449015 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh"] Jul 28 01:00:13.449453 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.449435 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1f6a9825-9a16-466f-9429-f9089a60b4da" containerName="manager" Jul 28 01:00:13.449538 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.449457 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="1f6a9825-9a16-466f-9429-f9089a60b4da" containerName="manager" Jul 28 01:00:13.449538 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.449532 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="1f6a9825-9a16-466f-9429-f9089a60b4da" containerName="manager" Jul 28 01:00:13.452718 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.452694 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh" Jul 28 01:00:13.461065 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:00:13.461014 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7cdc5\" is forbidden: User \"system:node:ip-10-0-132-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-44.ec2.internal' and this object" podUID="1f6a9825-9a16-466f-9429-f9089a60b4da" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5" Jul 28 01:00:13.464770 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.464725 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh"] Jul 28 01:00:13.489252 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.489222 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc2d67a1-b6d5-445a-b8a8-42664f19505c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4bpwh\" (UID: \"fc2d67a1-b6d5-445a-b8a8-42664f19505c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh" Jul 28 01:00:13.489408 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.489273 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kftlc\" (UniqueName: \"kubernetes.io/projected/fc2d67a1-b6d5-445a-b8a8-42664f19505c-kube-api-access-kftlc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4bpwh\" (UID: \"fc2d67a1-b6d5-445a-b8a8-42664f19505c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh" Jul 28 01:00:13.537296 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:00:13.535181 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-7cdc5\" is forbidden: User \"system:node:ip-10-0-132-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-44.ec2.internal' and this object" podUID="1f6a9825-9a16-466f-9429-f9089a60b4da" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5" Jul 28 01:00:13.590902 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.590856 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc2d67a1-b6d5-445a-b8a8-42664f19505c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4bpwh\" (UID: \"fc2d67a1-b6d5-445a-b8a8-42664f19505c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh" Jul 28 01:00:13.591090 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.590933 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kftlc\" (UniqueName: \"kubernetes.io/projected/fc2d67a1-b6d5-445a-b8a8-42664f19505c-kube-api-access-kftlc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4bpwh\" (UID: \"fc2d67a1-b6d5-445a-b8a8-42664f19505c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh" Jul 28 01:00:13.591090 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.590966 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l9mk6\" (UniqueName: \"kubernetes.io/projected/0f210f9e-83c2-4099-9535-ab006497e7a4-kube-api-access-l9mk6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-thvlh\" (UID: \"0f210f9e-83c2-4099-9535-ab006497e7a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh" Jul 28 01:00:13.591198 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.591122 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f210f9e-83c2-4099-9535-ab006497e7a4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-thvlh\" (UID: \"0f210f9e-83c2-4099-9535-ab006497e7a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh" Jul 28 01:00:13.591349 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.591324 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc2d67a1-b6d5-445a-b8a8-42664f19505c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4bpwh\" (UID: \"fc2d67a1-b6d5-445a-b8a8-42664f19505c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh" Jul 28 01:00:13.601136 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.601108 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kftlc\" (UniqueName: \"kubernetes.io/projected/fc2d67a1-b6d5-445a-b8a8-42664f19505c-kube-api-access-kftlc\") pod \"kuadrant-operator-controller-manager-6fb7879bc9-4bpwh\" (UID: \"fc2d67a1-b6d5-445a-b8a8-42664f19505c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh" Jul 28 01:00:13.669324 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.669296 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5" Jul 28 01:00:13.692578 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.692515 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l9mk6\" (UniqueName: \"kubernetes.io/projected/0f210f9e-83c2-4099-9535-ab006497e7a4-kube-api-access-l9mk6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-thvlh\" (UID: \"0f210f9e-83c2-4099-9535-ab006497e7a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh" Jul 28 01:00:13.692759 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.692621 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f210f9e-83c2-4099-9535-ab006497e7a4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-thvlh\" (UID: \"0f210f9e-83c2-4099-9535-ab006497e7a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh" Jul 28 01:00:13.693021 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.692996 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f210f9e-83c2-4099-9535-ab006497e7a4-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-thvlh\" (UID: \"0f210f9e-83c2-4099-9535-ab006497e7a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh" Jul 28 01:00:13.704997 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.704961 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l9mk6\" (UniqueName: \"kubernetes.io/projected/0f210f9e-83c2-4099-9535-ab006497e7a4-kube-api-access-l9mk6\") pod \"kuadrant-operator-controller-manager-8684c9ff49-thvlh\" (UID: \"0f210f9e-83c2-4099-9535-ab006497e7a4\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh" Jul 28 01:00:13.766685 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.766643 2568 generic.go:356] "Generic (PLEG): container finished" podID="1f6a9825-9a16-466f-9429-f9089a60b4da" containerID="8ebafd2eb6dc6644cb4a93d241cd223e2b2926e69e3c775a67cfe1a2e1335c90" exitCode=0 Jul 28 01:00:13.766878 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.766693 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-7cdc5" Jul 28 01:00:13.766878 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.766741 2568 scope.go:117] "RemoveContainer" containerID="8ebafd2eb6dc6644cb4a93d241cd223e2b2926e69e3c775a67cfe1a2e1335c90" Jul 28 01:00:13.768794 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:00:13.768775 2568 kuberuntime_manager.go:649] "Missing actuated resource record" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d68fd" container="manager" Jul 28 01:00:13.776851 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.776829 2568 scope.go:117] "RemoveContainer" containerID="8ebafd2eb6dc6644cb4a93d241cd223e2b2926e69e3c775a67cfe1a2e1335c90" Jul 28 01:00:13.777172 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:00:13.777143 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8ebafd2eb6dc6644cb4a93d241cd223e2b2926e69e3c775a67cfe1a2e1335c90\": container with ID starting with 8ebafd2eb6dc6644cb4a93d241cd223e2b2926e69e3c775a67cfe1a2e1335c90 not found: ID does not exist" containerID="8ebafd2eb6dc6644cb4a93d241cd223e2b2926e69e3c775a67cfe1a2e1335c90" Jul 28 01:00:13.777247 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.777187 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8ebafd2eb6dc6644cb4a93d241cd223e2b2926e69e3c775a67cfe1a2e1335c90"} err="failed to get container status \"8ebafd2eb6dc6644cb4a93d241cd223e2b2926e69e3c775a67cfe1a2e1335c90\": rpc error: code = NotFound desc = could not find container \"8ebafd2eb6dc6644cb4a93d241cd223e2b2926e69e3c775a67cfe1a2e1335c90\": container with ID starting with 8ebafd2eb6dc6644cb4a93d241cd223e2b2926e69e3c775a67cfe1a2e1335c90 not found: ID does not exist" Jul 28 01:00:13.787802 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.787770 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh" Jul 28 01:00:13.793021 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.792995 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-qw66z\" (UniqueName: \"kubernetes.io/projected/1f6a9825-9a16-466f-9429-f9089a60b4da-kube-api-access-qw66z\") pod \"1f6a9825-9a16-466f-9429-f9089a60b4da\" (UID: \"1f6a9825-9a16-466f-9429-f9089a60b4da\") " Jul 28 01:00:13.793113 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.793099 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f6a9825-9a16-466f-9429-f9089a60b4da-extensions-socket-volume\") pod \"1f6a9825-9a16-466f-9429-f9089a60b4da\" (UID: \"1f6a9825-9a16-466f-9429-f9089a60b4da\") " Jul 28 01:00:13.793655 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.793627 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1f6a9825-9a16-466f-9429-f9089a60b4da-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1f6a9825-9a16-466f-9429-f9089a60b4da" (UID: "1f6a9825-9a16-466f-9429-f9089a60b4da"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:00:13.795336 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.795307 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1f6a9825-9a16-466f-9429-f9089a60b4da-kube-api-access-qw66z" (OuterVolumeSpecName: "kube-api-access-qw66z") pod "1f6a9825-9a16-466f-9429-f9089a60b4da" (UID: "1f6a9825-9a16-466f-9429-f9089a60b4da"). InnerVolumeSpecName "kube-api-access-qw66z". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:00:13.795336 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.795334 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh" Jul 28 01:00:13.894444 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.894361 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1f6a9825-9a16-466f-9429-f9089a60b4da-extensions-socket-volume\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:00:13.894444 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.894401 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-qw66z\" (UniqueName: \"kubernetes.io/projected/1f6a9825-9a16-466f-9429-f9089a60b4da-kube-api-access-qw66z\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:00:13.951550 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.951520 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh"] Jul 28 01:00:13.954979 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:00:13.954949 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfc2d67a1_b6d5_445a_b8a8_42664f19505c.slice/crio-64259afd71433c71b4784211d97692fb65912e5f3ee164b90ae8dd8e44949953 WatchSource:0}: Error finding container 64259afd71433c71b4784211d97692fb65912e5f3ee164b90ae8dd8e44949953: Status 404 returned error can't find the container with id 64259afd71433c71b4784211d97692fb65912e5f3ee164b90ae8dd8e44949953 Jul 28 01:00:13.971014 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:13.970953 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh"] Jul 28 01:00:13.973734 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:00:13.973707 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0f210f9e_83c2_4099_9535_ab006497e7a4.slice/crio-8ad7f489e5391b3f981ff16311a349b61c93765ebdb40211348bc31ef287a8d3 WatchSource:0}: Error finding container 8ad7f489e5391b3f981ff16311a349b61c93765ebdb40211348bc31ef287a8d3: Status 404 returned error can't find the container with id 8ad7f489e5391b3f981ff16311a349b61c93765ebdb40211348bc31ef287a8d3 Jul 28 01:00:14.777223 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:14.777174 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d68fd" podUID="6740eca6-bd9f-4625-954b-0cf3d1fe77d4" containerName="manager" containerID="cri-o://45f3f02af134f9f52fc550b700bbc04d0ca54bc134dfed75daf4137014505f78" gracePeriod=2 Jul 28 01:00:14.780706 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:14.780670 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh" event={"ID":"0f210f9e-83c2-4099-9535-ab006497e7a4","Type":"ContainerStarted","Data":"f501fee7bac233b3ed6c97d8b81dd80cf9da050a9cefc0e1e476afc09b5c42a7"} Jul 28 01:00:14.781609 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:14.781589 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh" Jul 28 01:00:14.781808 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:14.781793 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh" event={"ID":"0f210f9e-83c2-4099-9535-ab006497e7a4","Type":"ContainerStarted","Data":"8ad7f489e5391b3f981ff16311a349b61c93765ebdb40211348bc31ef287a8d3"} Jul 28 01:00:14.781910 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:00:14.780955 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-d68fd\" is forbidden: User \"system:node:ip-10-0-132-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-44.ec2.internal' and this object" podUID="6740eca6-bd9f-4625-954b-0cf3d1fe77d4" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d68fd" Jul 28 01:00:14.784026 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:14.783919 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh" event={"ID":"fc2d67a1-b6d5-445a-b8a8-42664f19505c","Type":"ContainerStarted","Data":"49b0ed72a33bdac0317d450fb93b7faeb6305f3946a4878c3b6a6bb762298fc3"} Jul 28 01:00:14.784026 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:14.783977 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh" event={"ID":"fc2d67a1-b6d5-445a-b8a8-42664f19505c","Type":"ContainerStarted","Data":"64259afd71433c71b4784211d97692fb65912e5f3ee164b90ae8dd8e44949953"} Jul 28 01:00:14.784163 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:14.784045 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh" Jul 28 01:00:14.806721 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:00:14.806681 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-d68fd\" is forbidden: User \"system:node:ip-10-0-132-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-44.ec2.internal' and this object" podUID="6740eca6-bd9f-4625-954b-0cf3d1fe77d4" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d68fd" Jul 28 01:00:14.807116 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:14.806672 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh" podStartSLOduration=1.806648355 podStartE2EDuration="1.806648355s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:00:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:00:14.804817692 +0000 UTC m=+411.724418375" watchObservedRunningTime="2026-07-28 01:00:14.806648355 +0000 UTC m=+411.726249041" Jul 28 01:00:14.808580 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:00:14.808538 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-d68fd\" is forbidden: User \"system:node:ip-10-0-132-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-44.ec2.internal' and this object" podUID="6740eca6-bd9f-4625-954b-0cf3d1fe77d4" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d68fd" Jul 28 01:00:14.826555 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:14.826496 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh" podStartSLOduration=1.826479123 podStartE2EDuration="1.826479123s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:00:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:00:14.825687752 +0000 UTC m=+411.745288437" watchObservedRunningTime="2026-07-28 01:00:14.826479123 +0000 UTC m=+411.746079807" Jul 28 01:00:15.035332 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:15.035262 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d68fd" Jul 28 01:00:15.037685 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:00:15.037656 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-d68fd\" is forbidden: User \"system:node:ip-10-0-132-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-44.ec2.internal' and this object" podUID="6740eca6-bd9f-4625-954b-0cf3d1fe77d4" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d68fd" Jul 28 01:00:15.102942 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:15.102899 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzhqk\" (UniqueName: \"kubernetes.io/projected/6740eca6-bd9f-4625-954b-0cf3d1fe77d4-kube-api-access-nzhqk\") pod \"6740eca6-bd9f-4625-954b-0cf3d1fe77d4\" (UID: \"6740eca6-bd9f-4625-954b-0cf3d1fe77d4\") " Jul 28 01:00:15.103108 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:15.102971 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6740eca6-bd9f-4625-954b-0cf3d1fe77d4-extensions-socket-volume\") pod \"6740eca6-bd9f-4625-954b-0cf3d1fe77d4\" (UID: \"6740eca6-bd9f-4625-954b-0cf3d1fe77d4\") " Jul 28 01:00:15.103234 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:15.103207 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6740eca6-bd9f-4625-954b-0cf3d1fe77d4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6740eca6-bd9f-4625-954b-0cf3d1fe77d4" (UID: "6740eca6-bd9f-4625-954b-0cf3d1fe77d4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:00:15.105215 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:15.105189 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6740eca6-bd9f-4625-954b-0cf3d1fe77d4-kube-api-access-nzhqk" (OuterVolumeSpecName: "kube-api-access-nzhqk") pod "6740eca6-bd9f-4625-954b-0cf3d1fe77d4" (UID: "6740eca6-bd9f-4625-954b-0cf3d1fe77d4"). InnerVolumeSpecName "kube-api-access-nzhqk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:00:15.203997 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:15.203962 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzhqk\" (UniqueName: \"kubernetes.io/projected/6740eca6-bd9f-4625-954b-0cf3d1fe77d4-kube-api-access-nzhqk\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:00:15.203997 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:15.203994 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6740eca6-bd9f-4625-954b-0cf3d1fe77d4-extensions-socket-volume\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:00:15.533849 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:15.533814 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1f6a9825-9a16-466f-9429-f9089a60b4da" path="/var/lib/kubelet/pods/1f6a9825-9a16-466f-9429-f9089a60b4da/volumes" Jul 28 01:00:15.534183 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:15.534170 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6740eca6-bd9f-4625-954b-0cf3d1fe77d4" path="/var/lib/kubelet/pods/6740eca6-bd9f-4625-954b-0cf3d1fe77d4/volumes" Jul 28 01:00:15.791453 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:15.791361 2568 generic.go:356] "Generic (PLEG): container finished" podID="6740eca6-bd9f-4625-954b-0cf3d1fe77d4" containerID="45f3f02af134f9f52fc550b700bbc04d0ca54bc134dfed75daf4137014505f78" exitCode=2 Jul 28 01:00:15.791453 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:15.791404 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d68fd" Jul 28 01:00:15.791695 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:15.791471 2568 scope.go:117] "RemoveContainer" containerID="45f3f02af134f9f52fc550b700bbc04d0ca54bc134dfed75daf4137014505f78" Jul 28 01:00:15.796152 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:00:15.796113 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-6fb7879bc9-d68fd\" is forbidden: User \"system:node:ip-10-0-132-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-132-44.ec2.internal' and this object" podUID="6740eca6-bd9f-4625-954b-0cf3d1fe77d4" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-d68fd" Jul 28 01:00:15.801284 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:15.801264 2568 scope.go:117] "RemoveContainer" containerID="45f3f02af134f9f52fc550b700bbc04d0ca54bc134dfed75daf4137014505f78" Jul 28 01:00:15.801670 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:00:15.801645 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"45f3f02af134f9f52fc550b700bbc04d0ca54bc134dfed75daf4137014505f78\": container with ID starting with 45f3f02af134f9f52fc550b700bbc04d0ca54bc134dfed75daf4137014505f78 not found: ID does not exist" containerID="45f3f02af134f9f52fc550b700bbc04d0ca54bc134dfed75daf4137014505f78" Jul 28 01:00:15.801744 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:15.801680 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"45f3f02af134f9f52fc550b700bbc04d0ca54bc134dfed75daf4137014505f78"} err="failed to get container status \"45f3f02af134f9f52fc550b700bbc04d0ca54bc134dfed75daf4137014505f78\": rpc error: code = NotFound desc = could not find container \"45f3f02af134f9f52fc550b700bbc04d0ca54bc134dfed75daf4137014505f78\": container with ID starting with 45f3f02af134f9f52fc550b700bbc04d0ca54bc134dfed75daf4137014505f78 not found: ID does not exist" Jul 28 01:00:20.283010 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:20.282969 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-896d47fb7-69wkg"] Jul 28 01:00:25.794620 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:25.794589 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh" Jul 28 01:00:25.848181 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:25.848142 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh"] Jul 28 01:00:25.848825 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:25.848786 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh" podUID="0f210f9e-83c2-4099-9535-ab006497e7a4" containerName="manager" containerID="cri-o://f501fee7bac233b3ed6c97d8b81dd80cf9da050a9cefc0e1e476afc09b5c42a7" gracePeriod=10 Jul 28 01:00:25.852067 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:25.852036 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh" Jul 28 01:00:26.140591 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:26.140546 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh" Jul 28 01:00:26.305325 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:26.305285 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l9mk6\" (UniqueName: \"kubernetes.io/projected/0f210f9e-83c2-4099-9535-ab006497e7a4-kube-api-access-l9mk6\") pod \"0f210f9e-83c2-4099-9535-ab006497e7a4\" (UID: \"0f210f9e-83c2-4099-9535-ab006497e7a4\") " Jul 28 01:00:26.305520 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:26.305339 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f210f9e-83c2-4099-9535-ab006497e7a4-extensions-socket-volume\") pod \"0f210f9e-83c2-4099-9535-ab006497e7a4\" (UID: \"0f210f9e-83c2-4099-9535-ab006497e7a4\") " Jul 28 01:00:26.305767 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:26.305740 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0f210f9e-83c2-4099-9535-ab006497e7a4-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "0f210f9e-83c2-4099-9535-ab006497e7a4" (UID: "0f210f9e-83c2-4099-9535-ab006497e7a4"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:00:26.308122 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:26.308079 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0f210f9e-83c2-4099-9535-ab006497e7a4-kube-api-access-l9mk6" (OuterVolumeSpecName: "kube-api-access-l9mk6") pod "0f210f9e-83c2-4099-9535-ab006497e7a4" (UID: "0f210f9e-83c2-4099-9535-ab006497e7a4"). InnerVolumeSpecName "kube-api-access-l9mk6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:00:26.406933 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:26.406886 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l9mk6\" (UniqueName: \"kubernetes.io/projected/0f210f9e-83c2-4099-9535-ab006497e7a4-kube-api-access-l9mk6\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:00:26.406933 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:26.406921 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/0f210f9e-83c2-4099-9535-ab006497e7a4-extensions-socket-volume\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:00:26.861263 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:26.861228 2568 generic.go:356] "Generic (PLEG): container finished" podID="0f210f9e-83c2-4099-9535-ab006497e7a4" containerID="f501fee7bac233b3ed6c97d8b81dd80cf9da050a9cefc0e1e476afc09b5c42a7" exitCode=0 Jul 28 01:00:26.861704 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:26.861338 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh" Jul 28 01:00:26.861704 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:26.861361 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh" event={"ID":"0f210f9e-83c2-4099-9535-ab006497e7a4","Type":"ContainerDied","Data":"f501fee7bac233b3ed6c97d8b81dd80cf9da050a9cefc0e1e476afc09b5c42a7"} Jul 28 01:00:26.861704 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:26.861418 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh" event={"ID":"0f210f9e-83c2-4099-9535-ab006497e7a4","Type":"ContainerDied","Data":"8ad7f489e5391b3f981ff16311a349b61c93765ebdb40211348bc31ef287a8d3"} Jul 28 01:00:26.861704 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:26.861442 2568 scope.go:117] "RemoveContainer" containerID="f501fee7bac233b3ed6c97d8b81dd80cf9da050a9cefc0e1e476afc09b5c42a7" Jul 28 01:00:26.872100 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:26.872076 2568 scope.go:117] "RemoveContainer" containerID="f501fee7bac233b3ed6c97d8b81dd80cf9da050a9cefc0e1e476afc09b5c42a7" Jul 28 01:00:26.872426 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:00:26.872400 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f501fee7bac233b3ed6c97d8b81dd80cf9da050a9cefc0e1e476afc09b5c42a7\": container with ID starting with f501fee7bac233b3ed6c97d8b81dd80cf9da050a9cefc0e1e476afc09b5c42a7 not found: ID does not exist" containerID="f501fee7bac233b3ed6c97d8b81dd80cf9da050a9cefc0e1e476afc09b5c42a7" Jul 28 01:00:26.872533 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:26.872434 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f501fee7bac233b3ed6c97d8b81dd80cf9da050a9cefc0e1e476afc09b5c42a7"} err="failed to get container status \"f501fee7bac233b3ed6c97d8b81dd80cf9da050a9cefc0e1e476afc09b5c42a7\": rpc error: code = NotFound desc = could not find container \"f501fee7bac233b3ed6c97d8b81dd80cf9da050a9cefc0e1e476afc09b5c42a7\": container with ID starting with f501fee7bac233b3ed6c97d8b81dd80cf9da050a9cefc0e1e476afc09b5c42a7 not found: ID does not exist" Jul 28 01:00:26.897956 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:26.897918 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh"] Jul 28 01:00:26.903221 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:26.903183 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-thvlh"] Jul 28 01:00:27.533766 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:27.533730 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="0f210f9e-83c2-4099-9535-ab006497e7a4" path="/var/lib/kubelet/pods/0f210f9e-83c2-4099-9535-ab006497e7a4/volumes" Jul 28 01:00:42.135497 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.135456 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c"] Jul 28 01:00:42.136071 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.135859 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0f210f9e-83c2-4099-9535-ab006497e7a4" containerName="manager" Jul 28 01:00:42.136071 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.135873 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="0f210f9e-83c2-4099-9535-ab006497e7a4" containerName="manager" Jul 28 01:00:42.136071 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.135952 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="0f210f9e-83c2-4099-9535-ab006497e7a4" containerName="manager" Jul 28 01:00:42.139736 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.139713 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.141944 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.141915 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-m298w\"" Jul 28 01:00:42.147864 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.147098 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e79a768c-19f5-4af5-b7da-349c2cd665e9-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.147864 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.147140 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e79a768c-19f5-4af5-b7da-349c2cd665e9-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.147864 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.147231 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e79a768c-19f5-4af5-b7da-349c2cd665e9-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.147864 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.147265 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e79a768c-19f5-4af5-b7da-349c2cd665e9-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.147864 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.147286 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e79a768c-19f5-4af5-b7da-349c2cd665e9-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.147864 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.147316 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-828q8\" (UniqueName: \"kubernetes.io/projected/e79a768c-19f5-4af5-b7da-349c2cd665e9-kube-api-access-828q8\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.147864 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.147348 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e79a768c-19f5-4af5-b7da-349c2cd665e9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.147864 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.147382 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e79a768c-19f5-4af5-b7da-349c2cd665e9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.147864 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.147407 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e79a768c-19f5-4af5-b7da-349c2cd665e9-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.151413 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.151377 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c"] Jul 28 01:00:42.247952 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.247907 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e79a768c-19f5-4af5-b7da-349c2cd665e9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.247952 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.247952 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e79a768c-19f5-4af5-b7da-349c2cd665e9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.248201 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.247975 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e79a768c-19f5-4af5-b7da-349c2cd665e9-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.248201 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.248014 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e79a768c-19f5-4af5-b7da-349c2cd665e9-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.248201 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.248038 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e79a768c-19f5-4af5-b7da-349c2cd665e9-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.248201 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.248114 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e79a768c-19f5-4af5-b7da-349c2cd665e9-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.248201 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.248145 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e79a768c-19f5-4af5-b7da-349c2cd665e9-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.248201 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.248164 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e79a768c-19f5-4af5-b7da-349c2cd665e9-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.248201 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.248192 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-828q8\" (UniqueName: \"kubernetes.io/projected/e79a768c-19f5-4af5-b7da-349c2cd665e9-kube-api-access-828q8\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.248545 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.248517 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e79a768c-19f5-4af5-b7da-349c2cd665e9-workload-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.248644 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.248546 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e79a768c-19f5-4af5-b7da-349c2cd665e9-credential-socket\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.248700 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.248652 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e79a768c-19f5-4af5-b7da-349c2cd665e9-istio-data\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.248794 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.248773 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e79a768c-19f5-4af5-b7da-349c2cd665e9-workload-certs\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.248845 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.248834 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e79a768c-19f5-4af5-b7da-349c2cd665e9-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.251195 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.251167 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e79a768c-19f5-4af5-b7da-349c2cd665e9-istio-envoy\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.251388 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.251372 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e79a768c-19f5-4af5-b7da-349c2cd665e9-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.255724 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.255694 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e79a768c-19f5-4af5-b7da-349c2cd665e9-istio-token\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.255842 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.255793 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-828q8\" (UniqueName: \"kubernetes.io/projected/e79a768c-19f5-4af5-b7da-349c2cd665e9-kube-api-access-828q8\") pod \"maas-default-gateway-openshift-default-5ccb968c66-8fg5c\" (UID: \"e79a768c-19f5-4af5-b7da-349c2cd665e9\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.452613 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.452488 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:42.601022 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.600991 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c"] Jul 28 01:00:42.602925 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:00:42.602898 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode79a768c_19f5_4af5_b7da_349c2cd665e9.slice/crio-448b01500690b4b7d455761fcd01e5a342c3f60691455b21c5229d1f7dfcbf23 WatchSource:0}: Error finding container 448b01500690b4b7d455761fcd01e5a342c3f60691455b21c5229d1f7dfcbf23: Status 404 returned error can't find the container with id 448b01500690b4b7d455761fcd01e5a342c3f60691455b21c5229d1f7dfcbf23 Jul 28 01:00:42.605228 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.605185 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:00:42.605307 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.605274 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:00:42.605351 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.605325 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:00:42.949041 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.949000 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" event={"ID":"e79a768c-19f5-4af5-b7da-349c2cd665e9","Type":"ContainerStarted","Data":"19fddcb0a69657037d94887ceaf6dbd0afbd8e99325e288d35e4018832358f03"} Jul 28 01:00:42.949235 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.949077 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" event={"ID":"e79a768c-19f5-4af5-b7da-349c2cd665e9","Type":"ContainerStarted","Data":"448b01500690b4b7d455761fcd01e5a342c3f60691455b21c5229d1f7dfcbf23"} Jul 28 01:00:42.969633 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:42.969543 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" podStartSLOduration=0.96951497 podStartE2EDuration="969.51497ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:00:42 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:00:42.965994887 +0000 UTC m=+439.885595571" watchObservedRunningTime="2026-07-28 01:00:42.96951497 +0000 UTC m=+439.889115655" Jul 28 01:00:43.453600 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:43.453528 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:43.458609 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:43.458579 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:43.932712 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:43.932677 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w2j8f"] Jul 28 01:00:43.935629 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:43.935606 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-w2j8f" Jul 28 01:00:43.939296 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:43.939268 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 28 01:00:43.939424 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:43.939267 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-vq2f5\"" Jul 28 01:00:43.946664 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:43.946624 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w2j8f"] Jul 28 01:00:43.954623 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:43.954591 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:43.955653 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:43.955626 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:00:43.960180 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:43.960151 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/22816147-c1a6-4992-ad71-29343628f329-config-file\") pod \"limitador-limitador-64c94fd64f-w2j8f\" (UID: \"22816147-c1a6-4992-ad71-29343628f329\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w2j8f" Jul 28 01:00:43.960375 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:43.960352 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hk8h\" (UniqueName: \"kubernetes.io/projected/22816147-c1a6-4992-ad71-29343628f329-kube-api-access-7hk8h\") pod \"limitador-limitador-64c94fd64f-w2j8f\" (UID: \"22816147-c1a6-4992-ad71-29343628f329\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w2j8f" Jul 28 01:00:44.037722 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.037681 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w2j8f"] Jul 28 01:00:44.061490 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.061448 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hk8h\" (UniqueName: \"kubernetes.io/projected/22816147-c1a6-4992-ad71-29343628f329-kube-api-access-7hk8h\") pod \"limitador-limitador-64c94fd64f-w2j8f\" (UID: \"22816147-c1a6-4992-ad71-29343628f329\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w2j8f" Jul 28 01:00:44.061713 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.061527 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/22816147-c1a6-4992-ad71-29343628f329-config-file\") pod \"limitador-limitador-64c94fd64f-w2j8f\" (UID: \"22816147-c1a6-4992-ad71-29343628f329\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w2j8f" Jul 28 01:00:44.062244 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.062219 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/22816147-c1a6-4992-ad71-29343628f329-config-file\") pod \"limitador-limitador-64c94fd64f-w2j8f\" (UID: \"22816147-c1a6-4992-ad71-29343628f329\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w2j8f" Jul 28 01:00:44.069079 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.069015 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hk8h\" (UniqueName: \"kubernetes.io/projected/22816147-c1a6-4992-ad71-29343628f329-kube-api-access-7hk8h\") pod \"limitador-limitador-64c94fd64f-w2j8f\" (UID: \"22816147-c1a6-4992-ad71-29343628f329\") " pod="kuadrant-system/limitador-limitador-64c94fd64f-w2j8f" Jul 28 01:00:44.247772 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.247671 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-w2j8f" Jul 28 01:00:44.364211 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.364162 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh"] Jul 28 01:00:44.364475 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.364428 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh" podUID="fc2d67a1-b6d5-445a-b8a8-42664f19505c" containerName="manager" containerID="cri-o://49b0ed72a33bdac0317d450fb93b7faeb6305f3946a4878c3b6a6bb762298fc3" gracePeriod=10 Jul 28 01:00:44.402962 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.402924 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w2j8f"] Jul 28 01:00:44.405300 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:00:44.405260 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22816147_c1a6_4992_ad71_29343628f329.slice/crio-398f505ecb78da0af02abed6e5495ae6ccb2f2d4f9ddc10b4901fa1a0ff4b322 WatchSource:0}: Error finding container 398f505ecb78da0af02abed6e5495ae6ccb2f2d4f9ddc10b4901fa1a0ff4b322: Status 404 returned error can't find the container with id 398f505ecb78da0af02abed6e5495ae6ccb2f2d4f9ddc10b4901fa1a0ff4b322 Jul 28 01:00:44.614741 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.614716 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh" Jul 28 01:00:44.667379 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.667334 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kftlc\" (UniqueName: \"kubernetes.io/projected/fc2d67a1-b6d5-445a-b8a8-42664f19505c-kube-api-access-kftlc\") pod \"fc2d67a1-b6d5-445a-b8a8-42664f19505c\" (UID: \"fc2d67a1-b6d5-445a-b8a8-42664f19505c\") " Jul 28 01:00:44.667553 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.667397 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc2d67a1-b6d5-445a-b8a8-42664f19505c-extensions-socket-volume\") pod \"fc2d67a1-b6d5-445a-b8a8-42664f19505c\" (UID: \"fc2d67a1-b6d5-445a-b8a8-42664f19505c\") " Jul 28 01:00:44.667846 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.667807 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fc2d67a1-b6d5-445a-b8a8-42664f19505c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fc2d67a1-b6d5-445a-b8a8-42664f19505c" (UID: "fc2d67a1-b6d5-445a-b8a8-42664f19505c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:00:44.669793 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.669762 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fc2d67a1-b6d5-445a-b8a8-42664f19505c-kube-api-access-kftlc" (OuterVolumeSpecName: "kube-api-access-kftlc") pod "fc2d67a1-b6d5-445a-b8a8-42664f19505c" (UID: "fc2d67a1-b6d5-445a-b8a8-42664f19505c"). InnerVolumeSpecName "kube-api-access-kftlc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:00:44.718278 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.718232 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-r48rm"] Jul 28 01:00:44.718714 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.718696 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fc2d67a1-b6d5-445a-b8a8-42664f19505c" containerName="manager" Jul 28 01:00:44.718811 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.718716 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="fc2d67a1-b6d5-445a-b8a8-42664f19505c" containerName="manager" Jul 28 01:00:44.718865 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.718827 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="fc2d67a1-b6d5-445a-b8a8-42664f19505c" containerName="manager" Jul 28 01:00:44.720994 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.720970 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r48rm" Jul 28 01:00:44.723297 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.723272 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-8hlcl\"" Jul 28 01:00:44.729228 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.729148 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-r48rm"] Jul 28 01:00:44.768436 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.768391 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6hpxj\" (UniqueName: \"kubernetes.io/projected/44425c8d-6b63-40c8-80c4-cc428b7618fb-kube-api-access-6hpxj\") pod \"authorino-58cd955675-r48rm\" (UID: \"44425c8d-6b63-40c8-80c4-cc428b7618fb\") " pod="kuadrant-system/authorino-58cd955675-r48rm" Jul 28 01:00:44.768641 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.768543 2568 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fc2d67a1-b6d5-445a-b8a8-42664f19505c-extensions-socket-volume\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:00:44.768641 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.768582 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kftlc\" (UniqueName: \"kubernetes.io/projected/fc2d67a1-b6d5-445a-b8a8-42664f19505c-kube-api-access-kftlc\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:00:44.868983 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.868941 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6hpxj\" (UniqueName: \"kubernetes.io/projected/44425c8d-6b63-40c8-80c4-cc428b7618fb-kube-api-access-6hpxj\") pod \"authorino-58cd955675-r48rm\" (UID: \"44425c8d-6b63-40c8-80c4-cc428b7618fb\") " pod="kuadrant-system/authorino-58cd955675-r48rm" Jul 28 01:00:44.878109 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.878078 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6hpxj\" (UniqueName: \"kubernetes.io/projected/44425c8d-6b63-40c8-80c4-cc428b7618fb-kube-api-access-6hpxj\") pod \"authorino-58cd955675-r48rm\" (UID: \"44425c8d-6b63-40c8-80c4-cc428b7618fb\") " pod="kuadrant-system/authorino-58cd955675-r48rm" Jul 28 01:00:44.961088 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.961052 2568 generic.go:356] "Generic (PLEG): container finished" podID="fc2d67a1-b6d5-445a-b8a8-42664f19505c" containerID="49b0ed72a33bdac0317d450fb93b7faeb6305f3946a4878c3b6a6bb762298fc3" exitCode=0 Jul 28 01:00:44.961266 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.961100 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh" Jul 28 01:00:44.961266 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.961138 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh" event={"ID":"fc2d67a1-b6d5-445a-b8a8-42664f19505c","Type":"ContainerDied","Data":"49b0ed72a33bdac0317d450fb93b7faeb6305f3946a4878c3b6a6bb762298fc3"} Jul 28 01:00:44.961266 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.961189 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh" event={"ID":"fc2d67a1-b6d5-445a-b8a8-42664f19505c","Type":"ContainerDied","Data":"64259afd71433c71b4784211d97692fb65912e5f3ee164b90ae8dd8e44949953"} Jul 28 01:00:44.961266 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.961212 2568 scope.go:117] "RemoveContainer" containerID="49b0ed72a33bdac0317d450fb93b7faeb6305f3946a4878c3b6a6bb762298fc3" Jul 28 01:00:44.962962 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.962936 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-w2j8f" event={"ID":"22816147-c1a6-4992-ad71-29343628f329","Type":"ContainerStarted","Data":"398f505ecb78da0af02abed6e5495ae6ccb2f2d4f9ddc10b4901fa1a0ff4b322"} Jul 28 01:00:44.971417 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.971388 2568 scope.go:117] "RemoveContainer" containerID="49b0ed72a33bdac0317d450fb93b7faeb6305f3946a4878c3b6a6bb762298fc3" Jul 28 01:00:44.971751 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:00:44.971732 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49b0ed72a33bdac0317d450fb93b7faeb6305f3946a4878c3b6a6bb762298fc3\": container with ID starting with 49b0ed72a33bdac0317d450fb93b7faeb6305f3946a4878c3b6a6bb762298fc3 not found: ID does not exist" containerID="49b0ed72a33bdac0317d450fb93b7faeb6305f3946a4878c3b6a6bb762298fc3" Jul 28 01:00:44.971828 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.971761 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49b0ed72a33bdac0317d450fb93b7faeb6305f3946a4878c3b6a6bb762298fc3"} err="failed to get container status \"49b0ed72a33bdac0317d450fb93b7faeb6305f3946a4878c3b6a6bb762298fc3\": rpc error: code = NotFound desc = could not find container \"49b0ed72a33bdac0317d450fb93b7faeb6305f3946a4878c3b6a6bb762298fc3\": container with ID starting with 49b0ed72a33bdac0317d450fb93b7faeb6305f3946a4878c3b6a6bb762298fc3 not found: ID does not exist" Jul 28 01:00:44.985037 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.985001 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh"] Jul 28 01:00:44.990171 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:44.990141 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-6fb7879bc9-4bpwh"] Jul 28 01:00:45.032433 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.032396 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r48rm" Jul 28 01:00:45.176288 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.176253 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-r48rm"] Jul 28 01:00:45.177924 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:00:45.177899 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod44425c8d_6b63_40c8_80c4_cc428b7618fb.slice/crio-982b9e0b66ce4493944b9f96b2ced93c01837077140ae854baacfa21641de541 WatchSource:0}: Error finding container 982b9e0b66ce4493944b9f96b2ced93c01837077140ae854baacfa21641de541: Status 404 returned error can't find the container with id 982b9e0b66ce4493944b9f96b2ced93c01837077140ae854baacfa21641de541 Jul 28 01:00:45.305461 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.305416 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-896d47fb7-69wkg" podUID="e808158a-821c-4ead-8d85-1e753a225c66" containerName="console" containerID="cri-o://2e0b1a39cc14d9f2ee9deb6f5126fc3fd491ea92cea8e8f29ba3e4dfe5d83012" gracePeriod=15 Jul 28 01:00:45.541859 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.541445 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fc2d67a1-b6d5-445a-b8a8-42664f19505c" path="/var/lib/kubelet/pods/fc2d67a1-b6d5-445a-b8a8-42664f19505c/volumes" Jul 28 01:00:45.623354 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.623324 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-896d47fb7-69wkg" Jul 28 01:00:45.675601 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.675489 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e808158a-821c-4ead-8d85-1e753a225c66-console-oauth-config\") pod \"e808158a-821c-4ead-8d85-1e753a225c66\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " Jul 28 01:00:45.675601 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.675585 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-trusted-ca-bundle\") pod \"e808158a-821c-4ead-8d85-1e753a225c66\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " Jul 28 01:00:45.675840 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.675618 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-oauth-serving-cert\") pod \"e808158a-821c-4ead-8d85-1e753a225c66\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " Jul 28 01:00:45.675840 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.675664 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-service-ca\") pod \"e808158a-821c-4ead-8d85-1e753a225c66\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " Jul 28 01:00:45.675840 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.675706 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-console-config\") pod \"e808158a-821c-4ead-8d85-1e753a225c66\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " Jul 28 01:00:45.675840 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.675733 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c257d\" (UniqueName: \"kubernetes.io/projected/e808158a-821c-4ead-8d85-1e753a225c66-kube-api-access-c257d\") pod \"e808158a-821c-4ead-8d85-1e753a225c66\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " Jul 28 01:00:45.675840 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.675819 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e808158a-821c-4ead-8d85-1e753a225c66-console-serving-cert\") pod \"e808158a-821c-4ead-8d85-1e753a225c66\" (UID: \"e808158a-821c-4ead-8d85-1e753a225c66\") " Jul 28 01:00:45.676503 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.676236 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e808158a-821c-4ead-8d85-1e753a225c66" (UID: "e808158a-821c-4ead-8d85-1e753a225c66"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:00:45.676683 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.676659 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-service-ca" (OuterVolumeSpecName: "service-ca") pod "e808158a-821c-4ead-8d85-1e753a225c66" (UID: "e808158a-821c-4ead-8d85-1e753a225c66"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:00:45.676683 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.676673 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-console-config" (OuterVolumeSpecName: "console-config") pod "e808158a-821c-4ead-8d85-1e753a225c66" (UID: "e808158a-821c-4ead-8d85-1e753a225c66"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:00:45.676959 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.676909 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e808158a-821c-4ead-8d85-1e753a225c66" (UID: "e808158a-821c-4ead-8d85-1e753a225c66"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:00:45.681591 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.681510 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e808158a-821c-4ead-8d85-1e753a225c66-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e808158a-821c-4ead-8d85-1e753a225c66" (UID: "e808158a-821c-4ead-8d85-1e753a225c66"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 01:00:45.681591 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.681532 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e808158a-821c-4ead-8d85-1e753a225c66-kube-api-access-c257d" (OuterVolumeSpecName: "kube-api-access-c257d") pod "e808158a-821c-4ead-8d85-1e753a225c66" (UID: "e808158a-821c-4ead-8d85-1e753a225c66"). InnerVolumeSpecName "kube-api-access-c257d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:00:45.681591 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.681532 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e808158a-821c-4ead-8d85-1e753a225c66-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e808158a-821c-4ead-8d85-1e753a225c66" (UID: "e808158a-821c-4ead-8d85-1e753a225c66"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 01:00:45.776655 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.776559 2568 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e808158a-821c-4ead-8d85-1e753a225c66-console-serving-cert\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:00:45.776655 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.776613 2568 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e808158a-821c-4ead-8d85-1e753a225c66-console-oauth-config\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:00:45.776655 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.776628 2568 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-trusted-ca-bundle\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:00:45.776655 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.776639 2568 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-oauth-serving-cert\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:00:45.776655 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.776648 2568 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-service-ca\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:00:45.776655 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.776656 2568 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e808158a-821c-4ead-8d85-1e753a225c66-console-config\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:00:45.776655 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.776664 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c257d\" (UniqueName: \"kubernetes.io/projected/e808158a-821c-4ead-8d85-1e753a225c66-kube-api-access-c257d\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:00:45.977847 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.977745 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r48rm" event={"ID":"44425c8d-6b63-40c8-80c4-cc428b7618fb","Type":"ContainerStarted","Data":"982b9e0b66ce4493944b9f96b2ced93c01837077140ae854baacfa21641de541"} Jul 28 01:00:45.979333 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.979298 2568 generic.go:356] "Generic (PLEG): container finished" podID="e808158a-821c-4ead-8d85-1e753a225c66" containerID="2e0b1a39cc14d9f2ee9deb6f5126fc3fd491ea92cea8e8f29ba3e4dfe5d83012" exitCode=0 Jul 28 01:00:45.979518 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.979370 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-896d47fb7-69wkg" Jul 28 01:00:45.979518 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.979391 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-896d47fb7-69wkg" event={"ID":"e808158a-821c-4ead-8d85-1e753a225c66","Type":"ContainerDied","Data":"2e0b1a39cc14d9f2ee9deb6f5126fc3fd491ea92cea8e8f29ba3e4dfe5d83012"} Jul 28 01:00:45.979518 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.979485 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-896d47fb7-69wkg" event={"ID":"e808158a-821c-4ead-8d85-1e753a225c66","Type":"ContainerDied","Data":"7b3796508e4c08baf8c0c6cd1ef8a0cf68e9cf969aed9c085f01d763949cc2eb"} Jul 28 01:00:45.979518 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.979514 2568 scope.go:117] "RemoveContainer" containerID="2e0b1a39cc14d9f2ee9deb6f5126fc3fd491ea92cea8e8f29ba3e4dfe5d83012" Jul 28 01:00:45.991770 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.991742 2568 scope.go:117] "RemoveContainer" containerID="2e0b1a39cc14d9f2ee9deb6f5126fc3fd491ea92cea8e8f29ba3e4dfe5d83012" Jul 28 01:00:45.992107 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:00:45.992088 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"2e0b1a39cc14d9f2ee9deb6f5126fc3fd491ea92cea8e8f29ba3e4dfe5d83012\": container with ID starting with 2e0b1a39cc14d9f2ee9deb6f5126fc3fd491ea92cea8e8f29ba3e4dfe5d83012 not found: ID does not exist" containerID="2e0b1a39cc14d9f2ee9deb6f5126fc3fd491ea92cea8e8f29ba3e4dfe5d83012" Jul 28 01:00:45.992178 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:45.992116 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"2e0b1a39cc14d9f2ee9deb6f5126fc3fd491ea92cea8e8f29ba3e4dfe5d83012"} err="failed to get container status \"2e0b1a39cc14d9f2ee9deb6f5126fc3fd491ea92cea8e8f29ba3e4dfe5d83012\": rpc error: code = NotFound desc = could not find container \"2e0b1a39cc14d9f2ee9deb6f5126fc3fd491ea92cea8e8f29ba3e4dfe5d83012\": container with ID starting with 2e0b1a39cc14d9f2ee9deb6f5126fc3fd491ea92cea8e8f29ba3e4dfe5d83012 not found: ID does not exist" Jul 28 01:00:46.006041 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:46.005998 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-896d47fb7-69wkg"] Jul 28 01:00:46.017359 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:46.017325 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-896d47fb7-69wkg"] Jul 28 01:00:47.535138 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:47.535097 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e808158a-821c-4ead-8d85-1e753a225c66" path="/var/lib/kubelet/pods/e808158a-821c-4ead-8d85-1e753a225c66/volumes" Jul 28 01:00:50.006287 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:50.006250 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-w2j8f" event={"ID":"22816147-c1a6-4992-ad71-29343628f329","Type":"ContainerStarted","Data":"a58f4d59deb7f62ba20ef4561315fa01a29b821cd06c04adcf70a10643508414"} Jul 28 01:00:50.006772 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:50.006328 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-w2j8f" Jul 28 01:00:50.007797 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:50.007770 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r48rm" event={"ID":"44425c8d-6b63-40c8-80c4-cc428b7618fb","Type":"ContainerStarted","Data":"26c95b6955edb15dc702d62e067fae5e925e3a1dd0dee1698219aa7628f36327"} Jul 28 01:00:50.025948 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:50.025892 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-64c94fd64f-w2j8f" podStartSLOduration=2.065616026 podStartE2EDuration="7.025872621s" totalImagesPullingTime="4.960256595s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:00:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:00:50.024615901 +0000 UTC m=+446.944216576" watchObservedRunningTime="2026-07-28 01:00:50.025872621 +0000 UTC m=+446.945473351" Jul 28 01:00:50.039592 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:00:50.039519 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-r48rm" podStartSLOduration=1.891034414 podStartE2EDuration="6.039501778s" totalImagesPullingTime="4.148467364s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:00:44 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:00:50.038805071 +0000 UTC m=+446.958405767" watchObservedRunningTime="2026-07-28 01:00:50.039501778 +0000 UTC m=+446.959102463" Jul 28 01:01:00.856905 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:00.856863 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-75d556bd77-q6ssk"] Jul 28 01:01:00.857309 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:00.857238 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e808158a-821c-4ead-8d85-1e753a225c66" containerName="console" Jul 28 01:01:00.857309 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:00.857248 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e808158a-821c-4ead-8d85-1e753a225c66" containerName="console" Jul 28 01:01:00.857309 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:00.857302 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e808158a-821c-4ead-8d85-1e753a225c66" containerName="console" Jul 28 01:01:00.859577 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:00.859543 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-q6ssk" Jul 28 01:01:00.866845 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:00.866813 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-q6ssk"] Jul 28 01:01:00.914168 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:00.914122 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnf2s\" (UniqueName: \"kubernetes.io/projected/ea2a4cc0-6cdf-470f-aa39-d8de8326347b-kube-api-access-mnf2s\") pod \"authorino-75d556bd77-q6ssk\" (UID: \"ea2a4cc0-6cdf-470f-aa39-d8de8326347b\") " pod="kuadrant-system/authorino-75d556bd77-q6ssk" Jul 28 01:01:01.014011 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:01.013978 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-64c94fd64f-w2j8f" Jul 28 01:01:01.014818 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:01.014800 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnf2s\" (UniqueName: \"kubernetes.io/projected/ea2a4cc0-6cdf-470f-aa39-d8de8326347b-kube-api-access-mnf2s\") pod \"authorino-75d556bd77-q6ssk\" (UID: \"ea2a4cc0-6cdf-470f-aa39-d8de8326347b\") " pod="kuadrant-system/authorino-75d556bd77-q6ssk" Jul 28 01:01:01.025643 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:01.025610 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnf2s\" (UniqueName: \"kubernetes.io/projected/ea2a4cc0-6cdf-470f-aa39-d8de8326347b-kube-api-access-mnf2s\") pod \"authorino-75d556bd77-q6ssk\" (UID: \"ea2a4cc0-6cdf-470f-aa39-d8de8326347b\") " pod="kuadrant-system/authorino-75d556bd77-q6ssk" Jul 28 01:01:01.170877 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:01.170774 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-q6ssk" Jul 28 01:01:01.317481 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:01.317451 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-75d556bd77-q6ssk"] Jul 28 01:01:01.319483 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:01:01.319457 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podea2a4cc0_6cdf_470f_aa39_d8de8326347b.slice/crio-52ad718dd347f1a5d87672914371919da31a8eb35a14a784ff69f5aca65ea05e WatchSource:0}: Error finding container 52ad718dd347f1a5d87672914371919da31a8eb35a14a784ff69f5aca65ea05e: Status 404 returned error can't find the container with id 52ad718dd347f1a5d87672914371919da31a8eb35a14a784ff69f5aca65ea05e Jul 28 01:01:02.078243 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:02.078125 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-q6ssk" event={"ID":"ea2a4cc0-6cdf-470f-aa39-d8de8326347b","Type":"ContainerStarted","Data":"960c25837e9bf1c763b4758bca2c4ef87fa5f88a0989f7f9d4ff7962a7520393"} Jul 28 01:01:02.078243 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:02.078186 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-q6ssk" event={"ID":"ea2a4cc0-6cdf-470f-aa39-d8de8326347b","Type":"ContainerStarted","Data":"52ad718dd347f1a5d87672914371919da31a8eb35a14a784ff69f5aca65ea05e"} Jul 28 01:01:02.093501 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:02.093426 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-75d556bd77-q6ssk" podStartSLOduration=1.755474418 podStartE2EDuration="2.093404159s" totalImagesPullingTime="337.929741ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:01:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:01:02.091176612 +0000 UTC m=+459.010777296" watchObservedRunningTime="2026-07-28 01:01:02.093404159 +0000 UTC m=+459.013004843" Jul 28 01:01:02.122369 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:02.122308 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-r48rm"] Jul 28 01:01:02.122674 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:02.122609 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-r48rm" podUID="44425c8d-6b63-40c8-80c4-cc428b7618fb" containerName="authorino" containerID="cri-o://26c95b6955edb15dc702d62e067fae5e925e3a1dd0dee1698219aa7628f36327" gracePeriod=30 Jul 28 01:01:02.374755 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:02.374717 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r48rm" Jul 28 01:01:02.430454 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:02.430398 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6hpxj\" (UniqueName: \"kubernetes.io/projected/44425c8d-6b63-40c8-80c4-cc428b7618fb-kube-api-access-6hpxj\") pod \"44425c8d-6b63-40c8-80c4-cc428b7618fb\" (UID: \"44425c8d-6b63-40c8-80c4-cc428b7618fb\") " Jul 28 01:01:02.432798 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:02.432759 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/44425c8d-6b63-40c8-80c4-cc428b7618fb-kube-api-access-6hpxj" (OuterVolumeSpecName: "kube-api-access-6hpxj") pod "44425c8d-6b63-40c8-80c4-cc428b7618fb" (UID: "44425c8d-6b63-40c8-80c4-cc428b7618fb"). InnerVolumeSpecName "kube-api-access-6hpxj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:01:02.531945 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:02.531899 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6hpxj\" (UniqueName: \"kubernetes.io/projected/44425c8d-6b63-40c8-80c4-cc428b7618fb-kube-api-access-6hpxj\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:01:03.085355 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:03.085255 2568 generic.go:356] "Generic (PLEG): container finished" podID="44425c8d-6b63-40c8-80c4-cc428b7618fb" containerID="26c95b6955edb15dc702d62e067fae5e925e3a1dd0dee1698219aa7628f36327" exitCode=0 Jul 28 01:01:03.085355 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:03.085299 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-r48rm" Jul 28 01:01:03.085355 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:03.085343 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r48rm" event={"ID":"44425c8d-6b63-40c8-80c4-cc428b7618fb","Type":"ContainerDied","Data":"26c95b6955edb15dc702d62e067fae5e925e3a1dd0dee1698219aa7628f36327"} Jul 28 01:01:03.085951 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:03.085384 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-r48rm" event={"ID":"44425c8d-6b63-40c8-80c4-cc428b7618fb","Type":"ContainerDied","Data":"982b9e0b66ce4493944b9f96b2ced93c01837077140ae854baacfa21641de541"} Jul 28 01:01:03.085951 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:03.085401 2568 scope.go:117] "RemoveContainer" containerID="26c95b6955edb15dc702d62e067fae5e925e3a1dd0dee1698219aa7628f36327" Jul 28 01:01:03.095348 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:03.095326 2568 scope.go:117] "RemoveContainer" containerID="26c95b6955edb15dc702d62e067fae5e925e3a1dd0dee1698219aa7628f36327" Jul 28 01:01:03.095703 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:01:03.095680 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"26c95b6955edb15dc702d62e067fae5e925e3a1dd0dee1698219aa7628f36327\": container with ID starting with 26c95b6955edb15dc702d62e067fae5e925e3a1dd0dee1698219aa7628f36327 not found: ID does not exist" containerID="26c95b6955edb15dc702d62e067fae5e925e3a1dd0dee1698219aa7628f36327" Jul 28 01:01:03.095808 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:03.095711 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"26c95b6955edb15dc702d62e067fae5e925e3a1dd0dee1698219aa7628f36327"} err="failed to get container status \"26c95b6955edb15dc702d62e067fae5e925e3a1dd0dee1698219aa7628f36327\": rpc error: code = NotFound desc = could not find container \"26c95b6955edb15dc702d62e067fae5e925e3a1dd0dee1698219aa7628f36327\": container with ID starting with 26c95b6955edb15dc702d62e067fae5e925e3a1dd0dee1698219aa7628f36327 not found: ID does not exist" Jul 28 01:01:03.106130 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:03.106089 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-r48rm"] Jul 28 01:01:03.108879 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:03.108845 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-r48rm"] Jul 28 01:01:03.535460 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:03.535417 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="44425c8d-6b63-40c8-80c4-cc428b7618fb" path="/var/lib/kubelet/pods/44425c8d-6b63-40c8-80c4-cc428b7618fb/volumes" Jul 28 01:01:15.806090 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:15.806051 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w2j8f"] Jul 28 01:01:15.806705 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:15.806274 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/limitador-limitador-64c94fd64f-w2j8f" podUID="22816147-c1a6-4992-ad71-29343628f329" containerName="limitador" containerID="cri-o://a58f4d59deb7f62ba20ef4561315fa01a29b821cd06c04adcf70a10643508414" gracePeriod=30 Jul 28 01:01:16.161905 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:16.161865 2568 generic.go:356] "Generic (PLEG): container finished" podID="22816147-c1a6-4992-ad71-29343628f329" containerID="a58f4d59deb7f62ba20ef4561315fa01a29b821cd06c04adcf70a10643508414" exitCode=0 Jul 28 01:01:16.162095 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:16.161944 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-w2j8f" event={"ID":"22816147-c1a6-4992-ad71-29343628f329","Type":"ContainerDied","Data":"a58f4d59deb7f62ba20ef4561315fa01a29b821cd06c04adcf70a10643508414"} Jul 28 01:01:16.770531 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:16.770504 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-w2j8f" Jul 28 01:01:16.858445 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:16.858413 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hk8h\" (UniqueName: \"kubernetes.io/projected/22816147-c1a6-4992-ad71-29343628f329-kube-api-access-7hk8h\") pod \"22816147-c1a6-4992-ad71-29343628f329\" (UID: \"22816147-c1a6-4992-ad71-29343628f329\") " Jul 28 01:01:16.858962 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:16.858489 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/22816147-c1a6-4992-ad71-29343628f329-config-file\") pod \"22816147-c1a6-4992-ad71-29343628f329\" (UID: \"22816147-c1a6-4992-ad71-29343628f329\") " Jul 28 01:01:16.858962 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:16.858841 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22816147-c1a6-4992-ad71-29343628f329-config-file" (OuterVolumeSpecName: "config-file") pod "22816147-c1a6-4992-ad71-29343628f329" (UID: "22816147-c1a6-4992-ad71-29343628f329"). InnerVolumeSpecName "config-file". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:01:16.860727 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:16.860702 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22816147-c1a6-4992-ad71-29343628f329-kube-api-access-7hk8h" (OuterVolumeSpecName: "kube-api-access-7hk8h") pod "22816147-c1a6-4992-ad71-29343628f329" (UID: "22816147-c1a6-4992-ad71-29343628f329"). InnerVolumeSpecName "kube-api-access-7hk8h". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:01:16.959522 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:16.959418 2568 reconciler_common.go:299] "Volume detached for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/22816147-c1a6-4992-ad71-29343628f329-config-file\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:01:16.959522 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:16.959461 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hk8h\" (UniqueName: \"kubernetes.io/projected/22816147-c1a6-4992-ad71-29343628f329-kube-api-access-7hk8h\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:01:17.169341 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:17.169305 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-64c94fd64f-w2j8f" event={"ID":"22816147-c1a6-4992-ad71-29343628f329","Type":"ContainerDied","Data":"398f505ecb78da0af02abed6e5495ae6ccb2f2d4f9ddc10b4901fa1a0ff4b322"} Jul 28 01:01:17.169547 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:17.169371 2568 scope.go:117] "RemoveContainer" containerID="a58f4d59deb7f62ba20ef4561315fa01a29b821cd06c04adcf70a10643508414" Jul 28 01:01:17.169547 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:17.169319 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-64c94fd64f-w2j8f" Jul 28 01:01:17.192445 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:17.192411 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w2j8f"] Jul 28 01:01:17.194525 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:17.194499 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/limitador-limitador-64c94fd64f-w2j8f"] Jul 28 01:01:17.534202 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:17.534166 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22816147-c1a6-4992-ad71-29343628f329" path="/var/lib/kubelet/pods/22816147-c1a6-4992-ad71-29343628f329/volumes" Jul 28 01:01:20.902827 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:20.902789 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-nr87l"] Jul 28 01:01:20.903638 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:20.903610 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44425c8d-6b63-40c8-80c4-cc428b7618fb" containerName="authorino" Jul 28 01:01:20.903638 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:20.903638 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="44425c8d-6b63-40c8-80c4-cc428b7618fb" containerName="authorino" Jul 28 01:01:20.903819 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:20.903650 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22816147-c1a6-4992-ad71-29343628f329" containerName="limitador" Jul 28 01:01:20.903819 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:20.903658 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="22816147-c1a6-4992-ad71-29343628f329" containerName="limitador" Jul 28 01:01:20.903819 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:20.903752 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="22816147-c1a6-4992-ad71-29343628f329" containerName="limitador" Jul 28 01:01:20.903819 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:20.903766 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="44425c8d-6b63-40c8-80c4-cc428b7618fb" containerName="authorino" Jul 28 01:01:20.967496 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:20.967447 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-nr87l"] Jul 28 01:01:20.967696 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:20.967609 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nr87l" Jul 28 01:01:20.970637 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:20.970608 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 28 01:01:20.970794 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:20.970690 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"default-dockercfg-tnwf2\"" Jul 28 01:01:20.970794 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:20.970727 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 28 01:01:20.971430 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:20.971413 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 28 01:01:21.098474 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:21.098435 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9de47ce0-1be0-47a4-9971-89bfa395d37c-data\") pod \"postgres-69fb4594cf-nr87l\" (UID: \"9de47ce0-1be0-47a4-9971-89bfa395d37c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nr87l" Jul 28 01:01:21.098713 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:21.098517 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4l5bq\" (UniqueName: \"kubernetes.io/projected/9de47ce0-1be0-47a4-9971-89bfa395d37c-kube-api-access-4l5bq\") pod \"postgres-69fb4594cf-nr87l\" (UID: \"9de47ce0-1be0-47a4-9971-89bfa395d37c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nr87l" Jul 28 01:01:21.200051 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:21.199939 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4l5bq\" (UniqueName: \"kubernetes.io/projected/9de47ce0-1be0-47a4-9971-89bfa395d37c-kube-api-access-4l5bq\") pod \"postgres-69fb4594cf-nr87l\" (UID: \"9de47ce0-1be0-47a4-9971-89bfa395d37c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nr87l" Jul 28 01:01:21.200051 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:21.200011 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9de47ce0-1be0-47a4-9971-89bfa395d37c-data\") pod \"postgres-69fb4594cf-nr87l\" (UID: \"9de47ce0-1be0-47a4-9971-89bfa395d37c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nr87l" Jul 28 01:01:21.200437 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:21.200412 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data\" (UniqueName: \"kubernetes.io/empty-dir/9de47ce0-1be0-47a4-9971-89bfa395d37c-data\") pod \"postgres-69fb4594cf-nr87l\" (UID: \"9de47ce0-1be0-47a4-9971-89bfa395d37c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nr87l" Jul 28 01:01:21.208388 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:21.208360 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4l5bq\" (UniqueName: \"kubernetes.io/projected/9de47ce0-1be0-47a4-9971-89bfa395d37c-kube-api-access-4l5bq\") pod \"postgres-69fb4594cf-nr87l\" (UID: \"9de47ce0-1be0-47a4-9971-89bfa395d37c\") " pod="odh-ai-gateway-infra/postgres-69fb4594cf-nr87l" Jul 28 01:01:21.278502 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:21.278457 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nr87l" Jul 28 01:01:21.427998 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:21.427964 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/postgres-69fb4594cf-nr87l"] Jul 28 01:01:21.430806 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:01:21.430775 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9de47ce0_1be0_47a4_9971_89bfa395d37c.slice/crio-6adcbc60dc550db75a34804f9edb62a0602bb1147d564f338a8aeb8945e3e2bf WatchSource:0}: Error finding container 6adcbc60dc550db75a34804f9edb62a0602bb1147d564f338a8aeb8945e3e2bf: Status 404 returned error can't find the container with id 6adcbc60dc550db75a34804f9edb62a0602bb1147d564f338a8aeb8945e3e2bf Jul 28 01:01:22.208531 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:22.208490 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nr87l" event={"ID":"9de47ce0-1be0-47a4-9971-89bfa395d37c","Type":"ContainerStarted","Data":"6adcbc60dc550db75a34804f9edb62a0602bb1147d564f338a8aeb8945e3e2bf"} Jul 28 01:01:26.890460 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:26.890430 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"postgres-creds\"" Jul 28 01:01:27.243906 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:27.243807 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nr87l" event={"ID":"9de47ce0-1be0-47a4-9971-89bfa395d37c","Type":"ContainerStarted","Data":"b97eb36b5190f92788d55c49ea43e6f5ff8a7e2ee04284ffdf35d1ec5e8e48f9"} Jul 28 01:01:27.244098 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:27.243958 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nr87l" Jul 28 01:01:27.259320 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:27.259262 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nr87l" podStartSLOduration=1.80376957 podStartE2EDuration="7.259244033s" totalImagesPullingTime="5.455474463s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:01:20 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:01:27.257033712 +0000 UTC m=+484.176634396" watchObservedRunningTime="2026-07-28 01:01:27.259244033 +0000 UTC m=+484.178844716" Jul 28 01:01:33.280543 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:33.280510 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/postgres-69fb4594cf-nr87l" Jul 28 01:01:33.816945 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:33.816904 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gbqtf"] Jul 28 01:01:33.819680 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:33.819660 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gbqtf" Jul 28 01:01:33.828053 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:33.828020 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gbqtf"] Jul 28 01:01:34.016787 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.016735 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-phz5t\" (UniqueName: \"kubernetes.io/projected/c238d9cb-1f62-4eec-8e04-b8653f2e791b-kube-api-access-phz5t\") pod \"authorino-5d4b67c446-gbqtf\" (UID: \"c238d9cb-1f62-4eec-8e04-b8653f2e791b\") " pod="kuadrant-system/authorino-5d4b67c446-gbqtf" Jul 28 01:01:34.048119 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.048076 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gbqtf"] Jul 28 01:01:34.048385 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:01:34.048365 2568 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-phz5t], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-5d4b67c446-gbqtf" podUID="c238d9cb-1f62-4eec-8e04-b8653f2e791b" Jul 28 01:01:34.068488 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.068391 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-6775bcf48c-7dxdq"] Jul 28 01:01:34.071244 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.071224 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6775bcf48c-7dxdq" Jul 28 01:01:34.077403 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.077368 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-6775bcf48c-7dxdq"] Jul 28 01:01:34.117970 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.117926 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-phz5t\" (UniqueName: \"kubernetes.io/projected/c238d9cb-1f62-4eec-8e04-b8653f2e791b-kube-api-access-phz5t\") pod \"authorino-5d4b67c446-gbqtf\" (UID: \"c238d9cb-1f62-4eec-8e04-b8653f2e791b\") " pod="kuadrant-system/authorino-5d4b67c446-gbqtf" Jul 28 01:01:34.128819 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.128790 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-phz5t\" (UniqueName: \"kubernetes.io/projected/c238d9cb-1f62-4eec-8e04-b8653f2e791b-kube-api-access-phz5t\") pod \"authorino-5d4b67c446-gbqtf\" (UID: \"c238d9cb-1f62-4eec-8e04-b8653f2e791b\") " pod="kuadrant-system/authorino-5d4b67c446-gbqtf" Jul 28 01:01:34.219358 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.219318 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g78vk\" (UniqueName: \"kubernetes.io/projected/13eefbe4-8308-4ab8-86cf-f35ffd5361f6-kube-api-access-g78vk\") pod \"authorino-6775bcf48c-7dxdq\" (UID: \"13eefbe4-8308-4ab8-86cf-f35ffd5361f6\") " pod="kuadrant-system/authorino-6775bcf48c-7dxdq" Jul 28 01:01:34.279662 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.279624 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gbqtf" Jul 28 01:01:34.293667 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.293639 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gbqtf" Jul 28 01:01:34.320843 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.320744 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g78vk\" (UniqueName: \"kubernetes.io/projected/13eefbe4-8308-4ab8-86cf-f35ffd5361f6-kube-api-access-g78vk\") pod \"authorino-6775bcf48c-7dxdq\" (UID: \"13eefbe4-8308-4ab8-86cf-f35ffd5361f6\") " pod="kuadrant-system/authorino-6775bcf48c-7dxdq" Jul 28 01:01:34.329018 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.328994 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g78vk\" (UniqueName: \"kubernetes.io/projected/13eefbe4-8308-4ab8-86cf-f35ffd5361f6-kube-api-access-g78vk\") pod \"authorino-6775bcf48c-7dxdq\" (UID: \"13eefbe4-8308-4ab8-86cf-f35ffd5361f6\") " pod="kuadrant-system/authorino-6775bcf48c-7dxdq" Jul 28 01:01:34.381678 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.381635 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6775bcf48c-7dxdq" Jul 28 01:01:34.418431 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.418389 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6775bcf48c-7dxdq"] Jul 28 01:01:34.421406 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.421373 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-phz5t\" (UniqueName: \"kubernetes.io/projected/c238d9cb-1f62-4eec-8e04-b8653f2e791b-kube-api-access-phz5t\") pod \"c238d9cb-1f62-4eec-8e04-b8653f2e791b\" (UID: \"c238d9cb-1f62-4eec-8e04-b8653f2e791b\") " Jul 28 01:01:34.423885 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.423849 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c238d9cb-1f62-4eec-8e04-b8653f2e791b-kube-api-access-phz5t" (OuterVolumeSpecName: "kube-api-access-phz5t") pod "c238d9cb-1f62-4eec-8e04-b8653f2e791b" (UID: "c238d9cb-1f62-4eec-8e04-b8653f2e791b"). InnerVolumeSpecName "kube-api-access-phz5t". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:01:34.443944 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.443893 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-597854b5d7-b58hq"] Jul 28 01:01:34.447656 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.447622 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-597854b5d7-b58hq" Jul 28 01:01:34.455273 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.454304 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 28 01:01:34.456338 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.456299 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-597854b5d7-b58hq"] Jul 28 01:01:34.522815 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.522770 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-crjjx\" (UniqueName: \"kubernetes.io/projected/e5190e03-0dfb-4f12-aa55-2b65cf4c7800-kube-api-access-crjjx\") pod \"authorino-597854b5d7-b58hq\" (UID: \"e5190e03-0dfb-4f12-aa55-2b65cf4c7800\") " pod="kuadrant-system/authorino-597854b5d7-b58hq" Jul 28 01:01:34.523009 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.522910 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5190e03-0dfb-4f12-aa55-2b65cf4c7800-tls-cert\") pod \"authorino-597854b5d7-b58hq\" (UID: \"e5190e03-0dfb-4f12-aa55-2b65cf4c7800\") " pod="kuadrant-system/authorino-597854b5d7-b58hq" Jul 28 01:01:34.523083 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.523012 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-phz5t\" (UniqueName: \"kubernetes.io/projected/c238d9cb-1f62-4eec-8e04-b8653f2e791b-kube-api-access-phz5t\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:01:34.543966 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.543936 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6775bcf48c-7dxdq"] Jul 28 01:01:34.545921 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:01:34.545888 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod13eefbe4_8308_4ab8_86cf_f35ffd5361f6.slice/crio-5a0bc8e62cb47280340fef796c57eb18905d2dfbf8b2be37f45b6230184e7a20 WatchSource:0}: Error finding container 5a0bc8e62cb47280340fef796c57eb18905d2dfbf8b2be37f45b6230184e7a20: Status 404 returned error can't find the container with id 5a0bc8e62cb47280340fef796c57eb18905d2dfbf8b2be37f45b6230184e7a20 Jul 28 01:01:34.624248 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.624200 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-crjjx\" (UniqueName: \"kubernetes.io/projected/e5190e03-0dfb-4f12-aa55-2b65cf4c7800-kube-api-access-crjjx\") pod \"authorino-597854b5d7-b58hq\" (UID: \"e5190e03-0dfb-4f12-aa55-2b65cf4c7800\") " pod="kuadrant-system/authorino-597854b5d7-b58hq" Jul 28 01:01:34.624485 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.624304 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5190e03-0dfb-4f12-aa55-2b65cf4c7800-tls-cert\") pod \"authorino-597854b5d7-b58hq\" (UID: \"e5190e03-0dfb-4f12-aa55-2b65cf4c7800\") " pod="kuadrant-system/authorino-597854b5d7-b58hq" Jul 28 01:01:34.627008 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.626972 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5190e03-0dfb-4f12-aa55-2b65cf4c7800-tls-cert\") pod \"authorino-597854b5d7-b58hq\" (UID: \"e5190e03-0dfb-4f12-aa55-2b65cf4c7800\") " pod="kuadrant-system/authorino-597854b5d7-b58hq" Jul 28 01:01:34.631966 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.631937 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-crjjx\" (UniqueName: \"kubernetes.io/projected/e5190e03-0dfb-4f12-aa55-2b65cf4c7800-kube-api-access-crjjx\") pod \"authorino-597854b5d7-b58hq\" (UID: \"e5190e03-0dfb-4f12-aa55-2b65cf4c7800\") " pod="kuadrant-system/authorino-597854b5d7-b58hq" Jul 28 01:01:34.763998 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.763955 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-597854b5d7-b58hq" Jul 28 01:01:34.909385 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:34.909325 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-597854b5d7-b58hq"] Jul 28 01:01:34.912075 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:01:34.912051 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pode5190e03_0dfb_4f12_aa55_2b65cf4c7800.slice/crio-99bb6e25014d8d0f9d58fb4f5693a22021a801c091d8b65a32a88eaa2d166036 WatchSource:0}: Error finding container 99bb6e25014d8d0f9d58fb4f5693a22021a801c091d8b65a32a88eaa2d166036: Status 404 returned error can't find the container with id 99bb6e25014d8d0f9d58fb4f5693a22021a801c091d8b65a32a88eaa2d166036 Jul 28 01:01:35.287041 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:35.286944 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-597854b5d7-b58hq" event={"ID":"e5190e03-0dfb-4f12-aa55-2b65cf4c7800","Type":"ContainerStarted","Data":"99bb6e25014d8d0f9d58fb4f5693a22021a801c091d8b65a32a88eaa2d166036"} Jul 28 01:01:35.288586 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:35.288543 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6775bcf48c-7dxdq" event={"ID":"13eefbe4-8308-4ab8-86cf-f35ffd5361f6","Type":"ContainerStarted","Data":"3718f41bf334c79455b84f3e302b5990189ea8227ced2a0e98477db9f63b5300"} Jul 28 01:01:35.288768 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:35.288609 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6775bcf48c-7dxdq" event={"ID":"13eefbe4-8308-4ab8-86cf-f35ffd5361f6","Type":"ContainerStarted","Data":"5a0bc8e62cb47280340fef796c57eb18905d2dfbf8b2be37f45b6230184e7a20"} Jul 28 01:01:35.288768 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:35.288609 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-6775bcf48c-7dxdq" podUID="13eefbe4-8308-4ab8-86cf-f35ffd5361f6" containerName="authorino" containerID="cri-o://3718f41bf334c79455b84f3e302b5990189ea8227ced2a0e98477db9f63b5300" gracePeriod=30 Jul 28 01:01:35.288768 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:35.288734 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-gbqtf" Jul 28 01:01:35.300978 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:35.300828 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-6775bcf48c-7dxdq" podStartSLOduration=0.903447711 podStartE2EDuration="1.300806849s" totalImagesPullingTime="397.359138ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:01:35.300698867 +0000 UTC m=+492.220299551" watchObservedRunningTime="2026-07-28 01:01:35.300806849 +0000 UTC m=+492.220407534" Jul 28 01:01:35.398983 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:35.398947 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gbqtf"] Jul 28 01:01:35.402145 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:35.402113 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-gbqtf"] Jul 28 01:01:35.535526 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:35.535492 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c238d9cb-1f62-4eec-8e04-b8653f2e791b" path="/var/lib/kubelet/pods/c238d9cb-1f62-4eec-8e04-b8653f2e791b/volumes" Jul 28 01:01:35.546411 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:35.546383 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6775bcf48c-7dxdq" Jul 28 01:01:35.632757 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:35.632715 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g78vk\" (UniqueName: \"kubernetes.io/projected/13eefbe4-8308-4ab8-86cf-f35ffd5361f6-kube-api-access-g78vk\") pod \"13eefbe4-8308-4ab8-86cf-f35ffd5361f6\" (UID: \"13eefbe4-8308-4ab8-86cf-f35ffd5361f6\") " Jul 28 01:01:35.635074 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:35.635041 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/13eefbe4-8308-4ab8-86cf-f35ffd5361f6-kube-api-access-g78vk" (OuterVolumeSpecName: "kube-api-access-g78vk") pod "13eefbe4-8308-4ab8-86cf-f35ffd5361f6" (UID: "13eefbe4-8308-4ab8-86cf-f35ffd5361f6"). InnerVolumeSpecName "kube-api-access-g78vk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:01:35.733578 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:35.733535 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g78vk\" (UniqueName: \"kubernetes.io/projected/13eefbe4-8308-4ab8-86cf-f35ffd5361f6-kube-api-access-g78vk\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:01:36.295704 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:36.295663 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-597854b5d7-b58hq" event={"ID":"e5190e03-0dfb-4f12-aa55-2b65cf4c7800","Type":"ContainerStarted","Data":"f044b54d3d0d90535805c4aa491ecd29d07ea861f9e7a4cc19d7a877dc1cdce0"} Jul 28 01:01:36.296965 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:36.296935 2568 generic.go:356] "Generic (PLEG): container finished" podID="13eefbe4-8308-4ab8-86cf-f35ffd5361f6" containerID="3718f41bf334c79455b84f3e302b5990189ea8227ced2a0e98477db9f63b5300" exitCode=0 Jul 28 01:01:36.296965 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:36.296967 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-6775bcf48c-7dxdq" Jul 28 01:01:36.297138 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:36.297010 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6775bcf48c-7dxdq" event={"ID":"13eefbe4-8308-4ab8-86cf-f35ffd5361f6","Type":"ContainerDied","Data":"3718f41bf334c79455b84f3e302b5990189ea8227ced2a0e98477db9f63b5300"} Jul 28 01:01:36.297138 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:36.297051 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-6775bcf48c-7dxdq" event={"ID":"13eefbe4-8308-4ab8-86cf-f35ffd5361f6","Type":"ContainerDied","Data":"5a0bc8e62cb47280340fef796c57eb18905d2dfbf8b2be37f45b6230184e7a20"} Jul 28 01:01:36.297138 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:36.297070 2568 scope.go:117] "RemoveContainer" containerID="3718f41bf334c79455b84f3e302b5990189ea8227ced2a0e98477db9f63b5300" Jul 28 01:01:36.307299 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:36.307278 2568 scope.go:117] "RemoveContainer" containerID="3718f41bf334c79455b84f3e302b5990189ea8227ced2a0e98477db9f63b5300" Jul 28 01:01:36.307645 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:01:36.307622 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3718f41bf334c79455b84f3e302b5990189ea8227ced2a0e98477db9f63b5300\": container with ID starting with 3718f41bf334c79455b84f3e302b5990189ea8227ced2a0e98477db9f63b5300 not found: ID does not exist" containerID="3718f41bf334c79455b84f3e302b5990189ea8227ced2a0e98477db9f63b5300" Jul 28 01:01:36.307688 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:36.307658 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3718f41bf334c79455b84f3e302b5990189ea8227ced2a0e98477db9f63b5300"} err="failed to get container status \"3718f41bf334c79455b84f3e302b5990189ea8227ced2a0e98477db9f63b5300\": rpc error: code = NotFound desc = could not find container \"3718f41bf334c79455b84f3e302b5990189ea8227ced2a0e98477db9f63b5300\": container with ID starting with 3718f41bf334c79455b84f3e302b5990189ea8227ced2a0e98477db9f63b5300 not found: ID does not exist" Jul 28 01:01:36.311861 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:36.311812 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-597854b5d7-b58hq" podStartSLOduration=1.876432174 podStartE2EDuration="2.311795638s" totalImagesPullingTime="435.363464ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:01:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:01:36.30962846 +0000 UTC m=+493.229229147" watchObservedRunningTime="2026-07-28 01:01:36.311795638 +0000 UTC m=+493.231396322" Jul 28 01:01:36.322699 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:36.322611 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-6775bcf48c-7dxdq"] Jul 28 01:01:36.325850 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:36.325820 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-6775bcf48c-7dxdq"] Jul 28 01:01:36.334716 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:36.334680 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-q6ssk"] Jul 28 01:01:36.334904 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:36.334861 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-75d556bd77-q6ssk" podUID="ea2a4cc0-6cdf-470f-aa39-d8de8326347b" containerName="authorino" containerID="cri-o://960c25837e9bf1c763b4758bca2c4ef87fa5f88a0989f7f9d4ff7962a7520393" gracePeriod=30 Jul 28 01:01:36.616278 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:36.616241 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-q6ssk" Jul 28 01:01:36.639658 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:36.639617 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnf2s\" (UniqueName: \"kubernetes.io/projected/ea2a4cc0-6cdf-470f-aa39-d8de8326347b-kube-api-access-mnf2s\") pod \"ea2a4cc0-6cdf-470f-aa39-d8de8326347b\" (UID: \"ea2a4cc0-6cdf-470f-aa39-d8de8326347b\") " Jul 28 01:01:36.641983 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:36.641945 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ea2a4cc0-6cdf-470f-aa39-d8de8326347b-kube-api-access-mnf2s" (OuterVolumeSpecName: "kube-api-access-mnf2s") pod "ea2a4cc0-6cdf-470f-aa39-d8de8326347b" (UID: "ea2a4cc0-6cdf-470f-aa39-d8de8326347b"). InnerVolumeSpecName "kube-api-access-mnf2s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:01:36.740313 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:36.740216 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnf2s\" (UniqueName: \"kubernetes.io/projected/ea2a4cc0-6cdf-470f-aa39-d8de8326347b-kube-api-access-mnf2s\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:01:37.308362 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:37.308316 2568 generic.go:356] "Generic (PLEG): container finished" podID="ea2a4cc0-6cdf-470f-aa39-d8de8326347b" containerID="960c25837e9bf1c763b4758bca2c4ef87fa5f88a0989f7f9d4ff7962a7520393" exitCode=0 Jul 28 01:01:37.308923 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:37.308387 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-75d556bd77-q6ssk" Jul 28 01:01:37.308923 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:37.308399 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-q6ssk" event={"ID":"ea2a4cc0-6cdf-470f-aa39-d8de8326347b","Type":"ContainerDied","Data":"960c25837e9bf1c763b4758bca2c4ef87fa5f88a0989f7f9d4ff7962a7520393"} Jul 28 01:01:37.308923 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:37.308444 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-75d556bd77-q6ssk" event={"ID":"ea2a4cc0-6cdf-470f-aa39-d8de8326347b","Type":"ContainerDied","Data":"52ad718dd347f1a5d87672914371919da31a8eb35a14a784ff69f5aca65ea05e"} Jul 28 01:01:37.308923 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:37.308462 2568 scope.go:117] "RemoveContainer" containerID="960c25837e9bf1c763b4758bca2c4ef87fa5f88a0989f7f9d4ff7962a7520393" Jul 28 01:01:37.319555 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:37.319533 2568 scope.go:117] "RemoveContainer" containerID="960c25837e9bf1c763b4758bca2c4ef87fa5f88a0989f7f9d4ff7962a7520393" Jul 28 01:01:37.319945 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:01:37.319923 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"960c25837e9bf1c763b4758bca2c4ef87fa5f88a0989f7f9d4ff7962a7520393\": container with ID starting with 960c25837e9bf1c763b4758bca2c4ef87fa5f88a0989f7f9d4ff7962a7520393 not found: ID does not exist" containerID="960c25837e9bf1c763b4758bca2c4ef87fa5f88a0989f7f9d4ff7962a7520393" Jul 28 01:01:37.320011 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:37.319955 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"960c25837e9bf1c763b4758bca2c4ef87fa5f88a0989f7f9d4ff7962a7520393"} err="failed to get container status \"960c25837e9bf1c763b4758bca2c4ef87fa5f88a0989f7f9d4ff7962a7520393\": rpc error: code = NotFound desc = could not find container \"960c25837e9bf1c763b4758bca2c4ef87fa5f88a0989f7f9d4ff7962a7520393\": container with ID starting with 960c25837e9bf1c763b4758bca2c4ef87fa5f88a0989f7f9d4ff7962a7520393 not found: ID does not exist" Jul 28 01:01:37.329753 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:37.329715 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-75d556bd77-q6ssk"] Jul 28 01:01:37.333236 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:37.333204 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-75d556bd77-q6ssk"] Jul 28 01:01:37.534808 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:37.534771 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="13eefbe4-8308-4ab8-86cf-f35ffd5361f6" path="/var/lib/kubelet/pods/13eefbe4-8308-4ab8-86cf-f35ffd5361f6/volumes" Jul 28 01:01:37.535125 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:37.535110 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ea2a4cc0-6cdf-470f-aa39-d8de8326347b" path="/var/lib/kubelet/pods/ea2a4cc0-6cdf-470f-aa39-d8de8326347b/volumes" Jul 28 01:01:40.818657 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:40.818617 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-5d5854bbf6-cr7r7"] Jul 28 01:01:40.819145 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:40.819125 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ea2a4cc0-6cdf-470f-aa39-d8de8326347b" containerName="authorino" Jul 28 01:01:40.819236 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:40.819149 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ea2a4cc0-6cdf-470f-aa39-d8de8326347b" containerName="authorino" Jul 28 01:01:40.819236 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:40.819176 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="13eefbe4-8308-4ab8-86cf-f35ffd5361f6" containerName="authorino" Jul 28 01:01:40.819236 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:40.819185 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="13eefbe4-8308-4ab8-86cf-f35ffd5361f6" containerName="authorino" Jul 28 01:01:40.819388 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:40.819287 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ea2a4cc0-6cdf-470f-aa39-d8de8326347b" containerName="authorino" Jul 28 01:01:40.819388 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:40.819302 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="13eefbe4-8308-4ab8-86cf-f35ffd5361f6" containerName="authorino" Jul 28 01:01:40.822625 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:40.822600 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d5854bbf6-cr7r7" Jul 28 01:01:40.827293 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:40.827267 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 28 01:01:40.827453 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:40.827435 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 28 01:01:40.827509 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:40.827489 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tj44w\"" Jul 28 01:01:40.836201 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:40.836171 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d5854bbf6-cr7r7"] Jul 28 01:01:40.872927 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:40.872882 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bdae9bf2-79d9-458b-af31-3b2f5afdcdbb-webhook-cert\") pod \"maas-controller-5d5854bbf6-cr7r7\" (UID: \"bdae9bf2-79d9-458b-af31-3b2f5afdcdbb\") " pod="opendatahub/maas-controller-5d5854bbf6-cr7r7" Jul 28 01:01:40.873115 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:40.872935 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-27ntj\" (UniqueName: \"kubernetes.io/projected/bdae9bf2-79d9-458b-af31-3b2f5afdcdbb-kube-api-access-27ntj\") pod \"maas-controller-5d5854bbf6-cr7r7\" (UID: \"bdae9bf2-79d9-458b-af31-3b2f5afdcdbb\") " pod="opendatahub/maas-controller-5d5854bbf6-cr7r7" Jul 28 01:01:40.973702 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:40.973665 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-27ntj\" (UniqueName: \"kubernetes.io/projected/bdae9bf2-79d9-458b-af31-3b2f5afdcdbb-kube-api-access-27ntj\") pod \"maas-controller-5d5854bbf6-cr7r7\" (UID: \"bdae9bf2-79d9-458b-af31-3b2f5afdcdbb\") " pod="opendatahub/maas-controller-5d5854bbf6-cr7r7" Jul 28 01:01:40.973917 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:40.973817 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bdae9bf2-79d9-458b-af31-3b2f5afdcdbb-webhook-cert\") pod \"maas-controller-5d5854bbf6-cr7r7\" (UID: \"bdae9bf2-79d9-458b-af31-3b2f5afdcdbb\") " pod="opendatahub/maas-controller-5d5854bbf6-cr7r7" Jul 28 01:01:40.973995 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:01:40.973933 2568 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 28 01:01:40.974052 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:01:40.974003 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bdae9bf2-79d9-458b-af31-3b2f5afdcdbb-webhook-cert podName:bdae9bf2-79d9-458b-af31-3b2f5afdcdbb nodeName:}" failed. No retries permitted until 2026-07-28 01:01:41.473980519 +0000 UTC m=+498.393581195 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/bdae9bf2-79d9-458b-af31-3b2f5afdcdbb-webhook-cert") pod "maas-controller-5d5854bbf6-cr7r7" (UID: "bdae9bf2-79d9-458b-af31-3b2f5afdcdbb") : secret "maas-controller-webhook-cert" not found Jul 28 01:01:40.986821 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:40.986790 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-27ntj\" (UniqueName: \"kubernetes.io/projected/bdae9bf2-79d9-458b-af31-3b2f5afdcdbb-kube-api-access-27ntj\") pod \"maas-controller-5d5854bbf6-cr7r7\" (UID: \"bdae9bf2-79d9-458b-af31-3b2f5afdcdbb\") " pod="opendatahub/maas-controller-5d5854bbf6-cr7r7" Jul 28 01:01:40.987924 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:40.987893 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85cd6fdbf4-r9jmr"] Jul 28 01:01:40.990610 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:40.990592 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85cd6fdbf4-r9jmr" Jul 28 01:01:41.001454 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:41.001426 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85cd6fdbf4-r9jmr"] Jul 28 01:01:41.074736 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:41.074633 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q4jsm\" (UniqueName: \"kubernetes.io/projected/ca56d924-f0e0-4d55-92ed-b92b873a57b8-kube-api-access-q4jsm\") pod \"maas-controller-85cd6fdbf4-r9jmr\" (UID: \"ca56d924-f0e0-4d55-92ed-b92b873a57b8\") " pod="opendatahub/maas-controller-85cd6fdbf4-r9jmr" Jul 28 01:01:41.074736 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:41.074709 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca56d924-f0e0-4d55-92ed-b92b873a57b8-webhook-cert\") pod \"maas-controller-85cd6fdbf4-r9jmr\" (UID: \"ca56d924-f0e0-4d55-92ed-b92b873a57b8\") " pod="opendatahub/maas-controller-85cd6fdbf4-r9jmr" Jul 28 01:01:41.175432 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:41.175397 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q4jsm\" (UniqueName: \"kubernetes.io/projected/ca56d924-f0e0-4d55-92ed-b92b873a57b8-kube-api-access-q4jsm\") pod \"maas-controller-85cd6fdbf4-r9jmr\" (UID: \"ca56d924-f0e0-4d55-92ed-b92b873a57b8\") " pod="opendatahub/maas-controller-85cd6fdbf4-r9jmr" Jul 28 01:01:41.175693 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:41.175475 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca56d924-f0e0-4d55-92ed-b92b873a57b8-webhook-cert\") pod \"maas-controller-85cd6fdbf4-r9jmr\" (UID: \"ca56d924-f0e0-4d55-92ed-b92b873a57b8\") " pod="opendatahub/maas-controller-85cd6fdbf4-r9jmr" Jul 28 01:01:41.175693 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:01:41.175610 2568 secret.go:189] Couldn't get secret opendatahub/maas-controller-webhook-cert: secret "maas-controller-webhook-cert" not found Jul 28 01:01:41.175693 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:01:41.175677 2568 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca56d924-f0e0-4d55-92ed-b92b873a57b8-webhook-cert podName:ca56d924-f0e0-4d55-92ed-b92b873a57b8 nodeName:}" failed. No retries permitted until 2026-07-28 01:01:41.675662033 +0000 UTC m=+498.595262694 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "webhook-cert" (UniqueName: "kubernetes.io/secret/ca56d924-f0e0-4d55-92ed-b92b873a57b8-webhook-cert") pod "maas-controller-85cd6fdbf4-r9jmr" (UID: "ca56d924-f0e0-4d55-92ed-b92b873a57b8") : secret "maas-controller-webhook-cert" not found Jul 28 01:01:41.186256 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:41.186228 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q4jsm\" (UniqueName: \"kubernetes.io/projected/ca56d924-f0e0-4d55-92ed-b92b873a57b8-kube-api-access-q4jsm\") pod \"maas-controller-85cd6fdbf4-r9jmr\" (UID: \"ca56d924-f0e0-4d55-92ed-b92b873a57b8\") " pod="opendatahub/maas-controller-85cd6fdbf4-r9jmr" Jul 28 01:01:41.477348 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:41.477306 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bdae9bf2-79d9-458b-af31-3b2f5afdcdbb-webhook-cert\") pod \"maas-controller-5d5854bbf6-cr7r7\" (UID: \"bdae9bf2-79d9-458b-af31-3b2f5afdcdbb\") " pod="opendatahub/maas-controller-5d5854bbf6-cr7r7" Jul 28 01:01:41.480168 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:41.480143 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bdae9bf2-79d9-458b-af31-3b2f5afdcdbb-webhook-cert\") pod \"maas-controller-5d5854bbf6-cr7r7\" (UID: \"bdae9bf2-79d9-458b-af31-3b2f5afdcdbb\") " pod="opendatahub/maas-controller-5d5854bbf6-cr7r7" Jul 28 01:01:41.679799 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:41.679764 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca56d924-f0e0-4d55-92ed-b92b873a57b8-webhook-cert\") pod \"maas-controller-85cd6fdbf4-r9jmr\" (UID: \"ca56d924-f0e0-4d55-92ed-b92b873a57b8\") " pod="opendatahub/maas-controller-85cd6fdbf4-r9jmr" Jul 28 01:01:41.682523 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:41.682487 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca56d924-f0e0-4d55-92ed-b92b873a57b8-webhook-cert\") pod \"maas-controller-85cd6fdbf4-r9jmr\" (UID: \"ca56d924-f0e0-4d55-92ed-b92b873a57b8\") " pod="opendatahub/maas-controller-85cd6fdbf4-r9jmr" Jul 28 01:01:41.733793 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:41.733705 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d5854bbf6-cr7r7" Jul 28 01:01:41.886946 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:41.885558 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-5d5854bbf6-cr7r7"] Jul 28 01:01:41.911965 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:41.911921 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85cd6fdbf4-r9jmr" Jul 28 01:01:42.057476 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:42.057448 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85cd6fdbf4-r9jmr"] Jul 28 01:01:42.059143 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:01:42.059111 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca56d924_f0e0_4d55_92ed_b92b873a57b8.slice/crio-8453ef780b8e9915e7cc2c18616c39040b1f397409edf300df16d256c313b3ff WatchSource:0}: Error finding container 8453ef780b8e9915e7cc2c18616c39040b1f397409edf300df16d256c313b3ff: Status 404 returned error can't find the container with id 8453ef780b8e9915e7cc2c18616c39040b1f397409edf300df16d256c313b3ff Jul 28 01:01:42.338937 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:42.338837 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85cd6fdbf4-r9jmr" event={"ID":"ca56d924-f0e0-4d55-92ed-b92b873a57b8","Type":"ContainerStarted","Data":"8453ef780b8e9915e7cc2c18616c39040b1f397409edf300df16d256c313b3ff"} Jul 28 01:01:42.340183 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:42.340151 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d5854bbf6-cr7r7" event={"ID":"bdae9bf2-79d9-458b-af31-3b2f5afdcdbb","Type":"ContainerStarted","Data":"c8cdca95a4294bcb972152f66e70146bb1429b5d63ec384ebe50278f22f2eecb"} Jul 28 01:01:45.361971 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:45.361925 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85cd6fdbf4-r9jmr" event={"ID":"ca56d924-f0e0-4d55-92ed-b92b873a57b8","Type":"ContainerStarted","Data":"a038b2b83e3b1ed63b57927c64f53a7171fca1831a111e34edc56071e124ee96"} Jul 28 01:01:45.362490 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:45.362002 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85cd6fdbf4-r9jmr" Jul 28 01:01:45.363538 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:45.363513 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d5854bbf6-cr7r7" event={"ID":"bdae9bf2-79d9-458b-af31-3b2f5afdcdbb","Type":"ContainerStarted","Data":"a6b79ad4247acb4527ee8893097e34f2a091cec6a178d763b3f124177f9afe66"} Jul 28 01:01:45.363688 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:45.363658 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-5d5854bbf6-cr7r7" Jul 28 01:01:45.380209 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:45.380149 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85cd6fdbf4-r9jmr" podStartSLOduration=2.869727519 podStartE2EDuration="5.380131715s" totalImagesPullingTime="2.510404196s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:01:45.377522157 +0000 UTC m=+502.297122842" watchObservedRunningTime="2026-07-28 01:01:45.380131715 +0000 UTC m=+502.299732399" Jul 28 01:01:45.393691 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:45.393628 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-5d5854bbf6-cr7r7" podStartSLOduration=2.698720703 podStartE2EDuration="5.39360857s" totalImagesPullingTime="2.694887867s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:01:40 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:01:45.391895159 +0000 UTC m=+502.311495840" watchObservedRunningTime="2026-07-28 01:01:45.39360857 +0000 UTC m=+502.313209254" Jul 28 01:01:56.371269 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:56.371234 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85cd6fdbf4-r9jmr" Jul 28 01:01:56.371926 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:56.371331 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-5d5854bbf6-cr7r7" Jul 28 01:01:56.434738 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:56.434699 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d5854bbf6-cr7r7"] Jul 28 01:01:56.434960 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:56.434933 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-5d5854bbf6-cr7r7" podUID="bdae9bf2-79d9-458b-af31-3b2f5afdcdbb" containerName="manager" containerID="cri-o://a6b79ad4247acb4527ee8893097e34f2a091cec6a178d763b3f124177f9afe66" gracePeriod=30 Jul 28 01:01:56.694240 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:56.694206 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d5854bbf6-cr7r7" Jul 28 01:01:56.823402 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:56.823355 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-27ntj\" (UniqueName: \"kubernetes.io/projected/bdae9bf2-79d9-458b-af31-3b2f5afdcdbb-kube-api-access-27ntj\") pod \"bdae9bf2-79d9-458b-af31-3b2f5afdcdbb\" (UID: \"bdae9bf2-79d9-458b-af31-3b2f5afdcdbb\") " Jul 28 01:01:56.823625 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:56.823432 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bdae9bf2-79d9-458b-af31-3b2f5afdcdbb-webhook-cert\") pod \"bdae9bf2-79d9-458b-af31-3b2f5afdcdbb\" (UID: \"bdae9bf2-79d9-458b-af31-3b2f5afdcdbb\") " Jul 28 01:01:56.825903 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:56.825860 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bdae9bf2-79d9-458b-af31-3b2f5afdcdbb-kube-api-access-27ntj" (OuterVolumeSpecName: "kube-api-access-27ntj") pod "bdae9bf2-79d9-458b-af31-3b2f5afdcdbb" (UID: "bdae9bf2-79d9-458b-af31-3b2f5afdcdbb"). InnerVolumeSpecName "kube-api-access-27ntj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:01:56.826043 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:56.825950 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bdae9bf2-79d9-458b-af31-3b2f5afdcdbb-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "bdae9bf2-79d9-458b-af31-3b2f5afdcdbb" (UID: "bdae9bf2-79d9-458b-af31-3b2f5afdcdbb"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 01:01:56.924887 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:56.924792 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-27ntj\" (UniqueName: \"kubernetes.io/projected/bdae9bf2-79d9-458b-af31-3b2f5afdcdbb-kube-api-access-27ntj\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:01:56.924887 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:56.924828 2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bdae9bf2-79d9-458b-af31-3b2f5afdcdbb-webhook-cert\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:01:57.433901 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:57.433866 2568 generic.go:356] "Generic (PLEG): container finished" podID="bdae9bf2-79d9-458b-af31-3b2f5afdcdbb" containerID="a6b79ad4247acb4527ee8893097e34f2a091cec6a178d763b3f124177f9afe66" exitCode=0 Jul 28 01:01:57.434378 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:57.433923 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d5854bbf6-cr7r7" event={"ID":"bdae9bf2-79d9-458b-af31-3b2f5afdcdbb","Type":"ContainerDied","Data":"a6b79ad4247acb4527ee8893097e34f2a091cec6a178d763b3f124177f9afe66"} Jul 28 01:01:57.434378 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:57.433927 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-5d5854bbf6-cr7r7" Jul 28 01:01:57.434378 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:57.433995 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-5d5854bbf6-cr7r7" event={"ID":"bdae9bf2-79d9-458b-af31-3b2f5afdcdbb","Type":"ContainerDied","Data":"c8cdca95a4294bcb972152f66e70146bb1429b5d63ec384ebe50278f22f2eecb"} Jul 28 01:01:57.434378 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:57.434020 2568 scope.go:117] "RemoveContainer" containerID="a6b79ad4247acb4527ee8893097e34f2a091cec6a178d763b3f124177f9afe66" Jul 28 01:01:57.444029 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:57.443866 2568 scope.go:117] "RemoveContainer" containerID="a6b79ad4247acb4527ee8893097e34f2a091cec6a178d763b3f124177f9afe66" Jul 28 01:01:57.444172 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:01:57.444150 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a6b79ad4247acb4527ee8893097e34f2a091cec6a178d763b3f124177f9afe66\": container with ID starting with a6b79ad4247acb4527ee8893097e34f2a091cec6a178d763b3f124177f9afe66 not found: ID does not exist" containerID="a6b79ad4247acb4527ee8893097e34f2a091cec6a178d763b3f124177f9afe66" Jul 28 01:01:57.444223 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:57.444181 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a6b79ad4247acb4527ee8893097e34f2a091cec6a178d763b3f124177f9afe66"} err="failed to get container status \"a6b79ad4247acb4527ee8893097e34f2a091cec6a178d763b3f124177f9afe66\": rpc error: code = NotFound desc = could not find container \"a6b79ad4247acb4527ee8893097e34f2a091cec6a178d763b3f124177f9afe66\": container with ID starting with a6b79ad4247acb4527ee8893097e34f2a091cec6a178d763b3f124177f9afe66 not found: ID does not exist" Jul 28 01:01:57.454510 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:57.454476 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-5d5854bbf6-cr7r7"] Jul 28 01:01:57.456852 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:57.456826 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-5d5854bbf6-cr7r7"] Jul 28 01:01:57.535061 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:01:57.535021 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bdae9bf2-79d9-458b-af31-3b2f5afdcdbb" path="/var/lib/kubelet/pods/bdae9bf2-79d9-458b-af31-3b2f5afdcdbb/volumes" Jul 28 01:02:18.317403 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.317314 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-7d5cfb7454-scrl8"] Jul 28 01:02:18.324002 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.323906 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bdae9bf2-79d9-458b-af31-3b2f5afdcdbb" containerName="manager" Jul 28 01:02:18.324002 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.324009 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bdae9bf2-79d9-458b-af31-3b2f5afdcdbb" containerName="manager" Jul 28 01:02:18.324405 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.324380 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bdae9bf2-79d9-458b-af31-3b2f5afdcdbb" containerName="manager" Jul 28 01:02:18.327735 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.327713 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d5cfb7454-scrl8" Jul 28 01:02:18.331853 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.331810 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-lrljm\"" Jul 28 01:02:18.332030 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.331860 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-serving-cert\"" Jul 28 01:02:18.334450 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.334418 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d5cfb7454-scrl8"] Jul 28 01:02:18.425115 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.425073 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a01c95ad-2b64-4a22-98ab-513e485b3231-maas-api-tls\") pod \"maas-api-7d5cfb7454-scrl8\" (UID: \"a01c95ad-2b64-4a22-98ab-513e485b3231\") " pod="odh-ai-gateway-infra/maas-api-7d5cfb7454-scrl8" Jul 28 01:02:18.425313 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.425128 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a01c95ad-2b64-4a22-98ab-513e485b3231-openshift-service-ca\") pod \"maas-api-7d5cfb7454-scrl8\" (UID: \"a01c95ad-2b64-4a22-98ab-513e485b3231\") " pod="odh-ai-gateway-infra/maas-api-7d5cfb7454-scrl8" Jul 28 01:02:18.425313 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.425181 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bn6nk\" (UniqueName: \"kubernetes.io/projected/a01c95ad-2b64-4a22-98ab-513e485b3231-kube-api-access-bn6nk\") pod \"maas-api-7d5cfb7454-scrl8\" (UID: \"a01c95ad-2b64-4a22-98ab-513e485b3231\") " pod="odh-ai-gateway-infra/maas-api-7d5cfb7454-scrl8" Jul 28 01:02:18.525807 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.525773 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a01c95ad-2b64-4a22-98ab-513e485b3231-maas-api-tls\") pod \"maas-api-7d5cfb7454-scrl8\" (UID: \"a01c95ad-2b64-4a22-98ab-513e485b3231\") " pod="odh-ai-gateway-infra/maas-api-7d5cfb7454-scrl8" Jul 28 01:02:18.525807 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.525817 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a01c95ad-2b64-4a22-98ab-513e485b3231-openshift-service-ca\") pod \"maas-api-7d5cfb7454-scrl8\" (UID: \"a01c95ad-2b64-4a22-98ab-513e485b3231\") " pod="odh-ai-gateway-infra/maas-api-7d5cfb7454-scrl8" Jul 28 01:02:18.526091 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.526078 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bn6nk\" (UniqueName: \"kubernetes.io/projected/a01c95ad-2b64-4a22-98ab-513e485b3231-kube-api-access-bn6nk\") pod \"maas-api-7d5cfb7454-scrl8\" (UID: \"a01c95ad-2b64-4a22-98ab-513e485b3231\") " pod="odh-ai-gateway-infra/maas-api-7d5cfb7454-scrl8" Jul 28 01:02:18.526701 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.526677 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a01c95ad-2b64-4a22-98ab-513e485b3231-openshift-service-ca\") pod \"maas-api-7d5cfb7454-scrl8\" (UID: \"a01c95ad-2b64-4a22-98ab-513e485b3231\") " pod="odh-ai-gateway-infra/maas-api-7d5cfb7454-scrl8" Jul 28 01:02:18.528605 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.528555 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a01c95ad-2b64-4a22-98ab-513e485b3231-maas-api-tls\") pod \"maas-api-7d5cfb7454-scrl8\" (UID: \"a01c95ad-2b64-4a22-98ab-513e485b3231\") " pod="odh-ai-gateway-infra/maas-api-7d5cfb7454-scrl8" Jul 28 01:02:18.539238 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.539208 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bn6nk\" (UniqueName: \"kubernetes.io/projected/a01c95ad-2b64-4a22-98ab-513e485b3231-kube-api-access-bn6nk\") pod \"maas-api-7d5cfb7454-scrl8\" (UID: \"a01c95ad-2b64-4a22-98ab-513e485b3231\") " pod="odh-ai-gateway-infra/maas-api-7d5cfb7454-scrl8" Jul 28 01:02:18.643101 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.643055 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-7d5cfb7454-scrl8" Jul 28 01:02:18.799580 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.799532 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-7d5cfb7454-scrl8"] Jul 28 01:02:18.801767 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:02:18.801726 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda01c95ad_2b64_4a22_98ab_513e485b3231.slice/crio-dae3e6b139c49443a9ba055dc56355a9fea156dac0a2a0be71edf3750ef13a8b WatchSource:0}: Error finding container dae3e6b139c49443a9ba055dc56355a9fea156dac0a2a0be71edf3750ef13a8b: Status 404 returned error can't find the container with id dae3e6b139c49443a9ba055dc56355a9fea156dac0a2a0be71edf3750ef13a8b Jul 28 01:02:18.884080 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.884036 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-8gzgx"] Jul 28 01:02:18.888236 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.888209 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-8gzgx" Jul 28 01:02:18.892278 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.892245 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-g9xkl\"" Jul 28 01:02:18.892445 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.892241 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 28 01:02:18.900963 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.900924 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-8gzgx"] Jul 28 01:02:18.914545 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.914502 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-fss7v"] Jul 28 01:02:18.917794 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.917769 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fss7v" Jul 28 01:02:18.929290 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:18.929255 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-fss7v"] Jul 28 01:02:19.030018 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:19.029982 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9dbm8\" (UniqueName: \"kubernetes.io/projected/30729cb8-3e4d-4c41-b1e6-3062595cc6b9-kube-api-access-9dbm8\") pod \"payload-processing-5cc6cd444b-8gzgx\" (UID: \"30729cb8-3e4d-4c41-b1e6-3062595cc6b9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8gzgx" Jul 28 01:02:19.030220 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:19.030038 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdf68\" (UniqueName: \"kubernetes.io/projected/226f476f-1ab3-48b1-b03c-dcc7dc7eca46-kube-api-access-fdf68\") pod \"payload-pre-processing-687dbb6cf6-fss7v\" (UID: \"226f476f-1ab3-48b1-b03c-dcc7dc7eca46\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fss7v" Jul 28 01:02:19.030220 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:19.030104 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30729cb8-3e4d-4c41-b1e6-3062595cc6b9-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-8gzgx\" (UID: \"30729cb8-3e4d-4c41-b1e6-3062595cc6b9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8gzgx" Jul 28 01:02:19.030220 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:19.030141 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/226f476f-1ab3-48b1-b03c-dcc7dc7eca46-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-fss7v\" (UID: \"226f476f-1ab3-48b1-b03c-dcc7dc7eca46\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fss7v" Jul 28 01:02:19.131455 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:19.131413 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9dbm8\" (UniqueName: \"kubernetes.io/projected/30729cb8-3e4d-4c41-b1e6-3062595cc6b9-kube-api-access-9dbm8\") pod \"payload-processing-5cc6cd444b-8gzgx\" (UID: \"30729cb8-3e4d-4c41-b1e6-3062595cc6b9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8gzgx" Jul 28 01:02:19.131722 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:19.131474 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdf68\" (UniqueName: \"kubernetes.io/projected/226f476f-1ab3-48b1-b03c-dcc7dc7eca46-kube-api-access-fdf68\") pod \"payload-pre-processing-687dbb6cf6-fss7v\" (UID: \"226f476f-1ab3-48b1-b03c-dcc7dc7eca46\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fss7v" Jul 28 01:02:19.131722 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:19.131505 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30729cb8-3e4d-4c41-b1e6-3062595cc6b9-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-8gzgx\" (UID: \"30729cb8-3e4d-4c41-b1e6-3062595cc6b9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8gzgx" Jul 28 01:02:19.131722 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:19.131530 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/226f476f-1ab3-48b1-b03c-dcc7dc7eca46-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-fss7v\" (UID: \"226f476f-1ab3-48b1-b03c-dcc7dc7eca46\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fss7v" Jul 28 01:02:19.132362 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:19.132340 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/226f476f-1ab3-48b1-b03c-dcc7dc7eca46-plugins-config-volume\") pod \"payload-pre-processing-687dbb6cf6-fss7v\" (UID: \"226f476f-1ab3-48b1-b03c-dcc7dc7eca46\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fss7v" Jul 28 01:02:19.132480 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:19.132458 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/30729cb8-3e4d-4c41-b1e6-3062595cc6b9-plugins-config-volume\") pod \"payload-processing-5cc6cd444b-8gzgx\" (UID: \"30729cb8-3e4d-4c41-b1e6-3062595cc6b9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8gzgx" Jul 28 01:02:19.143558 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:19.143517 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdf68\" (UniqueName: \"kubernetes.io/projected/226f476f-1ab3-48b1-b03c-dcc7dc7eca46-kube-api-access-fdf68\") pod \"payload-pre-processing-687dbb6cf6-fss7v\" (UID: \"226f476f-1ab3-48b1-b03c-dcc7dc7eca46\") " pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fss7v" Jul 28 01:02:19.144186 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:19.144164 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9dbm8\" (UniqueName: \"kubernetes.io/projected/30729cb8-3e4d-4c41-b1e6-3062595cc6b9-kube-api-access-9dbm8\") pod \"payload-processing-5cc6cd444b-8gzgx\" (UID: \"30729cb8-3e4d-4c41-b1e6-3062595cc6b9\") " pod="openshift-ingress/payload-processing-5cc6cd444b-8gzgx" Jul 28 01:02:19.201913 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:19.201810 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-processing-5cc6cd444b-8gzgx" Jul 28 01:02:19.229800 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:19.229762 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fss7v" Jul 28 01:02:19.370125 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:19.370088 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-processing-5cc6cd444b-8gzgx"] Jul 28 01:02:19.408001 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:19.407963 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-687dbb6cf6-fss7v"] Jul 28 01:02:19.410071 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:02:19.410033 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod226f476f_1ab3_48b1_b03c_dcc7dc7eca46.slice/crio-2a6085bf885008256ec687d544670f37d2c15040356da1bd5bdc66a7df039134 WatchSource:0}: Error finding container 2a6085bf885008256ec687d544670f37d2c15040356da1bd5bdc66a7df039134: Status 404 returned error can't find the container with id 2a6085bf885008256ec687d544670f37d2c15040356da1bd5bdc66a7df039134 Jul 28 01:02:19.555735 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:19.555642 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-8gzgx" event={"ID":"30729cb8-3e4d-4c41-b1e6-3062595cc6b9","Type":"ContainerStarted","Data":"ef733b382bf13ecc95b6a87df759fcd57ff3804c36c9fba9d08cd48a518fd39a"} Jul 28 01:02:19.557009 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:19.556978 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d5cfb7454-scrl8" event={"ID":"a01c95ad-2b64-4a22-98ab-513e485b3231","Type":"ContainerStarted","Data":"dae3e6b139c49443a9ba055dc56355a9fea156dac0a2a0be71edf3750ef13a8b"} Jul 28 01:02:19.558306 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:19.558275 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fss7v" event={"ID":"226f476f-1ab3-48b1-b03c-dcc7dc7eca46","Type":"ContainerStarted","Data":"2a6085bf885008256ec687d544670f37d2c15040356da1bd5bdc66a7df039134"} Jul 28 01:02:22.614114 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:22.614064 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-processing-5cc6cd444b-8gzgx" event={"ID":"30729cb8-3e4d-4c41-b1e6-3062595cc6b9","Type":"ContainerStarted","Data":"fc535e09cd1bb76f23004d67e0469a72f7c29a497cbe3bd94c957baecdc6682d"} Jul 28 01:02:22.615061 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:22.615032 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-processing-5cc6cd444b-8gzgx" Jul 28 01:02:22.617330 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:22.617291 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-7d5cfb7454-scrl8" event={"ID":"a01c95ad-2b64-4a22-98ab-513e485b3231","Type":"ContainerStarted","Data":"f7d74bb94681468d02e77580c000c77c0d53f1a7ed955e3027802eddc4413854"} Jul 28 01:02:22.617506 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:22.617371 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-7d5cfb7454-scrl8" Jul 28 01:02:22.619598 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:22.619510 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fss7v" event={"ID":"226f476f-1ab3-48b1-b03c-dcc7dc7eca46","Type":"ContainerStarted","Data":"ced014827833e5531af2795e70cd9c5f90c994fe185164fe76aa78198385b858"} Jul 28 01:02:22.619819 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:22.619704 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fss7v" Jul 28 01:02:22.632965 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:22.632901 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-processing-5cc6cd444b-8gzgx" podStartSLOduration=1.834344219 podStartE2EDuration="4.632861524s" totalImagesPullingTime="2.798517305s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:02:22.630021208 +0000 UTC m=+539.549621893" watchObservedRunningTime="2026-07-28 01:02:22.632861524 +0000 UTC m=+539.552462208" Jul 28 01:02:22.647577 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:22.647499 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fss7v" podStartSLOduration=1.8951068850000001 podStartE2EDuration="4.647482193s" totalImagesPullingTime="2.752375308s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:02:22.644842529 +0000 UTC m=+539.564443214" watchObservedRunningTime="2026-07-28 01:02:22.647482193 +0000 UTC m=+539.567082912" Jul 28 01:02:22.661676 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:22.661616 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-7d5cfb7454-scrl8" podStartSLOduration=1.300231266 podStartE2EDuration="4.661596946s" totalImagesPullingTime="3.36136568s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:02:18 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:02:22.659465266 +0000 UTC m=+539.579065951" watchObservedRunningTime="2026-07-28 01:02:22.661596946 +0000 UTC m=+539.581197628" Jul 28 01:02:27.652768 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:27.652723 2568 generic.go:356] "Generic (PLEG): container finished" podID="e79a768c-19f5-4af5-b7da-349c2cd665e9" containerID="19fddcb0a69657037d94887ceaf6dbd0afbd8e99325e288d35e4018832358f03" exitCode=0 Jul 28 01:02:27.653257 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:27.652803 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" event={"ID":"e79a768c-19f5-4af5-b7da-349c2cd665e9","Type":"ContainerDied","Data":"19fddcb0a69657037d94887ceaf6dbd0afbd8e99325e288d35e4018832358f03"} Jul 28 01:02:27.653257 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:27.653194 2568 scope.go:117] "RemoveContainer" containerID="19fddcb0a69657037d94887ceaf6dbd0afbd8e99325e288d35e4018832358f03" Jul 28 01:02:27.654224 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:27.654193 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:02:27.654320 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:27.654281 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:02:27.654398 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:27.654330 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:02:28.632500 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:28.632469 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-7d5cfb7454-scrl8" Jul 28 01:02:28.661640 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:28.661596 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" event={"ID":"e79a768c-19f5-4af5-b7da-349c2cd665e9","Type":"ContainerStarted","Data":"f2d97b23cda1248a55c497f59a02c67db31a8341abf99cf8db75d36d0c8c9c0c"} Jul 28 01:02:28.954967 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:28.954857 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:02:29.452958 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:29.452913 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:02:29.454283 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:29.454257 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-8fg5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 28 01:02:29.454444 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:29.454302 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" podUID="e79a768c-19f5-4af5-b7da-349c2cd665e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 28 01:02:30.453538 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:30.453503 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-8fg5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 28 01:02:30.453977 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:30.453614 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" podUID="e79a768c-19f5-4af5-b7da-349c2cd665e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 28 01:02:31.453237 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:31.453190 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-8fg5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 28 01:02:31.453431 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:31.453270 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" podUID="e79a768c-19f5-4af5-b7da-349c2cd665e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 28 01:02:32.453582 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:32.453537 2568 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5ccb968c66-8fg5c container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" start-of-body= Jul 28 01:02:32.454096 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:32.453633 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" podUID="e79a768c-19f5-4af5-b7da-349c2cd665e9" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.45:15021/healthz/ready\": dial tcp 10.132.0.45:15021: connect: connection refused" Jul 28 01:02:33.457861 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:33.457816 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:02:33.458969 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:33.458944 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5ccb968c66-8fg5c" Jul 28 01:02:33.629155 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:33.629124 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-687dbb6cf6-fss7v" Jul 28 01:02:34.636257 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:02:34.636223 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-processing-5cc6cd444b-8gzgx" Jul 28 01:03:13.322817 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.322783 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw"] Jul 28 01:03:13.328188 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.328160 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:13.330926 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.330891 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 28 01:03:13.331131 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.330978 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 28 01:03:13.331131 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.331015 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-pfrfw\"" Jul 28 01:03:13.331131 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.330978 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 28 01:03:13.335715 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.335680 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw"] Jul 28 01:03:13.347274 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.347236 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70f6d4d9-f0d2-4c7d-90c5-d03210e39b56-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-szkkw\" (UID: \"70f6d4d9-f0d2-4c7d-90c5-d03210e39b56\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:13.347470 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.347296 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70f6d4d9-f0d2-4c7d-90c5-d03210e39b56-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-szkkw\" (UID: \"70f6d4d9-f0d2-4c7d-90c5-d03210e39b56\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:13.347470 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.347354 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70f6d4d9-f0d2-4c7d-90c5-d03210e39b56-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-szkkw\" (UID: \"70f6d4d9-f0d2-4c7d-90c5-d03210e39b56\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:13.347470 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.347427 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70f6d4d9-f0d2-4c7d-90c5-d03210e39b56-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-szkkw\" (UID: \"70f6d4d9-f0d2-4c7d-90c5-d03210e39b56\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:13.347470 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.347469 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70f6d4d9-f0d2-4c7d-90c5-d03210e39b56-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-szkkw\" (UID: \"70f6d4d9-f0d2-4c7d-90c5-d03210e39b56\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:13.347677 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.347548 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zm92x\" (UniqueName: \"kubernetes.io/projected/70f6d4d9-f0d2-4c7d-90c5-d03210e39b56-kube-api-access-zm92x\") pod \"e2e-distinct-simulated-kserve-59975d69f9-szkkw\" (UID: \"70f6d4d9-f0d2-4c7d-90c5-d03210e39b56\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:13.448921 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.448876 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70f6d4d9-f0d2-4c7d-90c5-d03210e39b56-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-szkkw\" (UID: \"70f6d4d9-f0d2-4c7d-90c5-d03210e39b56\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:13.449127 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.448948 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70f6d4d9-f0d2-4c7d-90c5-d03210e39b56-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-szkkw\" (UID: \"70f6d4d9-f0d2-4c7d-90c5-d03210e39b56\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:13.449127 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.448989 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70f6d4d9-f0d2-4c7d-90c5-d03210e39b56-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-szkkw\" (UID: \"70f6d4d9-f0d2-4c7d-90c5-d03210e39b56\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:13.449368 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.449336 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zm92x\" (UniqueName: \"kubernetes.io/projected/70f6d4d9-f0d2-4c7d-90c5-d03210e39b56-kube-api-access-zm92x\") pod \"e2e-distinct-simulated-kserve-59975d69f9-szkkw\" (UID: \"70f6d4d9-f0d2-4c7d-90c5-d03210e39b56\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:13.449610 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.449589 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70f6d4d9-f0d2-4c7d-90c5-d03210e39b56-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-szkkw\" (UID: \"70f6d4d9-f0d2-4c7d-90c5-d03210e39b56\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:13.449788 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.449770 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70f6d4d9-f0d2-4c7d-90c5-d03210e39b56-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-szkkw\" (UID: \"70f6d4d9-f0d2-4c7d-90c5-d03210e39b56\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:13.450089 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.450030 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/70f6d4d9-f0d2-4c7d-90c5-d03210e39b56-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-szkkw\" (UID: \"70f6d4d9-f0d2-4c7d-90c5-d03210e39b56\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:13.450196 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.450170 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/70f6d4d9-f0d2-4c7d-90c5-d03210e39b56-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-szkkw\" (UID: \"70f6d4d9-f0d2-4c7d-90c5-d03210e39b56\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:13.450343 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.450237 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/70f6d4d9-f0d2-4c7d-90c5-d03210e39b56-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-szkkw\" (UID: \"70f6d4d9-f0d2-4c7d-90c5-d03210e39b56\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:13.452389 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.452368 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/70f6d4d9-f0d2-4c7d-90c5-d03210e39b56-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-szkkw\" (UID: \"70f6d4d9-f0d2-4c7d-90c5-d03210e39b56\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:13.452667 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.452648 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/70f6d4d9-f0d2-4c7d-90c5-d03210e39b56-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-szkkw\" (UID: \"70f6d4d9-f0d2-4c7d-90c5-d03210e39b56\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:13.457304 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.457275 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zm92x\" (UniqueName: \"kubernetes.io/projected/70f6d4d9-f0d2-4c7d-90c5-d03210e39b56-kube-api-access-zm92x\") pod \"e2e-distinct-simulated-kserve-59975d69f9-szkkw\" (UID: \"70f6d4d9-f0d2-4c7d-90c5-d03210e39b56\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:13.641835 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.641793 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:13.796603 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.796555 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw"] Jul 28 01:03:13.799185 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:03:13.799152 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod70f6d4d9_f0d2_4c7d_90c5_d03210e39b56.slice/crio-f4e73ff85aeb39ad93cc33e43a03c9d7a7a0d5c833249a05d437eca21401c35a WatchSource:0}: Error finding container f4e73ff85aeb39ad93cc33e43a03c9d7a7a0d5c833249a05d437eca21401c35a: Status 404 returned error can't find the container with id f4e73ff85aeb39ad93cc33e43a03c9d7a7a0d5c833249a05d437eca21401c35a Jul 28 01:03:13.930032 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:13.929940 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" event={"ID":"70f6d4d9-f0d2-4c7d-90c5-d03210e39b56","Type":"ContainerStarted","Data":"f4e73ff85aeb39ad93cc33e43a03c9d7a7a0d5c833249a05d437eca21401c35a"} Jul 28 01:03:14.938619 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:14.938558 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" event={"ID":"70f6d4d9-f0d2-4c7d-90c5-d03210e39b56","Type":"ContainerStarted","Data":"518e5835d2e8f3da520ff7e4d3ad89d3e65b7a2281bc8ee51f071239434e2759"} Jul 28 01:03:14.954444 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:14.954383 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" podStartSLOduration=0.892043238 podStartE2EDuration="1.954354265s" totalImagesPullingTime="1.062311027s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:03:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:03:14.952904627 +0000 UTC m=+591.872505311" watchObservedRunningTime="2026-07-28 01:03:14.954354265 +0000 UTC m=+591.873954949" Jul 28 01:03:22.318649 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.318552 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs"] Jul 28 01:03:22.328653 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.328525 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:22.334906 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.334875 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 28 01:03:22.335158 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.335007 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs"] Jul 28 01:03:22.433543 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.433492 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb30540d-864a-4e4e-bf5a-df6eb42fcd14-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x2jgs\" (UID: \"bb30540d-864a-4e4e-bf5a-df6eb42fcd14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:22.433543 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.433550 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb30540d-864a-4e4e-bf5a-df6eb42fcd14-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x2jgs\" (UID: \"bb30540d-864a-4e4e-bf5a-df6eb42fcd14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:22.433810 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.433653 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbz95\" (UniqueName: \"kubernetes.io/projected/bb30540d-864a-4e4e-bf5a-df6eb42fcd14-kube-api-access-xbz95\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x2jgs\" (UID: \"bb30540d-864a-4e4e-bf5a-df6eb42fcd14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:22.433810 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.433713 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb30540d-864a-4e4e-bf5a-df6eb42fcd14-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x2jgs\" (UID: \"bb30540d-864a-4e4e-bf5a-df6eb42fcd14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:22.433810 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.433765 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb30540d-864a-4e4e-bf5a-df6eb42fcd14-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x2jgs\" (UID: \"bb30540d-864a-4e4e-bf5a-df6eb42fcd14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:22.433810 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.433781 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb30540d-864a-4e4e-bf5a-df6eb42fcd14-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x2jgs\" (UID: \"bb30540d-864a-4e4e-bf5a-df6eb42fcd14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:22.535186 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.535131 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb30540d-864a-4e4e-bf5a-df6eb42fcd14-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x2jgs\" (UID: \"bb30540d-864a-4e4e-bf5a-df6eb42fcd14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:22.535186 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.535182 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb30540d-864a-4e4e-bf5a-df6eb42fcd14-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x2jgs\" (UID: \"bb30540d-864a-4e4e-bf5a-df6eb42fcd14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:22.535457 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.535220 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb30540d-864a-4e4e-bf5a-df6eb42fcd14-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x2jgs\" (UID: \"bb30540d-864a-4e4e-bf5a-df6eb42fcd14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:22.535457 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.535257 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb30540d-864a-4e4e-bf5a-df6eb42fcd14-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x2jgs\" (UID: \"bb30540d-864a-4e4e-bf5a-df6eb42fcd14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:22.535457 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.535316 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbz95\" (UniqueName: \"kubernetes.io/projected/bb30540d-864a-4e4e-bf5a-df6eb42fcd14-kube-api-access-xbz95\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x2jgs\" (UID: \"bb30540d-864a-4e4e-bf5a-df6eb42fcd14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:22.535457 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.535368 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb30540d-864a-4e4e-bf5a-df6eb42fcd14-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x2jgs\" (UID: \"bb30540d-864a-4e4e-bf5a-df6eb42fcd14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:22.535738 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.535716 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/bb30540d-864a-4e4e-bf5a-df6eb42fcd14-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x2jgs\" (UID: \"bb30540d-864a-4e4e-bf5a-df6eb42fcd14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:22.535805 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.535792 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/bb30540d-864a-4e4e-bf5a-df6eb42fcd14-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x2jgs\" (UID: \"bb30540d-864a-4e4e-bf5a-df6eb42fcd14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:22.535855 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.535828 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/bb30540d-864a-4e4e-bf5a-df6eb42fcd14-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x2jgs\" (UID: \"bb30540d-864a-4e4e-bf5a-df6eb42fcd14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:22.537896 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.537873 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/bb30540d-864a-4e4e-bf5a-df6eb42fcd14-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x2jgs\" (UID: \"bb30540d-864a-4e4e-bf5a-df6eb42fcd14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:22.537982 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.537951 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bb30540d-864a-4e4e-bf5a-df6eb42fcd14-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x2jgs\" (UID: \"bb30540d-864a-4e4e-bf5a-df6eb42fcd14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:22.543220 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.543185 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbz95\" (UniqueName: \"kubernetes.io/projected/bb30540d-864a-4e4e-bf5a-df6eb42fcd14-kube-api-access-xbz95\") pod \"e2e-trlp-test-simulated-kserve-598466548d-x2jgs\" (UID: \"bb30540d-864a-4e4e-bf5a-df6eb42fcd14\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:22.643665 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.643619 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:22.799379 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.799344 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs"] Jul 28 01:03:22.801924 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:03:22.801877 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb30540d_864a_4e4e_bf5a_df6eb42fcd14.slice/crio-2e059aec62e7365be2d332b9bc196cc57e81bbe2e4e2b19072141cc9d28de073 WatchSource:0}: Error finding container 2e059aec62e7365be2d332b9bc196cc57e81bbe2e4e2b19072141cc9d28de073: Status 404 returned error can't find the container with id 2e059aec62e7365be2d332b9bc196cc57e81bbe2e4e2b19072141cc9d28de073 Jul 28 01:03:22.984676 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:22.984642 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" event={"ID":"bb30540d-864a-4e4e-bf5a-df6eb42fcd14","Type":"ContainerStarted","Data":"2e059aec62e7365be2d332b9bc196cc57e81bbe2e4e2b19072141cc9d28de073"} Jul 28 01:03:23.508211 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:23.508179 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:03:23.513353 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:23.513328 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:03:23.642643 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:23.642602 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:23.642853 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:23.642679 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:23.656405 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:23.656376 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:23.998168 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:23.998108 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" event={"ID":"bb30540d-864a-4e4e-bf5a-df6eb42fcd14","Type":"ContainerStarted","Data":"9b389407b9025fe9b015d61b1303a060b3860d3c4eb746dfa347fa431fa34c69"} Jul 28 01:03:24.013766 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:24.013735 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-szkkw" Jul 28 01:03:24.017478 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:24.017422 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" podStartSLOduration=1.848144886 podStartE2EDuration="2.017402344s" totalImagesPullingTime="169.257458ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:03:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:03:24.015211659 +0000 UTC m=+600.934812342" watchObservedRunningTime="2026-07-28 01:03:24.017402344 +0000 UTC m=+600.937003047" Jul 28 01:03:32.644724 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:32.644681 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:32.645241 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:32.644752 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:32.657785 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:32.657755 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:33.058494 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:33.058405 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-x2jgs" Jul 28 01:03:43.246713 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.246676 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk"] Jul 28 01:03:43.250750 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.250720 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:43.253188 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.253152 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-unab60ef4d3a239b5143b412cab04acac3-kserve-self-signed-certs\"" Jul 28 01:03:43.259748 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.259715 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk"] Jul 28 01:03:43.343452 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.343410 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd4e660f-a20f-4262-a278-a4f236dc7a02-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk\" (UID: \"dd4e660f-a20f-4262-a278-a4f236dc7a02\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:43.343656 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.343479 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2f9kp\" (UniqueName: \"kubernetes.io/projected/dd4e660f-a20f-4262-a278-a4f236dc7a02-kube-api-access-2f9kp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk\" (UID: \"dd4e660f-a20f-4262-a278-a4f236dc7a02\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:43.343656 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.343522 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd4e660f-a20f-4262-a278-a4f236dc7a02-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk\" (UID: \"dd4e660f-a20f-4262-a278-a4f236dc7a02\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:43.343656 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.343554 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd4e660f-a20f-4262-a278-a4f236dc7a02-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk\" (UID: \"dd4e660f-a20f-4262-a278-a4f236dc7a02\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:43.343656 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.343625 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd4e660f-a20f-4262-a278-a4f236dc7a02-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk\" (UID: \"dd4e660f-a20f-4262-a278-a4f236dc7a02\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:43.343796 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.343678 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd4e660f-a20f-4262-a278-a4f236dc7a02-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk\" (UID: \"dd4e660f-a20f-4262-a278-a4f236dc7a02\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:43.444403 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.444358 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd4e660f-a20f-4262-a278-a4f236dc7a02-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk\" (UID: \"dd4e660f-a20f-4262-a278-a4f236dc7a02\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:43.444403 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.444401 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd4e660f-a20f-4262-a278-a4f236dc7a02-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk\" (UID: \"dd4e660f-a20f-4262-a278-a4f236dc7a02\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:43.444663 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.444424 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd4e660f-a20f-4262-a278-a4f236dc7a02-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk\" (UID: \"dd4e660f-a20f-4262-a278-a4f236dc7a02\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:43.444663 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.444471 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd4e660f-a20f-4262-a278-a4f236dc7a02-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk\" (UID: \"dd4e660f-a20f-4262-a278-a4f236dc7a02\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:43.444663 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.444514 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2f9kp\" (UniqueName: \"kubernetes.io/projected/dd4e660f-a20f-4262-a278-a4f236dc7a02-kube-api-access-2f9kp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk\" (UID: \"dd4e660f-a20f-4262-a278-a4f236dc7a02\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:43.444663 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.444546 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd4e660f-a20f-4262-a278-a4f236dc7a02-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk\" (UID: \"dd4e660f-a20f-4262-a278-a4f236dc7a02\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:43.444946 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.444920 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/dd4e660f-a20f-4262-a278-a4f236dc7a02-home\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk\" (UID: \"dd4e660f-a20f-4262-a278-a4f236dc7a02\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:43.445086 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.444959 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/dd4e660f-a20f-4262-a278-a4f236dc7a02-model-cache\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk\" (UID: \"dd4e660f-a20f-4262-a278-a4f236dc7a02\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:43.445086 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.445008 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/dd4e660f-a20f-4262-a278-a4f236dc7a02-tmp-dir\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk\" (UID: \"dd4e660f-a20f-4262-a278-a4f236dc7a02\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:43.446975 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.446952 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/dd4e660f-a20f-4262-a278-a4f236dc7a02-dshm\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk\" (UID: \"dd4e660f-a20f-4262-a278-a4f236dc7a02\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:43.447360 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.447336 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/dd4e660f-a20f-4262-a278-a4f236dc7a02-tls-certs\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk\" (UID: \"dd4e660f-a20f-4262-a278-a4f236dc7a02\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:43.452489 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.452455 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2f9kp\" (UniqueName: \"kubernetes.io/projected/dd4e660f-a20f-4262-a278-a4f236dc7a02-kube-api-access-2f9kp\") pod \"e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk\" (UID: \"dd4e660f-a20f-4262-a278-a4f236dc7a02\") " pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:43.563261 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.563161 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:43.723632 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.723598 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk"] Jul 28 01:03:43.725280 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:03:43.725249 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd4e660f_a20f_4262_a278_a4f236dc7a02.slice/crio-0321e027db266fb4678de4209511ed4189c3d2ce4b79e877aa0cb52a3772ed17 WatchSource:0}: Error finding container 0321e027db266fb4678de4209511ed4189c3d2ce4b79e877aa0cb52a3772ed17: Status 404 returned error can't find the container with id 0321e027db266fb4678de4209511ed4189c3d2ce4b79e877aa0cb52a3772ed17 Jul 28 01:03:43.726841 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:43.726818 2568 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 28 01:03:44.113266 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:44.113161 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" event={"ID":"dd4e660f-a20f-4262-a278-a4f236dc7a02","Type":"ContainerStarted","Data":"95eecf1fca2bf69e5abc279dc29de0a02a1355828add9933cb260551b71fda95"} Jul 28 01:03:44.113266 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:44.113241 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" event={"ID":"dd4e660f-a20f-4262-a278-a4f236dc7a02","Type":"ContainerStarted","Data":"0321e027db266fb4678de4209511ed4189c3d2ce4b79e877aa0cb52a3772ed17"} Jul 28 01:03:44.131209 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:44.131150 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" podStartSLOduration=0.946379094 podStartE2EDuration="1.131125935s" totalImagesPullingTime="184.746841ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:03:43 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:03:44.130110172 +0000 UTC m=+621.049710856" watchObservedRunningTime="2026-07-28 01:03:44.131125935 +0000 UTC m=+621.050726619" Jul 28 01:03:53.563877 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:53.563827 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:53.564395 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:53.563908 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:53.577507 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:53.577467 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:03:54.183783 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:03:54.183747 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk" Jul 28 01:04:57.589494 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:04:57.589443 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-7fbc9889c4-8946w"] Jul 28 01:04:57.593261 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:04:57.593233 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fbc9889c4-8946w" Jul 28 01:04:57.599908 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:04:57.599877 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7fbc9889c4-8946w"] Jul 28 01:04:57.635858 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:04:57.635806 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-w6624\" (UniqueName: \"kubernetes.io/projected/289dba42-a059-4482-a53e-208b74e3c08a-kube-api-access-w6624\") pod \"authorino-7fbc9889c4-8946w\" (UID: \"289dba42-a059-4482-a53e-208b74e3c08a\") " pod="kuadrant-system/authorino-7fbc9889c4-8946w" Jul 28 01:04:57.636071 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:04:57.635895 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/289dba42-a059-4482-a53e-208b74e3c08a-tls-cert\") pod \"authorino-7fbc9889c4-8946w\" (UID: \"289dba42-a059-4482-a53e-208b74e3c08a\") " pod="kuadrant-system/authorino-7fbc9889c4-8946w" Jul 28 01:04:57.737330 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:04:57.737286 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-w6624\" (UniqueName: \"kubernetes.io/projected/289dba42-a059-4482-a53e-208b74e3c08a-kube-api-access-w6624\") pod \"authorino-7fbc9889c4-8946w\" (UID: \"289dba42-a059-4482-a53e-208b74e3c08a\") " pod="kuadrant-system/authorino-7fbc9889c4-8946w" Jul 28 01:04:57.737544 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:04:57.737348 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/289dba42-a059-4482-a53e-208b74e3c08a-tls-cert\") pod \"authorino-7fbc9889c4-8946w\" (UID: \"289dba42-a059-4482-a53e-208b74e3c08a\") " pod="kuadrant-system/authorino-7fbc9889c4-8946w" Jul 28 01:04:57.740115 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:04:57.740086 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/289dba42-a059-4482-a53e-208b74e3c08a-tls-cert\") pod \"authorino-7fbc9889c4-8946w\" (UID: \"289dba42-a059-4482-a53e-208b74e3c08a\") " pod="kuadrant-system/authorino-7fbc9889c4-8946w" Jul 28 01:04:57.745719 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:04:57.745686 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-w6624\" (UniqueName: \"kubernetes.io/projected/289dba42-a059-4482-a53e-208b74e3c08a-kube-api-access-w6624\") pod \"authorino-7fbc9889c4-8946w\" (UID: \"289dba42-a059-4482-a53e-208b74e3c08a\") " pod="kuadrant-system/authorino-7fbc9889c4-8946w" Jul 28 01:04:57.905747 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:04:57.905706 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-7fbc9889c4-8946w" Jul 28 01:04:58.064672 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:04:58.064629 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-7fbc9889c4-8946w"] Jul 28 01:04:58.066124 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:04:58.066091 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod289dba42_a059_4482_a53e_208b74e3c08a.slice/crio-48ae95f47cb89dde1e0e4d59674c126bbc943f9c23938973489abdafd39e61a9 WatchSource:0}: Error finding container 48ae95f47cb89dde1e0e4d59674c126bbc943f9c23938973489abdafd39e61a9: Status 404 returned error can't find the container with id 48ae95f47cb89dde1e0e4d59674c126bbc943f9c23938973489abdafd39e61a9 Jul 28 01:04:58.554343 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:04:58.554309 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fbc9889c4-8946w" event={"ID":"289dba42-a059-4482-a53e-208b74e3c08a","Type":"ContainerStarted","Data":"48ae95f47cb89dde1e0e4d59674c126bbc943f9c23938973489abdafd39e61a9"} Jul 28 01:04:59.562284 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:04:59.562220 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-7fbc9889c4-8946w" event={"ID":"289dba42-a059-4482-a53e-208b74e3c08a","Type":"ContainerStarted","Data":"e65d07444a778eecf9a167fe99da952b70f3b7888cf703cf9a8949df026e7b7d"} Jul 28 01:04:59.589398 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:04:59.589328 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-7fbc9889c4-8946w" podStartSLOduration=2.099298559 podStartE2EDuration="2.589305963s" totalImagesPullingTime="490.007404ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:04:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:04:59.588665363 +0000 UTC m=+696.508266050" watchObservedRunningTime="2026-07-28 01:04:59.589305963 +0000 UTC m=+696.508906662" Jul 28 01:04:59.623504 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:04:59.621854 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-597854b5d7-b58hq"] Jul 28 01:04:59.623504 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:04:59.622109 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-597854b5d7-b58hq" podUID="e5190e03-0dfb-4f12-aa55-2b65cf4c7800" containerName="authorino" containerID="cri-o://f044b54d3d0d90535805c4aa491ecd29d07ea861f9e7a4cc19d7a877dc1cdce0" gracePeriod=30 Jul 28 01:04:59.898479 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:04:59.898442 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-597854b5d7-b58hq" Jul 28 01:04:59.962179 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:04:59.962138 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-crjjx\" (UniqueName: \"kubernetes.io/projected/e5190e03-0dfb-4f12-aa55-2b65cf4c7800-kube-api-access-crjjx\") pod \"e5190e03-0dfb-4f12-aa55-2b65cf4c7800\" (UID: \"e5190e03-0dfb-4f12-aa55-2b65cf4c7800\") " Jul 28 01:04:59.962179 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:04:59.962178 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5190e03-0dfb-4f12-aa55-2b65cf4c7800-tls-cert\") pod \"e5190e03-0dfb-4f12-aa55-2b65cf4c7800\" (UID: \"e5190e03-0dfb-4f12-aa55-2b65cf4c7800\") " Jul 28 01:04:59.964537 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:04:59.964498 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e5190e03-0dfb-4f12-aa55-2b65cf4c7800-kube-api-access-crjjx" (OuterVolumeSpecName: "kube-api-access-crjjx") pod "e5190e03-0dfb-4f12-aa55-2b65cf4c7800" (UID: "e5190e03-0dfb-4f12-aa55-2b65cf4c7800"). InnerVolumeSpecName "kube-api-access-crjjx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:04:59.976158 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:04:59.976123 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e5190e03-0dfb-4f12-aa55-2b65cf4c7800-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "e5190e03-0dfb-4f12-aa55-2b65cf4c7800" (UID: "e5190e03-0dfb-4f12-aa55-2b65cf4c7800"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 01:05:00.063335 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:00.063293 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-crjjx\" (UniqueName: \"kubernetes.io/projected/e5190e03-0dfb-4f12-aa55-2b65cf4c7800-kube-api-access-crjjx\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:05:00.063335 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:00.063331 2568 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/e5190e03-0dfb-4f12-aa55-2b65cf4c7800-tls-cert\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:05:00.568906 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:00.568868 2568 generic.go:356] "Generic (PLEG): container finished" podID="e5190e03-0dfb-4f12-aa55-2b65cf4c7800" containerID="f044b54d3d0d90535805c4aa491ecd29d07ea861f9e7a4cc19d7a877dc1cdce0" exitCode=0 Jul 28 01:05:00.569346 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:00.568915 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-597854b5d7-b58hq" Jul 28 01:05:00.569346 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:00.568956 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-597854b5d7-b58hq" event={"ID":"e5190e03-0dfb-4f12-aa55-2b65cf4c7800","Type":"ContainerDied","Data":"f044b54d3d0d90535805c4aa491ecd29d07ea861f9e7a4cc19d7a877dc1cdce0"} Jul 28 01:05:00.569346 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:00.569005 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-597854b5d7-b58hq" event={"ID":"e5190e03-0dfb-4f12-aa55-2b65cf4c7800","Type":"ContainerDied","Data":"99bb6e25014d8d0f9d58fb4f5693a22021a801c091d8b65a32a88eaa2d166036"} Jul 28 01:05:00.569346 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:00.569026 2568 scope.go:117] "RemoveContainer" containerID="f044b54d3d0d90535805c4aa491ecd29d07ea861f9e7a4cc19d7a877dc1cdce0" Jul 28 01:05:00.579549 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:00.579525 2568 scope.go:117] "RemoveContainer" containerID="f044b54d3d0d90535805c4aa491ecd29d07ea861f9e7a4cc19d7a877dc1cdce0" Jul 28 01:05:00.579911 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:05:00.579891 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f044b54d3d0d90535805c4aa491ecd29d07ea861f9e7a4cc19d7a877dc1cdce0\": container with ID starting with f044b54d3d0d90535805c4aa491ecd29d07ea861f9e7a4cc19d7a877dc1cdce0 not found: ID does not exist" containerID="f044b54d3d0d90535805c4aa491ecd29d07ea861f9e7a4cc19d7a877dc1cdce0" Jul 28 01:05:00.579979 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:00.579922 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f044b54d3d0d90535805c4aa491ecd29d07ea861f9e7a4cc19d7a877dc1cdce0"} err="failed to get container status \"f044b54d3d0d90535805c4aa491ecd29d07ea861f9e7a4cc19d7a877dc1cdce0\": rpc error: code = NotFound desc = could not find container \"f044b54d3d0d90535805c4aa491ecd29d07ea861f9e7a4cc19d7a877dc1cdce0\": container with ID starting with f044b54d3d0d90535805c4aa491ecd29d07ea861f9e7a4cc19d7a877dc1cdce0 not found: ID does not exist" Jul 28 01:05:00.595969 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:00.595936 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-597854b5d7-b58hq"] Jul 28 01:05:00.598355 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:00.598330 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-597854b5d7-b58hq"] Jul 28 01:05:01.534980 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:01.534940 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e5190e03-0dfb-4f12-aa55-2b65cf4c7800" path="/var/lib/kubelet/pods/e5190e03-0dfb-4f12-aa55-2b65cf4c7800/volumes" Jul 28 01:05:44.751157 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:44.751111 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85cd6fdbf4-r9jmr"] Jul 28 01:05:44.751752 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:44.751348 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-85cd6fdbf4-r9jmr" podUID="ca56d924-f0e0-4d55-92ed-b92b873a57b8" containerName="manager" containerID="cri-o://a038b2b83e3b1ed63b57927c64f53a7171fca1831a111e34edc56071e124ee96" gracePeriod=30 Jul 28 01:05:45.015760 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:45.015670 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85cd6fdbf4-r9jmr" Jul 28 01:05:45.105099 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:45.105061 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q4jsm\" (UniqueName: \"kubernetes.io/projected/ca56d924-f0e0-4d55-92ed-b92b873a57b8-kube-api-access-q4jsm\") pod \"ca56d924-f0e0-4d55-92ed-b92b873a57b8\" (UID: \"ca56d924-f0e0-4d55-92ed-b92b873a57b8\") " Jul 28 01:05:45.105099 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:45.105100 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca56d924-f0e0-4d55-92ed-b92b873a57b8-webhook-cert\") pod \"ca56d924-f0e0-4d55-92ed-b92b873a57b8\" (UID: \"ca56d924-f0e0-4d55-92ed-b92b873a57b8\") " Jul 28 01:05:45.107456 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:45.107419 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ca56d924-f0e0-4d55-92ed-b92b873a57b8-kube-api-access-q4jsm" (OuterVolumeSpecName: "kube-api-access-q4jsm") pod "ca56d924-f0e0-4d55-92ed-b92b873a57b8" (UID: "ca56d924-f0e0-4d55-92ed-b92b873a57b8"). InnerVolumeSpecName "kube-api-access-q4jsm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:05:45.107521 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:45.107478 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/ca56d924-f0e0-4d55-92ed-b92b873a57b8-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "ca56d924-f0e0-4d55-92ed-b92b873a57b8" (UID: "ca56d924-f0e0-4d55-92ed-b92b873a57b8"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 01:05:45.206213 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:45.206169 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q4jsm\" (UniqueName: \"kubernetes.io/projected/ca56d924-f0e0-4d55-92ed-b92b873a57b8-kube-api-access-q4jsm\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:05:45.206213 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:45.206206 2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ca56d924-f0e0-4d55-92ed-b92b873a57b8-webhook-cert\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:05:45.833525 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:45.833425 2568 generic.go:356] "Generic (PLEG): container finished" podID="ca56d924-f0e0-4d55-92ed-b92b873a57b8" containerID="a038b2b83e3b1ed63b57927c64f53a7171fca1831a111e34edc56071e124ee96" exitCode=0 Jul 28 01:05:45.833525 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:45.833474 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85cd6fdbf4-r9jmr" Jul 28 01:05:45.834081 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:45.833478 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85cd6fdbf4-r9jmr" event={"ID":"ca56d924-f0e0-4d55-92ed-b92b873a57b8","Type":"ContainerDied","Data":"a038b2b83e3b1ed63b57927c64f53a7171fca1831a111e34edc56071e124ee96"} Jul 28 01:05:45.834081 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:45.833612 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85cd6fdbf4-r9jmr" event={"ID":"ca56d924-f0e0-4d55-92ed-b92b873a57b8","Type":"ContainerDied","Data":"8453ef780b8e9915e7cc2c18616c39040b1f397409edf300df16d256c313b3ff"} Jul 28 01:05:45.834081 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:45.833650 2568 scope.go:117] "RemoveContainer" containerID="a038b2b83e3b1ed63b57927c64f53a7171fca1831a111e34edc56071e124ee96" Jul 28 01:05:45.844019 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:45.843995 2568 scope.go:117] "RemoveContainer" containerID="a038b2b83e3b1ed63b57927c64f53a7171fca1831a111e34edc56071e124ee96" Jul 28 01:05:45.844348 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:05:45.844327 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a038b2b83e3b1ed63b57927c64f53a7171fca1831a111e34edc56071e124ee96\": container with ID starting with a038b2b83e3b1ed63b57927c64f53a7171fca1831a111e34edc56071e124ee96 not found: ID does not exist" containerID="a038b2b83e3b1ed63b57927c64f53a7171fca1831a111e34edc56071e124ee96" Jul 28 01:05:45.844417 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:45.844360 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a038b2b83e3b1ed63b57927c64f53a7171fca1831a111e34edc56071e124ee96"} err="failed to get container status \"a038b2b83e3b1ed63b57927c64f53a7171fca1831a111e34edc56071e124ee96\": rpc error: code = NotFound desc = could not find container \"a038b2b83e3b1ed63b57927c64f53a7171fca1831a111e34edc56071e124ee96\": container with ID starting with a038b2b83e3b1ed63b57927c64f53a7171fca1831a111e34edc56071e124ee96 not found: ID does not exist" Jul 28 01:05:45.849861 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:45.849823 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85cd6fdbf4-r9jmr"] Jul 28 01:05:45.853728 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:45.853696 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85cd6fdbf4-r9jmr"] Jul 28 01:05:47.535032 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:05:47.534993 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="ca56d924-f0e0-4d55-92ed-b92b873a57b8" path="/var/lib/kubelet/pods/ca56d924-f0e0-4d55-92ed-b92b873a57b8/volumes" Jul 28 01:06:46.638593 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:46.638490 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85cd6fdbf4-mwkdf"] Jul 28 01:06:46.639077 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:46.638935 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ca56d924-f0e0-4d55-92ed-b92b873a57b8" containerName="manager" Jul 28 01:06:46.639077 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:46.638948 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="ca56d924-f0e0-4d55-92ed-b92b873a57b8" containerName="manager" Jul 28 01:06:46.639077 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:46.638967 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e5190e03-0dfb-4f12-aa55-2b65cf4c7800" containerName="authorino" Jul 28 01:06:46.639077 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:46.638972 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="e5190e03-0dfb-4f12-aa55-2b65cf4c7800" containerName="authorino" Jul 28 01:06:46.639077 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:46.639028 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="e5190e03-0dfb-4f12-aa55-2b65cf4c7800" containerName="authorino" Jul 28 01:06:46.639077 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:46.639039 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="ca56d924-f0e0-4d55-92ed-b92b873a57b8" containerName="manager" Jul 28 01:06:46.642470 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:46.642448 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85cd6fdbf4-mwkdf" Jul 28 01:06:46.646058 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:46.646010 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 28 01:06:46.646220 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:46.646170 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tj44w\"" Jul 28 01:06:46.646305 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:46.646283 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 28 01:06:46.650092 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:46.650061 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85cd6fdbf4-mwkdf"] Jul 28 01:06:46.762502 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:46.762462 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kgdrz\" (UniqueName: \"kubernetes.io/projected/bcaab312-6fb9-4a57-9a57-40541c179440-kube-api-access-kgdrz\") pod \"maas-controller-85cd6fdbf4-mwkdf\" (UID: \"bcaab312-6fb9-4a57-9a57-40541c179440\") " pod="opendatahub/maas-controller-85cd6fdbf4-mwkdf" Jul 28 01:06:46.762709 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:46.762518 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bcaab312-6fb9-4a57-9a57-40541c179440-webhook-cert\") pod \"maas-controller-85cd6fdbf4-mwkdf\" (UID: \"bcaab312-6fb9-4a57-9a57-40541c179440\") " pod="opendatahub/maas-controller-85cd6fdbf4-mwkdf" Jul 28 01:06:46.863686 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:46.863558 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bcaab312-6fb9-4a57-9a57-40541c179440-webhook-cert\") pod \"maas-controller-85cd6fdbf4-mwkdf\" (UID: \"bcaab312-6fb9-4a57-9a57-40541c179440\") " pod="opendatahub/maas-controller-85cd6fdbf4-mwkdf" Jul 28 01:06:46.863865 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:46.863763 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kgdrz\" (UniqueName: \"kubernetes.io/projected/bcaab312-6fb9-4a57-9a57-40541c179440-kube-api-access-kgdrz\") pod \"maas-controller-85cd6fdbf4-mwkdf\" (UID: \"bcaab312-6fb9-4a57-9a57-40541c179440\") " pod="opendatahub/maas-controller-85cd6fdbf4-mwkdf" Jul 28 01:06:46.866354 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:46.866327 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bcaab312-6fb9-4a57-9a57-40541c179440-webhook-cert\") pod \"maas-controller-85cd6fdbf4-mwkdf\" (UID: \"bcaab312-6fb9-4a57-9a57-40541c179440\") " pod="opendatahub/maas-controller-85cd6fdbf4-mwkdf" Jul 28 01:06:46.871400 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:46.871369 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kgdrz\" (UniqueName: \"kubernetes.io/projected/bcaab312-6fb9-4a57-9a57-40541c179440-kube-api-access-kgdrz\") pod \"maas-controller-85cd6fdbf4-mwkdf\" (UID: \"bcaab312-6fb9-4a57-9a57-40541c179440\") " pod="opendatahub/maas-controller-85cd6fdbf4-mwkdf" Jul 28 01:06:46.955811 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:46.955717 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85cd6fdbf4-mwkdf" Jul 28 01:06:47.111354 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:47.111324 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85cd6fdbf4-mwkdf"] Jul 28 01:06:47.113120 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:06:47.113090 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbcaab312_6fb9_4a57_9a57_40541c179440.slice/crio-787f84843abf6f9ffd2eaaf5ea4c24126408e5d483e8eda8143b477fa98367b2 WatchSource:0}: Error finding container 787f84843abf6f9ffd2eaaf5ea4c24126408e5d483e8eda8143b477fa98367b2: Status 404 returned error can't find the container with id 787f84843abf6f9ffd2eaaf5ea4c24126408e5d483e8eda8143b477fa98367b2 Jul 28 01:06:47.193181 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:47.193145 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85cd6fdbf4-mwkdf" event={"ID":"bcaab312-6fb9-4a57-9a57-40541c179440","Type":"ContainerStarted","Data":"787f84843abf6f9ffd2eaaf5ea4c24126408e5d483e8eda8143b477fa98367b2"} Jul 28 01:06:48.200693 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:48.200650 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85cd6fdbf4-mwkdf" event={"ID":"bcaab312-6fb9-4a57-9a57-40541c179440","Type":"ContainerStarted","Data":"63380c88fc3164b71681942266d805e60fa900869a8b663df6a789648042182d"} Jul 28 01:06:48.201223 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:48.200717 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85cd6fdbf4-mwkdf" Jul 28 01:06:48.216154 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:48.216090 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85cd6fdbf4-mwkdf" podStartSLOduration=1.650981479 podStartE2EDuration="2.216070283s" totalImagesPullingTime="565.088804ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:06:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:06:48.214253684 +0000 UTC m=+805.133854369" watchObservedRunningTime="2026-07-28 01:06:48.216070283 +0000 UTC m=+805.135670967" Jul 28 01:06:59.209428 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:06:59.209394 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85cd6fdbf4-mwkdf" Jul 28 01:07:03.818494 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:03.818455 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85cd6fdbf4-mwkdf"] Jul 28 01:07:03.818996 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:03.818687 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="opendatahub/maas-controller-85cd6fdbf4-mwkdf" podUID="bcaab312-6fb9-4a57-9a57-40541c179440" containerName="manager" containerID="cri-o://63380c88fc3164b71681942266d805e60fa900869a8b663df6a789648042182d" gracePeriod=30 Jul 28 01:07:04.077589 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:04.077490 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85cd6fdbf4-mwkdf" Jul 28 01:07:04.229900 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:04.229863 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kgdrz\" (UniqueName: \"kubernetes.io/projected/bcaab312-6fb9-4a57-9a57-40541c179440-kube-api-access-kgdrz\") pod \"bcaab312-6fb9-4a57-9a57-40541c179440\" (UID: \"bcaab312-6fb9-4a57-9a57-40541c179440\") " Jul 28 01:07:04.230127 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:04.229968 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bcaab312-6fb9-4a57-9a57-40541c179440-webhook-cert\") pod \"bcaab312-6fb9-4a57-9a57-40541c179440\" (UID: \"bcaab312-6fb9-4a57-9a57-40541c179440\") " Jul 28 01:07:04.232311 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:04.232266 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/bcaab312-6fb9-4a57-9a57-40541c179440-kube-api-access-kgdrz" (OuterVolumeSpecName: "kube-api-access-kgdrz") pod "bcaab312-6fb9-4a57-9a57-40541c179440" (UID: "bcaab312-6fb9-4a57-9a57-40541c179440"). InnerVolumeSpecName "kube-api-access-kgdrz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:07:04.232311 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:04.232312 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/bcaab312-6fb9-4a57-9a57-40541c179440-webhook-cert" (OuterVolumeSpecName: "webhook-cert") pod "bcaab312-6fb9-4a57-9a57-40541c179440" (UID: "bcaab312-6fb9-4a57-9a57-40541c179440"). InnerVolumeSpecName "webhook-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 28 01:07:04.306743 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:04.306704 2568 generic.go:356] "Generic (PLEG): container finished" podID="bcaab312-6fb9-4a57-9a57-40541c179440" containerID="63380c88fc3164b71681942266d805e60fa900869a8b663df6a789648042182d" exitCode=0 Jul 28 01:07:04.306927 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:04.306754 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85cd6fdbf4-mwkdf" Jul 28 01:07:04.306927 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:04.306796 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85cd6fdbf4-mwkdf" event={"ID":"bcaab312-6fb9-4a57-9a57-40541c179440","Type":"ContainerDied","Data":"63380c88fc3164b71681942266d805e60fa900869a8b663df6a789648042182d"} Jul 28 01:07:04.306927 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:04.306867 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85cd6fdbf4-mwkdf" event={"ID":"bcaab312-6fb9-4a57-9a57-40541c179440","Type":"ContainerDied","Data":"787f84843abf6f9ffd2eaaf5ea4c24126408e5d483e8eda8143b477fa98367b2"} Jul 28 01:07:04.306927 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:04.306890 2568 scope.go:117] "RemoveContainer" containerID="63380c88fc3164b71681942266d805e60fa900869a8b663df6a789648042182d" Jul 28 01:07:04.316698 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:04.316676 2568 scope.go:117] "RemoveContainer" containerID="63380c88fc3164b71681942266d805e60fa900869a8b663df6a789648042182d" Jul 28 01:07:04.316982 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:07:04.316963 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"63380c88fc3164b71681942266d805e60fa900869a8b663df6a789648042182d\": container with ID starting with 63380c88fc3164b71681942266d805e60fa900869a8b663df6a789648042182d not found: ID does not exist" containerID="63380c88fc3164b71681942266d805e60fa900869a8b663df6a789648042182d" Jul 28 01:07:04.317024 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:04.316993 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"63380c88fc3164b71681942266d805e60fa900869a8b663df6a789648042182d"} err="failed to get container status \"63380c88fc3164b71681942266d805e60fa900869a8b663df6a789648042182d\": rpc error: code = NotFound desc = could not find container \"63380c88fc3164b71681942266d805e60fa900869a8b663df6a789648042182d\": container with ID starting with 63380c88fc3164b71681942266d805e60fa900869a8b663df6a789648042182d not found: ID does not exist" Jul 28 01:07:04.328148 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:04.328073 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["opendatahub/maas-controller-85cd6fdbf4-mwkdf"] Jul 28 01:07:04.331331 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:04.331308 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kgdrz\" (UniqueName: \"kubernetes.io/projected/bcaab312-6fb9-4a57-9a57-40541c179440-kube-api-access-kgdrz\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:07:04.331331 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:04.331331 2568 reconciler_common.go:299] "Volume detached for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/bcaab312-6fb9-4a57-9a57-40541c179440-webhook-cert\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:07:04.331522 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:04.331502 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["opendatahub/maas-controller-85cd6fdbf4-mwkdf"] Jul 28 01:07:05.085644 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:05.085603 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/maas-controller-85cd6fdbf4-x8947"] Jul 28 01:07:05.086127 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:05.086002 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="bcaab312-6fb9-4a57-9a57-40541c179440" containerName="manager" Jul 28 01:07:05.086127 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:05.086013 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="bcaab312-6fb9-4a57-9a57-40541c179440" containerName="manager" Jul 28 01:07:05.086127 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:05.086087 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="bcaab312-6fb9-4a57-9a57-40541c179440" containerName="manager" Jul 28 01:07:05.090606 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:05.090553 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85cd6fdbf4-x8947" Jul 28 01:07:05.094144 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:05.094115 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"maas-parameters\"" Jul 28 01:07:05.094303 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:05.094115 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-dockercfg-tj44w\"" Jul 28 01:07:05.094303 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:05.094122 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"maas-controller-webhook-cert\"" Jul 28 01:07:05.096663 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:05.096637 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85cd6fdbf4-x8947"] Jul 28 01:07:05.238174 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:05.238131 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9fd33551-d6d5-4a2c-a991-5c9ec797584a-webhook-cert\") pod \"maas-controller-85cd6fdbf4-x8947\" (UID: \"9fd33551-d6d5-4a2c-a991-5c9ec797584a\") " pod="opendatahub/maas-controller-85cd6fdbf4-x8947" Jul 28 01:07:05.238362 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:05.238261 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kcdjj\" (UniqueName: \"kubernetes.io/projected/9fd33551-d6d5-4a2c-a991-5c9ec797584a-kube-api-access-kcdjj\") pod \"maas-controller-85cd6fdbf4-x8947\" (UID: \"9fd33551-d6d5-4a2c-a991-5c9ec797584a\") " pod="opendatahub/maas-controller-85cd6fdbf4-x8947" Jul 28 01:07:05.339545 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:05.339431 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9fd33551-d6d5-4a2c-a991-5c9ec797584a-webhook-cert\") pod \"maas-controller-85cd6fdbf4-x8947\" (UID: \"9fd33551-d6d5-4a2c-a991-5c9ec797584a\") " pod="opendatahub/maas-controller-85cd6fdbf4-x8947" Jul 28 01:07:05.339545 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:05.339534 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kcdjj\" (UniqueName: \"kubernetes.io/projected/9fd33551-d6d5-4a2c-a991-5c9ec797584a-kube-api-access-kcdjj\") pod \"maas-controller-85cd6fdbf4-x8947\" (UID: \"9fd33551-d6d5-4a2c-a991-5c9ec797584a\") " pod="opendatahub/maas-controller-85cd6fdbf4-x8947" Jul 28 01:07:05.342125 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:05.342085 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/9fd33551-d6d5-4a2c-a991-5c9ec797584a-webhook-cert\") pod \"maas-controller-85cd6fdbf4-x8947\" (UID: \"9fd33551-d6d5-4a2c-a991-5c9ec797584a\") " pod="opendatahub/maas-controller-85cd6fdbf4-x8947" Jul 28 01:07:05.348975 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:05.348952 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kcdjj\" (UniqueName: \"kubernetes.io/projected/9fd33551-d6d5-4a2c-a991-5c9ec797584a-kube-api-access-kcdjj\") pod \"maas-controller-85cd6fdbf4-x8947\" (UID: \"9fd33551-d6d5-4a2c-a991-5c9ec797584a\") " pod="opendatahub/maas-controller-85cd6fdbf4-x8947" Jul 28 01:07:05.403926 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:05.403884 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/maas-controller-85cd6fdbf4-x8947" Jul 28 01:07:05.535126 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:05.535090 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="bcaab312-6fb9-4a57-9a57-40541c179440" path="/var/lib/kubelet/pods/bcaab312-6fb9-4a57-9a57-40541c179440/volumes" Jul 28 01:07:05.549659 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:05.549631 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/maas-controller-85cd6fdbf4-x8947"] Jul 28 01:07:05.551036 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:07:05.551003 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9fd33551_d6d5_4a2c_a991_5c9ec797584a.slice/crio-3dfc80b02019ccad36ce152dff210f78182e23bf1b63960fe395650f05e5e125 WatchSource:0}: Error finding container 3dfc80b02019ccad36ce152dff210f78182e23bf1b63960fe395650f05e5e125: Status 404 returned error can't find the container with id 3dfc80b02019ccad36ce152dff210f78182e23bf1b63960fe395650f05e5e125 Jul 28 01:07:06.321846 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:06.321738 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85cd6fdbf4-x8947" event={"ID":"9fd33551-d6d5-4a2c-a991-5c9ec797584a","Type":"ContainerStarted","Data":"3cc9414a8c3b5988dbba4fbed65b63d2099954ccae40b8bf7c5f5d0fdc4a03ad"} Jul 28 01:07:06.321846 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:06.321805 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/maas-controller-85cd6fdbf4-x8947" event={"ID":"9fd33551-d6d5-4a2c-a991-5c9ec797584a","Type":"ContainerStarted","Data":"3dfc80b02019ccad36ce152dff210f78182e23bf1b63960fe395650f05e5e125"} Jul 28 01:07:06.321846 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:06.321831 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/maas-controller-85cd6fdbf4-x8947" Jul 28 01:07:06.339689 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:06.339629 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/maas-controller-85cd6fdbf4-x8947" podStartSLOduration=0.945612174 podStartE2EDuration="1.33960944s" totalImagesPullingTime="393.997266ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:07:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:07:06.33789241 +0000 UTC m=+823.257493094" watchObservedRunningTime="2026-07-28 01:07:06.33960944 +0000 UTC m=+823.259210124" Jul 28 01:07:17.330378 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:07:17.330347 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/maas-controller-85cd6fdbf4-x8947" Jul 28 01:08:23.550063 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:08:23.549972 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:08:23.551429 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:08:23.551407 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:13:23.592870 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:13:23.592841 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:13:23.593646 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:13:23.593626 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:18:23.628726 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:18:23.628696 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:18:23.631132 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:18:23.631062 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:20:55.049510 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.049470 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8"] Jul 28 01:20:55.052988 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.052967 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.055663 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.055519 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-0dbe3ebb-openshift-default-dockercfg-vh2cr\"" Jul 28 01:20:55.075942 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.075908 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8"] Jul 28 01:20:55.164144 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.164112 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-envoy\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.164144 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.164148 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-credential-socket\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.164371 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.164166 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-data\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.164371 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.164223 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-podinfo\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.164371 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.164287 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mx7x\" (UniqueName: \"kubernetes.io/projected/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-kube-api-access-6mx7x\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.164371 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.164341 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-workload-socket\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.164371 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.164364 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-token\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.164526 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.164381 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istiod-ca-cert\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.164526 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.164433 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-workload-certs\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.265985 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.265937 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-envoy\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.265985 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.265989 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-credential-socket\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.266257 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.266102 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-data\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.266257 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.266155 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-podinfo\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.266257 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.266219 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mx7x\" (UniqueName: \"kubernetes.io/projected/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-kube-api-access-6mx7x\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.266433 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.266302 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-workload-socket\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.266433 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.266405 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-credential-socket\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.266635 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.266441 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-token\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.266635 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.266493 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-data\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.266635 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.266494 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istiod-ca-cert\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.266635 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.266628 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-workload-socket\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.266843 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.266775 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-workload-certs\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.267211 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.267190 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istiod-ca-cert\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.267340 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.267319 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-workload-certs\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.268604 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.268588 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-envoy\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.268937 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.268917 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-podinfo\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.274482 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.274456 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-token\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.274623 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.274604 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mx7x\" (UniqueName: \"kubernetes.io/projected/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-kube-api-access-6mx7x\") pod \"e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.365547 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.365498 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:55.532179 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:20:55.532146 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe60f1ee_c2a6_40ab_ac8e_bb9822c0d022.slice/crio-02b3cfaeb9a5da39edb0c12e87527ce18e25564e4630a84cc3026d1eb66fb968 WatchSource:0}: Error finding container 02b3cfaeb9a5da39edb0c12e87527ce18e25564e4630a84cc3026d1eb66fb968: Status 404 returned error can't find the container with id 02b3cfaeb9a5da39edb0c12e87527ce18e25564e4630a84cc3026d1eb66fb968 Jul 28 01:20:55.534258 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.534222 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:20:55.534357 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.534303 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:20:55.534357 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.534343 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:20:55.536490 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:55.536470 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8"] Jul 28 01:20:56.080290 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:56.080251 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" event={"ID":"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022","Type":"ContainerStarted","Data":"cb76c3e33777b8d72dd5784dc5a0177be3c44a9f9aadaf7ac20b40c33fba0540"} Jul 28 01:20:56.080702 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:56.080316 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" event={"ID":"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022","Type":"ContainerStarted","Data":"02b3cfaeb9a5da39edb0c12e87527ce18e25564e4630a84cc3026d1eb66fb968"} Jul 28 01:20:56.108635 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:56.108582 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" podStartSLOduration=1.108550275 podStartE2EDuration="1.108550275s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:20:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:20:56.104900761 +0000 UTC m=+1653.024501469" watchObservedRunningTime="2026-07-28 01:20:56.108550275 +0000 UTC m=+1653.028150958" Jul 28 01:20:56.365774 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:56.365737 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:56.371014 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:56.370987 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:57.086419 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:57.086355 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:20:57.087264 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:20:57.087245 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:21:10.165941 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:21:10.165908 2568 generic.go:356] "Generic (PLEG): container finished" podID="be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" containerID="cb76c3e33777b8d72dd5784dc5a0177be3c44a9f9aadaf7ac20b40c33fba0540" exitCode=0 Jul 28 01:21:10.166386 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:21:10.165985 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" event={"ID":"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022","Type":"ContainerDied","Data":"cb76c3e33777b8d72dd5784dc5a0177be3c44a9f9aadaf7ac20b40c33fba0540"} Jul 28 01:21:10.166457 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:21:10.166439 2568 scope.go:117] "RemoveContainer" containerID="cb76c3e33777b8d72dd5784dc5a0177be3c44a9f9aadaf7ac20b40c33fba0540" Jul 28 01:21:10.167471 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:21:10.167435 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:21:10.167600 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:21:10.167510 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:21:10.167600 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:21:10.167557 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:21:11.174073 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:21:11.174035 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" event={"ID":"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022","Type":"ContainerStarted","Data":"c2a3268c265a2aca4da104b01c3cae672063cf950315ea870a9f9df9c627b417"} Jul 28 01:21:11.366521 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:21:11.366479 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:21:11.367550 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:21:11.367525 2568 patch_prober.go:28] interesting pod/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 28 01:21:11.367633 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:21:11.367593 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" podUID="be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 28 01:21:12.087358 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:21:12.087287 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:21:12.366120 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:21:12.366072 2568 patch_prober.go:28] interesting pod/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 28 01:21:12.366558 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:21:12.366139 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" podUID="be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 28 01:21:13.366619 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:21:13.366555 2568 patch_prober.go:28] interesting pod/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 28 01:21:13.367024 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:21:13.366647 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" podUID="be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 28 01:21:14.365921 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:21:14.365882 2568 patch_prober.go:28] interesting pod/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 28 01:21:14.366107 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:21:14.365951 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" podUID="be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 28 01:21:15.366265 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:21:15.366221 2568 patch_prober.go:28] interesting pod/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" start-of-body= Jul 28 01:21:15.366709 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:21:15.366285 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" podUID="be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.64:15021/healthz/ready\": dial tcp 10.132.0.64:15021: connect: connection refused" Jul 28 01:21:16.370968 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:21:16.370927 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:21:16.372001 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:21:16.371980 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:23:23.670145 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:23:23.670117 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:23:23.672526 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:23:23.672486 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:26:19.751529 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:19.751485 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8"] Jul 28 01:26:19.752120 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:19.751795 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" podUID="be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" containerName="istio-proxy" containerID="cri-o://c2a3268c265a2aca4da104b01c3cae672063cf950315ea870a9f9df9c627b417" gracePeriod=30 Jul 28 01:26:20.828494 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.828453 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk"] Jul 28 01:26:20.831826 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.831798 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.834552 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.834518 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-c08eabd1-gw-openshift-default-dockercfg-k8gtm\"" Jul 28 01:26:20.848389 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.848355 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk"] Jul 28 01:26:20.891266 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.891222 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2lwjj\" (UniqueName: \"kubernetes.io/projected/d38a40c9-813c-478b-8faf-dda4788030e0-kube-api-access-2lwjj\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.891475 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.891278 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d38a40c9-813c-478b-8faf-dda4788030e0-istiod-ca-cert\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.891475 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.891324 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-credential-socket\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.891475 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.891345 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-istio-data\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.891475 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.891369 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-istio-envoy\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.891475 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.891396 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d38a40c9-813c-478b-8faf-dda4788030e0-istio-token\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.891475 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.891433 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-workload-certs\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.891735 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.891556 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d38a40c9-813c-478b-8faf-dda4788030e0-istio-podinfo\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.891735 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.891662 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-workload-socket\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.992434 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.992389 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-workload-socket\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.992696 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.992488 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2lwjj\" (UniqueName: \"kubernetes.io/projected/d38a40c9-813c-478b-8faf-dda4788030e0-kube-api-access-2lwjj\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.992696 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.992542 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d38a40c9-813c-478b-8faf-dda4788030e0-istiod-ca-cert\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.992696 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.992631 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-credential-socket\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.992696 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.992664 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-istio-data\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.992696 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.992690 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-istio-envoy\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.992940 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.992818 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d38a40c9-813c-478b-8faf-dda4788030e0-istio-token\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.992940 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.992923 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-workload-certs\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.993037 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.992964 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d38a40c9-813c-478b-8faf-dda4788030e0-istio-podinfo\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.993037 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.993015 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-workload-socket\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.993151 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.993050 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-istio-data\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.993208 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.993179 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-credential-socket\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.993338 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.993311 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-workload-certs\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.993491 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.993472 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d38a40c9-813c-478b-8faf-dda4788030e0-istiod-ca-cert\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.995436 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.995416 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-istio-envoy\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:20.995643 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:20.995624 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d38a40c9-813c-478b-8faf-dda4788030e0-istio-podinfo\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:21.002611 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:21.002554 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d38a40c9-813c-478b-8faf-dda4788030e0-istio-token\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:21.002751 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:21.002700 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2lwjj\" (UniqueName: \"kubernetes.io/projected/d38a40c9-813c-478b-8faf-dda4788030e0-kube-api-access-2lwjj\") pod \"e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:21.143734 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:21.143689 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:21.301135 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:21.301102 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk"] Jul 28 01:26:21.303435 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:26:21.303404 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd38a40c9_813c_478b_8faf_dda4788030e0.slice/crio-0b4e50f8fb930ecda4126395898a0bea8ac58e98ad110816c6276f7af941a1e4 WatchSource:0}: Error finding container 0b4e50f8fb930ecda4126395898a0bea8ac58e98ad110816c6276f7af941a1e4: Status 404 returned error can't find the container with id 0b4e50f8fb930ecda4126395898a0bea8ac58e98ad110816c6276f7af941a1e4 Jul 28 01:26:21.306301 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:21.306266 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:26:21.306402 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:21.306345 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:26:21.306402 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:21.306375 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:26:22.016744 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:22.016697 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" event={"ID":"d38a40c9-813c-478b-8faf-dda4788030e0","Type":"ContainerStarted","Data":"093b21aa83d9e0ca9abe0fa2d0e2fd92c285071fd38238642a6af228a85255ad"} Jul 28 01:26:22.017245 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:22.016820 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" event={"ID":"d38a40c9-813c-478b-8faf-dda4788030e0","Type":"ContainerStarted","Data":"0b4e50f8fb930ecda4126395898a0bea8ac58e98ad110816c6276f7af941a1e4"} Jul 28 01:26:22.040674 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:22.040614 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" podStartSLOduration=2.04059942 podStartE2EDuration="2.04059942s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:26:20 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:26:22.038169248 +0000 UTC m=+1978.957769934" watchObservedRunningTime="2026-07-28 01:26:22.04059942 +0000 UTC m=+1978.960200105" Jul 28 01:26:22.144637 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:22.144601 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:22.158048 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:22.158000 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:23.022114 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:23.022079 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:23.023267 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:23.023243 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:25.011053 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.011027 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:26:25.032846 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.032750 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-podinfo\") pod \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " Jul 28 01:26:25.032846 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.032792 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6mx7x\" (UniqueName: \"kubernetes.io/projected/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-kube-api-access-6mx7x\") pod \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " Jul 28 01:26:25.032846 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.032833 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-data\") pod \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " Jul 28 01:26:25.033159 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.032912 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-envoy\") pod \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " Jul 28 01:26:25.033159 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.032987 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-credential-socket\") pod \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " Jul 28 01:26:25.033159 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.033070 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-workload-socket\") pod \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " Jul 28 01:26:25.033159 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.033129 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-token\") pod \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " Jul 28 01:26:25.033381 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.033162 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-workload-certs\") pod \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " Jul 28 01:26:25.033381 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.033194 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istiod-ca-cert\") pod \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\" (UID: \"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022\") " Jul 28 01:26:25.033903 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.033559 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" (UID: "be60f1ee-c2a6-40ab-ac8e-bb9822c0d022"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:26:25.033903 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.033774 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-credential-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:26:25.033903 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.033827 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" (UID: "be60f1ee-c2a6-40ab-ac8e-bb9822c0d022"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:26:25.034129 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.033896 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-data" (OuterVolumeSpecName: "istio-data") pod "be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" (UID: "be60f1ee-c2a6-40ab-ac8e-bb9822c0d022"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:26:25.034129 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.033924 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" (UID: "be60f1ee-c2a6-40ab-ac8e-bb9822c0d022"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:26:25.034129 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.034092 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" (UID: "be60f1ee-c2a6-40ab-ac8e-bb9822c0d022"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:26:25.035445 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.035085 2568 generic.go:356] "Generic (PLEG): container finished" podID="be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" containerID="c2a3268c265a2aca4da104b01c3cae672063cf950315ea870a9f9df9c627b417" exitCode=0 Jul 28 01:26:25.035445 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.035162 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" Jul 28 01:26:25.035445 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.035229 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" event={"ID":"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022","Type":"ContainerDied","Data":"c2a3268c265a2aca4da104b01c3cae672063cf950315ea870a9f9df9c627b417"} Jul 28 01:26:25.035445 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.035278 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8" event={"ID":"be60f1ee-c2a6-40ab-ac8e-bb9822c0d022","Type":"ContainerDied","Data":"02b3cfaeb9a5da39edb0c12e87527ce18e25564e4630a84cc3026d1eb66fb968"} Jul 28 01:26:25.035445 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.035304 2568 scope.go:117] "RemoveContainer" containerID="c2a3268c265a2aca4da104b01c3cae672063cf950315ea870a9f9df9c627b417" Jul 28 01:26:25.036068 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.036044 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" (UID: "be60f1ee-c2a6-40ab-ac8e-bb9822c0d022"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:26:25.036432 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.036390 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-kube-api-access-6mx7x" (OuterVolumeSpecName: "kube-api-access-6mx7x") pod "be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" (UID: "be60f1ee-c2a6-40ab-ac8e-bb9822c0d022"). InnerVolumeSpecName "kube-api-access-6mx7x". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:26:25.036705 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.036667 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-token" (OuterVolumeSpecName: "istio-token") pod "be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" (UID: "be60f1ee-c2a6-40ab-ac8e-bb9822c0d022"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:26:25.037211 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.037164 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" (UID: "be60f1ee-c2a6-40ab-ac8e-bb9822c0d022"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 28 01:26:25.061697 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.061665 2568 scope.go:117] "RemoveContainer" containerID="cb76c3e33777b8d72dd5784dc5a0177be3c44a9f9aadaf7ac20b40c33fba0540" Jul 28 01:26:25.072155 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.072125 2568 scope.go:117] "RemoveContainer" containerID="c2a3268c265a2aca4da104b01c3cae672063cf950315ea870a9f9df9c627b417" Jul 28 01:26:25.072501 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:26:25.072481 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2a3268c265a2aca4da104b01c3cae672063cf950315ea870a9f9df9c627b417\": container with ID starting with c2a3268c265a2aca4da104b01c3cae672063cf950315ea870a9f9df9c627b417 not found: ID does not exist" containerID="c2a3268c265a2aca4da104b01c3cae672063cf950315ea870a9f9df9c627b417" Jul 28 01:26:25.072623 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.072511 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2a3268c265a2aca4da104b01c3cae672063cf950315ea870a9f9df9c627b417"} err="failed to get container status \"c2a3268c265a2aca4da104b01c3cae672063cf950315ea870a9f9df9c627b417\": rpc error: code = NotFound desc = could not find container \"c2a3268c265a2aca4da104b01c3cae672063cf950315ea870a9f9df9c627b417\": container with ID starting with c2a3268c265a2aca4da104b01c3cae672063cf950315ea870a9f9df9c627b417 not found: ID does not exist" Jul 28 01:26:25.072623 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.072533 2568 scope.go:117] "RemoveContainer" containerID="cb76c3e33777b8d72dd5784dc5a0177be3c44a9f9aadaf7ac20b40c33fba0540" Jul 28 01:26:25.072898 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:26:25.072874 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb76c3e33777b8d72dd5784dc5a0177be3c44a9f9aadaf7ac20b40c33fba0540\": container with ID starting with cb76c3e33777b8d72dd5784dc5a0177be3c44a9f9aadaf7ac20b40c33fba0540 not found: ID does not exist" containerID="cb76c3e33777b8d72dd5784dc5a0177be3c44a9f9aadaf7ac20b40c33fba0540" Jul 28 01:26:25.072952 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.072904 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb76c3e33777b8d72dd5784dc5a0177be3c44a9f9aadaf7ac20b40c33fba0540"} err="failed to get container status \"cb76c3e33777b8d72dd5784dc5a0177be3c44a9f9aadaf7ac20b40c33fba0540\": rpc error: code = NotFound desc = could not find container \"cb76c3e33777b8d72dd5784dc5a0177be3c44a9f9aadaf7ac20b40c33fba0540\": container with ID starting with cb76c3e33777b8d72dd5784dc5a0177be3c44a9f9aadaf7ac20b40c33fba0540 not found: ID does not exist" Jul 28 01:26:25.135184 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.134706 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-podinfo\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:26:25.135184 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.134740 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6mx7x\" (UniqueName: \"kubernetes.io/projected/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-kube-api-access-6mx7x\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:26:25.135184 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.134758 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-data\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:26:25.135184 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.134773 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-envoy\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:26:25.135184 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.134785 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-workload-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:26:25.135184 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.134797 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istio-token\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:26:25.135184 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.134809 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-workload-certs\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:26:25.135184 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.134820 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022-istiod-ca-cert\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:26:25.360637 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.360594 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8"] Jul 28 01:26:25.368203 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.368170 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-0dbe3ebb-openshift-default-779f8f7cc8-258f8"] Jul 28 01:26:25.534709 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:25.534675 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" path="/var/lib/kubelet/pods/be60f1ee-c2a6-40ab-ac8e-bb9822c0d022/volumes" Jul 28 01:26:39.023225 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:39.023183 2568 patch_prober.go:28] interesting pod/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 28 01:26:39.023663 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:39.023251 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" podUID="d38a40c9-813c-478b-8faf-dda4788030e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 28 01:26:40.131925 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:40.131886 2568 generic.go:356] "Generic (PLEG): container finished" podID="d38a40c9-813c-478b-8faf-dda4788030e0" containerID="093b21aa83d9e0ca9abe0fa2d0e2fd92c285071fd38238642a6af228a85255ad" exitCode=0 Jul 28 01:26:40.132432 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:40.131961 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" event={"ID":"d38a40c9-813c-478b-8faf-dda4788030e0","Type":"ContainerDied","Data":"093b21aa83d9e0ca9abe0fa2d0e2fd92c285071fd38238642a6af228a85255ad"} Jul 28 01:26:40.132432 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:40.132425 2568 scope.go:117] "RemoveContainer" containerID="093b21aa83d9e0ca9abe0fa2d0e2fd92c285071fd38238642a6af228a85255ad" Jul 28 01:26:40.133447 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:40.133418 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:26:40.133501 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:40.133488 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:26:40.133543 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:40.133518 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:26:41.140037 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:41.139999 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" event={"ID":"d38a40c9-813c-478b-8faf-dda4788030e0","Type":"ContainerStarted","Data":"3a77a65e0705b6f3cf16cfeb2638e2cce34ebb2c4ab7f4281ab67710265d290d"} Jul 28 01:26:41.143999 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:41.143971 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:41.144224 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:41.144203 2568 patch_prober.go:28] interesting pod/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 28 01:26:41.144312 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:41.144254 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" podUID="d38a40c9-813c-478b-8faf-dda4788030e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 28 01:26:42.144489 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:42.144452 2568 patch_prober.go:28] interesting pod/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 28 01:26:42.145007 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:42.144508 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" podUID="d38a40c9-813c-478b-8faf-dda4788030e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 28 01:26:43.144451 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:43.144419 2568 patch_prober.go:28] interesting pod/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 28 01:26:43.144702 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:43.144623 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" podUID="d38a40c9-813c-478b-8faf-dda4788030e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 28 01:26:44.144241 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:44.144202 2568 patch_prober.go:28] interesting pod/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" start-of-body= Jul 28 01:26:44.144449 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:44.144261 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" podUID="d38a40c9-813c-478b-8faf-dda4788030e0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.65:15021/healthz/ready\": dial tcp 10.132.0.65:15021: connect: connection refused" Jul 28 01:26:45.148710 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:45.148673 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:45.149147 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:45.148933 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:26:45.149636 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:26:45.149618 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:28:23.711018 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:28:23.710989 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:28:23.714309 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:28:23.714276 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:29:47.403326 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:47.403287 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk"] Jul 28 01:29:47.403904 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:47.403506 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" podUID="d38a40c9-813c-478b-8faf-dda4788030e0" containerName="istio-proxy" containerID="cri-o://3a77a65e0705b6f3cf16cfeb2638e2cce34ebb2c4ab7f4281ab67710265d290d" gracePeriod=30 Jul 28 01:29:48.190774 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.190738 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v"] Jul 28 01:29:48.191240 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.191221 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" containerName="istio-proxy" Jul 28 01:29:48.191360 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.191242 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" containerName="istio-proxy" Jul 28 01:29:48.191421 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.191368 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" containerName="istio-proxy" Jul 28 01:29:48.191421 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.191386 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" containerName="istio-proxy" Jul 28 01:29:48.193904 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.193882 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.196301 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.196280 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-e0fd3dac-openshift-default-dockercfg-bg9dm\"" Jul 28 01:29:48.201622 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.201539 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4xnfh\" (UniqueName: \"kubernetes.io/projected/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-kube-api-access-4xnfh\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.201849 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.201810 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-workload-socket\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.201993 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.201909 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-envoy\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.201993 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.201957 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istiod-ca-cert\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.201993 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.202000 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-workload-certs\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.202212 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.202042 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-token\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.202212 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.202062 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-credential-socket\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.202212 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.202093 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-podinfo\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.202212 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.202136 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-data\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.206646 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.206617 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v"] Jul 28 01:29:48.302886 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.302851 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-token\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.303114 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.302892 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-credential-socket\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.303114 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.302922 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-podinfo\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.303114 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.302956 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-data\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.303114 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.303012 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4xnfh\" (UniqueName: \"kubernetes.io/projected/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-kube-api-access-4xnfh\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.303352 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.303184 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-workload-socket\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.303352 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.303262 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-envoy\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.303352 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.303293 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istiod-ca-cert\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.303352 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.303328 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-workload-certs\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.303592 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.303349 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-credential-socket\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.303592 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.303374 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-data\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.303730 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.303551 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-workload-socket\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.303781 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.303730 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-workload-certs\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.304013 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.303996 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istiod-ca-cert\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.305620 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.305594 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-envoy\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.305620 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.305602 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-podinfo\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.313491 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.313467 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-token\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.313660 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.313529 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4xnfh\" (UniqueName: \"kubernetes.io/projected/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-kube-api-access-4xnfh\") pod \"e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.507152 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.507060 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:48.656579 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.656542 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v"] Jul 28 01:29:48.658235 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:29:48.658204 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2aeabcbf_9b53_4aa7_a3aa_9762c22cc5d5.slice/crio-82dff00bb077b13c438851b3bf6f976b1933d1c51a0eef493b3ef1b81d39aadc WatchSource:0}: Error finding container 82dff00bb077b13c438851b3bf6f976b1933d1c51a0eef493b3ef1b81d39aadc: Status 404 returned error can't find the container with id 82dff00bb077b13c438851b3bf6f976b1933d1c51a0eef493b3ef1b81d39aadc Jul 28 01:29:48.660622 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.660590 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:29:48.660689 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.660658 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:29:48.660724 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:48.660691 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:29:49.233863 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:49.233824 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" event={"ID":"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5","Type":"ContainerStarted","Data":"710b1bd89e9ee7352da3daa9a503626bc2d4e1cf48a11d61f5aecc12ac063352"} Jul 28 01:29:49.234058 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:49.233889 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" event={"ID":"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5","Type":"ContainerStarted","Data":"82dff00bb077b13c438851b3bf6f976b1933d1c51a0eef493b3ef1b81d39aadc"} Jul 28 01:29:49.258035 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:49.257961 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" podStartSLOduration=1.257939608 podStartE2EDuration="1.257939608s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:29:48 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:29:49.253624422 +0000 UTC m=+2186.173225107" watchObservedRunningTime="2026-07-28 01:29:49.257939608 +0000 UTC m=+2186.177540294" Jul 28 01:29:49.507661 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:49.507546 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:49.513211 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:49.513180 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:50.239884 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:50.239851 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:50.240793 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:50.240773 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:29:52.658354 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.658318 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:29:52.734817 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.734733 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d38a40c9-813c-478b-8faf-dda4788030e0-istio-token\") pod \"d38a40c9-813c-478b-8faf-dda4788030e0\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " Jul 28 01:29:52.734817 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.734766 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d38a40c9-813c-478b-8faf-dda4788030e0-istiod-ca-cert\") pod \"d38a40c9-813c-478b-8faf-dda4788030e0\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " Jul 28 01:29:52.734817 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.734799 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-istio-envoy\") pod \"d38a40c9-813c-478b-8faf-dda4788030e0\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " Jul 28 01:29:52.735106 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.734835 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2lwjj\" (UniqueName: \"kubernetes.io/projected/d38a40c9-813c-478b-8faf-dda4788030e0-kube-api-access-2lwjj\") pod \"d38a40c9-813c-478b-8faf-dda4788030e0\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " Jul 28 01:29:52.735106 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.734863 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-workload-certs\") pod \"d38a40c9-813c-478b-8faf-dda4788030e0\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " Jul 28 01:29:52.735106 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.734878 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-workload-socket\") pod \"d38a40c9-813c-478b-8faf-dda4788030e0\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " Jul 28 01:29:52.735106 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.734900 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-istio-data\") pod \"d38a40c9-813c-478b-8faf-dda4788030e0\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " Jul 28 01:29:52.735106 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.734961 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-credential-socket\") pod \"d38a40c9-813c-478b-8faf-dda4788030e0\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " Jul 28 01:29:52.735106 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.734988 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d38a40c9-813c-478b-8faf-dda4788030e0-istio-podinfo\") pod \"d38a40c9-813c-478b-8faf-dda4788030e0\" (UID: \"d38a40c9-813c-478b-8faf-dda4788030e0\") " Jul 28 01:29:52.735413 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.735119 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d38a40c9-813c-478b-8faf-dda4788030e0" (UID: "d38a40c9-813c-478b-8faf-dda4788030e0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:29:52.735413 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.735138 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d38a40c9-813c-478b-8faf-dda4788030e0" (UID: "d38a40c9-813c-478b-8faf-dda4788030e0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:29:52.735413 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.735196 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d38a40c9-813c-478b-8faf-dda4788030e0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d38a40c9-813c-478b-8faf-dda4788030e0" (UID: "d38a40c9-813c-478b-8faf-dda4788030e0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:29:52.735413 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.735357 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d38a40c9-813c-478b-8faf-dda4788030e0" (UID: "d38a40c9-813c-478b-8faf-dda4788030e0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:29:52.735833 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.735457 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d38a40c9-813c-478b-8faf-dda4788030e0-istiod-ca-cert\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:29:52.735833 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.735478 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-workload-certs\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:29:52.735833 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.735490 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-workload-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:29:52.735833 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.735502 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-credential-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:29:52.736049 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.735878 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-istio-data" (OuterVolumeSpecName: "istio-data") pod "d38a40c9-813c-478b-8faf-dda4788030e0" (UID: "d38a40c9-813c-478b-8faf-dda4788030e0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:29:52.737242 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.737212 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d38a40c9-813c-478b-8faf-dda4788030e0-kube-api-access-2lwjj" (OuterVolumeSpecName: "kube-api-access-2lwjj") pod "d38a40c9-813c-478b-8faf-dda4788030e0" (UID: "d38a40c9-813c-478b-8faf-dda4788030e0"). InnerVolumeSpecName "kube-api-access-2lwjj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:29:52.737376 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.737355 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d38a40c9-813c-478b-8faf-dda4788030e0-istio-token" (OuterVolumeSpecName: "istio-token") pod "d38a40c9-813c-478b-8faf-dda4788030e0" (UID: "d38a40c9-813c-478b-8faf-dda4788030e0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:29:52.737669 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.737651 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d38a40c9-813c-478b-8faf-dda4788030e0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d38a40c9-813c-478b-8faf-dda4788030e0" (UID: "d38a40c9-813c-478b-8faf-dda4788030e0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 28 01:29:52.737742 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.737662 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d38a40c9-813c-478b-8faf-dda4788030e0" (UID: "d38a40c9-813c-478b-8faf-dda4788030e0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:29:52.836020 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.835985 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d38a40c9-813c-478b-8faf-dda4788030e0-istio-podinfo\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:29:52.836020 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.836017 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d38a40c9-813c-478b-8faf-dda4788030e0-istio-token\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:29:52.836020 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.836027 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-istio-envoy\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:29:52.836258 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.836034 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2lwjj\" (UniqueName: \"kubernetes.io/projected/d38a40c9-813c-478b-8faf-dda4788030e0-kube-api-access-2lwjj\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:29:52.836258 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:52.836043 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d38a40c9-813c-478b-8faf-dda4788030e0-istio-data\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:29:53.260062 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:53.260028 2568 generic.go:356] "Generic (PLEG): container finished" podID="d38a40c9-813c-478b-8faf-dda4788030e0" containerID="3a77a65e0705b6f3cf16cfeb2638e2cce34ebb2c4ab7f4281ab67710265d290d" exitCode=0 Jul 28 01:29:53.260233 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:53.260078 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" Jul 28 01:29:53.260233 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:53.260096 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" event={"ID":"d38a40c9-813c-478b-8faf-dda4788030e0","Type":"ContainerDied","Data":"3a77a65e0705b6f3cf16cfeb2638e2cce34ebb2c4ab7f4281ab67710265d290d"} Jul 28 01:29:53.260233 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:53.260142 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk" event={"ID":"d38a40c9-813c-478b-8faf-dda4788030e0","Type":"ContainerDied","Data":"0b4e50f8fb930ecda4126395898a0bea8ac58e98ad110816c6276f7af941a1e4"} Jul 28 01:29:53.260233 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:53.260166 2568 scope.go:117] "RemoveContainer" containerID="3a77a65e0705b6f3cf16cfeb2638e2cce34ebb2c4ab7f4281ab67710265d290d" Jul 28 01:29:53.271248 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:53.271227 2568 scope.go:117] "RemoveContainer" containerID="093b21aa83d9e0ca9abe0fa2d0e2fd92c285071fd38238642a6af228a85255ad" Jul 28 01:29:53.281450 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:53.281418 2568 scope.go:117] "RemoveContainer" containerID="3a77a65e0705b6f3cf16cfeb2638e2cce34ebb2c4ab7f4281ab67710265d290d" Jul 28 01:29:53.282022 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:29:53.281991 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3a77a65e0705b6f3cf16cfeb2638e2cce34ebb2c4ab7f4281ab67710265d290d\": container with ID starting with 3a77a65e0705b6f3cf16cfeb2638e2cce34ebb2c4ab7f4281ab67710265d290d not found: ID does not exist" containerID="3a77a65e0705b6f3cf16cfeb2638e2cce34ebb2c4ab7f4281ab67710265d290d" Jul 28 01:29:53.282169 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:53.282037 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3a77a65e0705b6f3cf16cfeb2638e2cce34ebb2c4ab7f4281ab67710265d290d"} err="failed to get container status \"3a77a65e0705b6f3cf16cfeb2638e2cce34ebb2c4ab7f4281ab67710265d290d\": rpc error: code = NotFound desc = could not find container \"3a77a65e0705b6f3cf16cfeb2638e2cce34ebb2c4ab7f4281ab67710265d290d\": container with ID starting with 3a77a65e0705b6f3cf16cfeb2638e2cce34ebb2c4ab7f4281ab67710265d290d not found: ID does not exist" Jul 28 01:29:53.282169 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:53.282062 2568 scope.go:117] "RemoveContainer" containerID="093b21aa83d9e0ca9abe0fa2d0e2fd92c285071fd38238642a6af228a85255ad" Jul 28 01:29:53.282415 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:29:53.282393 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"093b21aa83d9e0ca9abe0fa2d0e2fd92c285071fd38238642a6af228a85255ad\": container with ID starting with 093b21aa83d9e0ca9abe0fa2d0e2fd92c285071fd38238642a6af228a85255ad not found: ID does not exist" containerID="093b21aa83d9e0ca9abe0fa2d0e2fd92c285071fd38238642a6af228a85255ad" Jul 28 01:29:53.282472 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:53.282421 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"093b21aa83d9e0ca9abe0fa2d0e2fd92c285071fd38238642a6af228a85255ad"} err="failed to get container status \"093b21aa83d9e0ca9abe0fa2d0e2fd92c285071fd38238642a6af228a85255ad\": rpc error: code = NotFound desc = could not find container \"093b21aa83d9e0ca9abe0fa2d0e2fd92c285071fd38238642a6af228a85255ad\": container with ID starting with 093b21aa83d9e0ca9abe0fa2d0e2fd92c285071fd38238642a6af228a85255ad not found: ID does not exist" Jul 28 01:29:53.285197 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:53.285175 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk"] Jul 28 01:29:53.289422 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:53.289397 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-c08eabd1-gw-openshift-default-7cf8596564-wnhtk"] Jul 28 01:29:53.535617 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:29:53.535516 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d38a40c9-813c-478b-8faf-dda4788030e0" path="/var/lib/kubelet/pods/d38a40c9-813c-478b-8faf-dda4788030e0/volumes" Jul 28 01:30:04.336743 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:30:04.336640 2568 generic.go:356] "Generic (PLEG): container finished" podID="2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" containerID="710b1bd89e9ee7352da3daa9a503626bc2d4e1cf48a11d61f5aecc12ac063352" exitCode=0 Jul 28 01:30:04.336743 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:30:04.336685 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" event={"ID":"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5","Type":"ContainerDied","Data":"710b1bd89e9ee7352da3daa9a503626bc2d4e1cf48a11d61f5aecc12ac063352"} Jul 28 01:30:04.337331 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:30:04.337229 2568 scope.go:117] "RemoveContainer" containerID="710b1bd89e9ee7352da3daa9a503626bc2d4e1cf48a11d61f5aecc12ac063352" Jul 28 01:30:04.338372 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:30:04.338332 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:30:04.338434 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:30:04.338418 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:30:04.338475 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:30:04.338458 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:30:05.240246 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:30:05.240197 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:30:05.349303 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:30:05.349266 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" event={"ID":"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5","Type":"ContainerStarted","Data":"0f29c11a39f47fa854aa5acbb95ac8add97bd4f87c8e754839947e22005ca283"} Jul 28 01:30:05.508067 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:30:05.507944 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:30:05.509188 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:30:05.509161 2568 patch_prober.go:28] interesting pod/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Jul 28 01:30:05.509314 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:30:05.509227 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" podUID="2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Jul 28 01:30:06.508468 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:30:06.508427 2568 patch_prober.go:28] interesting pod/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Jul 28 01:30:06.508902 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:30:06.508487 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" podUID="2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Jul 28 01:30:07.507834 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:30:07.507791 2568 patch_prober.go:28] interesting pod/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Jul 28 01:30:07.508026 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:30:07.507853 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" podUID="2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Jul 28 01:30:08.508071 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:30:08.508016 2568 patch_prober.go:28] interesting pod/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Jul 28 01:30:08.508071 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:30:08.508075 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" podUID="2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Jul 28 01:30:09.507582 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:30:09.507530 2568 patch_prober.go:28] interesting pod/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" start-of-body= Jul 28 01:30:09.507770 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:30:09.507629 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" podUID="2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.66:15021/healthz/ready\": dial tcp 10.132.0.66:15021: connect: connection refused" Jul 28 01:30:10.512696 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:30:10.512662 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:30:10.513168 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:30:10.513038 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:30:10.513791 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:30:10.513771 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:33:23.750678 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:33:23.750640 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:33:23.757172 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:33:23.757143 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:35:12.602056 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:12.602011 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v"] Jul 28 01:35:12.602604 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:12.602245 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" podUID="2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" containerName="istio-proxy" containerID="cri-o://0f29c11a39f47fa854aa5acbb95ac8add97bd4f87c8e754839947e22005ca283" gracePeriod=30 Jul 28 01:35:13.390696 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.390653 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz"] Jul 28 01:35:13.391304 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.391289 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" containerName="istio-proxy" Jul 28 01:35:13.391358 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.391309 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="be60f1ee-c2a6-40ab-ac8e-bb9822c0d022" containerName="istio-proxy" Jul 28 01:35:13.391358 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.391346 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d38a40c9-813c-478b-8faf-dda4788030e0" containerName="istio-proxy" Jul 28 01:35:13.391358 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.391355 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d38a40c9-813c-478b-8faf-dda4788030e0" containerName="istio-proxy" Jul 28 01:35:13.391459 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.391367 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d38a40c9-813c-478b-8faf-dda4788030e0" containerName="istio-proxy" Jul 28 01:35:13.391459 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.391376 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d38a40c9-813c-478b-8faf-dda4788030e0" containerName="istio-proxy" Jul 28 01:35:13.391459 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.391457 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d38a40c9-813c-478b-8faf-dda4788030e0" containerName="istio-proxy" Jul 28 01:35:13.391552 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.391471 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d38a40c9-813c-478b-8faf-dda4788030e0" containerName="istio-proxy" Jul 28 01:35:13.394308 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.394286 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.400538 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:35:13.400498 2568 reflector.go:205] "Failed to watch" err="failed to list *v1.Secret: secrets \"e2e-derive-1a2510d6-openshift-default-dockercfg-bmw6t\" is forbidden: User \"system:node:ip-10-0-132-44.ec2.internal\" cannot list resource \"secrets\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-132-44.ec2.internal' and this object" logger="UnhandledError" reflector="object-\"openshift-ingress\"/\"e2e-derive-1a2510d6-openshift-default-dockercfg-bmw6t\"" type="*v1.Secret" Jul 28 01:35:13.400538 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:35:13.400508 2568 status_manager.go:1018] "Failed to get status for pod" err="pods \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" is forbidden: User \"system:node:ip-10-0-132-44.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"openshift-ingress\": no relationship found between node 'ip-10-0-132-44.ec2.internal' and this object" podUID="57038123-41b0-49a9-b834-454aaaf22060" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.432803 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.432765 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz"] Jul 28 01:35:13.552683 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.552647 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-istio-envoy\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.552683 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.552692 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-credential-socket\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.552933 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.552764 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-istio-data\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.552933 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.552810 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57038123-41b0-49a9-b834-454aaaf22060-istio-podinfo\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.552933 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.552833 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-workload-certs\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.552933 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.552859 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jw7pv\" (UniqueName: \"kubernetes.io/projected/57038123-41b0-49a9-b834-454aaaf22060-kube-api-access-jw7pv\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.553076 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.552948 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-workload-socket\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.553076 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.552988 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57038123-41b0-49a9-b834-454aaaf22060-istio-token\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.553076 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.553030 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57038123-41b0-49a9-b834-454aaaf22060-istiod-ca-cert\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.654401 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.654287 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-workload-socket\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.654401 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.654332 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57038123-41b0-49a9-b834-454aaaf22060-istio-token\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.654401 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.654386 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57038123-41b0-49a9-b834-454aaaf22060-istiod-ca-cert\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.655055 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.654436 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-istio-envoy\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.655055 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.654466 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-credential-socket\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.655055 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.654515 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-istio-data\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.655055 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.654551 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57038123-41b0-49a9-b834-454aaaf22060-istio-podinfo\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.655055 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.654623 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-workload-certs\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.655055 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.654650 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jw7pv\" (UniqueName: \"kubernetes.io/projected/57038123-41b0-49a9-b834-454aaaf22060-kube-api-access-jw7pv\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.655055 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.654776 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-workload-socket\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.655055 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.655007 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-credential-socket\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.655055 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.655039 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-istio-data\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.655438 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.655148 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-workload-certs\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.655438 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.655175 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57038123-41b0-49a9-b834-454aaaf22060-istiod-ca-cert\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.657706 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.657673 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-istio-envoy\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.657927 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.657906 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57038123-41b0-49a9-b834-454aaaf22060-istio-podinfo\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.662898 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.662858 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57038123-41b0-49a9-b834-454aaaf22060-istio-token\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:13.663042 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:13.662963 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jw7pv\" (UniqueName: \"kubernetes.io/projected/57038123-41b0-49a9-b834-454aaaf22060-kube-api-access-jw7pv\") pod \"e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:14.706605 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:14.706528 2568 kubelet_pods.go:1085] "Unable to retrieve pull secret, the image pull may not succeed." pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" secret="" err="failed to sync secret cache: timed out waiting for the condition" Jul 28 01:35:14.707017 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:14.706662 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:14.868410 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:14.868357 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz"] Jul 28 01:35:14.874910 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:35:14.874861 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod57038123_41b0_49a9_b834_454aaaf22060.slice/crio-c86e7bde96c4b8ce92587a468872164541b2479855089f140aba2ddcaf1ca6e8 WatchSource:0}: Error finding container c86e7bde96c4b8ce92587a468872164541b2479855089f140aba2ddcaf1ca6e8: Status 404 returned error can't find the container with id c86e7bde96c4b8ce92587a468872164541b2479855089f140aba2ddcaf1ca6e8 Jul 28 01:35:14.876961 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:14.876929 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:35:14.877036 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:14.876998 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:35:14.877036 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:14.877024 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:35:14.924139 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:14.924111 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-1a2510d6-openshift-default-dockercfg-bmw6t\"" Jul 28 01:35:15.144347 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:15.144310 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" event={"ID":"57038123-41b0-49a9-b834-454aaaf22060","Type":"ContainerStarted","Data":"a91b06290bf5cda032da09a8d65a8292f6f201176bcd96d9d1b659b2809ae32c"} Jul 28 01:35:15.144618 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:15.144377 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" event={"ID":"57038123-41b0-49a9-b834-454aaaf22060","Type":"ContainerStarted","Data":"c86e7bde96c4b8ce92587a468872164541b2479855089f140aba2ddcaf1ca6e8"} Jul 28 01:35:15.165048 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:15.164985 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" podStartSLOduration=2.1649666180000002 podStartE2EDuration="2.164966618s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:35:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:35:15.163072516 +0000 UTC m=+2512.082673200" watchObservedRunningTime="2026-07-28 01:35:15.164966618 +0000 UTC m=+2512.084567302" Jul 28 01:35:15.707952 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:15.707915 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:15.713195 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:15.713167 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:16.149627 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:16.149593 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:16.150749 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:16.150716 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:17.865543 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:17.865469 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:35:18.002177 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.002142 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-data\") pod \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " Jul 28 01:35:18.002388 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.002193 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-podinfo\") pod \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " Jul 28 01:35:18.002388 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.002234 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-4xnfh\" (UniqueName: \"kubernetes.io/projected/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-kube-api-access-4xnfh\") pod \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " Jul 28 01:35:18.002388 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.002260 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istiod-ca-cert\") pod \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " Jul 28 01:35:18.002388 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.002285 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-workload-certs\") pod \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " Jul 28 01:35:18.002388 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.002322 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-envoy\") pod \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " Jul 28 01:35:18.002388 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.002372 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-workload-socket\") pod \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " Jul 28 01:35:18.002756 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.002400 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-token\") pod \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " Jul 28 01:35:18.002756 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.002431 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-credential-socket\") pod \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\" (UID: \"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5\") " Jul 28 01:35:18.002927 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.002795 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" (UID: "2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:35:18.002990 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.002943 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" (UID: "2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:35:18.002990 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.002965 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" (UID: "2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:35:18.003090 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.002873 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" (UID: "2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:35:18.003148 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.003108 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-data" (OuterVolumeSpecName: "istio-data") pod "2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" (UID: "2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:35:18.004900 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.004874 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" (UID: "2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 28 01:35:18.005032 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.004909 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-kube-api-access-4xnfh" (OuterVolumeSpecName: "kube-api-access-4xnfh") pod "2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" (UID: "2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5"). InnerVolumeSpecName "kube-api-access-4xnfh". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:35:18.005032 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.004971 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" (UID: "2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:35:18.005164 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.005091 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-token" (OuterVolumeSpecName: "istio-token") pod "2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" (UID: "2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:35:18.104210 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.104168 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-envoy\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:35:18.104210 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.104208 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-workload-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:35:18.104210 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.104220 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-token\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:35:18.104541 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.104230 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-credential-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:35:18.104541 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.104240 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-data\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:35:18.104541 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.104248 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istio-podinfo\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:35:18.104541 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.104256 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-4xnfh\" (UniqueName: \"kubernetes.io/projected/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-kube-api-access-4xnfh\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:35:18.104541 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.104264 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-istiod-ca-cert\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:35:18.104541 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.104272 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5-workload-certs\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:35:18.163335 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.163237 2568 generic.go:356] "Generic (PLEG): container finished" podID="2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" containerID="0f29c11a39f47fa854aa5acbb95ac8add97bd4f87c8e754839947e22005ca283" exitCode=0 Jul 28 01:35:18.163335 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.163288 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" Jul 28 01:35:18.163335 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.163321 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" event={"ID":"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5","Type":"ContainerDied","Data":"0f29c11a39f47fa854aa5acbb95ac8add97bd4f87c8e754839947e22005ca283"} Jul 28 01:35:18.163628 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.163379 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v" event={"ID":"2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5","Type":"ContainerDied","Data":"82dff00bb077b13c438851b3bf6f976b1933d1c51a0eef493b3ef1b81d39aadc"} Jul 28 01:35:18.163628 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.163411 2568 scope.go:117] "RemoveContainer" containerID="0f29c11a39f47fa854aa5acbb95ac8add97bd4f87c8e754839947e22005ca283" Jul 28 01:35:18.174416 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.174394 2568 scope.go:117] "RemoveContainer" containerID="710b1bd89e9ee7352da3daa9a503626bc2d4e1cf48a11d61f5aecc12ac063352" Jul 28 01:35:18.185273 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.185249 2568 scope.go:117] "RemoveContainer" containerID="0f29c11a39f47fa854aa5acbb95ac8add97bd4f87c8e754839947e22005ca283" Jul 28 01:35:18.185675 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:35:18.185652 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0f29c11a39f47fa854aa5acbb95ac8add97bd4f87c8e754839947e22005ca283\": container with ID starting with 0f29c11a39f47fa854aa5acbb95ac8add97bd4f87c8e754839947e22005ca283 not found: ID does not exist" containerID="0f29c11a39f47fa854aa5acbb95ac8add97bd4f87c8e754839947e22005ca283" Jul 28 01:35:18.185770 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.185691 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0f29c11a39f47fa854aa5acbb95ac8add97bd4f87c8e754839947e22005ca283"} err="failed to get container status \"0f29c11a39f47fa854aa5acbb95ac8add97bd4f87c8e754839947e22005ca283\": rpc error: code = NotFound desc = could not find container \"0f29c11a39f47fa854aa5acbb95ac8add97bd4f87c8e754839947e22005ca283\": container with ID starting with 0f29c11a39f47fa854aa5acbb95ac8add97bd4f87c8e754839947e22005ca283 not found: ID does not exist" Jul 28 01:35:18.185770 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.185719 2568 scope.go:117] "RemoveContainer" containerID="710b1bd89e9ee7352da3daa9a503626bc2d4e1cf48a11d61f5aecc12ac063352" Jul 28 01:35:18.186037 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:35:18.186020 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"710b1bd89e9ee7352da3daa9a503626bc2d4e1cf48a11d61f5aecc12ac063352\": container with ID starting with 710b1bd89e9ee7352da3daa9a503626bc2d4e1cf48a11d61f5aecc12ac063352 not found: ID does not exist" containerID="710b1bd89e9ee7352da3daa9a503626bc2d4e1cf48a11d61f5aecc12ac063352" Jul 28 01:35:18.186079 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.186045 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"710b1bd89e9ee7352da3daa9a503626bc2d4e1cf48a11d61f5aecc12ac063352"} err="failed to get container status \"710b1bd89e9ee7352da3daa9a503626bc2d4e1cf48a11d61f5aecc12ac063352\": rpc error: code = NotFound desc = could not find container \"710b1bd89e9ee7352da3daa9a503626bc2d4e1cf48a11d61f5aecc12ac063352\": container with ID starting with 710b1bd89e9ee7352da3daa9a503626bc2d4e1cf48a11d61f5aecc12ac063352 not found: ID does not exist" Jul 28 01:35:18.196212 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.196172 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v"] Jul 28 01:35:18.205676 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:18.205639 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-e0fd3dac-openshift-default-745fbf857b-hfw7v"] Jul 28 01:35:19.534872 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:19.534832 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" path="/var/lib/kubelet/pods/2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5/volumes" Jul 28 01:35:31.151294 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:31.151209 2568 patch_prober.go:28] interesting pod/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Jul 28 01:35:31.151294 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:31.151282 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" podUID="57038123-41b0-49a9-b834-454aaaf22060" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Jul 28 01:35:31.251638 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:31.251534 2568 generic.go:356] "Generic (PLEG): container finished" podID="57038123-41b0-49a9-b834-454aaaf22060" containerID="a91b06290bf5cda032da09a8d65a8292f6f201176bcd96d9d1b659b2809ae32c" exitCode=0 Jul 28 01:35:31.251638 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:31.251614 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" event={"ID":"57038123-41b0-49a9-b834-454aaaf22060","Type":"ContainerDied","Data":"a91b06290bf5cda032da09a8d65a8292f6f201176bcd96d9d1b659b2809ae32c"} Jul 28 01:35:31.252027 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:31.252013 2568 scope.go:117] "RemoveContainer" containerID="a91b06290bf5cda032da09a8d65a8292f6f201176bcd96d9d1b659b2809ae32c" Jul 28 01:35:31.253068 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:31.253044 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:35:31.253129 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:31.253110 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:35:31.253167 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:31.253142 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:35:32.259234 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:32.259195 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" event={"ID":"57038123-41b0-49a9-b834-454aaaf22060","Type":"ContainerStarted","Data":"49be6daf031a38ead703ee9249ae914784b2c1fef6c36186e0dcf03cbde63733"} Jul 28 01:35:32.707686 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:32.707635 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:32.708013 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:32.707987 2568 patch_prober.go:28] interesting pod/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Jul 28 01:35:32.708108 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:32.708048 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" podUID="57038123-41b0-49a9-b834-454aaaf22060" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Jul 28 01:35:33.707518 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:33.707465 2568 patch_prober.go:28] interesting pod/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Jul 28 01:35:33.707960 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:33.707541 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" podUID="57038123-41b0-49a9-b834-454aaaf22060" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Jul 28 01:35:34.707872 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:34.707830 2568 patch_prober.go:28] interesting pod/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Jul 28 01:35:34.708277 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:34.707903 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" podUID="57038123-41b0-49a9-b834-454aaaf22060" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Jul 28 01:35:35.708198 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:35.708155 2568 patch_prober.go:28] interesting pod/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" start-of-body= Jul 28 01:35:35.708712 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:35.708221 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" podUID="57038123-41b0-49a9-b834-454aaaf22060" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.67:15021/healthz/ready\": dial tcp 10.132.0.67:15021: connect: connection refused" Jul 28 01:35:36.711287 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:36.711251 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:36.711749 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:36.711592 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:35:36.712390 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:35:36.712370 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:38:23.789975 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:38:23.789901 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:38:23.798308 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:38:23.798283 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:40:38.337349 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:38.337305 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz"] Jul 28 01:40:38.337947 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:38.337587 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" podUID="57038123-41b0-49a9-b834-454aaaf22060" containerName="istio-proxy" containerID="cri-o://49be6daf031a38ead703ee9249ae914784b2c1fef6c36186e0dcf03cbde63733" gracePeriod=30 Jul 28 01:40:43.618597 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.618544 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:40:43.696235 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.696193 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57038123-41b0-49a9-b834-454aaaf22060-istiod-ca-cert\") pod \"57038123-41b0-49a9-b834-454aaaf22060\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " Jul 28 01:40:43.696410 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.696260 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57038123-41b0-49a9-b834-454aaaf22060-istio-token\") pod \"57038123-41b0-49a9-b834-454aaaf22060\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " Jul 28 01:40:43.696410 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.696292 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-credential-socket\") pod \"57038123-41b0-49a9-b834-454aaaf22060\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " Jul 28 01:40:43.696410 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.696318 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-workload-certs\") pod \"57038123-41b0-49a9-b834-454aaaf22060\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " Jul 28 01:40:43.696410 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.696358 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57038123-41b0-49a9-b834-454aaaf22060-istio-podinfo\") pod \"57038123-41b0-49a9-b834-454aaaf22060\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " Jul 28 01:40:43.696663 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.696412 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jw7pv\" (UniqueName: \"kubernetes.io/projected/57038123-41b0-49a9-b834-454aaaf22060-kube-api-access-jw7pv\") pod \"57038123-41b0-49a9-b834-454aaaf22060\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " Jul 28 01:40:43.696663 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.696442 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-istio-data\") pod \"57038123-41b0-49a9-b834-454aaaf22060\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " Jul 28 01:40:43.696663 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.696492 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-workload-socket\") pod \"57038123-41b0-49a9-b834-454aaaf22060\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " Jul 28 01:40:43.696663 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.696546 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-istio-envoy\") pod \"57038123-41b0-49a9-b834-454aaaf22060\" (UID: \"57038123-41b0-49a9-b834-454aaaf22060\") " Jul 28 01:40:43.696663 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.696616 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "57038123-41b0-49a9-b834-454aaaf22060" (UID: "57038123-41b0-49a9-b834-454aaaf22060"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:40:43.696929 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.696667 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "57038123-41b0-49a9-b834-454aaaf22060" (UID: "57038123-41b0-49a9-b834-454aaaf22060"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:40:43.696929 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.696721 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/57038123-41b0-49a9-b834-454aaaf22060-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "57038123-41b0-49a9-b834-454aaaf22060" (UID: "57038123-41b0-49a9-b834-454aaaf22060"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:40:43.696929 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.696915 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "57038123-41b0-49a9-b834-454aaaf22060" (UID: "57038123-41b0-49a9-b834-454aaaf22060"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:40:43.697141 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.696966 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/57038123-41b0-49a9-b834-454aaaf22060-istiod-ca-cert\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:40:43.697141 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.696989 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-credential-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:40:43.697141 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.697003 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-workload-certs\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:40:43.697608 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.697583 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-istio-data" (OuterVolumeSpecName: "istio-data") pod "57038123-41b0-49a9-b834-454aaaf22060" (UID: "57038123-41b0-49a9-b834-454aaaf22060"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:40:43.698855 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.698830 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57038123-41b0-49a9-b834-454aaaf22060-istio-token" (OuterVolumeSpecName: "istio-token") pod "57038123-41b0-49a9-b834-454aaaf22060" (UID: "57038123-41b0-49a9-b834-454aaaf22060"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:40:43.698855 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.698837 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/57038123-41b0-49a9-b834-454aaaf22060-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "57038123-41b0-49a9-b834-454aaaf22060" (UID: "57038123-41b0-49a9-b834-454aaaf22060"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 28 01:40:43.699003 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.698870 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "57038123-41b0-49a9-b834-454aaaf22060" (UID: "57038123-41b0-49a9-b834-454aaaf22060"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:40:43.699003 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.698919 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/57038123-41b0-49a9-b834-454aaaf22060-kube-api-access-jw7pv" (OuterVolumeSpecName: "kube-api-access-jw7pv") pod "57038123-41b0-49a9-b834-454aaaf22060" (UID: "57038123-41b0-49a9-b834-454aaaf22060"). InnerVolumeSpecName "kube-api-access-jw7pv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:40:43.798215 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.798179 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/57038123-41b0-49a9-b834-454aaaf22060-istio-token\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:40:43.798215 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.798210 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/57038123-41b0-49a9-b834-454aaaf22060-istio-podinfo\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:40:43.798215 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.798219 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jw7pv\" (UniqueName: \"kubernetes.io/projected/57038123-41b0-49a9-b834-454aaaf22060-kube-api-access-jw7pv\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:40:43.798464 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.798228 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-istio-data\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:40:43.798464 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.798237 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-workload-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:40:43.798464 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:43.798245 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/57038123-41b0-49a9-b834-454aaaf22060-istio-envoy\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:40:44.051123 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:44.051092 2568 generic.go:356] "Generic (PLEG): container finished" podID="57038123-41b0-49a9-b834-454aaaf22060" containerID="49be6daf031a38ead703ee9249ae914784b2c1fef6c36186e0dcf03cbde63733" exitCode=0 Jul 28 01:40:44.051315 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:44.051139 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" Jul 28 01:40:44.051315 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:44.051177 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" event={"ID":"57038123-41b0-49a9-b834-454aaaf22060","Type":"ContainerDied","Data":"49be6daf031a38ead703ee9249ae914784b2c1fef6c36186e0dcf03cbde63733"} Jul 28 01:40:44.051315 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:44.051237 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz" event={"ID":"57038123-41b0-49a9-b834-454aaaf22060","Type":"ContainerDied","Data":"c86e7bde96c4b8ce92587a468872164541b2479855089f140aba2ddcaf1ca6e8"} Jul 28 01:40:44.051315 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:44.051266 2568 scope.go:117] "RemoveContainer" containerID="49be6daf031a38ead703ee9249ae914784b2c1fef6c36186e0dcf03cbde63733" Jul 28 01:40:44.062358 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:44.062330 2568 scope.go:117] "RemoveContainer" containerID="a91b06290bf5cda032da09a8d65a8292f6f201176bcd96d9d1b659b2809ae32c" Jul 28 01:40:44.071764 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:44.071744 2568 scope.go:117] "RemoveContainer" containerID="49be6daf031a38ead703ee9249ae914784b2c1fef6c36186e0dcf03cbde63733" Jul 28 01:40:44.072084 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:40:44.072063 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"49be6daf031a38ead703ee9249ae914784b2c1fef6c36186e0dcf03cbde63733\": container with ID starting with 49be6daf031a38ead703ee9249ae914784b2c1fef6c36186e0dcf03cbde63733 not found: ID does not exist" containerID="49be6daf031a38ead703ee9249ae914784b2c1fef6c36186e0dcf03cbde63733" Jul 28 01:40:44.072137 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:44.072093 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"49be6daf031a38ead703ee9249ae914784b2c1fef6c36186e0dcf03cbde63733"} err="failed to get container status \"49be6daf031a38ead703ee9249ae914784b2c1fef6c36186e0dcf03cbde63733\": rpc error: code = NotFound desc = could not find container \"49be6daf031a38ead703ee9249ae914784b2c1fef6c36186e0dcf03cbde63733\": container with ID starting with 49be6daf031a38ead703ee9249ae914784b2c1fef6c36186e0dcf03cbde63733 not found: ID does not exist" Jul 28 01:40:44.072137 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:44.072112 2568 scope.go:117] "RemoveContainer" containerID="a91b06290bf5cda032da09a8d65a8292f6f201176bcd96d9d1b659b2809ae32c" Jul 28 01:40:44.072396 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:40:44.072376 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a91b06290bf5cda032da09a8d65a8292f6f201176bcd96d9d1b659b2809ae32c\": container with ID starting with a91b06290bf5cda032da09a8d65a8292f6f201176bcd96d9d1b659b2809ae32c not found: ID does not exist" containerID="a91b06290bf5cda032da09a8d65a8292f6f201176bcd96d9d1b659b2809ae32c" Jul 28 01:40:44.072456 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:44.072401 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a91b06290bf5cda032da09a8d65a8292f6f201176bcd96d9d1b659b2809ae32c"} err="failed to get container status \"a91b06290bf5cda032da09a8d65a8292f6f201176bcd96d9d1b659b2809ae32c\": rpc error: code = NotFound desc = could not find container \"a91b06290bf5cda032da09a8d65a8292f6f201176bcd96d9d1b659b2809ae32c\": container with ID starting with a91b06290bf5cda032da09a8d65a8292f6f201176bcd96d9d1b659b2809ae32c not found: ID does not exist" Jul 28 01:40:44.076154 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:44.076131 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz"] Jul 28 01:40:44.080300 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:44.080276 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-1a2510d6-openshift-default-b88549fb8-nr7jz"] Jul 28 01:40:45.534765 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:40:45.534728 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="57038123-41b0-49a9-b834-454aaaf22060" path="/var/lib/kubelet/pods/57038123-41b0-49a9-b834-454aaaf22060/volumes" Jul 28 01:42:30.041362 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.041327 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb"] Jul 28 01:42:30.042012 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.041748 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" containerName="istio-proxy" Jul 28 01:42:30.042012 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.041761 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" containerName="istio-proxy" Jul 28 01:42:30.042012 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.041774 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57038123-41b0-49a9-b834-454aaaf22060" containerName="istio-proxy" Jul 28 01:42:30.042012 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.041780 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="57038123-41b0-49a9-b834-454aaaf22060" containerName="istio-proxy" Jul 28 01:42:30.042012 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.041800 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="57038123-41b0-49a9-b834-454aaaf22060" containerName="istio-proxy" Jul 28 01:42:30.042012 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.041806 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="57038123-41b0-49a9-b834-454aaaf22060" containerName="istio-proxy" Jul 28 01:42:30.042012 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.041870 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" containerName="istio-proxy" Jul 28 01:42:30.042012 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.041878 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="57038123-41b0-49a9-b834-454aaaf22060" containerName="istio-proxy" Jul 28 01:42:30.042012 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.041884 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="57038123-41b0-49a9-b834-454aaaf22060" containerName="istio-proxy" Jul 28 01:42:30.044153 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.044136 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.046778 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.046760 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-c69ac9dc-openshift-default-dockercfg-zdhhm\"" Jul 28 01:42:30.073679 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.073646 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb"] Jul 28 01:42:30.133597 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.133534 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-credential-socket\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.133792 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.133603 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-data\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.133792 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.133686 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-workload-certs\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.133792 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.133761 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-envoy\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.133945 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.133795 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-token\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.133945 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.133819 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istiod-ca-cert\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.133945 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.133844 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-podinfo\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.133945 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.133879 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-workload-socket\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.133945 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.133897 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6d4jw\" (UniqueName: \"kubernetes.io/projected/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-kube-api-access-6d4jw\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.235110 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.235081 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-credential-socket\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.235281 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.235118 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-data\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.235281 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.235248 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-workload-certs\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.235360 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.235297 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-envoy\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.235360 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.235327 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-token\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.235462 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.235360 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istiod-ca-cert\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.235462 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.235396 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-podinfo\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.235462 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.235441 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-workload-socket\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.235653 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.235464 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6d4jw\" (UniqueName: \"kubernetes.io/projected/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-kube-api-access-6d4jw\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.235653 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.235530 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-credential-socket\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.235653 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.235543 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-data\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.235862 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.235834 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-workload-socket\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.236003 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.235946 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-workload-certs\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.236003 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.235981 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istiod-ca-cert\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.237898 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.237874 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-envoy\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.238068 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.238051 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-podinfo\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.243171 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.243152 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-token\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.243315 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.243296 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6d4jw\" (UniqueName: \"kubernetes.io/projected/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-kube-api-access-6d4jw\") pod \"e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.355171 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.355140 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:30.502230 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.502196 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb"] Jul 28 01:42:30.503180 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:42:30.503152 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5503f1bc_ae60_46b6_88b7_7b6cfa292fdb.slice/crio-d7d66fdfdb2e954aa6269424008f7e7f332063fab30e90cf8fd1019d4d11d77c WatchSource:0}: Error finding container d7d66fdfdb2e954aa6269424008f7e7f332063fab30e90cf8fd1019d4d11d77c: Status 404 returned error can't find the container with id d7d66fdfdb2e954aa6269424008f7e7f332063fab30e90cf8fd1019d4d11d77c Jul 28 01:42:30.505349 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.505316 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:42:30.505445 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.505383 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:42:30.505445 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.505414 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:42:30.675915 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.675812 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" event={"ID":"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb","Type":"ContainerStarted","Data":"cee508b10735acedacdbd7ea25a9416f5ae31bac5f52ebf51c5a690e1f4304d7"} Jul 28 01:42:30.675915 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.675873 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" event={"ID":"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb","Type":"ContainerStarted","Data":"d7d66fdfdb2e954aa6269424008f7e7f332063fab30e90cf8fd1019d4d11d77c"} Jul 28 01:42:30.695890 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:30.695826 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" podStartSLOduration=0.695808402 podStartE2EDuration="695.808402ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:42:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:42:30.69384758 +0000 UTC m=+2947.613448263" watchObservedRunningTime="2026-07-28 01:42:30.695808402 +0000 UTC m=+2947.615409085" Jul 28 01:42:31.355389 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:31.355350 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:31.360256 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:31.360227 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:31.683426 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:31.683342 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:31.684625 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:31.684601 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:47.724785 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:47.724745 2568 patch_prober.go:28] interesting pod/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 28 01:42:47.725258 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:47.724823 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" podUID="5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 28 01:42:48.782469 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:48.782433 2568 generic.go:356] "Generic (PLEG): container finished" podID="5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" containerID="cee508b10735acedacdbd7ea25a9416f5ae31bac5f52ebf51c5a690e1f4304d7" exitCode=0 Jul 28 01:42:48.783018 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:48.782512 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" event={"ID":"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb","Type":"ContainerDied","Data":"cee508b10735acedacdbd7ea25a9416f5ae31bac5f52ebf51c5a690e1f4304d7"} Jul 28 01:42:48.783018 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:48.782987 2568 scope.go:117] "RemoveContainer" containerID="cee508b10735acedacdbd7ea25a9416f5ae31bac5f52ebf51c5a690e1f4304d7" Jul 28 01:42:48.784064 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:48.784038 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:42:48.784124 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:48.784104 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:42:48.784163 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:48.784139 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:42:49.794936 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:49.794604 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" event={"ID":"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb","Type":"ContainerStarted","Data":"ca62ffc825d52fbc473093022faa245a7ac1eff88e7ea7b98de7ded1ad210d4f"} Jul 28 01:42:50.356011 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:50.355971 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:50.356243 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:50.356215 2568 patch_prober.go:28] interesting pod/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Jul 28 01:42:50.356328 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:50.356295 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" podUID="5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Jul 28 01:42:51.356048 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:51.356004 2568 patch_prober.go:28] interesting pod/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Jul 28 01:42:51.356449 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:51.356070 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" podUID="5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Jul 28 01:42:52.356234 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:52.356194 2568 patch_prober.go:28] interesting pod/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Jul 28 01:42:52.356708 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:52.356269 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" podUID="5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Jul 28 01:42:53.356136 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:53.356098 2568 patch_prober.go:28] interesting pod/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" start-of-body= Jul 28 01:42:53.356347 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:53.356159 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" podUID="5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.68:15021/healthz/ready\": dial tcp 10.132.0.68:15021: connect: connection refused" Jul 28 01:42:54.359979 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:54.359946 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:54.360444 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:54.360420 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:42:54.361295 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:42:54.361273 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:43:06.605618 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:06.605580 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb"] Jul 28 01:43:06.606057 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:06.605796 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" podUID="5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" containerName="istio-proxy" containerID="cri-o://ca62ffc825d52fbc473093022faa245a7ac1eff88e7ea7b98de7ded1ad210d4f" gracePeriod=30 Jul 28 01:43:09.363090 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:09.363053 2568 patch_prober.go:28] interesting pod/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 28 01:43:09.363505 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:09.363126 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" podUID="5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 01:43:11.868489 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.868431 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:43:11.923379 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.923345 2568 generic.go:356] "Generic (PLEG): container finished" podID="5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" containerID="ca62ffc825d52fbc473093022faa245a7ac1eff88e7ea7b98de7ded1ad210d4f" exitCode=0 Jul 28 01:43:11.923557 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.923393 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" Jul 28 01:43:11.923557 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.923420 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" event={"ID":"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb","Type":"ContainerDied","Data":"ca62ffc825d52fbc473093022faa245a7ac1eff88e7ea7b98de7ded1ad210d4f"} Jul 28 01:43:11.923557 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.923471 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb" event={"ID":"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb","Type":"ContainerDied","Data":"d7d66fdfdb2e954aa6269424008f7e7f332063fab30e90cf8fd1019d4d11d77c"} Jul 28 01:43:11.923557 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.923494 2568 scope.go:117] "RemoveContainer" containerID="ca62ffc825d52fbc473093022faa245a7ac1eff88e7ea7b98de7ded1ad210d4f" Jul 28 01:43:11.932876 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.932858 2568 scope.go:117] "RemoveContainer" containerID="cee508b10735acedacdbd7ea25a9416f5ae31bac5f52ebf51c5a690e1f4304d7" Jul 28 01:43:11.940984 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.940120 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-podinfo\") pod \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " Jul 28 01:43:11.940984 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.940188 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-credential-socket\") pod \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " Jul 28 01:43:11.940984 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.940287 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istiod-ca-cert\") pod \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " Jul 28 01:43:11.940984 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.940334 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-envoy\") pod \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " Jul 28 01:43:11.940984 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.940389 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-token\") pod \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " Jul 28 01:43:11.940984 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.940417 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-workload-certs\") pod \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " Jul 28 01:43:11.940984 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.940443 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-data\") pod \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " Jul 28 01:43:11.940984 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.940472 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6d4jw\" (UniqueName: \"kubernetes.io/projected/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-kube-api-access-6d4jw\") pod \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " Jul 28 01:43:11.940984 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.940493 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-workload-socket\") pod \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\" (UID: \"5503f1bc-ae60-46b6-88b7-7b6cfa292fdb\") " Jul 28 01:43:11.941735 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.941524 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" (UID: "5503f1bc-ae60-46b6-88b7-7b6cfa292fdb"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:43:11.942011 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.941859 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" (UID: "5503f1bc-ae60-46b6-88b7-7b6cfa292fdb"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:43:11.943487 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.942720 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-data" (OuterVolumeSpecName: "istio-data") pod "5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" (UID: "5503f1bc-ae60-46b6-88b7-7b6cfa292fdb"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:43:11.943738 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.943701 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" (UID: "5503f1bc-ae60-46b6-88b7-7b6cfa292fdb"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:43:11.943848 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.943784 2568 scope.go:117] "RemoveContainer" containerID="ca62ffc825d52fbc473093022faa245a7ac1eff88e7ea7b98de7ded1ad210d4f" Jul 28 01:43:11.943989 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.943944 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" (UID: "5503f1bc-ae60-46b6-88b7-7b6cfa292fdb"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:43:11.944402 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:43:11.944375 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"ca62ffc825d52fbc473093022faa245a7ac1eff88e7ea7b98de7ded1ad210d4f\": container with ID starting with ca62ffc825d52fbc473093022faa245a7ac1eff88e7ea7b98de7ded1ad210d4f not found: ID does not exist" containerID="ca62ffc825d52fbc473093022faa245a7ac1eff88e7ea7b98de7ded1ad210d4f" Jul 28 01:43:11.944506 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.944415 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"ca62ffc825d52fbc473093022faa245a7ac1eff88e7ea7b98de7ded1ad210d4f"} err="failed to get container status \"ca62ffc825d52fbc473093022faa245a7ac1eff88e7ea7b98de7ded1ad210d4f\": rpc error: code = NotFound desc = could not find container \"ca62ffc825d52fbc473093022faa245a7ac1eff88e7ea7b98de7ded1ad210d4f\": container with ID starting with ca62ffc825d52fbc473093022faa245a7ac1eff88e7ea7b98de7ded1ad210d4f not found: ID does not exist" Jul 28 01:43:11.944506 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.944442 2568 scope.go:117] "RemoveContainer" containerID="cee508b10735acedacdbd7ea25a9416f5ae31bac5f52ebf51c5a690e1f4304d7" Jul 28 01:43:11.944852 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:43:11.944823 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cee508b10735acedacdbd7ea25a9416f5ae31bac5f52ebf51c5a690e1f4304d7\": container with ID starting with cee508b10735acedacdbd7ea25a9416f5ae31bac5f52ebf51c5a690e1f4304d7 not found: ID does not exist" containerID="cee508b10735acedacdbd7ea25a9416f5ae31bac5f52ebf51c5a690e1f4304d7" Jul 28 01:43:11.944947 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.944863 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cee508b10735acedacdbd7ea25a9416f5ae31bac5f52ebf51c5a690e1f4304d7"} err="failed to get container status \"cee508b10735acedacdbd7ea25a9416f5ae31bac5f52ebf51c5a690e1f4304d7\": rpc error: code = NotFound desc = could not find container \"cee508b10735acedacdbd7ea25a9416f5ae31bac5f52ebf51c5a690e1f4304d7\": container with ID starting with cee508b10735acedacdbd7ea25a9416f5ae31bac5f52ebf51c5a690e1f4304d7 not found: ID does not exist" Jul 28 01:43:11.945265 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.945242 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-kube-api-access-6d4jw" (OuterVolumeSpecName: "kube-api-access-6d4jw") pod "5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" (UID: "5503f1bc-ae60-46b6-88b7-7b6cfa292fdb"). InnerVolumeSpecName "kube-api-access-6d4jw". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:43:11.945399 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.945370 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" (UID: "5503f1bc-ae60-46b6-88b7-7b6cfa292fdb"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 28 01:43:11.945871 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.945844 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-token" (OuterVolumeSpecName: "istio-token") pod "5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" (UID: "5503f1bc-ae60-46b6-88b7-7b6cfa292fdb"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:43:11.946177 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:11.946157 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" (UID: "5503f1bc-ae60-46b6-88b7-7b6cfa292fdb"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:43:12.041466 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:12.041427 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-credential-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:43:12.041466 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:12.041460 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istiod-ca-cert\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:43:12.041466 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:12.041470 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-envoy\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:43:12.041733 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:12.041478 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-token\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:43:12.041733 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:12.041486 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-workload-certs\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:43:12.041733 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:12.041495 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-data\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:43:12.041733 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:12.041502 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6d4jw\" (UniqueName: \"kubernetes.io/projected/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-kube-api-access-6d4jw\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:43:12.041733 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:12.041511 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-workload-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:43:12.041733 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:12.041519 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb-istio-podinfo\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:43:12.248312 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:12.248283 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb"] Jul 28 01:43:12.254050 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:12.254025 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-c69ac9dc-openshift-default-5cb4c9c97b-crtrb"] Jul 28 01:43:13.534703 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:13.534669 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" path="/var/lib/kubelet/pods/5503f1bc-ae60-46b6-88b7-7b6cfa292fdb/volumes" Jul 28 01:43:23.828748 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:23.828716 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:43:23.837600 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:23.837556 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:43:26.179837 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.179799 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt"] Jul 28 01:43:26.180410 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.180390 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" containerName="istio-proxy" Jul 28 01:43:26.180465 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.180416 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" containerName="istio-proxy" Jul 28 01:43:26.180465 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.180432 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" containerName="istio-proxy" Jul 28 01:43:26.180465 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.180440 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" containerName="istio-proxy" Jul 28 01:43:26.180465 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.180457 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" containerName="istio-proxy" Jul 28 01:43:26.180624 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.180466 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" containerName="istio-proxy" Jul 28 01:43:26.180624 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.180609 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="2aeabcbf-9b53-4aa7-a3aa-9762c22cc5d5" containerName="istio-proxy" Jul 28 01:43:26.180690 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.180624 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" containerName="istio-proxy" Jul 28 01:43:26.184607 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.184581 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.187910 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.187885 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-ec1b3fa4-openshift-default-dockercfg-d5246\"" Jul 28 01:43:26.196883 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.196850 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt"] Jul 28 01:43:26.376200 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.376126 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-credential-socket\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.376366 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.376326 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-istio-data\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.376366 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.376359 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-istio-envoy\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.376488 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.376396 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-x6fxq\" (UniqueName: \"kubernetes.io/projected/22fd398a-38af-40fc-bb19-4df661bab594-kube-api-access-x6fxq\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.376488 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.376424 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22fd398a-38af-40fc-bb19-4df661bab594-istio-token\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.376488 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.376442 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22fd398a-38af-40fc-bb19-4df661bab594-istio-podinfo\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.376488 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.376460 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22fd398a-38af-40fc-bb19-4df661bab594-istiod-ca-cert\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.376710 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.376541 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-workload-certs\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.376710 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.376651 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-workload-socket\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.477637 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.477533 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-credential-socket\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.477810 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.477662 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-istio-data\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.477810 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.477696 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-istio-envoy\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.477810 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.477738 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-x6fxq\" (UniqueName: \"kubernetes.io/projected/22fd398a-38af-40fc-bb19-4df661bab594-kube-api-access-x6fxq\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.477810 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.477772 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22fd398a-38af-40fc-bb19-4df661bab594-istio-token\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.477810 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.477798 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22fd398a-38af-40fc-bb19-4df661bab594-istio-podinfo\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.478080 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.477830 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22fd398a-38af-40fc-bb19-4df661bab594-istiod-ca-cert\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.478080 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.477890 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-workload-certs\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.478080 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.477962 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-workload-socket\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.478080 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.478021 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-credential-socket\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.478282 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.478250 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-workload-socket\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.478336 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.478314 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-workload-certs\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.478769 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.478740 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22fd398a-38af-40fc-bb19-4df661bab594-istiod-ca-cert\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.478888 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.478796 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-istio-data\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.480304 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.480280 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-istio-envoy\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.480777 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.480751 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22fd398a-38af-40fc-bb19-4df661bab594-istio-podinfo\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.485996 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.485965 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-x6fxq\" (UniqueName: \"kubernetes.io/projected/22fd398a-38af-40fc-bb19-4df661bab594-kube-api-access-x6fxq\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.486590 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.486553 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22fd398a-38af-40fc-bb19-4df661bab594-istio-token\") pod \"e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.497628 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.497597 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:26.655342 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.655312 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt"] Jul 28 01:43:26.656561 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:43:26.656527 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22fd398a_38af_40fc_bb19_4df661bab594.slice/crio-cb8591265c44e7916aba09dcf3c9cd413f43f30b204674a13686cd5fb88f8754 WatchSource:0}: Error finding container cb8591265c44e7916aba09dcf3c9cd413f43f30b204674a13686cd5fb88f8754: Status 404 returned error can't find the container with id cb8591265c44e7916aba09dcf3c9cd413f43f30b204674a13686cd5fb88f8754 Jul 28 01:43:26.658896 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.658865 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:43:26.658999 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.658937 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:43:26.658999 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:26.658966 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:43:27.011124 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:27.011073 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" event={"ID":"22fd398a-38af-40fc-bb19-4df661bab594","Type":"ContainerStarted","Data":"b2a1248b6d8792716a05c4285827e19cac2db28f9070dd1bde91573a10cb54c4"} Jul 28 01:43:27.011315 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:27.011143 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" event={"ID":"22fd398a-38af-40fc-bb19-4df661bab594","Type":"ContainerStarted","Data":"cb8591265c44e7916aba09dcf3c9cd413f43f30b204674a13686cd5fb88f8754"} Jul 28 01:43:27.031589 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:27.031520 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" podStartSLOduration=1.031503133 podStartE2EDuration="1.031503133s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:43:26 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:43:27.02965036 +0000 UTC m=+3003.949251046" watchObservedRunningTime="2026-07-28 01:43:27.031503133 +0000 UTC m=+3003.951103816" Jul 28 01:43:27.498017 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:27.497979 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:27.503961 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:27.503937 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:28.017181 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:28.017149 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:28.018117 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:28.018100 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:43.792727 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:43.792025 2568 patch_prober.go:28] interesting pod/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": read tcp 10.132.0.2:53266->10.132.0.69:15021: read: connection reset by peer" start-of-body= Jul 28 01:43:43.792727 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:43.792114 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" podUID="22fd398a-38af-40fc-bb19-4df661bab594" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": read tcp 10.132.0.2:53266->10.132.0.69:15021: read: connection reset by peer" Jul 28 01:43:44.123825 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:44.123787 2568 generic.go:356] "Generic (PLEG): container finished" podID="22fd398a-38af-40fc-bb19-4df661bab594" containerID="b2a1248b6d8792716a05c4285827e19cac2db28f9070dd1bde91573a10cb54c4" exitCode=0 Jul 28 01:43:44.124039 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:44.123862 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" event={"ID":"22fd398a-38af-40fc-bb19-4df661bab594","Type":"ContainerDied","Data":"b2a1248b6d8792716a05c4285827e19cac2db28f9070dd1bde91573a10cb54c4"} Jul 28 01:43:44.124340 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:44.124325 2568 scope.go:117] "RemoveContainer" containerID="b2a1248b6d8792716a05c4285827e19cac2db28f9070dd1bde91573a10cb54c4" Jul 28 01:43:44.125385 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:44.125354 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:43:44.125493 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:44.125440 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:43:44.125493 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:44.125486 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:43:45.132035 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:45.131991 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" event={"ID":"22fd398a-38af-40fc-bb19-4df661bab594","Type":"ContainerStarted","Data":"f7e5f7bf846d2fcaf0cfdf547292e564b5ad4f2227cff6344a8fd1eb51fefc68"} Jul 28 01:43:45.502839 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:45.502729 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:45.503153 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:45.503127 2568 patch_prober.go:28] interesting pod/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Jul 28 01:43:45.503250 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:45.503185 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" podUID="22fd398a-38af-40fc-bb19-4df661bab594" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Jul 28 01:43:46.499267 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:46.499230 2568 patch_prober.go:28] interesting pod/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Jul 28 01:43:46.500436 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:46.500402 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" podUID="22fd398a-38af-40fc-bb19-4df661bab594" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Jul 28 01:43:47.498841 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:47.498789 2568 patch_prober.go:28] interesting pod/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Jul 28 01:43:47.499184 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:47.498865 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" podUID="22fd398a-38af-40fc-bb19-4df661bab594" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Jul 28 01:43:48.502592 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:48.501987 2568 patch_prober.go:28] interesting pod/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" start-of-body= Jul 28 01:43:48.502592 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:48.502051 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" podUID="22fd398a-38af-40fc-bb19-4df661bab594" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.69:15021/healthz/ready\": dial tcp 10.132.0.69:15021: connect: connection refused" Jul 28 01:43:49.501470 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:49.501438 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:49.501890 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:49.501869 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:43:49.502599 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:43:49.502557 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:45:24.506012 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:24.505980 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt"] Jul 28 01:45:24.506720 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:24.506665 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" podUID="22fd398a-38af-40fc-bb19-4df661bab594" containerName="istio-proxy" containerID="cri-o://f7e5f7bf846d2fcaf0cfdf547292e564b5ad4f2227cff6344a8fd1eb51fefc68" gracePeriod=30 Jul 28 01:45:29.730864 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.730825 2568 generic.go:356] "Generic (PLEG): container finished" podID="22fd398a-38af-40fc-bb19-4df661bab594" containerID="f7e5f7bf846d2fcaf0cfdf547292e564b5ad4f2227cff6344a8fd1eb51fefc68" exitCode=0 Jul 28 01:45:29.731437 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.730894 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" event={"ID":"22fd398a-38af-40fc-bb19-4df661bab594","Type":"ContainerDied","Data":"f7e5f7bf846d2fcaf0cfdf547292e564b5ad4f2227cff6344a8fd1eb51fefc68"} Jul 28 01:45:29.731437 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.730965 2568 scope.go:117] "RemoveContainer" containerID="b2a1248b6d8792716a05c4285827e19cac2db28f9070dd1bde91573a10cb54c4" Jul 28 01:45:29.775271 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.775202 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:45:29.797142 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.797102 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-workload-socket\") pod \"22fd398a-38af-40fc-bb19-4df661bab594\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " Jul 28 01:45:29.797325 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.797149 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-x6fxq\" (UniqueName: \"kubernetes.io/projected/22fd398a-38af-40fc-bb19-4df661bab594-kube-api-access-x6fxq\") pod \"22fd398a-38af-40fc-bb19-4df661bab594\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " Jul 28 01:45:29.797325 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.797208 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22fd398a-38af-40fc-bb19-4df661bab594-istio-podinfo\") pod \"22fd398a-38af-40fc-bb19-4df661bab594\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " Jul 28 01:45:29.797325 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.797268 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22fd398a-38af-40fc-bb19-4df661bab594-istio-token\") pod \"22fd398a-38af-40fc-bb19-4df661bab594\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " Jul 28 01:45:29.797495 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.797413 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "22fd398a-38af-40fc-bb19-4df661bab594" (UID: "22fd398a-38af-40fc-bb19-4df661bab594"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:45:29.797495 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.797418 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22fd398a-38af-40fc-bb19-4df661bab594-istiod-ca-cert\") pod \"22fd398a-38af-40fc-bb19-4df661bab594\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " Jul 28 01:45:29.797495 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.797487 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-istio-envoy\") pod \"22fd398a-38af-40fc-bb19-4df661bab594\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " Jul 28 01:45:29.797699 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.797541 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-istio-data\") pod \"22fd398a-38af-40fc-bb19-4df661bab594\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " Jul 28 01:45:29.797699 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.797583 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-workload-certs\") pod \"22fd398a-38af-40fc-bb19-4df661bab594\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " Jul 28 01:45:29.797699 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.797641 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-credential-socket\") pod \"22fd398a-38af-40fc-bb19-4df661bab594\" (UID: \"22fd398a-38af-40fc-bb19-4df661bab594\") " Jul 28 01:45:29.797867 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.797790 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22fd398a-38af-40fc-bb19-4df661bab594-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "22fd398a-38af-40fc-bb19-4df661bab594" (UID: "22fd398a-38af-40fc-bb19-4df661bab594"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:45:29.798030 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.798005 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "22fd398a-38af-40fc-bb19-4df661bab594" (UID: "22fd398a-38af-40fc-bb19-4df661bab594"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:45:29.798216 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.798111 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "22fd398a-38af-40fc-bb19-4df661bab594" (UID: "22fd398a-38af-40fc-bb19-4df661bab594"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:45:29.798216 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.798055 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-workload-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:45:29.798608 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.798232 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22fd398a-38af-40fc-bb19-4df661bab594-istiod-ca-cert\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:45:29.799112 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.799078 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-istio-data" (OuterVolumeSpecName: "istio-data") pod "22fd398a-38af-40fc-bb19-4df661bab594" (UID: "22fd398a-38af-40fc-bb19-4df661bab594"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:45:29.800013 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.799982 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22fd398a-38af-40fc-bb19-4df661bab594-kube-api-access-x6fxq" (OuterVolumeSpecName: "kube-api-access-x6fxq") pod "22fd398a-38af-40fc-bb19-4df661bab594" (UID: "22fd398a-38af-40fc-bb19-4df661bab594"). InnerVolumeSpecName "kube-api-access-x6fxq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:45:29.800013 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.799994 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22fd398a-38af-40fc-bb19-4df661bab594-istio-token" (OuterVolumeSpecName: "istio-token") pod "22fd398a-38af-40fc-bb19-4df661bab594" (UID: "22fd398a-38af-40fc-bb19-4df661bab594"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:45:29.800301 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.800283 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "22fd398a-38af-40fc-bb19-4df661bab594" (UID: "22fd398a-38af-40fc-bb19-4df661bab594"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:45:29.800390 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.800304 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/22fd398a-38af-40fc-bb19-4df661bab594-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "22fd398a-38af-40fc-bb19-4df661bab594" (UID: "22fd398a-38af-40fc-bb19-4df661bab594"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 28 01:45:29.899368 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.899320 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-istio-data\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:45:29.899368 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.899360 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-workload-certs\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:45:29.899368 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.899374 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-credential-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:45:29.899660 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.899385 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-x6fxq\" (UniqueName: \"kubernetes.io/projected/22fd398a-38af-40fc-bb19-4df661bab594-kube-api-access-x6fxq\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:45:29.899660 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.899397 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22fd398a-38af-40fc-bb19-4df661bab594-istio-podinfo\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:45:29.899660 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.899410 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22fd398a-38af-40fc-bb19-4df661bab594-istio-token\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:45:29.899660 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:29.899420 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22fd398a-38af-40fc-bb19-4df661bab594-istio-envoy\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:45:30.738905 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:30.738872 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" Jul 28 01:45:30.739428 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:30.738906 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt" event={"ID":"22fd398a-38af-40fc-bb19-4df661bab594","Type":"ContainerDied","Data":"cb8591265c44e7916aba09dcf3c9cd413f43f30b204674a13686cd5fb88f8754"} Jul 28 01:45:30.739428 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:30.738967 2568 scope.go:117] "RemoveContainer" containerID="f7e5f7bf846d2fcaf0cfdf547292e564b5ad4f2227cff6344a8fd1eb51fefc68" Jul 28 01:45:30.763096 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:30.763054 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt"] Jul 28 01:45:30.767547 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:30.767508 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-ec1b3fa4-openshift-default-74d7c5d84-mb6mt"] Jul 28 01:45:31.534196 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:45:31.534151 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22fd398a-38af-40fc-bb19-4df661bab594" path="/var/lib/kubelet/pods/22fd398a-38af-40fc-bb19-4df661bab594/volumes" Jul 28 01:46:19.799353 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.799312 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4"] Jul 28 01:46:19.799995 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.799978 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22fd398a-38af-40fc-bb19-4df661bab594" containerName="istio-proxy" Jul 28 01:46:19.800042 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.799999 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="22fd398a-38af-40fc-bb19-4df661bab594" containerName="istio-proxy" Jul 28 01:46:19.800042 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.800016 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22fd398a-38af-40fc-bb19-4df661bab594" containerName="istio-proxy" Jul 28 01:46:19.800042 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.800026 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="22fd398a-38af-40fc-bb19-4df661bab594" containerName="istio-proxy" Jul 28 01:46:19.800138 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.800116 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="5503f1bc-ae60-46b6-88b7-7b6cfa292fdb" containerName="istio-proxy" Jul 28 01:46:19.800138 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.800126 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="22fd398a-38af-40fc-bb19-4df661bab594" containerName="istio-proxy" Jul 28 01:46:19.800208 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.800138 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="22fd398a-38af-40fc-bb19-4df661bab594" containerName="istio-proxy" Jul 28 01:46:19.802759 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.802733 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.805204 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.805170 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-2cd0f2-openshift-default-dockercfg-wm4gq\"" Jul 28 01:46:19.815535 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.815505 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4"] Jul 28 01:46:19.876623 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.876558 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mnz9d\" (UniqueName: \"kubernetes.io/projected/8c128022-b237-4fdc-965e-573c723d0ed3-kube-api-access-mnz9d\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.876623 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.876627 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-workload-certs\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.876853 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.876649 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-credential-socket\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.876853 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.876669 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-istio-envoy\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.876853 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.876738 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-workload-socket\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.876853 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.876762 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c128022-b237-4fdc-965e-573c723d0ed3-istio-podinfo\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.876853 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.876822 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c128022-b237-4fdc-965e-573c723d0ed3-istiod-ca-cert\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.877028 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.876871 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-istio-data\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.877028 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.876893 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c128022-b237-4fdc-965e-573c723d0ed3-istio-token\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.977776 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.977732 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mnz9d\" (UniqueName: \"kubernetes.io/projected/8c128022-b237-4fdc-965e-573c723d0ed3-kube-api-access-mnz9d\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.977776 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.977783 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-workload-certs\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.978060 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.977815 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-credential-socket\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.978060 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.977844 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-istio-envoy\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.978060 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.977891 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-workload-socket\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.978060 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.977915 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c128022-b237-4fdc-965e-573c723d0ed3-istio-podinfo\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.978060 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.977951 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c128022-b237-4fdc-965e-573c723d0ed3-istiod-ca-cert\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.978060 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.977992 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-istio-data\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.978060 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.978023 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c128022-b237-4fdc-965e-573c723d0ed3-istio-token\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.979028 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.978998 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c128022-b237-4fdc-965e-573c723d0ed3-istiod-ca-cert\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.979212 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.979099 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-workload-socket\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.979304 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.979149 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-istio-data\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.979467 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.979445 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-credential-socket\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.979534 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.979463 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-workload-certs\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.981178 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.981155 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c128022-b237-4fdc-965e-573c723d0ed3-istio-podinfo\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.981843 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.981823 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-istio-envoy\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.986225 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.986188 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c128022-b237-4fdc-965e-573c723d0ed3-istio-token\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:19.986337 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:19.986298 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mnz9d\" (UniqueName: \"kubernetes.io/projected/8c128022-b237-4fdc-965e-573c723d0ed3-kube-api-access-mnz9d\") pod \"e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:20.115251 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:20.115220 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:20.267274 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:20.267244 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4"] Jul 28 01:46:20.269014 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:46:20.268987 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c128022_b237_4fdc_965e_573c723d0ed3.slice/crio-333b69331aded07bbbeb54c5112fd88fe2ffbcc2fc1c9a578955bba924cf15ef WatchSource:0}: Error finding container 333b69331aded07bbbeb54c5112fd88fe2ffbcc2fc1c9a578955bba924cf15ef: Status 404 returned error can't find the container with id 333b69331aded07bbbeb54c5112fd88fe2ffbcc2fc1c9a578955bba924cf15ef Jul 28 01:46:20.271629 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:20.271557 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:46:20.271724 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:20.271670 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:46:20.271724 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:20.271705 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:46:21.036897 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:21.036863 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" event={"ID":"8c128022-b237-4fdc-965e-573c723d0ed3","Type":"ContainerStarted","Data":"8c2f1bcf085f23e3761a19292ee6950d7a48c9c7e2bc1f6afca6c9819d41ff07"} Jul 28 01:46:21.037354 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:21.036920 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" event={"ID":"8c128022-b237-4fdc-965e-573c723d0ed3","Type":"ContainerStarted","Data":"333b69331aded07bbbeb54c5112fd88fe2ffbcc2fc1c9a578955bba924cf15ef"} Jul 28 01:46:21.059555 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:21.059504 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" podStartSLOduration=2.059484982 podStartE2EDuration="2.059484982s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:46:19 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:46:21.057447972 +0000 UTC m=+3177.977048655" watchObservedRunningTime="2026-07-28 01:46:21.059484982 +0000 UTC m=+3177.979085666" Jul 28 01:46:21.115439 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:21.115399 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:21.120829 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:21.120800 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:22.042151 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:22.042111 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:22.043278 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:22.043258 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:28.038169 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.038122 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t"] Jul 28 01:46:28.041718 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.041693 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.044282 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.044253 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-f67c19-openshift-default-dockercfg-5p685\"" Jul 28 01:46:28.053805 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.053773 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t"] Jul 28 01:46:28.159709 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.159667 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/327836be-3b72-4dec-b231-93bef90f0cee-istio-podinfo\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.159709 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.159718 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/327836be-3b72-4dec-b231-93bef90f0cee-istio-token\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.160093 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.159769 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/327836be-3b72-4dec-b231-93bef90f0cee-istiod-ca-cert\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.160093 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.159798 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-istio-data\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.160093 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.159848 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-credential-socket\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.160093 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.159925 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-istio-envoy\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.160093 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.159957 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-workload-socket\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.160093 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.159997 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cp56f\" (UniqueName: \"kubernetes.io/projected/327836be-3b72-4dec-b231-93bef90f0cee-kube-api-access-cp56f\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.160093 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.160052 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-workload-certs\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.260890 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.260854 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/327836be-3b72-4dec-b231-93bef90f0cee-istiod-ca-cert\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.261093 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.260897 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-istio-data\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.261093 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.261043 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-credential-socket\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.261219 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.261140 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-istio-envoy\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.261219 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.261183 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-workload-socket\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.261327 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.261230 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cp56f\" (UniqueName: \"kubernetes.io/projected/327836be-3b72-4dec-b231-93bef90f0cee-kube-api-access-cp56f\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.261327 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.261271 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-workload-certs\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.261434 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.261355 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/327836be-3b72-4dec-b231-93bef90f0cee-istio-podinfo\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.261434 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.261380 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/327836be-3b72-4dec-b231-93bef90f0cee-istio-token\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.261434 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.261396 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-istio-data\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.261804 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.261777 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/327836be-3b72-4dec-b231-93bef90f0cee-istiod-ca-cert\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.262060 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.262034 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-credential-socket\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.262346 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.262165 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-workload-certs\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.262461 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.262440 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-workload-socket\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.263985 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.263963 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-istio-envoy\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.264101 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.264074 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/327836be-3b72-4dec-b231-93bef90f0cee-istio-podinfo\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.270080 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.270051 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/327836be-3b72-4dec-b231-93bef90f0cee-istio-token\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.270197 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.270164 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cp56f\" (UniqueName: \"kubernetes.io/projected/327836be-3b72-4dec-b231-93bef90f0cee-kube-api-access-cp56f\") pod \"e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.354662 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.354618 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:28.514234 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.514203 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t"] Jul 28 01:46:28.515155 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:46:28.515132 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod327836be_3b72_4dec_b231_93bef90f0cee.slice/crio-7385ab084769c5e2b911085b4e16bb18a44894b7c6a42fbb160703b0a48e6cf2 WatchSource:0}: Error finding container 7385ab084769c5e2b911085b4e16bb18a44894b7c6a42fbb160703b0a48e6cf2: Status 404 returned error can't find the container with id 7385ab084769c5e2b911085b4e16bb18a44894b7c6a42fbb160703b0a48e6cf2 Jul 28 01:46:28.517860 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.517828 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:46:28.517951 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.517897 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:46:28.517951 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:28.517926 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:46:29.109942 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:29.109894 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" event={"ID":"327836be-3b72-4dec-b231-93bef90f0cee","Type":"ContainerStarted","Data":"054f978f7832ebe7fc37340ce71b047165c1bdbdd738efb0717184cb5f08810d"} Jul 28 01:46:29.110467 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:29.109957 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" event={"ID":"327836be-3b72-4dec-b231-93bef90f0cee","Type":"ContainerStarted","Data":"7385ab084769c5e2b911085b4e16bb18a44894b7c6a42fbb160703b0a48e6cf2"} Jul 28 01:46:29.133673 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:29.133615 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" podStartSLOduration=1.133597367 podStartE2EDuration="1.133597367s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:46:28 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:46:29.130832424 +0000 UTC m=+3186.050433101" watchObservedRunningTime="2026-07-28 01:46:29.133597367 +0000 UTC m=+3186.053198052" Jul 28 01:46:29.355013 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:29.354973 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:29.360649 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:29.360556 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:30.116104 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:30.116065 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:30.117258 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:30.117238 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:36.153660 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:36.153619 2568 generic.go:356] "Generic (PLEG): container finished" podID="8c128022-b237-4fdc-965e-573c723d0ed3" containerID="8c2f1bcf085f23e3761a19292ee6950d7a48c9c7e2bc1f6afca6c9819d41ff07" exitCode=0 Jul 28 01:46:36.154085 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:36.153690 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" event={"ID":"8c128022-b237-4fdc-965e-573c723d0ed3","Type":"ContainerDied","Data":"8c2f1bcf085f23e3761a19292ee6950d7a48c9c7e2bc1f6afca6c9819d41ff07"} Jul 28 01:46:36.154085 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:36.154078 2568 scope.go:117] "RemoveContainer" containerID="8c2f1bcf085f23e3761a19292ee6950d7a48c9c7e2bc1f6afca6c9819d41ff07" Jul 28 01:46:36.155202 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:36.155173 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:46:36.155280 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:36.155262 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:46:36.155333 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:36.155316 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:46:37.042206 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:37.042172 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:37.161242 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:37.161203 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" event={"ID":"8c128022-b237-4fdc-965e-573c723d0ed3","Type":"ContainerStarted","Data":"301720463ad5b1aaf6d556f44230ba407f31965125dfea69fd403101b80fca70"} Jul 28 01:46:38.115897 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:38.115857 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:38.117284 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:38.117259 2568 patch_prober.go:28] interesting pod/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Jul 28 01:46:38.117407 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:38.117307 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" podUID="8c128022-b237-4fdc-965e-573c723d0ed3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Jul 28 01:46:39.116400 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:39.116364 2568 patch_prober.go:28] interesting pod/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Jul 28 01:46:39.116857 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:39.116424 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" podUID="8c128022-b237-4fdc-965e-573c723d0ed3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Jul 28 01:46:40.115836 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:40.115798 2568 patch_prober.go:28] interesting pod/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" start-of-body= Jul 28 01:46:40.116015 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:40.115875 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" podUID="8c128022-b237-4fdc-965e-573c723d0ed3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.70:15021/healthz/ready\": dial tcp 10.132.0.70:15021: connect: connection refused" Jul 28 01:46:41.119615 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:41.119561 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:41.120077 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:41.119892 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:41.120698 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:41.120676 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:46:50.252629 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:50.252585 2568 generic.go:356] "Generic (PLEG): container finished" podID="327836be-3b72-4dec-b231-93bef90f0cee" containerID="054f978f7832ebe7fc37340ce71b047165c1bdbdd738efb0717184cb5f08810d" exitCode=0 Jul 28 01:46:50.253211 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:50.252644 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" event={"ID":"327836be-3b72-4dec-b231-93bef90f0cee","Type":"ContainerDied","Data":"054f978f7832ebe7fc37340ce71b047165c1bdbdd738efb0717184cb5f08810d"} Jul 28 01:46:50.253284 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:50.253216 2568 scope.go:117] "RemoveContainer" containerID="054f978f7832ebe7fc37340ce71b047165c1bdbdd738efb0717184cb5f08810d" Jul 28 01:46:50.254382 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:50.254340 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:46:50.254472 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:50.254457 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:46:50.254513 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:50.254499 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:46:51.260232 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:51.260195 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" event={"ID":"327836be-3b72-4dec-b231-93bef90f0cee","Type":"ContainerStarted","Data":"467ebe223a6e8efe68853c23d23e9e92de843ca19ee147503714633ad36bf887"} Jul 28 01:46:51.354916 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:51.354865 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:51.355175 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:51.355151 2568 patch_prober.go:28] interesting pod/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 28 01:46:51.355228 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:51.355205 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" podUID="327836be-3b72-4dec-b231-93bef90f0cee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 28 01:46:52.355264 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:52.355219 2568 patch_prober.go:28] interesting pod/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 28 01:46:52.355720 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:52.355284 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" podUID="327836be-3b72-4dec-b231-93bef90f0cee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 28 01:46:53.355865 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:53.355819 2568 patch_prober.go:28] interesting pod/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 28 01:46:53.356346 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:53.355882 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" podUID="327836be-3b72-4dec-b231-93bef90f0cee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 28 01:46:54.355492 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:54.355449 2568 patch_prober.go:28] interesting pod/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 28 01:46:54.355742 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:54.355518 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" podUID="327836be-3b72-4dec-b231-93bef90f0cee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 28 01:46:55.355512 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:55.355477 2568 patch_prober.go:28] interesting pod/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" start-of-body= Jul 28 01:46:55.355936 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:55.355533 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" podUID="327836be-3b72-4dec-b231-93bef90f0cee" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.71:15021/healthz/ready\": dial tcp 10.132.0.71:15021: connect: connection refused" Jul 28 01:46:56.360303 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:56.360271 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:56.360720 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:56.360553 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:46:56.361392 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:46:56.361373 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:48:22.812921 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:22.812888 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4"] Jul 28 01:48:22.813432 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:22.813116 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" podUID="8c128022-b237-4fdc-965e-573c723d0ed3" containerName="istio-proxy" containerID="cri-o://301720463ad5b1aaf6d556f44230ba407f31965125dfea69fd403101b80fca70" gracePeriod=30 Jul 28 01:48:23.868261 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:23.868233 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:48:23.877635 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:23.877606 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:48:26.122167 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:26.122118 2568 patch_prober.go:28] interesting pod/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 28 01:48:26.122611 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:26.122210 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" podUID="8c128022-b237-4fdc-965e-573c723d0ed3" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 01:48:28.077947 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.077878 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:48:28.151480 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.151444 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c128022-b237-4fdc-965e-573c723d0ed3-istiod-ca-cert\") pod \"8c128022-b237-4fdc-965e-573c723d0ed3\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " Jul 28 01:48:28.151480 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.151486 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mnz9d\" (UniqueName: \"kubernetes.io/projected/8c128022-b237-4fdc-965e-573c723d0ed3-kube-api-access-mnz9d\") pod \"8c128022-b237-4fdc-965e-573c723d0ed3\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " Jul 28 01:48:28.151785 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.151522 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-credential-socket\") pod \"8c128022-b237-4fdc-965e-573c723d0ed3\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " Jul 28 01:48:28.151785 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.151557 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c128022-b237-4fdc-965e-573c723d0ed3-istio-podinfo\") pod \"8c128022-b237-4fdc-965e-573c723d0ed3\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " Jul 28 01:48:28.151785 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.151654 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c128022-b237-4fdc-965e-573c723d0ed3-istio-token\") pod \"8c128022-b237-4fdc-965e-573c723d0ed3\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " Jul 28 01:48:28.151785 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.151692 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-workload-certs\") pod \"8c128022-b237-4fdc-965e-573c723d0ed3\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " Jul 28 01:48:28.151785 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.151717 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-istio-data\") pod \"8c128022-b237-4fdc-965e-573c723d0ed3\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " Jul 28 01:48:28.151785 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.151763 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-istio-envoy\") pod \"8c128022-b237-4fdc-965e-573c723d0ed3\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " Jul 28 01:48:28.152121 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.151794 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-workload-socket\") pod \"8c128022-b237-4fdc-965e-573c723d0ed3\" (UID: \"8c128022-b237-4fdc-965e-573c723d0ed3\") " Jul 28 01:48:28.152121 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.151958 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "8c128022-b237-4fdc-965e-573c723d0ed3" (UID: "8c128022-b237-4fdc-965e-573c723d0ed3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:48:28.152121 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.152069 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "8c128022-b237-4fdc-965e-573c723d0ed3" (UID: "8c128022-b237-4fdc-965e-573c723d0ed3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:48:28.152121 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.152101 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/8c128022-b237-4fdc-965e-573c723d0ed3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "8c128022-b237-4fdc-965e-573c723d0ed3" (UID: "8c128022-b237-4fdc-965e-573c723d0ed3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:48:28.152343 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.152170 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "8c128022-b237-4fdc-965e-573c723d0ed3" (UID: "8c128022-b237-4fdc-965e-573c723d0ed3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:48:28.152343 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.152274 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-workload-certs\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:48:28.152343 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.152293 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-workload-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:48:28.152343 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.152307 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8c128022-b237-4fdc-965e-573c723d0ed3-istiod-ca-cert\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:48:28.152343 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.152319 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-credential-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:48:28.152809 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.152626 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-istio-data" (OuterVolumeSpecName: "istio-data") pod "8c128022-b237-4fdc-965e-573c723d0ed3" (UID: "8c128022-b237-4fdc-965e-573c723d0ed3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:48:28.154194 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.154161 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c128022-b237-4fdc-965e-573c723d0ed3-kube-api-access-mnz9d" (OuterVolumeSpecName: "kube-api-access-mnz9d") pod "8c128022-b237-4fdc-965e-573c723d0ed3" (UID: "8c128022-b237-4fdc-965e-573c723d0ed3"). InnerVolumeSpecName "kube-api-access-mnz9d". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:48:28.154329 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.154236 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "8c128022-b237-4fdc-965e-573c723d0ed3" (UID: "8c128022-b237-4fdc-965e-573c723d0ed3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:48:28.154517 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.154498 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/8c128022-b237-4fdc-965e-573c723d0ed3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "8c128022-b237-4fdc-965e-573c723d0ed3" (UID: "8c128022-b237-4fdc-965e-573c723d0ed3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 28 01:48:28.154596 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.154543 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/8c128022-b237-4fdc-965e-573c723d0ed3-istio-token" (OuterVolumeSpecName: "istio-token") pod "8c128022-b237-4fdc-965e-573c723d0ed3" (UID: "8c128022-b237-4fdc-965e-573c723d0ed3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:48:28.253731 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.253693 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-istio-envoy\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:48:28.253731 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.253724 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mnz9d\" (UniqueName: \"kubernetes.io/projected/8c128022-b237-4fdc-965e-573c723d0ed3-kube-api-access-mnz9d\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:48:28.253731 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.253735 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8c128022-b237-4fdc-965e-573c723d0ed3-istio-podinfo\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:48:28.253731 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.253744 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8c128022-b237-4fdc-965e-573c723d0ed3-istio-token\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:48:28.254112 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.253751 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8c128022-b237-4fdc-965e-573c723d0ed3-istio-data\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:48:28.835840 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.835804 2568 generic.go:356] "Generic (PLEG): container finished" podID="8c128022-b237-4fdc-965e-573c723d0ed3" containerID="301720463ad5b1aaf6d556f44230ba407f31965125dfea69fd403101b80fca70" exitCode=0 Jul 28 01:48:28.836128 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.835859 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" Jul 28 01:48:28.836128 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.835895 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" event={"ID":"8c128022-b237-4fdc-965e-573c723d0ed3","Type":"ContainerDied","Data":"301720463ad5b1aaf6d556f44230ba407f31965125dfea69fd403101b80fca70"} Jul 28 01:48:28.836128 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.835954 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4" event={"ID":"8c128022-b237-4fdc-965e-573c723d0ed3","Type":"ContainerDied","Data":"333b69331aded07bbbeb54c5112fd88fe2ffbcc2fc1c9a578955bba924cf15ef"} Jul 28 01:48:28.836128 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.835977 2568 scope.go:117] "RemoveContainer" containerID="301720463ad5b1aaf6d556f44230ba407f31965125dfea69fd403101b80fca70" Jul 28 01:48:28.847809 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.847779 2568 scope.go:117] "RemoveContainer" containerID="8c2f1bcf085f23e3761a19292ee6950d7a48c9c7e2bc1f6afca6c9819d41ff07" Jul 28 01:48:28.858645 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.858594 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4"] Jul 28 01:48:28.858731 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.858665 2568 scope.go:117] "RemoveContainer" containerID="301720463ad5b1aaf6d556f44230ba407f31965125dfea69fd403101b80fca70" Jul 28 01:48:28.859088 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:48:28.859023 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"301720463ad5b1aaf6d556f44230ba407f31965125dfea69fd403101b80fca70\": container with ID starting with 301720463ad5b1aaf6d556f44230ba407f31965125dfea69fd403101b80fca70 not found: ID does not exist" containerID="301720463ad5b1aaf6d556f44230ba407f31965125dfea69fd403101b80fca70" Jul 28 01:48:28.859286 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.859119 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"301720463ad5b1aaf6d556f44230ba407f31965125dfea69fd403101b80fca70"} err="failed to get container status \"301720463ad5b1aaf6d556f44230ba407f31965125dfea69fd403101b80fca70\": rpc error: code = NotFound desc = could not find container \"301720463ad5b1aaf6d556f44230ba407f31965125dfea69fd403101b80fca70\": container with ID starting with 301720463ad5b1aaf6d556f44230ba407f31965125dfea69fd403101b80fca70 not found: ID does not exist" Jul 28 01:48:28.859286 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.859141 2568 scope.go:117] "RemoveContainer" containerID="8c2f1bcf085f23e3761a19292ee6950d7a48c9c7e2bc1f6afca6c9819d41ff07" Jul 28 01:48:28.859520 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:48:28.859476 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8c2f1bcf085f23e3761a19292ee6950d7a48c9c7e2bc1f6afca6c9819d41ff07\": container with ID starting with 8c2f1bcf085f23e3761a19292ee6950d7a48c9c7e2bc1f6afca6c9819d41ff07 not found: ID does not exist" containerID="8c2f1bcf085f23e3761a19292ee6950d7a48c9c7e2bc1f6afca6c9819d41ff07" Jul 28 01:48:28.859731 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.859703 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8c2f1bcf085f23e3761a19292ee6950d7a48c9c7e2bc1f6afca6c9819d41ff07"} err="failed to get container status \"8c2f1bcf085f23e3761a19292ee6950d7a48c9c7e2bc1f6afca6c9819d41ff07\": rpc error: code = NotFound desc = could not find container \"8c2f1bcf085f23e3761a19292ee6950d7a48c9c7e2bc1f6afca6c9819d41ff07\": container with ID starting with 8c2f1bcf085f23e3761a19292ee6950d7a48c9c7e2bc1f6afca6c9819d41ff07 not found: ID does not exist" Jul 28 01:48:28.862161 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:28.862138 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-2cd0f2-openshift-default-5569c68476-6r4c4"] Jul 28 01:48:29.534422 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:29.534370 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="8c128022-b237-4fdc-965e-573c723d0ed3" path="/var/lib/kubelet/pods/8c128022-b237-4fdc-965e-573c723d0ed3/volumes" Jul 28 01:48:44.832322 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:44.832247 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t"] Jul 28 01:48:44.832703 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:44.832500 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" podUID="327836be-3b72-4dec-b231-93bef90f0cee" containerName="istio-proxy" containerID="cri-o://467ebe223a6e8efe68853c23d23e9e92de843ca19ee147503714633ad36bf887" gracePeriod=30 Jul 28 01:48:45.717728 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.717693 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x"] Jul 28 01:48:45.718179 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.718164 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c128022-b237-4fdc-965e-573c723d0ed3" containerName="istio-proxy" Jul 28 01:48:45.718260 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.718181 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c128022-b237-4fdc-965e-573c723d0ed3" containerName="istio-proxy" Jul 28 01:48:45.718260 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.718191 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="8c128022-b237-4fdc-965e-573c723d0ed3" containerName="istio-proxy" Jul 28 01:48:45.718260 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.718198 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="8c128022-b237-4fdc-965e-573c723d0ed3" containerName="istio-proxy" Jul 28 01:48:45.718436 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.718270 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c128022-b237-4fdc-965e-573c723d0ed3" containerName="istio-proxy" Jul 28 01:48:45.718436 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.718280 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="8c128022-b237-4fdc-965e-573c723d0ed3" containerName="istio-proxy" Jul 28 01:48:45.720663 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.720641 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.723455 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.723429 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-64a682-openshift-default-dockercfg-zrfbx\"" Jul 28 01:48:45.740036 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.739998 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x"] Jul 28 01:48:45.828325 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.828288 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-token\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.828545 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.828410 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-podinfo\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.828545 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.828457 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-workload-socket\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.828545 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.828482 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-credential-socket\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.828545 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.828515 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-workload-certs\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.828790 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.828618 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-envoy\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.828790 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.828684 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-data\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.828790 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.828729 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43be63ac-7e41-400b-b43a-26b98fc0bccf-istiod-ca-cert\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.828790 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.828746 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nm2tt\" (UniqueName: \"kubernetes.io/projected/43be63ac-7e41-400b-b43a-26b98fc0bccf-kube-api-access-nm2tt\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.930241 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.930196 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43be63ac-7e41-400b-b43a-26b98fc0bccf-istiod-ca-cert\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.930241 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.930235 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nm2tt\" (UniqueName: \"kubernetes.io/projected/43be63ac-7e41-400b-b43a-26b98fc0bccf-kube-api-access-nm2tt\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.930807 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.930256 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-token\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.930807 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.930301 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-podinfo\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.930807 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.930317 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-workload-socket\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.930807 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.930335 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-credential-socket\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.930807 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.930359 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-workload-certs\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.930807 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.930404 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-envoy\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.930807 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.930621 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-data\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.931119 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.930814 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-workload-certs\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.931119 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.930898 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-workload-socket\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.931119 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.930933 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-credential-socket\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.931119 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.930978 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-data\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.931119 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.931045 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43be63ac-7e41-400b-b43a-26b98fc0bccf-istiod-ca-cert\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.932908 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.932882 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-envoy\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.933098 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.933078 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-podinfo\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.941819 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.941794 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-token\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:45.941982 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:45.941897 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nm2tt\" (UniqueName: \"kubernetes.io/projected/43be63ac-7e41-400b-b43a-26b98fc0bccf-kube-api-access-nm2tt\") pod \"e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:46.031548 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:46.031450 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:46.186723 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:46.186689 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x"] Jul 28 01:48:46.188383 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:48:46.188351 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod43be63ac_7e41_400b_b43a_26b98fc0bccf.slice/crio-fd06751652b3fbd7337a664ebc10413cea6b5ba28ba1aa951b0ac7d5c6618d95 WatchSource:0}: Error finding container fd06751652b3fbd7337a664ebc10413cea6b5ba28ba1aa951b0ac7d5c6618d95: Status 404 returned error can't find the container with id fd06751652b3fbd7337a664ebc10413cea6b5ba28ba1aa951b0ac7d5c6618d95 Jul 28 01:48:46.190525 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:46.190490 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:48:46.190645 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:46.190604 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:48:46.190709 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:46.190650 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:48:46.946775 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:46.946739 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" event={"ID":"43be63ac-7e41-400b-b43a-26b98fc0bccf","Type":"ContainerStarted","Data":"8f34a83049326973cab670d88ae5adb035660c9f683e36681be55891931a304e"} Jul 28 01:48:46.947250 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:46.946795 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" event={"ID":"43be63ac-7e41-400b-b43a-26b98fc0bccf","Type":"ContainerStarted","Data":"fd06751652b3fbd7337a664ebc10413cea6b5ba28ba1aa951b0ac7d5c6618d95"} Jul 28 01:48:46.984078 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:46.984020 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" podStartSLOduration=1.984002676 podStartE2EDuration="1.984002676s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:48:45 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:48:46.981274227 +0000 UTC m=+3323.900874911" watchObservedRunningTime="2026-07-28 01:48:46.984002676 +0000 UTC m=+3323.903603360" Jul 28 01:48:47.032043 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:47.031997 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:47.037121 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:47.037093 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:47.952804 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:47.952772 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:47.953774 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:47.953752 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:48:49.967209 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:49.967172 2568 generic.go:356] "Generic (PLEG): container finished" podID="327836be-3b72-4dec-b231-93bef90f0cee" containerID="467ebe223a6e8efe68853c23d23e9e92de843ca19ee147503714633ad36bf887" exitCode=0 Jul 28 01:48:49.967648 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:49.967247 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" event={"ID":"327836be-3b72-4dec-b231-93bef90f0cee","Type":"ContainerDied","Data":"467ebe223a6e8efe68853c23d23e9e92de843ca19ee147503714633ad36bf887"} Jul 28 01:48:49.967648 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:49.967316 2568 scope.go:117] "RemoveContainer" containerID="054f978f7832ebe7fc37340ce71b047165c1bdbdd738efb0717184cb5f08810d" Jul 28 01:48:50.128579 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.128532 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:48:50.274654 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.274607 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-istio-data\") pod \"327836be-3b72-4dec-b231-93bef90f0cee\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " Jul 28 01:48:50.274654 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.274653 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-workload-socket\") pod \"327836be-3b72-4dec-b231-93bef90f0cee\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " Jul 28 01:48:50.274944 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.274711 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/327836be-3b72-4dec-b231-93bef90f0cee-istio-podinfo\") pod \"327836be-3b72-4dec-b231-93bef90f0cee\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " Jul 28 01:48:50.274944 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.274793 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-cp56f\" (UniqueName: \"kubernetes.io/projected/327836be-3b72-4dec-b231-93bef90f0cee-kube-api-access-cp56f\") pod \"327836be-3b72-4dec-b231-93bef90f0cee\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " Jul 28 01:48:50.274944 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.274827 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/327836be-3b72-4dec-b231-93bef90f0cee-istio-token\") pod \"327836be-3b72-4dec-b231-93bef90f0cee\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " Jul 28 01:48:50.274944 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.274859 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-credential-socket\") pod \"327836be-3b72-4dec-b231-93bef90f0cee\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " Jul 28 01:48:50.275164 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.274938 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "327836be-3b72-4dec-b231-93bef90f0cee" (UID: "327836be-3b72-4dec-b231-93bef90f0cee"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:48:50.275164 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.274988 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-istio-envoy\") pod \"327836be-3b72-4dec-b231-93bef90f0cee\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " Jul 28 01:48:50.275164 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.275041 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/327836be-3b72-4dec-b231-93bef90f0cee-istiod-ca-cert\") pod \"327836be-3b72-4dec-b231-93bef90f0cee\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " Jul 28 01:48:50.275164 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.275085 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-workload-certs\") pod \"327836be-3b72-4dec-b231-93bef90f0cee\" (UID: \"327836be-3b72-4dec-b231-93bef90f0cee\") " Jul 28 01:48:50.275164 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.275121 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "327836be-3b72-4dec-b231-93bef90f0cee" (UID: "327836be-3b72-4dec-b231-93bef90f0cee"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:48:50.275726 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.275511 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-credential-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:48:50.275726 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.275689 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-workload-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:48:50.275726 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.275556 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/327836be-3b72-4dec-b231-93bef90f0cee-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "327836be-3b72-4dec-b231-93bef90f0cee" (UID: "327836be-3b72-4dec-b231-93bef90f0cee"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:48:50.275972 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.275746 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "327836be-3b72-4dec-b231-93bef90f0cee" (UID: "327836be-3b72-4dec-b231-93bef90f0cee"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:48:50.275972 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.275882 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-istio-data" (OuterVolumeSpecName: "istio-data") pod "327836be-3b72-4dec-b231-93bef90f0cee" (UID: "327836be-3b72-4dec-b231-93bef90f0cee"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:48:50.277299 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.277268 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/327836be-3b72-4dec-b231-93bef90f0cee-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "327836be-3b72-4dec-b231-93bef90f0cee" (UID: "327836be-3b72-4dec-b231-93bef90f0cee"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 28 01:48:50.277424 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.277364 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "327836be-3b72-4dec-b231-93bef90f0cee" (UID: "327836be-3b72-4dec-b231-93bef90f0cee"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:48:50.277692 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.277670 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/327836be-3b72-4dec-b231-93bef90f0cee-kube-api-access-cp56f" (OuterVolumeSpecName: "kube-api-access-cp56f") pod "327836be-3b72-4dec-b231-93bef90f0cee" (UID: "327836be-3b72-4dec-b231-93bef90f0cee"). InnerVolumeSpecName "kube-api-access-cp56f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:48:50.277692 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.277676 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/327836be-3b72-4dec-b231-93bef90f0cee-istio-token" (OuterVolumeSpecName: "istio-token") pod "327836be-3b72-4dec-b231-93bef90f0cee" (UID: "327836be-3b72-4dec-b231-93bef90f0cee"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:48:50.376420 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.376320 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-cp56f\" (UniqueName: \"kubernetes.io/projected/327836be-3b72-4dec-b231-93bef90f0cee-kube-api-access-cp56f\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:48:50.376420 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.376355 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/327836be-3b72-4dec-b231-93bef90f0cee-istio-token\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:48:50.376420 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.376365 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-istio-envoy\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:48:50.376420 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.376387 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/327836be-3b72-4dec-b231-93bef90f0cee-istiod-ca-cert\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:48:50.376420 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.376395 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-workload-certs\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:48:50.376420 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.376403 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/327836be-3b72-4dec-b231-93bef90f0cee-istio-data\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:48:50.376420 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.376410 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/327836be-3b72-4dec-b231-93bef90f0cee-istio-podinfo\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:48:50.974819 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.974788 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" Jul 28 01:48:50.975314 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.974786 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t" event={"ID":"327836be-3b72-4dec-b231-93bef90f0cee","Type":"ContainerDied","Data":"7385ab084769c5e2b911085b4e16bb18a44894b7c6a42fbb160703b0a48e6cf2"} Jul 28 01:48:50.975314 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:50.974941 2568 scope.go:117] "RemoveContainer" containerID="467ebe223a6e8efe68853c23d23e9e92de843ca19ee147503714633ad36bf887" Jul 28 01:48:51.023679 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:51.023639 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t"] Jul 28 01:48:51.063044 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:51.063005 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-f67c19-openshift-default-c75bfcff6-gvd2t"] Jul 28 01:48:51.535956 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:51.535923 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="327836be-3b72-4dec-b231-93bef90f0cee" path="/var/lib/kubelet/pods/327836be-3b72-4dec-b231-93bef90f0cee/volumes" Jul 28 01:48:54.110501 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.110462 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp"] Jul 28 01:48:54.110962 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.110917 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="327836be-3b72-4dec-b231-93bef90f0cee" containerName="istio-proxy" Jul 28 01:48:54.110962 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.110930 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="327836be-3b72-4dec-b231-93bef90f0cee" containerName="istio-proxy" Jul 28 01:48:54.111064 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.111020 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="327836be-3b72-4dec-b231-93bef90f0cee" containerName="istio-proxy" Jul 28 01:48:54.114361 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.114339 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.117071 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.117048 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-3940b7-openshift-default-dockercfg-4zfxv\"" Jul 28 01:48:54.128268 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.128243 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp"] Jul 28 01:48:54.204137 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.204100 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-credential-socket\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.204344 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.204175 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-data\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.204344 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.204212 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z7kpr\" (UniqueName: \"kubernetes.io/projected/933d67e4-3a04-4e21-a466-b8ad44034e15-kube-api-access-z7kpr\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.204344 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.204245 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-envoy\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.204529 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.204373 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/933d67e4-3a04-4e21-a466-b8ad44034e15-istiod-ca-cert\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.204529 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.204418 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-podinfo\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.204529 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.204492 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-workload-socket\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.204529 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.204519 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-workload-certs\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.204726 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.204551 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-token\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.306041 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.305999 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-podinfo\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.306359 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.306336 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-workload-socket\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.306500 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.306484 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-workload-certs\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.306639 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.306624 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-token\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.306757 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.306744 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-credential-socket\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.306889 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.306874 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-data\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.306996 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.306984 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z7kpr\" (UniqueName: \"kubernetes.io/projected/933d67e4-3a04-4e21-a466-b8ad44034e15-kube-api-access-z7kpr\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.307103 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.307090 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-envoy\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.307258 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.307244 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/933d67e4-3a04-4e21-a466-b8ad44034e15-istiod-ca-cert\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.308153 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.308123 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/933d67e4-3a04-4e21-a466-b8ad44034e15-istiod-ca-cert\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.312898 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.312869 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-workload-certs\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.313069 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.312948 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-data\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.313134 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.313074 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-credential-socket\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.313134 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.313112 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-workload-socket\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.313944 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.313910 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-podinfo\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.315534 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.315516 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-envoy\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.321517 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.321490 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z7kpr\" (UniqueName: \"kubernetes.io/projected/933d67e4-3a04-4e21-a466-b8ad44034e15-kube-api-access-z7kpr\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.321639 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.321489 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-token\") pod \"e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.426597 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.426471 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:54.578599 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.578427 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp"] Jul 28 01:48:54.579498 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:48:54.579470 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod933d67e4_3a04_4e21_a466_b8ad44034e15.slice/crio-1bfa5853ef7676cf1750f00dc32813b8300a03e8d9e88ef4ab30bdc1eba5e4e0 WatchSource:0}: Error finding container 1bfa5853ef7676cf1750f00dc32813b8300a03e8d9e88ef4ab30bdc1eba5e4e0: Status 404 returned error can't find the container with id 1bfa5853ef7676cf1750f00dc32813b8300a03e8d9e88ef4ab30bdc1eba5e4e0 Jul 28 01:48:54.582098 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.582063 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:48:54.582194 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.582132 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:48:54.582194 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:54.582170 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:48:55.000780 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:55.000743 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" event={"ID":"933d67e4-3a04-4e21-a466-b8ad44034e15","Type":"ContainerStarted","Data":"8fe9452018acc68a2cefc257cb974dac6a6a7939662e4035261c36537281dc1c"} Jul 28 01:48:55.000938 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:55.000797 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" event={"ID":"933d67e4-3a04-4e21-a466-b8ad44034e15","Type":"ContainerStarted","Data":"1bfa5853ef7676cf1750f00dc32813b8300a03e8d9e88ef4ab30bdc1eba5e4e0"} Jul 28 01:48:55.023458 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:55.023407 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" podStartSLOduration=1.023389893 podStartE2EDuration="1.023389893s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:48:54 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:48:55.021088451 +0000 UTC m=+3331.940689137" watchObservedRunningTime="2026-07-28 01:48:55.023389893 +0000 UTC m=+3331.942990576" Jul 28 01:48:55.426683 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:55.426638 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:55.431878 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:55.431848 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:56.006716 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:56.006679 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:48:56.007690 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:48:56.007670 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:49:03.994777 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:03.994728 2568 patch_prober.go:28] interesting pod/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 28 01:49:03.995233 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:03.994810 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" podUID="43be63ac-7e41-400b-b43a-26b98fc0bccf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 28 01:49:06.073843 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:06.073807 2568 generic.go:356] "Generic (PLEG): container finished" podID="43be63ac-7e41-400b-b43a-26b98fc0bccf" containerID="8f34a83049326973cab670d88ae5adb035660c9f683e36681be55891931a304e" exitCode=0 Jul 28 01:49:06.074273 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:06.073884 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" event={"ID":"43be63ac-7e41-400b-b43a-26b98fc0bccf","Type":"ContainerDied","Data":"8f34a83049326973cab670d88ae5adb035660c9f683e36681be55891931a304e"} Jul 28 01:49:06.074341 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:06.074327 2568 scope.go:117] "RemoveContainer" containerID="8f34a83049326973cab670d88ae5adb035660c9f683e36681be55891931a304e" Jul 28 01:49:06.075426 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:06.075400 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:49:06.075491 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:06.075469 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:49:06.075532 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:06.075499 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:49:07.086087 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:07.086044 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" event={"ID":"43be63ac-7e41-400b-b43a-26b98fc0bccf","Type":"ContainerStarted","Data":"d100f4c4f4ae794bda7acb71856a058e72e053b615ff54a9aa7851cf0d7ae4fb"} Jul 28 01:49:08.031795 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:08.031743 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:49:08.032146 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:08.032123 2568 patch_prober.go:28] interesting pod/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Jul 28 01:49:08.032223 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:08.032180 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" podUID="43be63ac-7e41-400b-b43a-26b98fc0bccf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Jul 28 01:49:09.032066 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:09.032017 2568 patch_prober.go:28] interesting pod/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Jul 28 01:49:09.032532 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:09.032091 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" podUID="43be63ac-7e41-400b-b43a-26b98fc0bccf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Jul 28 01:49:10.032832 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:10.032784 2568 patch_prober.go:28] interesting pod/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Jul 28 01:49:10.033251 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:10.032854 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" podUID="43be63ac-7e41-400b-b43a-26b98fc0bccf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Jul 28 01:49:11.032189 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:11.032140 2568 patch_prober.go:28] interesting pod/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" start-of-body= Jul 28 01:49:11.032393 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:11.032206 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" podUID="43be63ac-7e41-400b-b43a-26b98fc0bccf" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.72:15021/healthz/ready\": dial tcp 10.132.0.72:15021: connect: connection refused" Jul 28 01:49:12.035813 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:12.035775 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:49:12.036305 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:12.036208 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:49:12.037122 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:12.037102 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:49:12.047738 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:12.047697 2568 patch_prober.go:28] interesting pod/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 28 01:49:12.047915 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:12.047767 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" podUID="933d67e4-3a04-4e21-a466-b8ad44034e15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 28 01:49:14.149249 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:14.149164 2568 generic.go:356] "Generic (PLEG): container finished" podID="933d67e4-3a04-4e21-a466-b8ad44034e15" containerID="8fe9452018acc68a2cefc257cb974dac6a6a7939662e4035261c36537281dc1c" exitCode=0 Jul 28 01:49:14.149702 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:14.149245 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" event={"ID":"933d67e4-3a04-4e21-a466-b8ad44034e15","Type":"ContainerDied","Data":"8fe9452018acc68a2cefc257cb974dac6a6a7939662e4035261c36537281dc1c"} Jul 28 01:49:14.149756 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:14.149714 2568 scope.go:117] "RemoveContainer" containerID="8fe9452018acc68a2cefc257cb974dac6a6a7939662e4035261c36537281dc1c" Jul 28 01:49:14.150842 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:14.150813 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:49:14.150931 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:14.150905 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:49:14.150971 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:14.150945 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:49:15.157886 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:15.157845 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" event={"ID":"933d67e4-3a04-4e21-a466-b8ad44034e15","Type":"ContainerStarted","Data":"6321bd49336f93d004420a2b9996d610c739c617e51ff3689c552265227725bc"} Jul 28 01:49:15.427091 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:15.426981 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:49:15.427260 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:15.427240 2568 patch_prober.go:28] interesting pod/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Jul 28 01:49:15.427306 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:15.427288 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" podUID="933d67e4-3a04-4e21-a466-b8ad44034e15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Jul 28 01:49:16.427877 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:16.427833 2568 patch_prober.go:28] interesting pod/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Jul 28 01:49:16.428296 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:16.427896 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" podUID="933d67e4-3a04-4e21-a466-b8ad44034e15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Jul 28 01:49:17.427350 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:17.427307 2568 patch_prober.go:28] interesting pod/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Jul 28 01:49:17.427522 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:17.427370 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" podUID="933d67e4-3a04-4e21-a466-b8ad44034e15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Jul 28 01:49:18.427426 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:18.427389 2568 patch_prober.go:28] interesting pod/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Jul 28 01:49:18.427851 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:18.427458 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" podUID="933d67e4-3a04-4e21-a466-b8ad44034e15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Jul 28 01:49:19.427672 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:19.427635 2568 patch_prober.go:28] interesting pod/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" start-of-body= Jul 28 01:49:19.428098 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:19.427712 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" podUID="933d67e4-3a04-4e21-a466-b8ad44034e15" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.73:15021/healthz/ready\": dial tcp 10.132.0.73:15021: connect: connection refused" Jul 28 01:49:20.431486 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:20.431451 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:49:20.432000 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:20.431695 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:49:20.433019 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:20.432997 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:49:35.866429 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:35.866382 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x"] Jul 28 01:49:35.867039 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:35.866643 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" podUID="43be63ac-7e41-400b-b43a-26b98fc0bccf" containerName="istio-proxy" containerID="cri-o://d100f4c4f4ae794bda7acb71856a058e72e053b615ff54a9aa7851cf0d7ae4fb" gracePeriod=30 Jul 28 01:49:41.122291 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.122262 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:49:41.198271 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.198193 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-podinfo\") pod \"43be63ac-7e41-400b-b43a-26b98fc0bccf\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " Jul 28 01:49:41.198271 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.198228 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-token\") pod \"43be63ac-7e41-400b-b43a-26b98fc0bccf\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " Jul 28 01:49:41.198271 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.198250 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43be63ac-7e41-400b-b43a-26b98fc0bccf-istiod-ca-cert\") pod \"43be63ac-7e41-400b-b43a-26b98fc0bccf\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " Jul 28 01:49:41.198271 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.198270 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-workload-certs\") pod \"43be63ac-7e41-400b-b43a-26b98fc0bccf\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " Jul 28 01:49:41.198667 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.198389 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-envoy\") pod \"43be63ac-7e41-400b-b43a-26b98fc0bccf\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " Jul 28 01:49:41.198667 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.198440 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-workload-socket\") pod \"43be63ac-7e41-400b-b43a-26b98fc0bccf\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " Jul 28 01:49:41.198667 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.198475 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-credential-socket\") pod \"43be63ac-7e41-400b-b43a-26b98fc0bccf\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " Jul 28 01:49:41.198667 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.198527 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nm2tt\" (UniqueName: \"kubernetes.io/projected/43be63ac-7e41-400b-b43a-26b98fc0bccf-kube-api-access-nm2tt\") pod \"43be63ac-7e41-400b-b43a-26b98fc0bccf\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " Jul 28 01:49:41.198667 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.198614 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-data\") pod \"43be63ac-7e41-400b-b43a-26b98fc0bccf\" (UID: \"43be63ac-7e41-400b-b43a-26b98fc0bccf\") " Jul 28 01:49:41.198667 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.198638 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "43be63ac-7e41-400b-b43a-26b98fc0bccf" (UID: "43be63ac-7e41-400b-b43a-26b98fc0bccf"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:49:41.198975 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.198786 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "43be63ac-7e41-400b-b43a-26b98fc0bccf" (UID: "43be63ac-7e41-400b-b43a-26b98fc0bccf"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:49:41.198975 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.198815 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/43be63ac-7e41-400b-b43a-26b98fc0bccf-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "43be63ac-7e41-400b-b43a-26b98fc0bccf" (UID: "43be63ac-7e41-400b-b43a-26b98fc0bccf"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:49:41.198975 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.198872 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "43be63ac-7e41-400b-b43a-26b98fc0bccf" (UID: "43be63ac-7e41-400b-b43a-26b98fc0bccf"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:49:41.199132 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.199035 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/43be63ac-7e41-400b-b43a-26b98fc0bccf-istiod-ca-cert\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:49:41.199132 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.199054 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-workload-certs\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:49:41.199132 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.199068 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-workload-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:49:41.199132 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.199082 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-credential-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:49:41.199870 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.199846 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-data" (OuterVolumeSpecName: "istio-data") pod "43be63ac-7e41-400b-b43a-26b98fc0bccf" (UID: "43be63ac-7e41-400b-b43a-26b98fc0bccf"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:49:41.200822 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.200795 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "43be63ac-7e41-400b-b43a-26b98fc0bccf" (UID: "43be63ac-7e41-400b-b43a-26b98fc0bccf"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:49:41.201002 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.200983 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43be63ac-7e41-400b-b43a-26b98fc0bccf-kube-api-access-nm2tt" (OuterVolumeSpecName: "kube-api-access-nm2tt") pod "43be63ac-7e41-400b-b43a-26b98fc0bccf" (UID: "43be63ac-7e41-400b-b43a-26b98fc0bccf"). InnerVolumeSpecName "kube-api-access-nm2tt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:49:41.201099 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.201083 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-token" (OuterVolumeSpecName: "istio-token") pod "43be63ac-7e41-400b-b43a-26b98fc0bccf" (UID: "43be63ac-7e41-400b-b43a-26b98fc0bccf"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:49:41.201143 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.201084 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "43be63ac-7e41-400b-b43a-26b98fc0bccf" (UID: "43be63ac-7e41-400b-b43a-26b98fc0bccf"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 28 01:49:41.300207 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.300165 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nm2tt\" (UniqueName: \"kubernetes.io/projected/43be63ac-7e41-400b-b43a-26b98fc0bccf-kube-api-access-nm2tt\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:49:41.300207 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.300198 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-data\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:49:41.300207 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.300211 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-podinfo\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:49:41.300514 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.300223 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-token\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:49:41.300514 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.300234 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/43be63ac-7e41-400b-b43a-26b98fc0bccf-istio-envoy\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:49:41.320910 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.320883 2568 generic.go:356] "Generic (PLEG): container finished" podID="43be63ac-7e41-400b-b43a-26b98fc0bccf" containerID="d100f4c4f4ae794bda7acb71856a058e72e053b615ff54a9aa7851cf0d7ae4fb" exitCode=0 Jul 28 01:49:41.321069 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.320940 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" Jul 28 01:49:41.321069 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.320973 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" event={"ID":"43be63ac-7e41-400b-b43a-26b98fc0bccf","Type":"ContainerDied","Data":"d100f4c4f4ae794bda7acb71856a058e72e053b615ff54a9aa7851cf0d7ae4fb"} Jul 28 01:49:41.321069 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.321033 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x" event={"ID":"43be63ac-7e41-400b-b43a-26b98fc0bccf","Type":"ContainerDied","Data":"fd06751652b3fbd7337a664ebc10413cea6b5ba28ba1aa951b0ac7d5c6618d95"} Jul 28 01:49:41.321069 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.321056 2568 scope.go:117] "RemoveContainer" containerID="d100f4c4f4ae794bda7acb71856a058e72e053b615ff54a9aa7851cf0d7ae4fb" Jul 28 01:49:41.331452 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.331437 2568 scope.go:117] "RemoveContainer" containerID="8f34a83049326973cab670d88ae5adb035660c9f683e36681be55891931a304e" Jul 28 01:49:41.340493 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.340476 2568 scope.go:117] "RemoveContainer" containerID="d100f4c4f4ae794bda7acb71856a058e72e053b615ff54a9aa7851cf0d7ae4fb" Jul 28 01:49:41.340753 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:49:41.340735 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d100f4c4f4ae794bda7acb71856a058e72e053b615ff54a9aa7851cf0d7ae4fb\": container with ID starting with d100f4c4f4ae794bda7acb71856a058e72e053b615ff54a9aa7851cf0d7ae4fb not found: ID does not exist" containerID="d100f4c4f4ae794bda7acb71856a058e72e053b615ff54a9aa7851cf0d7ae4fb" Jul 28 01:49:41.340814 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.340761 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d100f4c4f4ae794bda7acb71856a058e72e053b615ff54a9aa7851cf0d7ae4fb"} err="failed to get container status \"d100f4c4f4ae794bda7acb71856a058e72e053b615ff54a9aa7851cf0d7ae4fb\": rpc error: code = NotFound desc = could not find container \"d100f4c4f4ae794bda7acb71856a058e72e053b615ff54a9aa7851cf0d7ae4fb\": container with ID starting with d100f4c4f4ae794bda7acb71856a058e72e053b615ff54a9aa7851cf0d7ae4fb not found: ID does not exist" Jul 28 01:49:41.340814 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.340776 2568 scope.go:117] "RemoveContainer" containerID="8f34a83049326973cab670d88ae5adb035660c9f683e36681be55891931a304e" Jul 28 01:49:41.341016 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:49:41.340996 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8f34a83049326973cab670d88ae5adb035660c9f683e36681be55891931a304e\": container with ID starting with 8f34a83049326973cab670d88ae5adb035660c9f683e36681be55891931a304e not found: ID does not exist" containerID="8f34a83049326973cab670d88ae5adb035660c9f683e36681be55891931a304e" Jul 28 01:49:41.341071 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.341026 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8f34a83049326973cab670d88ae5adb035660c9f683e36681be55891931a304e"} err="failed to get container status \"8f34a83049326973cab670d88ae5adb035660c9f683e36681be55891931a304e\": rpc error: code = NotFound desc = could not find container \"8f34a83049326973cab670d88ae5adb035660c9f683e36681be55891931a304e\": container with ID starting with 8f34a83049326973cab670d88ae5adb035660c9f683e36681be55891931a304e not found: ID does not exist" Jul 28 01:49:41.344987 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.344967 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x"] Jul 28 01:49:41.349193 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.349171 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-64a682-openshift-default-576f78c5b6-7bb9x"] Jul 28 01:49:41.534159 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:49:41.534070 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="43be63ac-7e41-400b-b43a-26b98fc0bccf" path="/var/lib/kubelet/pods/43be63ac-7e41-400b-b43a-26b98fc0bccf/volumes" Jul 28 01:50:02.668860 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:02.668821 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp"] Jul 28 01:50:02.669385 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:02.669036 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" podUID="933d67e4-3a04-4e21-a466-b8ad44034e15" containerName="istio-proxy" containerID="cri-o://6321bd49336f93d004420a2b9996d610c739c617e51ff3689c552265227725bc" gracePeriod=30 Jul 28 01:50:03.642576 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.642517 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22"] Jul 28 01:50:03.643043 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.643023 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="327836be-3b72-4dec-b231-93bef90f0cee" containerName="istio-proxy" Jul 28 01:50:03.643043 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.643043 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="327836be-3b72-4dec-b231-93bef90f0cee" containerName="istio-proxy" Jul 28 01:50:03.643188 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.643058 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43be63ac-7e41-400b-b43a-26b98fc0bccf" containerName="istio-proxy" Jul 28 01:50:03.643188 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.643063 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="43be63ac-7e41-400b-b43a-26b98fc0bccf" containerName="istio-proxy" Jul 28 01:50:03.643188 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.643152 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="43be63ac-7e41-400b-b43a-26b98fc0bccf" containerName="istio-proxy" Jul 28 01:50:03.643188 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.643163 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="43be63ac-7e41-400b-b43a-26b98fc0bccf" containerName="istio-proxy" Jul 28 01:50:03.643188 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.643170 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="327836be-3b72-4dec-b231-93bef90f0cee" containerName="istio-proxy" Jul 28 01:50:03.648143 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.648118 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.651348 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.651321 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-73e2fd-openshift-default-dockercfg-5wlnj\"" Jul 28 01:50:03.662956 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.662919 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22"] Jul 28 01:50:03.729417 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.729355 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-envoy\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.729417 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.729415 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8218737-8b24-4bcf-a8fb-b544c5331e50-istiod-ca-cert\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.729965 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.729444 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-podinfo\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.729965 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.729524 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-token\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.729965 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.729596 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-b2v4l\" (UniqueName: \"kubernetes.io/projected/d8218737-8b24-4bcf-a8fb-b544c5331e50-kube-api-access-b2v4l\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.729965 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.729736 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-workload-certs\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.729965 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.729764 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-data\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.729965 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.729798 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-credential-socket\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.729965 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.729901 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-workload-socket\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.831390 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.831340 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-credential-socket\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.831622 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.831400 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-workload-socket\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.831622 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.831440 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-envoy\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.831622 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.831461 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8218737-8b24-4bcf-a8fb-b544c5331e50-istiod-ca-cert\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.831622 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.831492 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-podinfo\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.831622 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.831524 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-token\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.831622 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.831551 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-b2v4l\" (UniqueName: \"kubernetes.io/projected/d8218737-8b24-4bcf-a8fb-b544c5331e50-kube-api-access-b2v4l\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.832025 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.831714 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-workload-certs\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.832025 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.831740 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-data\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.832174 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.832148 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-workload-socket\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.832242 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.832167 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-workload-certs\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.832242 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.832199 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8218737-8b24-4bcf-a8fb-b544c5331e50-istiod-ca-cert\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.832359 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.832313 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-credential-socket\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.832359 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.832338 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-data\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.834153 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.834126 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-envoy\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.834518 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.834498 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-podinfo\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.848996 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.848956 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-token\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.850304 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.850280 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-b2v4l\" (UniqueName: \"kubernetes.io/projected/d8218737-8b24-4bcf-a8fb-b544c5331e50-kube-api-access-b2v4l\") pod \"e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:03.963281 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:03.963176 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:04.132045 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:04.132013 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22"] Jul 28 01:50:04.133373 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:50:04.133338 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd8218737_8b24_4bcf_a8fb_b544c5331e50.slice/crio-af052df6050a3092828c57c04cfe99670552b836bb0ea47a0700ac10c7d3c47b WatchSource:0}: Error finding container af052df6050a3092828c57c04cfe99670552b836bb0ea47a0700ac10c7d3c47b: Status 404 returned error can't find the container with id af052df6050a3092828c57c04cfe99670552b836bb0ea47a0700ac10c7d3c47b Jul 28 01:50:04.135550 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:04.135515 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:50:04.135640 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:04.135615 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:50:04.135681 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:04.135657 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:50:04.472019 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:04.471978 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" event={"ID":"d8218737-8b24-4bcf-a8fb-b544c5331e50","Type":"ContainerStarted","Data":"9dd4134dd594816c438d83373f674c219c0184965e44ffc817fb689ae6fced52"} Jul 28 01:50:04.472219 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:04.472043 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" event={"ID":"d8218737-8b24-4bcf-a8fb-b544c5331e50","Type":"ContainerStarted","Data":"af052df6050a3092828c57c04cfe99670552b836bb0ea47a0700ac10c7d3c47b"} Jul 28 01:50:04.495970 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:04.495901 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" podStartSLOduration=1.495885938 podStartE2EDuration="1.495885938s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:50:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:50:04.49462266 +0000 UTC m=+3401.414223344" watchObservedRunningTime="2026-07-28 01:50:04.495885938 +0000 UTC m=+3401.415486622" Jul 28 01:50:04.964159 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:04.964105 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:05.434433 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:05.434396 2568 patch_prober.go:28] interesting pod/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 28 01:50:05.434630 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:05.434458 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" podUID="933d67e4-3a04-4e21-a466-b8ad44034e15" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 28 01:50:05.969711 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:05.969674 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:06.485080 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:06.485047 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:06.486262 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:06.486241 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:07.934464 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.934394 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:50:07.972423 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.972375 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-z7kpr\" (UniqueName: \"kubernetes.io/projected/933d67e4-3a04-4e21-a466-b8ad44034e15-kube-api-access-z7kpr\") pod \"933d67e4-3a04-4e21-a466-b8ad44034e15\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " Jul 28 01:50:07.972643 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.972438 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-data\") pod \"933d67e4-3a04-4e21-a466-b8ad44034e15\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " Jul 28 01:50:07.972643 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.972471 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-envoy\") pod \"933d67e4-3a04-4e21-a466-b8ad44034e15\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " Jul 28 01:50:07.972643 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.972507 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-podinfo\") pod \"933d67e4-3a04-4e21-a466-b8ad44034e15\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " Jul 28 01:50:07.972643 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.972551 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-credential-socket\") pod \"933d67e4-3a04-4e21-a466-b8ad44034e15\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " Jul 28 01:50:07.972902 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.972865 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "933d67e4-3a04-4e21-a466-b8ad44034e15" (UID: "933d67e4-3a04-4e21-a466-b8ad44034e15"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:50:07.972993 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.972916 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-workload-socket\") pod \"933d67e4-3a04-4e21-a466-b8ad44034e15\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " Jul 28 01:50:07.972993 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.972956 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-token\") pod \"933d67e4-3a04-4e21-a466-b8ad44034e15\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " Jul 28 01:50:07.973108 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.973035 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-workload-certs\") pod \"933d67e4-3a04-4e21-a466-b8ad44034e15\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " Jul 28 01:50:07.973108 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.973089 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/933d67e4-3a04-4e21-a466-b8ad44034e15-istiod-ca-cert\") pod \"933d67e4-3a04-4e21-a466-b8ad44034e15\" (UID: \"933d67e4-3a04-4e21-a466-b8ad44034e15\") " Jul 28 01:50:07.973212 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.973187 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "933d67e4-3a04-4e21-a466-b8ad44034e15" (UID: "933d67e4-3a04-4e21-a466-b8ad44034e15"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:50:07.973671 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.973504 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-data" (OuterVolumeSpecName: "istio-data") pod "933d67e4-3a04-4e21-a466-b8ad44034e15" (UID: "933d67e4-3a04-4e21-a466-b8ad44034e15"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:50:07.973671 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.973579 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "933d67e4-3a04-4e21-a466-b8ad44034e15" (UID: "933d67e4-3a04-4e21-a466-b8ad44034e15"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:50:07.973671 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.973641 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/933d67e4-3a04-4e21-a466-b8ad44034e15-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "933d67e4-3a04-4e21-a466-b8ad44034e15" (UID: "933d67e4-3a04-4e21-a466-b8ad44034e15"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:50:07.973956 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.973929 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-credential-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:50:07.974065 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.973958 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-workload-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:50:07.974065 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.973973 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-workload-certs\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:50:07.974065 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.973987 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/933d67e4-3a04-4e21-a466-b8ad44034e15-istiod-ca-cert\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:50:07.974065 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.974000 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-data\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:50:07.975213 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.975180 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "933d67e4-3a04-4e21-a466-b8ad44034e15" (UID: "933d67e4-3a04-4e21-a466-b8ad44034e15"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 28 01:50:07.975353 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.975332 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-token" (OuterVolumeSpecName: "istio-token") pod "933d67e4-3a04-4e21-a466-b8ad44034e15" (UID: "933d67e4-3a04-4e21-a466-b8ad44034e15"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:50:07.975427 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.975408 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "933d67e4-3a04-4e21-a466-b8ad44034e15" (UID: "933d67e4-3a04-4e21-a466-b8ad44034e15"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:50:07.975670 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:07.975638 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/933d67e4-3a04-4e21-a466-b8ad44034e15-kube-api-access-z7kpr" (OuterVolumeSpecName: "kube-api-access-z7kpr") pod "933d67e4-3a04-4e21-a466-b8ad44034e15" (UID: "933d67e4-3a04-4e21-a466-b8ad44034e15"). InnerVolumeSpecName "kube-api-access-z7kpr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:50:08.075657 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:08.075620 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-z7kpr\" (UniqueName: \"kubernetes.io/projected/933d67e4-3a04-4e21-a466-b8ad44034e15-kube-api-access-z7kpr\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:50:08.075657 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:08.075650 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-envoy\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:50:08.075657 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:08.075659 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-podinfo\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:50:08.075657 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:08.075668 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/933d67e4-3a04-4e21-a466-b8ad44034e15-istio-token\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:50:08.498397 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:08.498357 2568 generic.go:356] "Generic (PLEG): container finished" podID="933d67e4-3a04-4e21-a466-b8ad44034e15" containerID="6321bd49336f93d004420a2b9996d610c739c617e51ff3689c552265227725bc" exitCode=0 Jul 28 01:50:08.498558 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:08.498412 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" Jul 28 01:50:08.498558 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:08.498434 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" event={"ID":"933d67e4-3a04-4e21-a466-b8ad44034e15","Type":"ContainerDied","Data":"6321bd49336f93d004420a2b9996d610c739c617e51ff3689c552265227725bc"} Jul 28 01:50:08.498558 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:08.498495 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp" event={"ID":"933d67e4-3a04-4e21-a466-b8ad44034e15","Type":"ContainerDied","Data":"1bfa5853ef7676cf1750f00dc32813b8300a03e8d9e88ef4ab30bdc1eba5e4e0"} Jul 28 01:50:08.498558 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:08.498523 2568 scope.go:117] "RemoveContainer" containerID="6321bd49336f93d004420a2b9996d610c739c617e51ff3689c552265227725bc" Jul 28 01:50:08.509134 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:08.509048 2568 scope.go:117] "RemoveContainer" containerID="8fe9452018acc68a2cefc257cb974dac6a6a7939662e4035261c36537281dc1c" Jul 28 01:50:08.519421 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:08.519397 2568 scope.go:117] "RemoveContainer" containerID="6321bd49336f93d004420a2b9996d610c739c617e51ff3689c552265227725bc" Jul 28 01:50:08.519780 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:50:08.519734 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6321bd49336f93d004420a2b9996d610c739c617e51ff3689c552265227725bc\": container with ID starting with 6321bd49336f93d004420a2b9996d610c739c617e51ff3689c552265227725bc not found: ID does not exist" containerID="6321bd49336f93d004420a2b9996d610c739c617e51ff3689c552265227725bc" Jul 28 01:50:08.519860 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:08.519790 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6321bd49336f93d004420a2b9996d610c739c617e51ff3689c552265227725bc"} err="failed to get container status \"6321bd49336f93d004420a2b9996d610c739c617e51ff3689c552265227725bc\": rpc error: code = NotFound desc = could not find container \"6321bd49336f93d004420a2b9996d610c739c617e51ff3689c552265227725bc\": container with ID starting with 6321bd49336f93d004420a2b9996d610c739c617e51ff3689c552265227725bc not found: ID does not exist" Jul 28 01:50:08.519860 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:08.519812 2568 scope.go:117] "RemoveContainer" containerID="8fe9452018acc68a2cefc257cb974dac6a6a7939662e4035261c36537281dc1c" Jul 28 01:50:08.520112 ip-10-0-132-44 kubenswrapper[2568]: E0728 01:50:08.520095 2568 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"8fe9452018acc68a2cefc257cb974dac6a6a7939662e4035261c36537281dc1c\": container with ID starting with 8fe9452018acc68a2cefc257cb974dac6a6a7939662e4035261c36537281dc1c not found: ID does not exist" containerID="8fe9452018acc68a2cefc257cb974dac6a6a7939662e4035261c36537281dc1c" Jul 28 01:50:08.520164 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:08.520115 2568 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"8fe9452018acc68a2cefc257cb974dac6a6a7939662e4035261c36537281dc1c"} err="failed to get container status \"8fe9452018acc68a2cefc257cb974dac6a6a7939662e4035261c36537281dc1c\": rpc error: code = NotFound desc = could not find container \"8fe9452018acc68a2cefc257cb974dac6a6a7939662e4035261c36537281dc1c\": container with ID starting with 8fe9452018acc68a2cefc257cb974dac6a6a7939662e4035261c36537281dc1c not found: ID does not exist" Jul 28 01:50:08.521827 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:08.521807 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp"] Jul 28 01:50:08.525366 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:08.525342 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-3940b7-openshift-default-5fdf77db64-jhphp"] Jul 28 01:50:09.533733 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:09.533696 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="933d67e4-3a04-4e21-a466-b8ad44034e15" path="/var/lib/kubelet/pods/933d67e4-3a04-4e21-a466-b8ad44034e15/volumes" Jul 28 01:50:11.483091 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.483054 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj"] Jul 28 01:50:11.483620 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.483586 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="933d67e4-3a04-4e21-a466-b8ad44034e15" containerName="istio-proxy" Jul 28 01:50:11.483620 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.483620 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="933d67e4-3a04-4e21-a466-b8ad44034e15" containerName="istio-proxy" Jul 28 01:50:11.483802 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.483641 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="933d67e4-3a04-4e21-a466-b8ad44034e15" containerName="istio-proxy" Jul 28 01:50:11.483802 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.483651 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="933d67e4-3a04-4e21-a466-b8ad44034e15" containerName="istio-proxy" Jul 28 01:50:11.483802 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.483677 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="43be63ac-7e41-400b-b43a-26b98fc0bccf" containerName="istio-proxy" Jul 28 01:50:11.483802 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.483685 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="43be63ac-7e41-400b-b43a-26b98fc0bccf" containerName="istio-proxy" Jul 28 01:50:11.484019 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.483828 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="933d67e4-3a04-4e21-a466-b8ad44034e15" containerName="istio-proxy" Jul 28 01:50:11.484019 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.483839 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="933d67e4-3a04-4e21-a466-b8ad44034e15" containerName="istio-proxy" Jul 28 01:50:11.488480 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.488458 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.491185 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.491166 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-7d2c59-openshift-default-dockercfg-64d6v\"" Jul 28 01:50:11.499446 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.499419 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj"] Jul 28 01:50:11.610834 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.610798 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wkd2s\" (UniqueName: \"kubernetes.io/projected/d9b9469e-53b9-423c-85f3-9e5322dd2dea-kube-api-access-wkd2s\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.610834 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.610841 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-credential-socket\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.611112 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.610912 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-workload-certs\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.611112 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.610981 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istiod-ca-cert\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.611112 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.611007 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-token\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.611112 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.611072 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-workload-socket\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.611325 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.611167 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-envoy\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.611325 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.611231 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-data\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.611325 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.611259 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-podinfo\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.712613 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.712547 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-workload-certs\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.712869 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.712627 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istiod-ca-cert\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.712869 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.712662 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-token\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.712869 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.712716 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-workload-socket\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.712869 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.712813 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-envoy\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.713101 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.712924 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-data\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.713101 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.712959 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-podinfo\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.713101 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.713001 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wkd2s\" (UniqueName: \"kubernetes.io/projected/d9b9469e-53b9-423c-85f3-9e5322dd2dea-kube-api-access-wkd2s\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.713101 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.713037 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-credential-socket\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.713101 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.713059 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-workload-certs\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.713101 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.713074 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-workload-socket\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.713427 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.713287 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-data\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.713586 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.713547 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istiod-ca-cert\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.713674 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.713612 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-credential-socket\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.715312 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.715291 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-envoy\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.715764 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.715745 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-podinfo\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.722186 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.722158 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-token\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.722288 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.722246 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wkd2s\" (UniqueName: \"kubernetes.io/projected/d9b9469e-53b9-423c-85f3-9e5322dd2dea-kube-api-access-wkd2s\") pod \"e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.800092 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.800005 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:11.972631 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.972592 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj"] Jul 28 01:50:11.974840 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:50:11.974798 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd9b9469e_53b9_423c_85f3_9e5322dd2dea.slice/crio-6fe5b971c82ee4bff3d5cc3fb1b19ae66d3b5ff8e4cc592fd81da4df28195ec2 WatchSource:0}: Error finding container 6fe5b971c82ee4bff3d5cc3fb1b19ae66d3b5ff8e4cc592fd81da4df28195ec2: Status 404 returned error can't find the container with id 6fe5b971c82ee4bff3d5cc3fb1b19ae66d3b5ff8e4cc592fd81da4df28195ec2 Jul 28 01:50:11.977619 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.977538 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:50:11.977761 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.977671 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:50:11.977761 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:11.977720 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:50:12.525017 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:12.524981 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" event={"ID":"d9b9469e-53b9-423c-85f3-9e5322dd2dea","Type":"ContainerStarted","Data":"2502a37797a99242ecccbde173e39e651ac45ca8e8d867b99d23ca79990a686c"} Jul 28 01:50:12.525438 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:12.525041 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" event={"ID":"d9b9469e-53b9-423c-85f3-9e5322dd2dea","Type":"ContainerStarted","Data":"6fe5b971c82ee4bff3d5cc3fb1b19ae66d3b5ff8e4cc592fd81da4df28195ec2"} Jul 28 01:50:12.548768 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:12.548692 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" podStartSLOduration=1.548665647 podStartE2EDuration="1.548665647s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-28 01:50:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:50:12.544226418 +0000 UTC m=+3409.463827103" watchObservedRunningTime="2026-07-28 01:50:12.548665647 +0000 UTC m=+3409.468266347" Jul 28 01:50:12.800723 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:12.800531 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:13.807452 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:13.807415 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:14.540647 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:14.540610 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:14.541852 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:14.541825 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:20.582083 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:20.582048 2568 generic.go:356] "Generic (PLEG): container finished" podID="d8218737-8b24-4bcf-a8fb-b544c5331e50" containerID="9dd4134dd594816c438d83373f674c219c0184965e44ffc817fb689ae6fced52" exitCode=0 Jul 28 01:50:20.582535 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:20.582124 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" event={"ID":"d8218737-8b24-4bcf-a8fb-b544c5331e50","Type":"ContainerDied","Data":"9dd4134dd594816c438d83373f674c219c0184965e44ffc817fb689ae6fced52"} Jul 28 01:50:20.582628 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:20.582548 2568 scope.go:117] "RemoveContainer" containerID="9dd4134dd594816c438d83373f674c219c0184965e44ffc817fb689ae6fced52" Jul 28 01:50:20.583712 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:20.583687 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:50:20.583781 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:20.583753 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:50:20.583818 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:20.583788 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:50:21.485325 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:21.485276 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:21.594798 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:21.594753 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" event={"ID":"d8218737-8b24-4bcf-a8fb-b544c5331e50","Type":"ContainerStarted","Data":"b7c1dd7a0496a228c7482fa933a5a1f6c55d0e0c9fae5b65da19d9d39f6dfb7c"} Jul 28 01:50:21.963361 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:21.963311 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:21.964869 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:21.964834 2568 patch_prober.go:28] interesting pod/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Jul 28 01:50:21.965011 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:21.964908 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" podUID="d8218737-8b24-4bcf-a8fb-b544c5331e50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Jul 28 01:50:22.964454 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:22.964414 2568 patch_prober.go:28] interesting pod/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Jul 28 01:50:22.964897 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:22.964483 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" podUID="d8218737-8b24-4bcf-a8fb-b544c5331e50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Jul 28 01:50:23.964202 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:23.964160 2568 patch_prober.go:28] interesting pod/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Jul 28 01:50:23.964422 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:23.964218 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" podUID="d8218737-8b24-4bcf-a8fb-b544c5331e50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Jul 28 01:50:24.963648 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:24.963596 2568 patch_prober.go:28] interesting pod/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" start-of-body= Jul 28 01:50:24.964063 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:24.963672 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" podUID="d8218737-8b24-4bcf-a8fb-b544c5331e50" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.74:15021/healthz/ready\": dial tcp 10.132.0.74:15021: connect: connection refused" Jul 28 01:50:25.967748 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:25.967708 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:25.968176 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:25.967988 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:25.968809 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:25.968789 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:50:29.542039 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:29.541994 2568 patch_prober.go:28] interesting pod/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Jul 28 01:50:29.542505 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:29.542051 2568 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" podUID="d9b9469e-53b9-423c-85f3-9e5322dd2dea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Jul 28 01:50:29.657959 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:29.657924 2568 generic.go:356] "Generic (PLEG): container finished" podID="d9b9469e-53b9-423c-85f3-9e5322dd2dea" containerID="2502a37797a99242ecccbde173e39e651ac45ca8e8d867b99d23ca79990a686c" exitCode=0 Jul 28 01:50:29.658135 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:29.658002 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" event={"ID":"d9b9469e-53b9-423c-85f3-9e5322dd2dea","Type":"ContainerDied","Data":"2502a37797a99242ecccbde173e39e651ac45ca8e8d867b99d23ca79990a686c"} Jul 28 01:50:29.658438 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:29.658423 2568 scope.go:117] "RemoveContainer" containerID="2502a37797a99242ecccbde173e39e651ac45ca8e8d867b99d23ca79990a686c" Jul 28 01:50:29.659522 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:29.659496 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:50:29.659658 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:29.659603 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:50:29.659658 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:29.659652 2568 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"30892156Ki","pods":"250"} Jul 28 01:50:30.665911 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:30.665878 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" event={"ID":"d9b9469e-53b9-423c-85f3-9e5322dd2dea","Type":"ContainerStarted","Data":"4e66eab497405a2ada90bbcece4191e9b04bd205afe9667360ea73a93679edaf"} Jul 28 01:50:30.801226 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:30.801165 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:30.801524 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:30.801481 2568 patch_prober.go:28] interesting pod/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Jul 28 01:50:30.801668 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:30.801559 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" podUID="d9b9469e-53b9-423c-85f3-9e5322dd2dea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Jul 28 01:50:31.800875 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:31.800825 2568 patch_prober.go:28] interesting pod/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Jul 28 01:50:31.801389 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:31.800901 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" podUID="d9b9469e-53b9-423c-85f3-9e5322dd2dea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Jul 28 01:50:32.803489 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:32.803013 2568 patch_prober.go:28] interesting pod/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Jul 28 01:50:32.803489 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:32.803096 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" podUID="d9b9469e-53b9-423c-85f3-9e5322dd2dea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Jul 28 01:50:33.801386 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:33.801339 2568 patch_prober.go:28] interesting pod/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" start-of-body= Jul 28 01:50:33.801624 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:33.801411 2568 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" podUID="d9b9469e-53b9-423c-85f3-9e5322dd2dea" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.132.0.75:15021/healthz/ready\": dial tcp 10.132.0.75:15021: connect: connection refused" Jul 28 01:50:34.806099 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:34.806068 2568 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:34.806530 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:34.806477 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:50:34.807087 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:50:34.807070 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:53:23.909897 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:53:23.909866 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:53:23.918907 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:53:23.918882 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:57:04.871185 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:04.871139 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22"] Jul 28 01:57:04.871784 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:04.871400 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" podUID="d8218737-8b24-4bcf-a8fb-b544c5331e50" containerName="istio-proxy" containerID="cri-o://b7c1dd7a0496a228c7482fa933a5a1f6c55d0e0c9fae5b65da19d9d39f6dfb7c" gracePeriod=30 Jul 28 01:57:10.029336 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.029304 2568 generic.go:356] "Generic (PLEG): container finished" podID="d8218737-8b24-4bcf-a8fb-b544c5331e50" containerID="b7c1dd7a0496a228c7482fa933a5a1f6c55d0e0c9fae5b65da19d9d39f6dfb7c" exitCode=0 Jul 28 01:57:10.029845 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.029356 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" event={"ID":"d8218737-8b24-4bcf-a8fb-b544c5331e50","Type":"ContainerDied","Data":"b7c1dd7a0496a228c7482fa933a5a1f6c55d0e0c9fae5b65da19d9d39f6dfb7c"} Jul 28 01:57:10.029845 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.029409 2568 scope.go:117] "RemoveContainer" containerID="9dd4134dd594816c438d83373f674c219c0184965e44ffc817fb689ae6fced52" Jul 28 01:57:10.132273 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.132242 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:57:10.217932 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.217841 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-b2v4l\" (UniqueName: \"kubernetes.io/projected/d8218737-8b24-4bcf-a8fb-b544c5331e50-kube-api-access-b2v4l\") pod \"d8218737-8b24-4bcf-a8fb-b544c5331e50\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " Jul 28 01:57:10.217932 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.217875 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-workload-certs\") pod \"d8218737-8b24-4bcf-a8fb-b544c5331e50\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " Jul 28 01:57:10.217932 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.217909 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-podinfo\") pod \"d8218737-8b24-4bcf-a8fb-b544c5331e50\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " Jul 28 01:57:10.217932 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.217933 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-envoy\") pod \"d8218737-8b24-4bcf-a8fb-b544c5331e50\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " Jul 28 01:57:10.218336 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.217979 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-workload-socket\") pod \"d8218737-8b24-4bcf-a8fb-b544c5331e50\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " Jul 28 01:57:10.218336 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.218026 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-credential-socket\") pod \"d8218737-8b24-4bcf-a8fb-b544c5331e50\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " Jul 28 01:57:10.218336 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.218102 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-token\") pod \"d8218737-8b24-4bcf-a8fb-b544c5331e50\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " Jul 28 01:57:10.218336 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.218139 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8218737-8b24-4bcf-a8fb-b544c5331e50-istiod-ca-cert\") pod \"d8218737-8b24-4bcf-a8fb-b544c5331e50\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " Jul 28 01:57:10.218336 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.218174 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-data\") pod \"d8218737-8b24-4bcf-a8fb-b544c5331e50\" (UID: \"d8218737-8b24-4bcf-a8fb-b544c5331e50\") " Jul 28 01:57:10.218336 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.218237 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d8218737-8b24-4bcf-a8fb-b544c5331e50" (UID: "d8218737-8b24-4bcf-a8fb-b544c5331e50"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:57:10.218689 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.218334 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d8218737-8b24-4bcf-a8fb-b544c5331e50" (UID: "d8218737-8b24-4bcf-a8fb-b544c5331e50"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:57:10.218689 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.218580 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-workload-certs\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:57:10.218689 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.218605 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-workload-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:57:10.218689 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.218625 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d8218737-8b24-4bcf-a8fb-b544c5331e50-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d8218737-8b24-4bcf-a8fb-b544c5331e50" (UID: "d8218737-8b24-4bcf-a8fb-b544c5331e50"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:57:10.218885 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.218636 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d8218737-8b24-4bcf-a8fb-b544c5331e50" (UID: "d8218737-8b24-4bcf-a8fb-b544c5331e50"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:57:10.220250 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.219666 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-data" (OuterVolumeSpecName: "istio-data") pod "d8218737-8b24-4bcf-a8fb-b544c5331e50" (UID: "d8218737-8b24-4bcf-a8fb-b544c5331e50"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:57:10.220815 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.220790 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d8218737-8b24-4bcf-a8fb-b544c5331e50" (UID: "d8218737-8b24-4bcf-a8fb-b544c5331e50"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:57:10.228401 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.228361 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d8218737-8b24-4bcf-a8fb-b544c5331e50" (UID: "d8218737-8b24-4bcf-a8fb-b544c5331e50"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 28 01:57:10.228536 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.228446 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8218737-8b24-4bcf-a8fb-b544c5331e50-kube-api-access-b2v4l" (OuterVolumeSpecName: "kube-api-access-b2v4l") pod "d8218737-8b24-4bcf-a8fb-b544c5331e50" (UID: "d8218737-8b24-4bcf-a8fb-b544c5331e50"). InnerVolumeSpecName "kube-api-access-b2v4l". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:57:10.228536 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.228474 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-token" (OuterVolumeSpecName: "istio-token") pod "d8218737-8b24-4bcf-a8fb-b544c5331e50" (UID: "d8218737-8b24-4bcf-a8fb-b544c5331e50"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:57:10.319508 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.319460 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-credential-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:57:10.319508 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.319501 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-token\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:57:10.319508 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.319513 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d8218737-8b24-4bcf-a8fb-b544c5331e50-istiod-ca-cert\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:57:10.319508 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.319522 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-data\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:57:10.319827 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.319551 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-b2v4l\" (UniqueName: \"kubernetes.io/projected/d8218737-8b24-4bcf-a8fb-b544c5331e50-kube-api-access-b2v4l\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:57:10.319827 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.319560 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-podinfo\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:57:10.319827 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:10.319593 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d8218737-8b24-4bcf-a8fb-b544c5331e50-istio-envoy\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:57:11.036037 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:11.035997 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" event={"ID":"d8218737-8b24-4bcf-a8fb-b544c5331e50","Type":"ContainerDied","Data":"af052df6050a3092828c57c04cfe99670552b836bb0ea47a0700ac10c7d3c47b"} Jul 28 01:57:11.036541 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:11.036056 2568 scope.go:117] "RemoveContainer" containerID="b7c1dd7a0496a228c7482fa933a5a1f6c55d0e0c9fae5b65da19d9d39f6dfb7c" Jul 28 01:57:11.036541 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:11.036010 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22" Jul 28 01:57:11.059548 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:11.059516 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22"] Jul 28 01:57:11.063370 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:11.063345 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-73e2fd-openshift-default-d6f49dbb8-p2v22"] Jul 28 01:57:11.534330 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:11.534294 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d8218737-8b24-4bcf-a8fb-b544c5331e50" path="/var/lib/kubelet/pods/d8218737-8b24-4bcf-a8fb-b544c5331e50/volumes" Jul 28 01:57:27.010520 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:27.010486 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj"] Jul 28 01:57:27.010988 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:27.010740 2568 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" podUID="d9b9469e-53b9-423c-85f3-9e5322dd2dea" containerName="istio-proxy" containerID="cri-o://4e66eab497405a2ada90bbcece4191e9b04bd205afe9667360ea73a93679edaf" gracePeriod=30 Jul 28 01:57:27.681792 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:27.681753 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7fbc9889c4-8946w_289dba42-a059-4482-a53e-208b74e3c08a/authorino/0.log" Jul 28 01:57:32.160314 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.160277 2568 generic.go:356] "Generic (PLEG): container finished" podID="d9b9469e-53b9-423c-85f3-9e5322dd2dea" containerID="4e66eab497405a2ada90bbcece4191e9b04bd205afe9667360ea73a93679edaf" exitCode=0 Jul 28 01:57:32.160851 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.160347 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" event={"ID":"d9b9469e-53b9-423c-85f3-9e5322dd2dea","Type":"ContainerDied","Data":"4e66eab497405a2ada90bbcece4191e9b04bd205afe9667360ea73a93679edaf"} Jul 28 01:57:32.160851 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.160411 2568 scope.go:117] "RemoveContainer" containerID="2502a37797a99242ecccbde173e39e651ac45ca8e8d867b99d23ca79990a686c" Jul 28 01:57:32.285528 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.285454 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:57:32.440447 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.440413 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-data\") pod \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " Jul 28 01:57:32.440700 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.440476 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istiod-ca-cert\") pod \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " Jul 28 01:57:32.440700 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.440505 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-wkd2s\" (UniqueName: \"kubernetes.io/projected/d9b9469e-53b9-423c-85f3-9e5322dd2dea-kube-api-access-wkd2s\") pod \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " Jul 28 01:57:32.440700 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.440540 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-envoy\") pod \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " Jul 28 01:57:32.440700 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.440610 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-credential-socket\") pod \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " Jul 28 01:57:32.440700 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.440661 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-token\") pod \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " Jul 28 01:57:32.440981 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.440717 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-workload-socket\") pod \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " Jul 28 01:57:32.440981 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.440748 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-workload-certs\") pod \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " Jul 28 01:57:32.440981 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.440774 2568 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-podinfo\") pod \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\" (UID: \"d9b9469e-53b9-423c-85f3-9e5322dd2dea\") " Jul 28 01:57:32.441126 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.441074 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d9b9469e-53b9-423c-85f3-9e5322dd2dea" (UID: "d9b9469e-53b9-423c-85f3-9e5322dd2dea"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 28 01:57:32.441189 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.441125 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d9b9469e-53b9-423c-85f3-9e5322dd2dea" (UID: "d9b9469e-53b9-423c-85f3-9e5322dd2dea"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:57:32.441189 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.441139 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d9b9469e-53b9-423c-85f3-9e5322dd2dea" (UID: "d9b9469e-53b9-423c-85f3-9e5322dd2dea"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:57:32.441321 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.441296 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d9b9469e-53b9-423c-85f3-9e5322dd2dea" (UID: "d9b9469e-53b9-423c-85f3-9e5322dd2dea"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:57:32.441474 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.441426 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-data" (OuterVolumeSpecName: "istio-data") pod "d9b9469e-53b9-423c-85f3-9e5322dd2dea" (UID: "d9b9469e-53b9-423c-85f3-9e5322dd2dea"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:57:32.443021 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.442991 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d9b9469e-53b9-423c-85f3-9e5322dd2dea" (UID: "d9b9469e-53b9-423c-85f3-9e5322dd2dea"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 28 01:57:32.443124 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.443047 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9b9469e-53b9-423c-85f3-9e5322dd2dea-kube-api-access-wkd2s" (OuterVolumeSpecName: "kube-api-access-wkd2s") pod "d9b9469e-53b9-423c-85f3-9e5322dd2dea" (UID: "d9b9469e-53b9-423c-85f3-9e5322dd2dea"). InnerVolumeSpecName "kube-api-access-wkd2s". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:57:32.443170 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.443129 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-token" (OuterVolumeSpecName: "istio-token") pod "d9b9469e-53b9-423c-85f3-9e5322dd2dea" (UID: "d9b9469e-53b9-423c-85f3-9e5322dd2dea"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 28 01:57:32.443211 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.443169 2568 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d9b9469e-53b9-423c-85f3-9e5322dd2dea" (UID: "d9b9469e-53b9-423c-85f3-9e5322dd2dea"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 28 01:57:32.542529 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.542439 2568 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-workload-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:57:32.542529 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.542470 2568 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-workload-certs\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:57:32.542529 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.542479 2568 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-podinfo\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:57:32.542529 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.542488 2568 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-data\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:57:32.542529 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.542496 2568 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istiod-ca-cert\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:57:32.542529 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.542504 2568 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-wkd2s\" (UniqueName: \"kubernetes.io/projected/d9b9469e-53b9-423c-85f3-9e5322dd2dea-kube-api-access-wkd2s\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:57:32.542529 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.542513 2568 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-envoy\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:57:32.542529 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.542523 2568 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d9b9469e-53b9-423c-85f3-9e5322dd2dea-credential-socket\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:57:32.542529 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:32.542531 2568 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d9b9469e-53b9-423c-85f3-9e5322dd2dea-istio-token\") on node \"ip-10-0-132-44.ec2.internal\" DevicePath \"\"" Jul 28 01:57:33.060404 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:33.060374 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-smgdt_71086811-684d-487b-bf40-c0c1b0f89447/manager/0.log" Jul 28 01:57:33.167171 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:33.167132 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" event={"ID":"d9b9469e-53b9-423c-85f3-9e5322dd2dea","Type":"ContainerDied","Data":"6fe5b971c82ee4bff3d5cc3fb1b19ae66d3b5ff8e4cc592fd81da4df28195ec2"} Jul 28 01:57:33.167681 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:33.167200 2568 scope.go:117] "RemoveContainer" containerID="4e66eab497405a2ada90bbcece4191e9b04bd205afe9667360ea73a93679edaf" Jul 28 01:57:33.167681 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:33.167151 2568 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj" Jul 28 01:57:33.181495 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:33.181474 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-85cd6fdbf4-x8947_9fd33551-d6d5-4a2c-a991-5c9ec797584a/manager/0.log" Jul 28 01:57:33.200723 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:33.200687 2568 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj"] Jul 28 01:57:33.208407 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:33.208374 2568 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-7d2c59-openshift-default-7bddc46c7b-6mtxj"] Jul 28 01:57:33.297920 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:33.297890 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-c7b2p_de75647f-1495-4cea-92e0-756b660541db/server/0.log" Jul 28 01:57:33.534671 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:33.534634 2568 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d9b9469e-53b9-423c-85f3-9e5322dd2dea" path="/var/lib/kubelet/pods/d9b9469e-53b9-423c-85f3-9e5322dd2dea/volumes" Jul 28 01:57:33.544319 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:33.544292 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6549c9954f-4q5q4_705070e0-bce3-4b32-86c9-e4e3b1cb04ac/copy-manifests/0.log" Jul 28 01:57:33.551888 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:33.551860 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6549c9954f-4q5q4_705070e0-bce3-4b32-86c9-e4e3b1cb04ac/manager/0.log" Jul 28 01:57:34.144996 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:34.144959 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-7d5cfb7454-scrl8_a01c95ad-2b64-4a22-98ab-513e485b3231/maas-api/0.log" Jul 28 01:57:34.581278 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:34.581199 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_postgres-69fb4594cf-nr87l_9de47ce0-1be0-47a4-9971-89bfa395d37c/postgres/0.log" Jul 28 01:57:35.354777 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:35.354754 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9_911faba6-b46e-4116-b600-9745dcdb22c0/util/0.log" Jul 28 01:57:35.361943 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:35.361914 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9_911faba6-b46e-4116-b600-9745dcdb22c0/pull/0.log" Jul 28 01:57:35.368536 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:35.368518 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9_911faba6-b46e-4116-b600-9745dcdb22c0/extract/0.log" Jul 28 01:57:35.482800 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:35.482770 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj_ef340466-7fcb-42f4-b75a-0a9d763afffd/util/0.log" Jul 28 01:57:35.489237 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:35.489216 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj_ef340466-7fcb-42f4-b75a-0a9d763afffd/pull/0.log" Jul 28 01:57:35.497092 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:35.497070 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj_ef340466-7fcb-42f4-b75a-0a9d763afffd/extract/0.log" Jul 28 01:57:35.605252 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:35.605176 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz_fbc5d13d-5d8a-46ff-9fc2-e92a3d721725/util/0.log" Jul 28 01:57:35.612971 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:35.612946 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz_fbc5d13d-5d8a-46ff-9fc2-e92a3d721725/pull/0.log" Jul 28 01:57:35.623319 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:35.623295 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz_fbc5d13d-5d8a-46ff-9fc2-e92a3d721725/extract/0.log" Jul 28 01:57:35.736409 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:35.736381 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd_805a0698-5ad7-44f4-b9e6-660bf1cd4621/util/0.log" Jul 28 01:57:35.743676 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:35.743651 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd_805a0698-5ad7-44f4-b9e6-660bf1cd4621/pull/0.log" Jul 28 01:57:35.750630 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:35.750607 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd_805a0698-5ad7-44f4-b9e6-660bf1cd4621/extract/0.log" Jul 28 01:57:35.864594 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:35.864495 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7fbc9889c4-8946w_289dba42-a059-4482-a53e-208b74e3c08a/authorino/0.log" Jul 28 01:57:36.317017 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:36.316934 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lw5hf_01396ba2-7de9-41a0-b7a4-0c3351d11cdf/registry-server/0.log" Jul 28 01:57:36.991653 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:36.991621 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc_5ecc800e-53fa-4447-8c4f-2ddf23667ada/istio-proxy/0.log" Jul 28 01:57:37.435575 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:37.435527 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-8fg5c_e79a768c-19f5-4af5-b7da-349c2cd665e9/istio-proxy/1.log" Jul 28 01:57:37.549325 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:37.549295 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-fss7v_226f476f-1ab3-48b1-b03c-dcc7dc7eca46/payload-pre-processing/0.log" Jul 28 01:57:37.659647 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:37.659615 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8gzgx_30729cb8-3e4d-4c41-b1e6-3062595cc6b9/payload-processing/0.log" Jul 28 01:57:37.772505 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:37.772421 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b886669c7-2wtgq_49fe97ad-3adc-4b96-a594-b0b505a0cffe/router/0.log" Jul 28 01:57:38.235881 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:38.235847 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-szkkw_70f6d4d9-f0d2-4c7d-90c5-d03210e39b56/main/0.log" Jul 28 01:57:38.348732 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:38.348699 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-x2jgs_bb30540d-864a-4e4e-bf5a-df6eb42fcd14/main/0.log" Jul 28 01:57:38.460158 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:38.460126 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-unconfigured-facebook-opt-125m-simulated-kserve-85b68frtckk_dd4e660f-a20f-4262-a278-a4f236dc7a02/main/0.log" Jul 28 01:57:46.572341 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:46.572265 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-9mbj7_0b32935c-be84-4ae4-bc60-0e462f6c89f6/global-pull-secret-syncer/0.log" Jul 28 01:57:46.764009 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:46.763976 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-5rpd2_2408ba36-e5e9-465c-8434-b17d73f6febb/konnectivity-agent/0.log" Jul 28 01:57:46.870902 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:46.870871 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-132-44.ec2.internal_7ee893b47080271f4b0fa8967f643209/haproxy/0.log" Jul 28 01:57:51.726964 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:51.726930 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9_911faba6-b46e-4116-b600-9745dcdb22c0/extract/0.log" Jul 28 01:57:51.755964 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:51.755936 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9_911faba6-b46e-4116-b600-9745dcdb22c0/util/0.log" Jul 28 01:57:51.779468 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:51.779434 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759sldr9_911faba6-b46e-4116-b600-9745dcdb22c0/pull/0.log" Jul 28 01:57:51.815332 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:51.815301 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj_ef340466-7fcb-42f4-b75a-0a9d763afffd/extract/0.log" Jul 28 01:57:51.843317 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:51.843281 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj_ef340466-7fcb-42f4-b75a-0a9d763afffd/util/0.log" Jul 28 01:57:51.866679 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:51.866651 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0sx4jj_ef340466-7fcb-42f4-b75a-0a9d763afffd/pull/0.log" Jul 28 01:57:51.897599 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:51.897556 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz_fbc5d13d-5d8a-46ff-9fc2-e92a3d721725/extract/0.log" Jul 28 01:57:51.921484 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:51.921455 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz_fbc5d13d-5d8a-46ff-9fc2-e92a3d721725/util/0.log" Jul 28 01:57:51.945621 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:51.945584 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73b7sfz_fbc5d13d-5d8a-46ff-9fc2-e92a3d721725/pull/0.log" Jul 28 01:57:51.974849 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:51.974819 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd_805a0698-5ad7-44f4-b9e6-660bf1cd4621/extract/0.log" Jul 28 01:57:52.001191 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:52.001111 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd_805a0698-5ad7-44f4-b9e6-660bf1cd4621/util/0.log" Jul 28 01:57:52.024978 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:52.024945 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1969cd_805a0698-5ad7-44f4-b9e6-660bf1cd4621/pull/0.log" Jul 28 01:57:52.367891 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:52.367858 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-7fbc9889c4-8946w_289dba42-a059-4482-a53e-208b74e3c08a/authorino/0.log" Jul 28 01:57:52.532987 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:52.532944 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-catalog-lw5hf_01396ba2-7de9-41a0-b7a4-0c3351d11cdf/registry-server/0.log" Jul 28 01:57:54.757810 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:54.757721 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_cluster-monitoring-operator-548b489cb8-2g4mg_a2f4fe8c-ef6c-459b-9e82-dbd224d85599/cluster-monitoring-operator/0.log" Jul 28 01:57:54.933686 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:54.933654 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8995r_ca500ac3-3b6a-4571-a4f0-463d4e13ff5e/node-exporter/0.log" Jul 28 01:57:54.965553 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:54.965522 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8995r_ca500ac3-3b6a-4571-a4f0-463d4e13ff5e/kube-rbac-proxy/0.log" Jul 28 01:57:54.990438 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:54.990411 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-8995r_ca500ac3-3b6a-4571-a4f0-463d4e13ff5e/init-textfile/0.log" Jul 28 01:57:56.821174 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.821139 2568 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd"] Jul 28 01:57:56.821624 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.821580 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8218737-8b24-4bcf-a8fb-b544c5331e50" containerName="istio-proxy" Jul 28 01:57:56.821624 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.821593 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8218737-8b24-4bcf-a8fb-b544c5331e50" containerName="istio-proxy" Jul 28 01:57:56.821624 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.821607 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9b9469e-53b9-423c-85f3-9e5322dd2dea" containerName="istio-proxy" Jul 28 01:57:56.821624 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.821613 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9b9469e-53b9-423c-85f3-9e5322dd2dea" containerName="istio-proxy" Jul 28 01:57:56.821624 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.821620 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d8218737-8b24-4bcf-a8fb-b544c5331e50" containerName="istio-proxy" Jul 28 01:57:56.821624 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.821625 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d8218737-8b24-4bcf-a8fb-b544c5331e50" containerName="istio-proxy" Jul 28 01:57:56.821896 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.821632 2568 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d9b9469e-53b9-423c-85f3-9e5322dd2dea" containerName="istio-proxy" Jul 28 01:57:56.821896 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.821637 2568 state_mem.go:107] "Deleted CPUSet assignment" podUID="d9b9469e-53b9-423c-85f3-9e5322dd2dea" containerName="istio-proxy" Jul 28 01:57:56.821896 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.821699 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d8218737-8b24-4bcf-a8fb-b544c5331e50" containerName="istio-proxy" Jul 28 01:57:56.821896 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.821709 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9b9469e-53b9-423c-85f3-9e5322dd2dea" containerName="istio-proxy" Jul 28 01:57:56.821896 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.821715 2568 memory_manager.go:368] "RemoveStaleState removing state" podUID="d9b9469e-53b9-423c-85f3-9e5322dd2dea" containerName="istio-proxy" Jul 28 01:57:56.823994 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.823976 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd" Jul 28 01:57:56.826396 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.826373 2568 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-hgbjn\"/\"default-dockercfg-vscst\"" Jul 28 01:57:56.826396 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.826393 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hgbjn\"/\"openshift-service-ca.crt\"" Jul 28 01:57:56.827205 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.827185 2568 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-hgbjn\"/\"kube-root-ca.crt\"" Jul 28 01:57:56.834113 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.834081 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd"] Jul 28 01:57:56.845509 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.845475 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f631a986-542b-470c-a2e4-192058e9f6f6-sys\") pod \"perf-node-gather-daemonset-w5dkd\" (UID: \"f631a986-542b-470c-a2e4-192058e9f6f6\") " pod="openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd" Jul 28 01:57:56.845738 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.845526 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f631a986-542b-470c-a2e4-192058e9f6f6-podres\") pod \"perf-node-gather-daemonset-w5dkd\" (UID: \"f631a986-542b-470c-a2e4-192058e9f6f6\") " pod="openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd" Jul 28 01:57:56.845738 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.845556 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f631a986-542b-470c-a2e4-192058e9f6f6-proc\") pod \"perf-node-gather-daemonset-w5dkd\" (UID: \"f631a986-542b-470c-a2e4-192058e9f6f6\") " pod="openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd" Jul 28 01:57:56.845738 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.845640 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dtjrs\" (UniqueName: \"kubernetes.io/projected/f631a986-542b-470c-a2e4-192058e9f6f6-kube-api-access-dtjrs\") pod \"perf-node-gather-daemonset-w5dkd\" (UID: \"f631a986-542b-470c-a2e4-192058e9f6f6\") " pod="openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd" Jul 28 01:57:56.845738 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.845709 2568 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f631a986-542b-470c-a2e4-192058e9f6f6-lib-modules\") pod \"perf-node-gather-daemonset-w5dkd\" (UID: \"f631a986-542b-470c-a2e4-192058e9f6f6\") " pod="openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd" Jul 28 01:57:56.896754 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.896720 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-network-console_networking-console-plugin-74c9f884b7-f7b2z_2527550a-ea54-4f32-af64-9417bd3060c0/networking-console-plugin/0.log" Jul 28 01:57:56.946415 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.946383 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f631a986-542b-470c-a2e4-192058e9f6f6-sys\") pod \"perf-node-gather-daemonset-w5dkd\" (UID: \"f631a986-542b-470c-a2e4-192058e9f6f6\") " pod="openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd" Jul 28 01:57:56.946669 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.946433 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f631a986-542b-470c-a2e4-192058e9f6f6-podres\") pod \"perf-node-gather-daemonset-w5dkd\" (UID: \"f631a986-542b-470c-a2e4-192058e9f6f6\") " pod="openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd" Jul 28 01:57:56.946669 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.946522 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/f631a986-542b-470c-a2e4-192058e9f6f6-sys\") pod \"perf-node-gather-daemonset-w5dkd\" (UID: \"f631a986-542b-470c-a2e4-192058e9f6f6\") " pod="openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd" Jul 28 01:57:56.946669 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.946597 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/f631a986-542b-470c-a2e4-192058e9f6f6-podres\") pod \"perf-node-gather-daemonset-w5dkd\" (UID: \"f631a986-542b-470c-a2e4-192058e9f6f6\") " pod="openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd" Jul 28 01:57:56.946669 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.946599 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f631a986-542b-470c-a2e4-192058e9f6f6-proc\") pod \"perf-node-gather-daemonset-w5dkd\" (UID: \"f631a986-542b-470c-a2e4-192058e9f6f6\") " pod="openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd" Jul 28 01:57:56.946669 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.946645 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/f631a986-542b-470c-a2e4-192058e9f6f6-proc\") pod \"perf-node-gather-daemonset-w5dkd\" (UID: \"f631a986-542b-470c-a2e4-192058e9f6f6\") " pod="openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd" Jul 28 01:57:56.946942 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.946678 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dtjrs\" (UniqueName: \"kubernetes.io/projected/f631a986-542b-470c-a2e4-192058e9f6f6-kube-api-access-dtjrs\") pod \"perf-node-gather-daemonset-w5dkd\" (UID: \"f631a986-542b-470c-a2e4-192058e9f6f6\") " pod="openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd" Jul 28 01:57:56.946942 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.946705 2568 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f631a986-542b-470c-a2e4-192058e9f6f6-lib-modules\") pod \"perf-node-gather-daemonset-w5dkd\" (UID: \"f631a986-542b-470c-a2e4-192058e9f6f6\") " pod="openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd" Jul 28 01:57:56.946942 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.946855 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/f631a986-542b-470c-a2e4-192058e9f6f6-lib-modules\") pod \"perf-node-gather-daemonset-w5dkd\" (UID: \"f631a986-542b-470c-a2e4-192058e9f6f6\") " pod="openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd" Jul 28 01:57:56.955506 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:56.955478 2568 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dtjrs\" (UniqueName: \"kubernetes.io/projected/f631a986-542b-470c-a2e4-192058e9f6f6-kube-api-access-dtjrs\") pod \"perf-node-gather-daemonset-w5dkd\" (UID: \"f631a986-542b-470c-a2e4-192058e9f6f6\") " pod="openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd" Jul 28 01:57:57.135952 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:57.135922 2568 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd" Jul 28 01:57:57.284294 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:57.284262 2568 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd"] Jul 28 01:57:57.286507 ip-10-0-132-44 kubenswrapper[2568]: W0728 01:57:57.286477 2568 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-podf631a986_542b_470c_a2e4_192058e9f6f6.slice/crio-87d32235f12add96244ed2950a140ddc5a3cdce86675e2f472787725612d98b6 WatchSource:0}: Error finding container 87d32235f12add96244ed2950a140ddc5a3cdce86675e2f472787725612d98b6: Status 404 returned error can't find the container with id 87d32235f12add96244ed2950a140ddc5a3cdce86675e2f472787725612d98b6 Jul 28 01:57:57.318076 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:57.318042 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd" event={"ID":"f631a986-542b-470c-a2e4-192058e9f6f6","Type":"ContainerStarted","Data":"87d32235f12add96244ed2950a140ddc5a3cdce86675e2f472787725612d98b6"} Jul 28 01:57:57.584305 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:57.584251 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/1.log" Jul 28 01:57:57.589754 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:57.589724 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console-operator_console-operator-584dcb6b54-gr7gw_21d98251-4171-4c26-ab52-9ba123ba3be9/console-operator/2.log" Jul 28 01:57:58.325229 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:58.325188 2568 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd" event={"ID":"f631a986-542b-470c-a2e4-192058e9f6f6","Type":"ContainerStarted","Data":"647dbd55b9a8f097d0487acc65b9a858cbde82145a783d364c48d661f65acd90"} Jul 28 01:57:58.325675 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:58.325330 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd" Jul 28 01:57:58.362799 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:58.362742 2568 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd" podStartSLOduration=2.362726382 podStartE2EDuration="2.362726382s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-28 01:57:56 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-28 01:57:58.362338488 +0000 UTC m=+3875.281939171" watchObservedRunningTime="2026-07-28 01:57:58.362726382 +0000 UTC m=+3875.282327124" Jul 28 01:57:58.684017 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:58.683989 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-cluster-storage-operator_volume-data-source-validator-549c6d54cf-7ndng_d247409f-9d05-4a9d-b74f-484931e06d25/volume-data-source-validator/0.log" Jul 28 01:57:59.769952 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:59.769894 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vjmlz_bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14/dns/0.log" Jul 28 01:57:59.791321 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:59.791288 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-vjmlz_bd96ff2b-48b9-4ef8-a2b1-d6c40b941a14/kube-rbac-proxy/0.log" Jul 28 01:57:59.840519 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:57:59.840484 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mjj4c_64b5029e-0628-4bbd-b16c-1ec599f76a21/dns-node-resolver/0.log" Jul 28 01:58:00.460555 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:00.460509 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-jd4kr_666b80c4-e226-4307-b25e-4f7ffd02f5b9/node-ca/0.log" Jul 28 01:58:01.399015 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:01.398971 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc_5ecc800e-53fa-4447-8c4f-2ddf23667ada/istio-proxy/0.log" Jul 28 01:58:01.619477 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:01.619449 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-8fg5c_e79a768c-19f5-4af5-b7da-349c2cd665e9/istio-proxy/0.log" Jul 28 01:58:01.648266 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:01.648229 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-8fg5c_e79a768c-19f5-4af5-b7da-349c2cd665e9/istio-proxy/1.log" Jul 28 01:58:01.679688 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:01.679600 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-fss7v_226f476f-1ab3-48b1-b03c-dcc7dc7eca46/payload-pre-processing/0.log" Jul 28 01:58:01.712016 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:01.711965 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8gzgx_30729cb8-3e4d-4c41-b1e6-3062595cc6b9/payload-processing/0.log" Jul 28 01:58:01.738403 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:01.738364 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b886669c7-2wtgq_49fe97ad-3adc-4b96-a594-b0b505a0cffe/router/0.log" Jul 28 01:58:02.545803 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:02.545770 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-5jr64_f63765b0-930b-4807-85d3-8447fd21dd69/serve-healthcheck-canary/0.log" Jul 28 01:58:03.081939 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:03.081907 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-8h8gt_80623db8-0901-4f5f-830d-f07ace2f6d05/insights-operator/0.log" Jul 28 01:58:03.082928 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:03.082908 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-operator-5885fdb759-8h8gt_80623db8-0901-4f5f-830d-f07ace2f6d05/insights-operator/1.log" Jul 28 01:58:03.177378 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:03.177351 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-74vc4_8af8637c-823f-42b5-b67e-0cdb8f030681/kube-rbac-proxy/0.log" Jul 28 01:58:03.200026 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:03.200000 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-74vc4_8af8637c-823f-42b5-b67e-0cdb8f030681/exporter/0.log" Jul 28 01:58:03.224643 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:03.224613 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-74vc4_8af8637c-823f-42b5-b67e-0cdb8f030681/extractor/0.log" Jul 28 01:58:04.343471 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:04.343446 2568 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-hgbjn/perf-node-gather-daemonset-w5dkd" Jul 28 01:58:05.739224 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:05.739147 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-smgdt_71086811-684d-487b-bf40-c0c1b0f89447/manager/0.log" Jul 28 01:58:05.913008 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:05.912986 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_maas-controller-85cd6fdbf4-x8947_9fd33551-d6d5-4a2c-a991-5c9ec797584a/manager/0.log" Jul 28 01:58:05.945879 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:05.945844 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-c7b2p_de75647f-1495-4cea-92e0-756b660541db/server/0.log" Jul 28 01:58:06.048071 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:06.047987 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6549c9954f-4q5q4_705070e0-bce3-4b32-86c9-e4e3b1cb04ac/manager/0.log" Jul 28 01:58:06.069739 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:06.069707 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-6549c9954f-4q5q4_705070e0-bce3-4b32-86c9-e4e3b1cb04ac/copy-manifests/0.log" Jul 28 01:58:07.578559 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:07.578524 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_lws-controller-manager-6478f6f65f-rmw67_db3a8f7b-21fe-4bfb-976a-898f01a9498a/manager/0.log" Jul 28 01:58:07.873285 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:07.873258 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc_5ecc800e-53fa-4447-8c4f-2ddf23667ada/istio-proxy/0.log" Jul 28 01:58:08.037558 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:08.037525 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-8fg5c_e79a768c-19f5-4af5-b7da-349c2cd665e9/istio-proxy/0.log" Jul 28 01:58:08.065582 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:08.065518 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-8fg5c_e79a768c-19f5-4af5-b7da-349c2cd665e9/istio-proxy/1.log" Jul 28 01:58:08.088426 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:08.088396 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-fss7v_226f476f-1ab3-48b1-b03c-dcc7dc7eca46/payload-pre-processing/0.log" Jul 28 01:58:08.109895 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:08.109865 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8gzgx_30729cb8-3e4d-4c41-b1e6-3062595cc6b9/payload-processing/0.log" Jul 28 01:58:08.124146 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:08.124066 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b886669c7-2wtgq_49fe97ad-3adc-4b96-a594-b0b505a0cffe/router/0.log" Jul 28 01:58:09.406911 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:09.406883 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-68cf4d799cjd8vc_5ecc800e-53fa-4447-8c4f-2ddf23667ada/istio-proxy/0.log" Jul 28 01:58:09.578868 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:09.578810 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-8fg5c_e79a768c-19f5-4af5-b7da-349c2cd665e9/istio-proxy/0.log" Jul 28 01:58:09.609865 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:09.609825 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5ccb968c66-8fg5c_e79a768c-19f5-4af5-b7da-349c2cd665e9/istio-proxy/1.log" Jul 28 01:58:09.632776 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:09.632729 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-687dbb6cf6-fss7v_226f476f-1ab3-48b1-b03c-dcc7dc7eca46/payload-pre-processing/0.log" Jul 28 01:58:09.658274 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:09.658195 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-processing-5cc6cd444b-8gzgx_30729cb8-3e4d-4c41-b1e6-3062595cc6b9/payload-processing/0.log" Jul 28 01:58:09.676947 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:09.676923 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_router-default-5b886669c7-2wtgq_49fe97ad-3adc-4b96-a594-b0b505a0cffe/router/0.log" Jul 28 01:58:12.644976 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:12.644944 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-9xsxr_3153340c-02a5-4da8-8811-48db8141c02e/migrator/0.log" Jul 28 01:58:12.667445 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:12.667414 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator_migrator-6865c9967-9xsxr_3153340c-02a5-4da8-8811-48db8141c02e/graceful-termination/0.log" Jul 28 01:58:13.029543 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:13.029462 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk_3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c/kube-storage-version-migrator-operator/1.log" Jul 28 01:58:13.030403 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:13.030384 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-kube-storage-version-migrator-operator_kube-storage-version-migrator-operator-6f4d6fb6bc-f29qk_3691a2f5-c43f-47ec-a5a0-3b1075e4fa7c/kube-storage-version-migrator-operator/0.log" Jul 28 01:58:14.260302 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:14.260271 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tpt6j_632dce7c-ff33-4238-84bb-c82356acc1d6/kube-multus-additional-cni-plugins/0.log" Jul 28 01:58:14.284588 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:14.284537 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tpt6j_632dce7c-ff33-4238-84bb-c82356acc1d6/egress-router-binary-copy/0.log" Jul 28 01:58:14.306336 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:14.306308 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tpt6j_632dce7c-ff33-4238-84bb-c82356acc1d6/cni-plugins/0.log" Jul 28 01:58:14.332827 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:14.332794 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tpt6j_632dce7c-ff33-4238-84bb-c82356acc1d6/bond-cni-plugin/0.log" Jul 28 01:58:14.355375 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:14.355341 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tpt6j_632dce7c-ff33-4238-84bb-c82356acc1d6/routeoverride-cni/0.log" Jul 28 01:58:14.378693 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:14.378653 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tpt6j_632dce7c-ff33-4238-84bb-c82356acc1d6/whereabouts-cni-bincopy/0.log" Jul 28 01:58:14.408791 ip-10-0-132-44 kubenswrapper[2568]: I0728 01:58:14.408757 2568 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-tpt6j_632dce7c-ff33-4238-84bb-c82356acc1d6/whereabouts-cni/0.log"