Jul 15 21:07:56.500927 ip-10-0-136-18 systemd[1]: kubelet.service: Failed to load environment files: No such file or directory Jul 15 21:07:56.500940 ip-10-0-136-18 systemd[1]: kubelet.service: Failed to run 'start-pre' task: No such file or directory Jul 15 21:07:56.500949 ip-10-0-136-18 systemd[1]: kubelet.service: Failed with result 'resources'. Jul 15 21:07:56.501242 ip-10-0-136-18 systemd[1]: Failed to start Kubernetes Kubelet. Jul 15 21:08:07.741639 ip-10-0-136-18 systemd[1]: kubelet.service: Failed to schedule restart job: Unit crio.service not found. Jul 15 21:08:07.741654 ip-10-0-136-18 systemd[1]: kubelet.service: Failed with result 'resources'. -- Boot b4afac6955eb4e23bd8ac8473e7f5892 -- Jul 15 21:10:06.018772 ip-10-0-136-18 systemd[1]: Starting Kubernetes Kubelet... Jul 15 21:10:07.716317 ip-10-0-136-18 kubenswrapper[2572]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 21:10:07.716317 ip-10-0-136-18 kubenswrapper[2572]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 15 21:10:07.716317 ip-10-0-136-18 kubenswrapper[2572]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 21:10:07.716317 ip-10-0-136-18 kubenswrapper[2572]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 15 21:10:07.716317 ip-10-0-136-18 kubenswrapper[2572]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 15 21:10:07.716317 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.694139 2572 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 15 21:10:07.716317 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701468 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:10:07.716317 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701484 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:10:07.716317 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701488 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:10:07.716317 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701491 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:10:07.716317 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701495 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:10:07.716317 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701498 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:10:07.716317 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701503 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:10:07.716317 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701506 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:10:07.717174 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701509 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:10:07.717174 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701512 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:10:07.717174 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701516 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:10:07.717174 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701519 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:10:07.717174 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701542 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:10:07.717174 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701547 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:10:07.717174 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701552 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:10:07.717174 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701555 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:10:07.717174 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701558 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:10:07.717174 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701561 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:10:07.717174 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701565 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:10:07.717174 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701568 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:10:07.717174 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701571 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:10:07.717174 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701574 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:10:07.717174 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701576 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:10:07.717174 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701579 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:10:07.717174 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701581 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:10:07.717174 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701584 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:10:07.717174 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701586 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:10:07.717174 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701588 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:10:07.718213 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701591 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:10:07.718213 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701594 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:10:07.718213 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701598 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:10:07.718213 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701601 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:10:07.718213 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701612 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:10:07.718213 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701616 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:10:07.718213 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701619 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:10:07.718213 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701622 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:10:07.718213 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701626 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:10:07.718213 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701630 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:10:07.718213 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701633 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:10:07.718213 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701635 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:10:07.718213 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701638 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:10:07.718213 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701641 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:10:07.718213 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701643 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:10:07.718213 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701646 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:10:07.718213 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701649 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:10:07.718213 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701651 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:10:07.718213 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701654 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:10:07.718862 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701656 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:10:07.718862 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701659 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:10:07.718862 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701661 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:10:07.718862 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701664 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:10:07.718862 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701666 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:10:07.718862 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701669 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:10:07.718862 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701671 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:10:07.718862 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701673 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:10:07.718862 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701676 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:10:07.718862 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701678 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:10:07.718862 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701681 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:10:07.718862 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701685 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:10:07.718862 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701689 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:10:07.718862 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701692 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:10:07.718862 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701695 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:10:07.718862 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701697 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:10:07.718862 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701701 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:10:07.718862 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701704 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:10:07.718862 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701707 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:10:07.719925 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701711 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:10:07.719925 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701714 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:10:07.719925 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701716 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:10:07.719925 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701719 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:10:07.719925 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701721 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:10:07.719925 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701724 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:10:07.719925 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701726 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:10:07.719925 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701729 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:10:07.719925 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701731 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:10:07.719925 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701734 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:10:07.719925 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701736 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:10:07.719925 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701740 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:10:07.719925 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701742 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:10:07.719925 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701745 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:10:07.719925 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701747 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:10:07.719925 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701749 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:10:07.719925 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701752 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:10:07.719925 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701755 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:10:07.719925 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701758 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:10:07.719925 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701761 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:10:07.720766 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701763 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:10:07.720766 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701766 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:10:07.720766 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701769 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:10:07.720766 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701771 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:10:07.720766 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701774 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:10:07.720766 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701776 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:10:07.720766 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701779 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:10:07.720766 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701782 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:10:07.720766 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701784 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:10:07.720766 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701788 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:10:07.720766 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701790 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:10:07.720766 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701794 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:10:07.720766 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.701796 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:10:07.720766 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704026 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:10:07.720766 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704035 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:10:07.720766 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704038 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:10:07.720766 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704041 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:10:07.720766 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704045 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:10:07.720766 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704048 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:10:07.720766 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704051 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:10:07.721316 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704053 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:10:07.721316 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704056 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:10:07.721316 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704059 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:10:07.721316 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704062 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:10:07.721316 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704064 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:10:07.721316 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704068 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:10:07.721316 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704071 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:10:07.721316 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704073 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:10:07.721316 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704076 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:10:07.721316 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704078 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:10:07.721316 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704081 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:10:07.721316 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704084 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:10:07.721316 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704087 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:10:07.721316 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704089 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:10:07.721316 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704092 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:10:07.721316 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704094 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:10:07.721316 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704097 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:10:07.721316 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704100 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:10:07.721316 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704103 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:10:07.721316 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704105 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:10:07.721996 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704108 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:10:07.721996 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704111 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:10:07.721996 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704114 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:10:07.721996 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704116 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:10:07.721996 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704119 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:10:07.721996 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704121 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:10:07.721996 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704124 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:10:07.721996 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704128 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:10:07.721996 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704132 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:10:07.721996 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704135 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:10:07.721996 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704138 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:10:07.721996 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704140 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:10:07.721996 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704143 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:10:07.721996 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704145 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:10:07.721996 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704148 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:10:07.721996 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704150 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:10:07.721996 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704152 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:10:07.721996 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704155 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:10:07.721996 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704158 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:10:07.722503 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704160 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:10:07.722503 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704163 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:10:07.722503 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704166 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:10:07.722503 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704168 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:10:07.722503 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704171 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:10:07.722503 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704174 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:10:07.722503 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704177 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:10:07.722503 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704179 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:10:07.722503 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704181 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:10:07.722503 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704186 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:10:07.722503 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704190 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:10:07.722503 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704193 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:10:07.722503 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704196 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:10:07.722503 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704199 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:10:07.722503 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704202 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:10:07.722503 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704205 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:10:07.722503 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704208 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:10:07.722503 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704210 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:10:07.722503 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704213 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:10:07.722993 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704215 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:10:07.722993 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704218 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:10:07.722993 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704220 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:10:07.722993 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704223 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:10:07.722993 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704225 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:10:07.722993 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704228 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:10:07.722993 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704230 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:10:07.722993 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704233 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:10:07.722993 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704235 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:10:07.722993 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704238 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:10:07.722993 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704240 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:10:07.722993 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704244 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:10:07.722993 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704247 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:10:07.722993 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704250 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:10:07.722993 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704253 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:10:07.722993 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704256 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:10:07.722993 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704259 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:10:07.722993 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704262 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:10:07.722993 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704265 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:10:07.723447 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704267 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:10:07.723447 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704270 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:10:07.723447 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704273 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:10:07.723447 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704276 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:10:07.723447 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704279 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:10:07.723447 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704282 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:10:07.723447 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704285 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:10:07.723447 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704287 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:10:07.723447 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704290 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:10:07.723447 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704293 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:10:07.723447 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704295 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:10:07.723447 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704298 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:10:07.723447 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704300 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:10:07.723447 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704303 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:10:07.723447 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704306 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:10:07.723447 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704723 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:10:07.723447 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704728 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:10:07.723447 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704732 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:10:07.723447 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704734 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:10:07.723447 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704738 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:10:07.723944 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704741 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:10:07.723944 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704744 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:10:07.723944 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704746 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:10:07.723944 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704749 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:10:07.723944 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704752 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:10:07.723944 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704755 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:10:07.723944 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704757 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:10:07.723944 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704760 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:10:07.723944 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704762 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:10:07.723944 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704765 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:10:07.723944 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704767 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:10:07.723944 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704770 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:10:07.723944 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704773 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:10:07.723944 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704776 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:10:07.723944 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704778 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:10:07.723944 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704780 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:10:07.723944 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704783 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:10:07.723944 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704788 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:10:07.723944 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704791 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:10:07.724390 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704795 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:10:07.724390 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704798 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:10:07.724390 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704801 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:10:07.724390 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704804 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:10:07.724390 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704806 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:10:07.724390 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704810 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:10:07.724390 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704814 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:10:07.724390 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704817 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:10:07.724390 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704819 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:10:07.724390 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704822 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:10:07.724390 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704825 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:10:07.724390 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704828 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:10:07.724390 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704831 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:10:07.724390 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704834 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:10:07.724390 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704837 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:10:07.724390 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704840 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:10:07.724390 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704842 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:10:07.724390 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704845 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:10:07.724390 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704847 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:10:07.724858 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704850 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:10:07.724858 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704852 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:10:07.724858 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704855 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:10:07.724858 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704859 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:10:07.724858 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704862 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:10:07.724858 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704865 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:10:07.724858 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704868 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:10:07.724858 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704871 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:10:07.724858 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704874 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:10:07.724858 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704877 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:10:07.724858 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704879 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:10:07.724858 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704882 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:10:07.724858 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704884 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:10:07.724858 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704887 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:10:07.724858 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704890 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:10:07.724858 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704892 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:10:07.724858 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704896 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:10:07.724858 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704898 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:10:07.724858 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704901 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:10:07.725346 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704903 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:10:07.725346 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704905 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:10:07.725346 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704908 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:10:07.725346 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704910 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:10:07.725346 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704915 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:10:07.725346 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704918 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:10:07.725346 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704920 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:10:07.725346 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704923 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:10:07.725346 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704926 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:10:07.725346 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704928 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:10:07.725346 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704933 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:10:07.725346 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704937 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:10:07.725346 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704940 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:10:07.725346 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704942 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:10:07.725346 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704945 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:10:07.725346 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704948 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:10:07.725346 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704950 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:10:07.725346 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704952 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:10:07.725346 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704955 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:10:07.725346 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704958 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:10:07.725845 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704961 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:10:07.725845 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704963 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:10:07.725845 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704966 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:10:07.725845 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704969 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:10:07.725845 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704971 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:10:07.725845 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704974 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:10:07.725845 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704977 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:10:07.725845 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704979 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:10:07.725845 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704982 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:10:07.725845 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704984 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:10:07.725845 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704986 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:10:07.725845 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704989 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:10:07.725845 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704992 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:10:07.725845 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704994 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:10:07.725845 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704997 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:10:07.725845 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.704999 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:10:07.725845 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705005 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:10:07.725845 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705077 2572 flags.go:64] FLAG: --address="0.0.0.0" Jul 15 21:10:07.725845 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705084 2572 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 15 21:10:07.725845 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705090 2572 flags.go:64] FLAG: --anonymous-auth="true" Jul 15 21:10:07.725845 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705095 2572 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 15 21:10:07.725845 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705099 2572 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705104 2572 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705108 2572 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705113 2572 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705116 2572 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705119 2572 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705122 2572 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705126 2572 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705129 2572 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705132 2572 flags.go:64] FLAG: --cgroup-root="" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705135 2572 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705138 2572 flags.go:64] FLAG: --client-ca-file="" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705141 2572 flags.go:64] FLAG: --cloud-provider="external" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705144 2572 flags.go:64] FLAG: --cluster-dns="[]" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705150 2572 flags.go:64] FLAG: --cluster-domain="" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705153 2572 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705156 2572 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705160 2572 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705163 2572 flags.go:64] FLAG: --container-log-max-files="5" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705167 2572 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705170 2572 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705173 2572 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705176 2572 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705179 2572 flags.go:64] FLAG: --contention-profiling="false" Jul 15 21:10:07.726368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705182 2572 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705185 2572 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705188 2572 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705192 2572 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705197 2572 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705200 2572 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705203 2572 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705206 2572 flags.go:64] FLAG: --enable-load-reader="false" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705209 2572 flags.go:64] FLAG: --enable-server="true" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705213 2572 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705218 2572 flags.go:64] FLAG: --event-burst="100" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705221 2572 flags.go:64] FLAG: --event-qps="50" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705224 2572 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705227 2572 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705230 2572 flags.go:64] FLAG: --eviction-hard="" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705233 2572 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705236 2572 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705239 2572 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705242 2572 flags.go:64] FLAG: --eviction-soft="" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705245 2572 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705247 2572 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705251 2572 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705254 2572 flags.go:64] FLAG: --experimental-mounter-path="" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705257 2572 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705260 2572 flags.go:64] FLAG: --fail-swap-on="true" Jul 15 21:10:07.726953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705263 2572 flags.go:64] FLAG: --feature-gates="" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705266 2572 flags.go:64] FLAG: --file-check-frequency="20s" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705269 2572 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705272 2572 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705275 2572 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705278 2572 flags.go:64] FLAG: --healthz-port="10248" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705281 2572 flags.go:64] FLAG: --help="false" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705284 2572 flags.go:64] FLAG: --hostname-override="ip-10-0-136-18.ec2.internal" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705287 2572 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705290 2572 flags.go:64] FLAG: --http-check-frequency="20s" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705294 2572 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705297 2572 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705301 2572 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705303 2572 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705306 2572 flags.go:64] FLAG: --image-service-endpoint="" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705309 2572 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705313 2572 flags.go:64] FLAG: --kube-api-burst="100" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705316 2572 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705319 2572 flags.go:64] FLAG: --kube-api-qps="50" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705322 2572 flags.go:64] FLAG: --kube-reserved="" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705325 2572 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705328 2572 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705331 2572 flags.go:64] FLAG: --kubelet-cgroups="" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705334 2572 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 15 21:10:07.727570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705337 2572 flags.go:64] FLAG: --lock-file="" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705340 2572 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705343 2572 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705346 2572 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705351 2572 flags.go:64] FLAG: --log-json-split-stream="false" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705355 2572 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705357 2572 flags.go:64] FLAG: --log-text-split-stream="false" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705360 2572 flags.go:64] FLAG: --logging-format="text" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705363 2572 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705366 2572 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705369 2572 flags.go:64] FLAG: --manifest-url="" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705372 2572 flags.go:64] FLAG: --manifest-url-header="" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705376 2572 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705378 2572 flags.go:64] FLAG: --max-open-files="1000000" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705382 2572 flags.go:64] FLAG: --max-pods="110" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705385 2572 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705388 2572 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705391 2572 flags.go:64] FLAG: --memory-manager-policy="None" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705395 2572 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705398 2572 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705401 2572 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705404 2572 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705411 2572 flags.go:64] FLAG: --node-status-max-images="50" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705414 2572 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705419 2572 flags.go:64] FLAG: --oom-score-adj="-999" Jul 15 21:10:07.728146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705422 2572 flags.go:64] FLAG: --pod-cidr="" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705425 2572 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705430 2572 flags.go:64] FLAG: --pod-manifest-path="" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705433 2572 flags.go:64] FLAG: --pod-max-pids="-1" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705436 2572 flags.go:64] FLAG: --pods-per-core="0" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705439 2572 flags.go:64] FLAG: --port="10250" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705442 2572 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705445 2572 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-00780c81200cff2c4" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705448 2572 flags.go:64] FLAG: --qos-reserved="" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705451 2572 flags.go:64] FLAG: --read-only-port="10255" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705454 2572 flags.go:64] FLAG: --register-node="true" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705458 2572 flags.go:64] FLAG: --register-with-taints="" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705461 2572 flags.go:64] FLAG: --registry-burst="10" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705464 2572 flags.go:64] FLAG: --registry-qps="5" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705467 2572 flags.go:64] FLAG: --reserved-cpus="" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705470 2572 flags.go:64] FLAG: --reserved-memory="" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705474 2572 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705477 2572 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705479 2572 flags.go:64] FLAG: --rotate-certificates="false" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705482 2572 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705485 2572 flags.go:64] FLAG: --runonce="false" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705488 2572 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705491 2572 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705494 2572 flags.go:64] FLAG: --seccomp-default="false" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705497 2572 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 15 21:10:07.728786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705501 2572 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705504 2572 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705507 2572 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705510 2572 flags.go:64] FLAG: --storage-driver-password="root" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705512 2572 flags.go:64] FLAG: --storage-driver-secure="false" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705515 2572 flags.go:64] FLAG: --storage-driver-table="stats" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705519 2572 flags.go:64] FLAG: --storage-driver-user="root" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705537 2572 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705542 2572 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705547 2572 flags.go:64] FLAG: --system-cgroups="" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705550 2572 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705556 2572 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705559 2572 flags.go:64] FLAG: --tls-cert-file="" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705562 2572 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705567 2572 flags.go:64] FLAG: --tls-min-version="" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705570 2572 flags.go:64] FLAG: --tls-private-key-file="" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705573 2572 flags.go:64] FLAG: --topology-manager-policy="none" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705576 2572 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705579 2572 flags.go:64] FLAG: --topology-manager-scope="container" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705582 2572 flags.go:64] FLAG: --v="2" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705586 2572 flags.go:64] FLAG: --version="false" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705596 2572 flags.go:64] FLAG: --vmodule="" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705600 2572 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.705603 2572 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705726 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:10:07.729402 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705730 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:10:07.730028 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705733 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:10:07.730028 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705736 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:10:07.730028 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705738 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:10:07.730028 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705741 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:10:07.730028 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705744 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:10:07.730028 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705746 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:10:07.730028 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705750 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:10:07.730028 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705753 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:10:07.730028 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705755 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:10:07.730028 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705758 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:10:07.730028 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705760 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:10:07.730028 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705763 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:10:07.730028 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705765 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:10:07.730028 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705770 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:10:07.730028 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705772 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:10:07.730028 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705775 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:10:07.730028 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705777 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:10:07.730028 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705780 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:10:07.730028 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705782 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:10:07.730028 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705785 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:10:07.730546 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705788 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:10:07.730546 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705792 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:10:07.730546 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705795 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:10:07.730546 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705798 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:10:07.730546 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705801 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:10:07.730546 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705804 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:10:07.730546 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705806 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:10:07.730546 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705809 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:10:07.730546 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705812 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:10:07.730546 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705815 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:10:07.730546 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705817 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:10:07.730546 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705820 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:10:07.730546 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705822 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:10:07.730546 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705825 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:10:07.730546 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705827 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:10:07.730546 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705830 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:10:07.730546 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705832 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:10:07.730546 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705835 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:10:07.730546 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705840 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:10:07.731014 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705842 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:10:07.731014 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705845 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:10:07.731014 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705848 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:10:07.731014 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705850 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:10:07.731014 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705853 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:10:07.731014 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705855 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:10:07.731014 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705859 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:10:07.731014 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705862 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:10:07.731014 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705866 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:10:07.731014 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705869 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:10:07.731014 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705873 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:10:07.731014 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705876 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:10:07.731014 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705879 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:10:07.731014 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705882 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:10:07.731014 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705885 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:10:07.731014 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705888 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:10:07.731014 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705891 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:10:07.731014 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705894 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:10:07.731014 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705896 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:10:07.731477 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705899 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:10:07.731477 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705902 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:10:07.731477 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705904 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:10:07.731477 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705908 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:10:07.731477 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705911 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:10:07.731477 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705913 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:10:07.731477 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705916 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:10:07.731477 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705919 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:10:07.731477 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705921 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:10:07.731477 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705924 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:10:07.731477 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705926 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:10:07.731477 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705929 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:10:07.731477 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705933 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:10:07.731477 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705935 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:10:07.731477 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705938 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:10:07.731477 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705940 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:10:07.731477 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705943 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:10:07.731477 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705947 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:10:07.731477 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705950 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:10:07.731477 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705954 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:10:07.731986 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705957 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:10:07.731986 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705960 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:10:07.731986 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705963 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:10:07.731986 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705966 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:10:07.731986 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705968 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:10:07.731986 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705971 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:10:07.731986 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705975 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:10:07.731986 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705977 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:10:07.731986 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705980 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:10:07.731986 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705983 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:10:07.731986 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705986 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:10:07.731986 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705988 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:10:07.731986 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705991 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:10:07.731986 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705994 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:10:07.731986 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705997 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:10:07.731986 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.705999 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:10:07.731986 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.706002 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:10:07.731986 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.706005 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:10:07.731986 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.706008 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:10:07.732434 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.706014 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 21:10:07.732434 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.722790 2572 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 15 21:10:07.732434 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.722808 2572 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 15 21:10:07.732434 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.722831 2572 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 15 21:10:07.732434 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.722842 2572 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 15 21:10:07.732434 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722915 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:10:07.732434 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722921 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:10:07.732434 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722924 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:10:07.732434 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722927 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:10:07.732434 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722932 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:10:07.732434 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722935 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:10:07.732434 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722939 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:10:07.732434 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722942 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:10:07.732434 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722945 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:10:07.732803 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722948 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:10:07.732803 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722951 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:10:07.732803 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722954 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:10:07.732803 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722956 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:10:07.732803 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722959 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:10:07.732803 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722962 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:10:07.732803 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722965 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:10:07.732803 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722968 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:10:07.732803 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722970 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:10:07.732803 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722973 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:10:07.732803 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722976 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:10:07.732803 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722980 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:10:07.732803 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722984 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:10:07.732803 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722989 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:10:07.732803 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.722994 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:10:07.732803 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723005 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:10:07.732803 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723008 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:10:07.732803 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723011 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:10:07.732803 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723015 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:10:07.732803 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723019 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:10:07.733315 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723023 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:10:07.733315 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723026 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:10:07.733315 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723029 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:10:07.733315 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723032 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:10:07.733315 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723034 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:10:07.733315 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723037 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:10:07.733315 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723041 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:10:07.733315 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723044 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:10:07.733315 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723047 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:10:07.733315 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723049 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:10:07.733315 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723052 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:10:07.733315 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723055 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:10:07.733315 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723057 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:10:07.733315 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723061 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:10:07.733315 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723066 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:10:07.733315 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723070 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:10:07.733315 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723074 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:10:07.733315 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723078 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:10:07.733315 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723081 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:10:07.733792 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723083 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:10:07.733792 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723086 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:10:07.733792 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723088 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:10:07.733792 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723091 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:10:07.733792 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723093 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:10:07.733792 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723096 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:10:07.733792 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723099 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:10:07.733792 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723101 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:10:07.733792 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723104 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:10:07.733792 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723107 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:10:07.733792 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723110 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:10:07.733792 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723113 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:10:07.733792 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723115 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:10:07.733792 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723118 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:10:07.733792 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723121 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:10:07.733792 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723123 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:10:07.733792 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723126 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:10:07.733792 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723129 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:10:07.733792 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723131 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:10:07.733792 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723134 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:10:07.734307 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723136 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:10:07.734307 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723139 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:10:07.734307 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723142 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:10:07.734307 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723147 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:10:07.734307 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723151 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:10:07.734307 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723155 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:10:07.734307 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723159 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:10:07.734307 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723162 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:10:07.734307 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723165 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:10:07.734307 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723167 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:10:07.734307 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723170 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:10:07.734307 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723173 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:10:07.734307 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723175 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:10:07.734307 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723178 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:10:07.734307 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723181 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:10:07.734307 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723183 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:10:07.734307 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723186 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:10:07.734307 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723189 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:10:07.734307 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723192 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:10:07.734307 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723195 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:10:07.734799 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723197 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:10:07.734799 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723200 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:10:07.734799 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723203 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:10:07.734799 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723206 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:10:07.734799 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723208 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:10:07.734799 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723211 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:10:07.734799 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723214 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:10:07.734799 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723216 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:10:07.734799 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723219 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:10:07.734799 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723222 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:10:07.734799 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723226 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:10:07.734799 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.723234 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 21:10:07.734799 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723365 2572 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 15 21:10:07.734799 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723371 2572 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 15 21:10:07.734799 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723375 2572 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 15 21:10:07.735166 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723377 2572 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 15 21:10:07.735166 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723380 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 15 21:10:07.735166 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723383 2572 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 15 21:10:07.735166 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723386 2572 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 15 21:10:07.735166 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723391 2572 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 15 21:10:07.735166 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723394 2572 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 15 21:10:07.735166 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723399 2572 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 15 21:10:07.735166 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723403 2572 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 15 21:10:07.735166 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723406 2572 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 15 21:10:07.735166 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723408 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 15 21:10:07.735166 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723411 2572 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 15 21:10:07.735166 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723413 2572 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 15 21:10:07.735166 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723416 2572 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 15 21:10:07.735166 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723418 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 15 21:10:07.735166 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723422 2572 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 15 21:10:07.735166 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723426 2572 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 15 21:10:07.735166 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723429 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 15 21:10:07.735166 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723432 2572 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 15 21:10:07.735166 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723435 2572 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 15 21:10:07.735639 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723438 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 15 21:10:07.735639 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723441 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 15 21:10:07.735639 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723444 2572 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 15 21:10:07.735639 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723447 2572 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 15 21:10:07.735639 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723451 2572 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 15 21:10:07.735639 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723454 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 15 21:10:07.735639 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723457 2572 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 15 21:10:07.735639 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723461 2572 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 15 21:10:07.735639 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723463 2572 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 15 21:10:07.735639 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723467 2572 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 15 21:10:07.735639 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723472 2572 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 15 21:10:07.735639 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723476 2572 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 15 21:10:07.735639 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723480 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 15 21:10:07.735639 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723484 2572 feature_gate.go:328] unrecognized feature gate: Example Jul 15 21:10:07.735639 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723486 2572 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 15 21:10:07.735639 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723489 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 15 21:10:07.735639 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723492 2572 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 15 21:10:07.735639 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723494 2572 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 15 21:10:07.735639 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723497 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 15 21:10:07.735639 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723499 2572 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 15 21:10:07.736124 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723502 2572 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 15 21:10:07.736124 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723504 2572 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 15 21:10:07.736124 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723507 2572 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 15 21:10:07.736124 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723509 2572 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 15 21:10:07.736124 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723512 2572 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 15 21:10:07.736124 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723514 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 15 21:10:07.736124 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723517 2572 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 15 21:10:07.736124 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723520 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 15 21:10:07.736124 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723537 2572 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 15 21:10:07.736124 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723540 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 15 21:10:07.736124 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723542 2572 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 15 21:10:07.736124 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723545 2572 feature_gate.go:328] unrecognized feature gate: Example2 Jul 15 21:10:07.736124 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723549 2572 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 15 21:10:07.736124 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723553 2572 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 15 21:10:07.736124 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723561 2572 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 15 21:10:07.736124 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723566 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 15 21:10:07.736124 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723570 2572 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 15 21:10:07.736124 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723572 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 15 21:10:07.736124 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723575 2572 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 15 21:10:07.736124 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723578 2572 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 15 21:10:07.736631 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723581 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 15 21:10:07.736631 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723583 2572 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 15 21:10:07.736631 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723586 2572 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 15 21:10:07.736631 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723588 2572 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 15 21:10:07.736631 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723591 2572 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 15 21:10:07.736631 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723593 2572 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 15 21:10:07.736631 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723596 2572 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 15 21:10:07.736631 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723598 2572 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 15 21:10:07.736631 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723601 2572 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 15 21:10:07.736631 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723603 2572 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 15 21:10:07.736631 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723606 2572 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 15 21:10:07.736631 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723608 2572 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 15 21:10:07.736631 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723611 2572 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 15 21:10:07.736631 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723613 2572 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 15 21:10:07.736631 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723616 2572 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 15 21:10:07.736631 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723618 2572 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 15 21:10:07.736631 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723621 2572 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 15 21:10:07.736631 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723623 2572 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 15 21:10:07.736631 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723626 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 15 21:10:07.736631 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723629 2572 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 15 21:10:07.737102 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723633 2572 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 15 21:10:07.737102 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723637 2572 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 15 21:10:07.737102 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723642 2572 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 15 21:10:07.737102 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723646 2572 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 15 21:10:07.737102 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723650 2572 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 15 21:10:07.737102 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723653 2572 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 15 21:10:07.737102 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723656 2572 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 15 21:10:07.737102 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723659 2572 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 15 21:10:07.737102 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723662 2572 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 15 21:10:07.737102 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723665 2572 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 15 21:10:07.737102 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723669 2572 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 15 21:10:07.737102 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723673 2572 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 15 21:10:07.737102 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723675 2572 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 15 21:10:07.737102 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723678 2572 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 15 21:10:07.737102 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723680 2572 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 15 21:10:07.737102 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723683 2572 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 15 21:10:07.737102 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:07.723685 2572 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 15 21:10:07.737504 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.723690 2572 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 15 21:10:07.737504 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.723830 2572 server.go:962] "Client rotation is on, will bootstrap in background" Jul 15 21:10:07.737504 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.725938 2572 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 15 21:10:07.737504 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.727231 2572 server.go:1019] "Starting client certificate rotation" Jul 15 21:10:07.737504 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.727343 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 21:10:07.737504 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.727391 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 15 21:10:07.737504 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.729437 2572 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 21:10:07.737504 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.732263 2572 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 15 21:10:07.742464 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.742445 2572 log.go:25] "Validated CRI v1 runtime API" Jul 15 21:10:07.744423 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.744406 2572 log.go:25] "Validated CRI v1 image API" Jul 15 21:10:07.745027 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.745013 2572 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 15 21:10:07.747275 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.747257 2572 fs.go:135] Filesystem UUIDs: map[1e33a5bf-df03-428a-8cd6-376533fd20ff:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 b87de7a9-ff4d-412d-b8bd-ae791ff608ac:/dev/nvme0n1p4] Jul 15 21:10:07.747320 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.747275 2572 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 15 21:10:07.753326 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.753208 2572 manager.go:216] Machine: {Timestamp:2026-07-15 21:10:07.751891137 +0000 UTC m=+0.573208445 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099191 MemoryCapacity:33164496896 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2379787c27ac6f787f0127a4027d23 SystemUUID:ec237978-7c27-ac6f-787f-0127a4027d23 BootID:b4afac69-55eb-4e23-bd8a-c8473e7f5892 Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582246400 Type:vfs Inodes:4048400 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:bf:43:e1:e8:23 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:bf:43:e1:e8:23 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:ca:51:8d:dd:fb:33 Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164496896 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 15 21:10:07.753326 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.753315 2572 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 15 21:10:07.753463 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.753402 2572 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 15 21:10:07.756496 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.756456 2572 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 15 21:10:07.756691 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.756502 2572 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-136-18.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 15 21:10:07.757274 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.757263 2572 topology_manager.go:138] "Creating topology manager with none policy" Jul 15 21:10:07.757308 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.757279 2572 container_manager_linux.go:309] "Creating device plugin manager" Jul 15 21:10:07.757308 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.757289 2572 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 21:10:07.758192 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.758180 2572 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 15 21:10:07.759096 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.759084 2572 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 15 21:10:07.761291 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.761274 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 21:10:07.762931 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.762919 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 15 21:10:07.763136 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.763125 2572 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 15 21:10:07.763171 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.763162 2572 kubelet.go:486] "Attempting to sync node with API server" Jul 15 21:10:07.763199 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.763179 2572 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 15 21:10:07.763236 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.763198 2572 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 15 21:10:07.763236 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.763212 2572 kubelet.go:398] "Adding apiserver pod source" Jul 15 21:10:07.763236 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.763224 2572 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 15 21:10:07.763690 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.763661 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 21:10:07.763690 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.763683 2572 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 15 21:10:07.766454 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.766435 2572 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 15 21:10:07.767800 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.767786 2572 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 15 21:10:07.767877 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.767815 2572 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 15 21:10:07.768381 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.768371 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 15 21:10:07.768448 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.768386 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 15 21:10:07.768448 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.768392 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 15 21:10:07.768448 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.768398 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 15 21:10:07.768448 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.768407 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 15 21:10:07.768448 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.768413 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 15 21:10:07.768631 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.768613 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 15 21:10:07.768631 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.768620 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 15 21:10:07.768631 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.768627 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 15 21:10:07.768631 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.768632 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 15 21:10:07.768741 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.768641 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 15 21:10:07.768741 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.768648 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 15 21:10:07.769574 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.769565 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 15 21:10:07.769574 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.769574 2572 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 15 21:10:07.772734 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.772721 2572 server.go:1268] "Started kubelet" Jul 15 21:10:07.772823 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.772789 2572 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 15 21:10:07.772961 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.772916 2572 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 15 21:10:07.773031 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.772981 2572 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 15 21:10:07.773515 ip-10-0-136-18 systemd[1]: Started Kubernetes Kubelet. Jul 15 21:10:07.774862 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.774848 2572 server.go:310] "Adding debug handlers to kubelet server" Jul 15 21:10:07.775771 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.775754 2572 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-136-18.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 15 21:10:07.775842 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:07.775755 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 15 21:10:07.775842 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:07.775755 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-136-18.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 15 21:10:07.776160 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.776125 2572 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 15 21:10:07.779427 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.779264 2572 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 15 21:10:07.779427 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.779286 2572 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 15 21:10:07.779427 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:07.779329 2572 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 15 21:10:07.779427 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:07.779407 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-18.ec2.internal\" not found" Jul 15 21:10:07.779979 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.779874 2572 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 15 21:10:07.779979 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.779875 2572 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 15 21:10:07.779979 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.779897 2572 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 15 21:10:07.780161 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.780010 2572 reconstruct.go:97] "Volume reconstruction finished" Jul 15 21:10:07.780161 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.780020 2572 reconciler.go:29] "Reconciler: start to sync state" Jul 15 21:10:07.780417 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.780403 2572 factory.go:55] Registering systemd factory Jul 15 21:10:07.780483 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.780420 2572 factory.go:223] Registration of the systemd container factory successfully Jul 15 21:10:07.780657 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.780643 2572 factory.go:153] Registering CRI-O factory Jul 15 21:10:07.780702 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.780662 2572 factory.go:223] Registration of the crio container factory successfully Jul 15 21:10:07.780735 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.780719 2572 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 15 21:10:07.780779 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.780749 2572 factory.go:103] Registering Raw factory Jul 15 21:10:07.780779 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.780763 2572 manager.go:1196] Started watching for new ooms in manager Jul 15 21:10:07.781268 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.781246 2572 manager.go:349] Starting recovery of all containers Jul 15 21:10:07.788783 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:07.788720 2572 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-136-18.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 15 21:10:07.789213 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.789173 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 15 21:10:07.789389 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:07.789351 2572 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 15 21:10:07.789758 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:07.788701 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-18.ec2.internal.18c292cc1e5f7cfd default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-18.ec2.internal,UID:ip-10-0-136-18.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-136-18.ec2.internal,},FirstTimestamp:2026-07-15 21:10:07.772695805 +0000 UTC m=+0.594013113,LastTimestamp:2026-07-15 21:10:07.772695805 +0000 UTC m=+0.594013113,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-18.ec2.internal,}" Jul 15 21:10:07.794278 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.794261 2572 manager.go:354] Recovery completed Jul 15 21:10:07.798950 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.798937 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:10:07.801856 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.801833 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:10:07.801955 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.801872 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:10:07.801955 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.801894 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:10:07.802791 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.802774 2572 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 15 21:10:07.802791 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.802785 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:10:07.802893 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.802789 2572 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 15 21:10:07.802893 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.802841 2572 state_mem.go:36] "Initialized new in-memory state store" Jul 15 21:10:07.803404 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.803389 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:10:07.803463 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.803415 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:10:07.803463 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.803424 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:10:07.803966 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:07.803895 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-18.ec2.internal.18c292cc201c6955 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-18.ec2.internal,UID:ip-10-0-136-18.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-18.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-18.ec2.internal,},FirstTimestamp:2026-07-15 21:10:07.801854293 +0000 UTC m=+0.623171606,LastTimestamp:2026-07-15 21:10:07.801854293 +0000 UTC m=+0.623171606,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-18.ec2.internal,}" Jul 15 21:10:07.804092 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.804079 2572 policy_none.go:49] "None policy: Start" Jul 15 21:10:07.804123 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.804100 2572 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 15 21:10:07.804123 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.804115 2572 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 15 21:10:07.805276 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.805264 2572 policy_none.go:47] "Start" Jul 15 21:10:07.806862 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:07.806790 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-18.ec2.internal.18c292cc201cc560 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-18.ec2.internal,UID:ip-10-0-136-18.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-18.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-18.ec2.internal,},FirstTimestamp:2026-07-15 21:10:07.801877856 +0000 UTC m=+0.623195164,LastTimestamp:2026-07-15 21:10:07.801877856 +0000 UTC m=+0.623195164,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-18.ec2.internal,}" Jul 15 21:10:07.812388 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:07.812253 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-18.ec2.internal.18c292cc201d1f98 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-18.ec2.internal,UID:ip-10-0-136-18.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-18.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-18.ec2.internal,},FirstTimestamp:2026-07-15 21:10:07.801900952 +0000 UTC m=+0.623218259,LastTimestamp:2026-07-15 21:10:07.801900952 +0000 UTC m=+0.623218259,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-18.ec2.internal,}" Jul 15 21:10:07.819306 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:07.819226 2572 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-18.ec2.internal.18c292cc201c6955\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-18.ec2.internal.18c292cc201c6955 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-18.ec2.internal,UID:ip-10-0-136-18.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientMemory,Message:Node ip-10-0-136-18.ec2.internal status is now: NodeHasSufficientMemory,Source:EventSource{Component:kubelet,Host:ip-10-0-136-18.ec2.internal,},FirstTimestamp:2026-07-15 21:10:07.801854293 +0000 UTC m=+0.623171606,LastTimestamp:2026-07-15 21:10:07.80340371 +0000 UTC m=+0.624721017,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-18.ec2.internal,}" Jul 15 21:10:07.821473 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:07.821411 2572 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-18.ec2.internal.18c292cc201cc560\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-18.ec2.internal.18c292cc201cc560 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-18.ec2.internal,UID:ip-10-0-136-18.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasNoDiskPressure,Message:Node ip-10-0-136-18.ec2.internal status is now: NodeHasNoDiskPressure,Source:EventSource{Component:kubelet,Host:ip-10-0-136-18.ec2.internal,},FirstTimestamp:2026-07-15 21:10:07.801877856 +0000 UTC m=+0.623195164,LastTimestamp:2026-07-15 21:10:07.803420028 +0000 UTC m=+0.624737335,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-18.ec2.internal,}" Jul 15 21:10:07.828306 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:07.828145 2572 event.go:359] "Server rejected event (will not retry!)" err="events \"ip-10-0-136-18.ec2.internal.18c292cc201d1f98\" is forbidden: User \"system:anonymous\" cannot patch resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-18.ec2.internal.18c292cc201d1f98 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-18.ec2.internal,UID:ip-10-0-136-18.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeHasSufficientPID,Message:Node ip-10-0-136-18.ec2.internal status is now: NodeHasSufficientPID,Source:EventSource{Component:kubelet,Host:ip-10-0-136-18.ec2.internal,},FirstTimestamp:2026-07-15 21:10:07.801900952 +0000 UTC m=+0.623218259,LastTimestamp:2026-07-15 21:10:07.803427806 +0000 UTC m=+0.624745114,Count:2,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-18.ec2.internal,}" Jul 15 21:10:07.836098 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.836082 2572 manager.go:337] "Starting Device Plugin manager" Jul 15 21:10:07.836168 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:07.836122 2572 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 15 21:10:07.836168 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.836138 2572 server.go:87] "Starting device plugin registration server" Jul 15 21:10:07.836382 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.836370 2572 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 15 21:10:07.836461 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.836386 2572 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 15 21:10:07.836514 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.836495 2572 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 15 21:10:07.836792 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.836585 2572 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 15 21:10:07.836792 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.836601 2572 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 15 21:10:07.837211 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:07.837178 2572 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 15 21:10:07.837283 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:07.837235 2572 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-136-18.ec2.internal\" not found" Jul 15 21:10:07.840512 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:07.840445 2572 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-136-18.ec2.internal.18c292cc22469523 default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-136-18.ec2.internal,UID:ip-10-0-136-18.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:NodeAllocatableEnforced,Message:Updated Node Allocatable limit across pods,Source:EventSource{Component:kubelet,Host:ip-10-0-136-18.ec2.internal,},FirstTimestamp:2026-07-15 21:10:07.838172451 +0000 UTC m=+0.659489747,LastTimestamp:2026-07-15 21:10:07.838172451 +0000 UTC m=+0.659489747,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-136-18.ec2.internal,}" Jul 15 21:10:07.848190 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.848171 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-px8wb" Jul 15 21:10:07.854829 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.854815 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-px8wb" Jul 15 21:10:07.937115 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.937074 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:10:07.938201 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.938116 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:10:07.938201 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.938157 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:10:07.938201 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.938181 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:10:07.938327 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.938207 2572 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-136-18.ec2.internal" Jul 15 21:10:07.953802 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.953782 2572 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 15 21:10:07.953893 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.953835 2572 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 15 21:10:07.953893 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.953857 2572 kubelet.go:2448] "Starting kubelet main sync loop" Jul 15 21:10:07.953893 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:07.953889 2572 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 15 21:10:07.955449 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.955418 2572 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-136-18.ec2.internal" Jul 15 21:10:07.955566 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:07.955453 2572 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-136-18.ec2.internal\": node \"ip-10-0-136-18.ec2.internal\" not found" Jul 15 21:10:07.959107 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:07.959082 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:10:08.014910 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:08.014882 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-18.ec2.internal\" not found" Jul 15 21:10:08.055034 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.054964 2572 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-18.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-136-18.ec2.internal"] Jul 15 21:10:08.055120 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.055048 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:10:08.056070 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.056054 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:10:08.056158 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.056087 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:10:08.056158 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.056101 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:10:08.057445 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.057430 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:10:08.057655 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.057640 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-18.ec2.internal" Jul 15 21:10:08.057706 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.057669 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:10:08.058821 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.058805 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:10:08.058878 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.058837 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:10:08.058878 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.058849 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:10:08.058985 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.058972 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:10:08.059015 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.058997 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:10:08.059015 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.059007 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:10:08.060032 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.060018 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-18.ec2.internal" Jul 15 21:10:08.060079 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.060042 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:10:08.060713 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.060698 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:10:08.060783 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.060726 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:10:08.060783 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.060739 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:10:08.082636 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.082608 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2320ae40ef41a04718e973c766a6e0c4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-18.ec2.internal\" (UID: \"2320ae40ef41a04718e973c766a6e0c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-18.ec2.internal" Jul 15 21:10:08.082731 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.082640 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/19a84ea42e04a6bb6b6f4312809222d6-config\") pod \"kube-apiserver-proxy-ip-10-0-136-18.ec2.internal\" (UID: \"19a84ea42e04a6bb6b6f4312809222d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-18.ec2.internal" Jul 15 21:10:08.082731 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.082659 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2320ae40ef41a04718e973c766a6e0c4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-18.ec2.internal\" (UID: \"2320ae40ef41a04718e973c766a6e0c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-18.ec2.internal" Jul 15 21:10:08.084155 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:08.084135 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-18.ec2.internal\" not found" node="ip-10-0-136-18.ec2.internal" Jul 15 21:10:08.088449 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:08.088434 2572 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-136-18.ec2.internal\" not found" node="ip-10-0-136-18.ec2.internal" Jul 15 21:10:08.115339 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:08.115322 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-18.ec2.internal\" not found" Jul 15 21:10:08.183151 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.183117 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2320ae40ef41a04718e973c766a6e0c4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-18.ec2.internal\" (UID: \"2320ae40ef41a04718e973c766a6e0c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-18.ec2.internal" Jul 15 21:10:08.183263 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.183157 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2320ae40ef41a04718e973c766a6e0c4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-18.ec2.internal\" (UID: \"2320ae40ef41a04718e973c766a6e0c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-18.ec2.internal" Jul 15 21:10:08.183263 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.183180 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/19a84ea42e04a6bb6b6f4312809222d6-config\") pod \"kube-apiserver-proxy-ip-10-0-136-18.ec2.internal\" (UID: \"19a84ea42e04a6bb6b6f4312809222d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-18.ec2.internal" Jul 15 21:10:08.183263 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.183219 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/2320ae40ef41a04718e973c766a6e0c4-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-136-18.ec2.internal\" (UID: \"2320ae40ef41a04718e973c766a6e0c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-18.ec2.internal" Jul 15 21:10:08.183263 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.183237 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/19a84ea42e04a6bb6b6f4312809222d6-config\") pod \"kube-apiserver-proxy-ip-10-0-136-18.ec2.internal\" (UID: \"19a84ea42e04a6bb6b6f4312809222d6\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-136-18.ec2.internal" Jul 15 21:10:08.183263 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.183227 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/2320ae40ef41a04718e973c766a6e0c4-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-136-18.ec2.internal\" (UID: \"2320ae40ef41a04718e973c766a6e0c4\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-18.ec2.internal" Jul 15 21:10:08.215592 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:08.215569 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-18.ec2.internal\" not found" Jul 15 21:10:08.316339 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:08.316283 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-18.ec2.internal\" not found" Jul 15 21:10:08.386806 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.386768 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-18.ec2.internal" Jul 15 21:10:08.392014 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.391894 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-18.ec2.internal" Jul 15 21:10:08.417366 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:08.417347 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-18.ec2.internal\" not found" Jul 15 21:10:08.517817 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:08.517780 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-18.ec2.internal\" not found" Jul 15 21:10:08.618286 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:08.618219 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-18.ec2.internal\" not found" Jul 15 21:10:08.718709 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:08.718675 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-18.ec2.internal\" not found" Jul 15 21:10:08.726840 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.726818 2572 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 15 21:10:08.726961 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.726943 2572 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 15 21:10:08.819584 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:08.819557 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-18.ec2.internal\" not found" Jul 15 21:10:08.858810 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.858755 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-14 21:05:07 +0000 UTC" deadline="2028-04-19 23:28:50.987333916 +0000 UTC" Jul 15 21:10:08.858810 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.858808 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="15458h18m42.128530653s" Jul 15 21:10:08.863917 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.863894 2572 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 15 21:10:08.865097 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.865079 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasSufficientMemory" Jul 15 21:10:08.865197 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.865111 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasNoDiskPressure" Jul 15 21:10:08.865197 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.865124 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeHasSufficientPID" Jul 15 21:10:08.919394 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:08.919357 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2320ae40ef41a04718e973c766a6e0c4.slice/crio-1929ac78b912a10a5ebab793943c399f4120daefaa69ad9ea44c0f1001576cd0 WatchSource:0}: Error finding container 1929ac78b912a10a5ebab793943c399f4120daefaa69ad9ea44c0f1001576cd0: Status 404 returned error can't find the container with id 1929ac78b912a10a5ebab793943c399f4120daefaa69ad9ea44c0f1001576cd0 Jul 15 21:10:08.919643 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:08.919621 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19a84ea42e04a6bb6b6f4312809222d6.slice/crio-1a4bd9df5c2f0557e707671370261d0a869b69ba05ecc45eed7adf521978c4c1 WatchSource:0}: Error finding container 1a4bd9df5c2f0557e707671370261d0a869b69ba05ecc45eed7adf521978c4c1: Status 404 returned error can't find the container with id 1a4bd9df5c2f0557e707671370261d0a869b69ba05ecc45eed7adf521978c4c1 Jul 15 21:10:08.919643 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:08.919628 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-18.ec2.internal\" not found" Jul 15 21:10:08.925250 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.924907 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:10:08.956485 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.956444 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-18.ec2.internal" event={"ID":"2320ae40ef41a04718e973c766a6e0c4","Type":"ContainerStarted","Data":"1929ac78b912a10a5ebab793943c399f4120daefaa69ad9ea44c0f1001576cd0"} Jul 15 21:10:08.957346 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.957326 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-18.ec2.internal" event={"ID":"19a84ea42e04a6bb6b6f4312809222d6","Type":"ContainerStarted","Data":"1a4bd9df5c2f0557e707671370261d0a869b69ba05ecc45eed7adf521978c4c1"} Jul 15 21:10:08.972620 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:08.972599 2572 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:10:09.020407 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:09.020380 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-18.ec2.internal\" not found" Jul 15 21:10:09.121013 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:09.120987 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-18.ec2.internal\" not found" Jul 15 21:10:09.121309 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.121296 2572 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:10:09.221496 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:09.221425 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-18.ec2.internal\" not found" Jul 15 21:10:09.322268 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:09.322234 2572 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-136-18.ec2.internal\" not found" Jul 15 21:10:09.351818 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.351791 2572 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:10:09.379618 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.379584 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-18.ec2.internal" Jul 15 21:10:09.390055 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.390029 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 21:10:09.390892 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.390873 2572 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-18.ec2.internal" Jul 15 21:10:09.401647 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.401627 2572 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 15 21:10:09.764290 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.764254 2572 apiserver.go:52] "Watching apiserver" Jul 15 21:10:09.770659 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.770636 2572 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 15 21:10:09.771787 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.771755 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/konnectivity-agent-mgqkb","kube-system/kube-apiserver-proxy-ip-10-0-136-18.ec2.internal","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j","openshift-dns/node-resolver-mlpzt","openshift-image-registry/node-ca-n2lsq","openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-18.ec2.internal","openshift-multus/multus-additional-cni-plugins-w7wc8","openshift-multus/multus-xjxpc","kube-system/global-pull-secret-syncer-jl9zp","openshift-cluster-node-tuning-operator/tuned-sxn79","openshift-multus/network-metrics-daemon-mct98","openshift-network-diagnostics/network-check-target-6nvzk","openshift-network-operator/iptables-alerter-7fqlq","openshift-ovn-kubernetes/ovnkube-node-dsl2f"] Jul 15 21:10:09.773193 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.773175 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.774383 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.774361 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.775567 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.775546 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:10:09.775661 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.775589 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-8mfzk\"" Jul 15 21:10:09.775661 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.775612 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 15 21:10:09.775825 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.775811 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:09.775912 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:09.775884 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:09.776933 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.776915 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:09.777022 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:09.776997 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:09.777383 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.777366 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 15 21:10:09.777446 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.777368 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 15 21:10:09.777446 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.777434 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-6b9bc\"" Jul 15 21:10:09.779878 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.778414 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mlpzt" Jul 15 21:10:09.779878 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.779471 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 15 21:10:09.779878 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.779634 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 15 21:10:09.780105 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.780077 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 15 21:10:09.781110 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.780317 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 15 21:10:09.781110 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.780424 2572 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 15 21:10:09.781829 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.781804 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 15 21:10:09.782987 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.782666 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 15 21:10:09.782987 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.782719 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.782987 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.782791 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-cfs9q\"" Jul 15 21:10:09.784219 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.784198 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.785402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.785385 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:09.785481 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:09.785461 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:09.785843 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.785825 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 15 21:10:09.785914 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.785896 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-8kck9\"" Jul 15 21:10:09.786310 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.786288 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 15 21:10:09.786395 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.786345 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 15 21:10:09.786395 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.786367 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 15 21:10:09.786716 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.786698 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 15 21:10:09.786797 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.786724 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 15 21:10:09.786857 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.786810 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-kdr5c\"" Jul 15 21:10:09.786961 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.786930 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n2lsq" Jul 15 21:10:09.788489 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.788473 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mgqkb" Jul 15 21:10:09.789360 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.789183 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 15 21:10:09.789360 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.789191 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 15 21:10:09.789360 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.789252 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 15 21:10:09.789551 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.789508 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-kvkfc\"" Jul 15 21:10:09.790310 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.790232 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:09.790806 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.790762 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 15 21:10:09.790892 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.790818 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 15 21:10:09.790892 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.790857 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-thzb2\"" Jul 15 21:10:09.791077 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791057 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-var-lib-openvswitch\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.791160 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791091 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b20afb1-f155-4609-b0d1-bd613650e660-cnibin\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.791160 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791113 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b20afb1-f155-4609-b0d1-bd613650e660-cni-binary-copy\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.791263 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791168 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3b20afb1-f155-4609-b0d1-bd613650e660-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.791263 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791204 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rxdlf\" (UniqueName: \"kubernetes.io/projected/3b20afb1-f155-4609-b0d1-bd613650e660-kube-api-access-rxdlf\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.791263 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791248 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-etc-openvswitch\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.791412 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791273 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-host-run-ovn-kubernetes\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.791412 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791309 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.791412 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791346 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-ovn-node-metrics-cert\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.791412 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791370 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b20afb1-f155-4609-b0d1-bd613650e660-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.791412 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791392 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-etc-sysctl-d\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.791670 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791427 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-host-cni-netd\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.791670 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791456 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kthtb\" (UniqueName: \"kubernetes.io/projected/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-kube-api-access-kthtb\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.791670 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791478 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-lib-modules\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.791670 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791507 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/377a9efa-ef13-4550-b2fe-1de53fb91619-etc-tuned\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.791670 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791563 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-host-kubelet\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.791670 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791613 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-systemd-units\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.791670 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791640 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-host-slash\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.791670 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791664 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-run-systemd\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.792083 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791686 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-host-cni-bin\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.792083 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791719 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs\") pod \"network-metrics-daemon-mct98\" (UID: \"5c81bb07-fdbf-43fc-9554-e3d0ed0312e9\") " pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:09.792083 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791743 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-etc-sysconfig\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.792083 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791765 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-run\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.792083 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791786 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-899cw\" (UniqueName: \"kubernetes.io/projected/377a9efa-ef13-4550-b2fe-1de53fb91619-kube-api-access-899cw\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.792083 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791823 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7c003a0-a90e-4f42-bde8-8106b42cbdb6-tmp-dir\") pod \"node-resolver-mlpzt\" (UID: \"a7c003a0-a90e-4f42-bde8-8106b42cbdb6\") " pod="openshift-dns/node-resolver-mlpzt" Jul 15 21:10:09.792083 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791849 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b20afb1-f155-4609-b0d1-bd613650e660-system-cni-dir\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.792083 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791876 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3b20afb1-f155-4609-b0d1-bd613650e660-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.792083 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791903 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-etc-kubernetes\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.792083 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791924 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-etc-sysctl-conf\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.792083 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791929 2572 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 15 21:10:09.792083 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791941 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-etc-systemd\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.792083 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.791994 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-var-lib-kubelet\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.792083 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.792028 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-host-run-netns\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.792083 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.792043 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-ovnkube-config\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.792083 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.792058 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-ovnkube-script-lib\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.792083 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.792073 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kj877\" (UniqueName: \"kubernetes.io/projected/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-kube-api-access-kj877\") pod \"network-metrics-daemon-mct98\" (UID: \"5c81bb07-fdbf-43fc-9554-e3d0ed0312e9\") " pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:09.792873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.792087 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/377a9efa-ef13-4550-b2fe-1de53fb91619-tmp\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.792873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.792116 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-node-log\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.792873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.792139 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 15 21:10:09.792873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.792142 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-env-overrides\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.792873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.792165 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7fqlq" Jul 15 21:10:09.792873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.792166 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b20afb1-f155-4609-b0d1-bd613650e660-os-release\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.792873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.792192 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-log-socket\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.792873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.792216 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-etc-modprobe-d\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.792873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.792259 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-sys\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.792873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.792286 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-run-openvswitch\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.792873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.792302 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hmqzf\" (UniqueName: \"kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf\") pod \"network-check-target-6nvzk\" (UID: \"2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05\") " pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:09.792873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.792336 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7c003a0-a90e-4f42-bde8-8106b42cbdb6-hosts-file\") pod \"node-resolver-mlpzt\" (UID: \"a7c003a0-a90e-4f42-bde8-8106b42cbdb6\") " pod="openshift-dns/node-resolver-mlpzt" Jul 15 21:10:09.792873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.792361 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sfbtl\" (UniqueName: \"kubernetes.io/projected/a7c003a0-a90e-4f42-bde8-8106b42cbdb6-kube-api-access-sfbtl\") pod \"node-resolver-mlpzt\" (UID: \"a7c003a0-a90e-4f42-bde8-8106b42cbdb6\") " pod="openshift-dns/node-resolver-mlpzt" Jul 15 21:10:09.792873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.792386 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-run-ovn\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.792873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.792408 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-host\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.792873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.792705 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 15 21:10:09.792873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.792731 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 15 21:10:09.792873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.792709 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-2ch28\"" Jul 15 21:10:09.794412 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.794393 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:10:09.794740 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.794716 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 15 21:10:09.794851 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.794774 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 15 21:10:09.795192 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.795139 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-cpldt\"" Jul 15 21:10:09.835373 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.835350 2572 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-jfl6z" Jul 15 21:10:09.843585 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.843561 2572 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-jfl6z" Jul 15 21:10:09.880937 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.880908 2572 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 15 21:10:09.892635 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.892604 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-sys\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.892761 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.892649 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-run-openvswitch\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.892761 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.892675 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmqzf\" (UniqueName: \"kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf\") pod \"network-check-target-6nvzk\" (UID: \"2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05\") " pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:09.892761 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.892696 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7c003a0-a90e-4f42-bde8-8106b42cbdb6-hosts-file\") pod \"node-resolver-mlpzt\" (UID: \"a7c003a0-a90e-4f42-bde8-8106b42cbdb6\") " pod="openshift-dns/node-resolver-mlpzt" Jul 15 21:10:09.892761 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.892712 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sfbtl\" (UniqueName: \"kubernetes.io/projected/a7c003a0-a90e-4f42-bde8-8106b42cbdb6-kube-api-access-sfbtl\") pod \"node-resolver-mlpzt\" (UID: \"a7c003a0-a90e-4f42-bde8-8106b42cbdb6\") " pod="openshift-dns/node-resolver-mlpzt" Jul 15 21:10:09.892761 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.892727 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b20afb1-f155-4609-b0d1-bd613650e660-cnibin\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.892761 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.892743 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3b20afb1-f155-4609-b0d1-bd613650e660-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.892761 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.892763 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-multus-cni-dir\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.892980 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.892793 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-host\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.892980 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.892810 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b20afb1-f155-4609-b0d1-bd613650e660-cni-binary-copy\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.892980 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.892825 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-system-cni-dir\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.892980 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.892839 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-hostroot\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.892980 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.892855 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ffad0e67-b489-4cb5-9e92-f36f166c613a-host\") pod \"node-ca-n2lsq\" (UID: \"ffad0e67-b489-4cb5-9e92-f36f166c613a\") " pod="openshift-image-registry/node-ca-n2lsq" Jul 15 21:10:09.892980 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.892869 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a532ccab-82b5-417e-9d76-d1fb436f0e1f-sys-fs\") pod \"aws-ebs-csi-driver-node-zd52j\" (UID: \"a532ccab-82b5-417e-9d76-d1fb436f0e1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:09.892980 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.892883 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-ovn-node-metrics-cert\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.892980 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.892897 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/577cd1c7-c14a-49b2-9b2a-a127f263029f-cni-binary-copy\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.892980 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.892910 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-host-run-k8s-cni-cncf-io\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.892980 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.892926 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-host-var-lib-kubelet\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.892980 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.892956 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-host-run-multus-certs\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.892980 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.892971 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-dbus\") pod \"global-pull-secret-syncer-jl9zp\" (UID: \"ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7\") " pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:09.893389 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.892991 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kthtb\" (UniqueName: \"kubernetes.io/projected/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-kube-api-access-kthtb\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.893389 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893008 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-lib-modules\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.893389 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893023 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-host-kubelet\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.893389 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893037 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-host-slash\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.893389 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893051 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-run-systemd\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.893389 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893066 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-host-cni-bin\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.893389 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893080 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs\") pod \"network-metrics-daemon-mct98\" (UID: \"5c81bb07-fdbf-43fc-9554-e3d0ed0312e9\") " pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:09.893389 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893096 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b20afb1-f155-4609-b0d1-bd613650e660-system-cni-dir\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.893389 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893113 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3b20afb1-f155-4609-b0d1-bd613650e660-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.893389 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893130 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-etc-sysconfig\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.893389 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893147 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-run\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.893389 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893169 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-899cw\" (UniqueName: \"kubernetes.io/projected/377a9efa-ef13-4550-b2fe-1de53fb91619-kube-api-access-899cw\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.893389 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893192 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7c003a0-a90e-4f42-bde8-8106b42cbdb6-tmp-dir\") pod \"node-resolver-mlpzt\" (UID: \"a7c003a0-a90e-4f42-bde8-8106b42cbdb6\") " pod="openshift-dns/node-resolver-mlpzt" Jul 15 21:10:09.893389 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893217 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret\") pod \"global-pull-secret-syncer-jl9zp\" (UID: \"ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7\") " pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:09.893389 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893247 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a532ccab-82b5-417e-9d76-d1fb436f0e1f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zd52j\" (UID: \"a532ccab-82b5-417e-9d76-d1fb436f0e1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:09.893389 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893272 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a532ccab-82b5-417e-9d76-d1fb436f0e1f-device-dir\") pod \"aws-ebs-csi-driver-node-zd52j\" (UID: \"a532ccab-82b5-417e-9d76-d1fb436f0e1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:09.893389 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893382 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/a7c003a0-a90e-4f42-bde8-8106b42cbdb6-hosts-file\") pod \"node-resolver-mlpzt\" (UID: \"a7c003a0-a90e-4f42-bde8-8106b42cbdb6\") " pod="openshift-dns/node-resolver-mlpzt" Jul 15 21:10:09.894174 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:09.893445 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:10:09.894174 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893507 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-run\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.894174 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:09.893560 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs podName:5c81bb07-fdbf-43fc-9554-e3d0ed0312e9 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:10.393518865 +0000 UTC m=+3.214836161 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs") pod "network-metrics-daemon-mct98" (UID: "5c81bb07-fdbf-43fc-9554-e3d0ed0312e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:10:09.894174 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893578 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-etc-kubernetes\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.894174 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893642 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/a7c003a0-a90e-4f42-bde8-8106b42cbdb6-tmp-dir\") pod \"node-resolver-mlpzt\" (UID: \"a7c003a0-a90e-4f42-bde8-8106b42cbdb6\") " pod="openshift-dns/node-resolver-mlpzt" Jul 15 21:10:09.894174 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893701 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-host-cni-bin\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.894174 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893711 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-sys\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.894174 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893731 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-etc-sysconfig\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.894174 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893733 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-run-openvswitch\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.894174 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893750 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-host\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.894174 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893750 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-etc-sysctl-conf\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.894174 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893780 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-etc-systemd\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.894174 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893798 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-host-kubelet\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.894174 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893824 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-etc-systemd\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.894174 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893875 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-etc-kubernetes\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.894174 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893880 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-etc-sysctl-conf\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.894174 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.893885 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/3b20afb1-f155-4609-b0d1-bd613650e660-cnibin\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.894174 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894025 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/3b20afb1-f155-4609-b0d1-bd613650e660-system-cni-dir\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.894938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894060 2572 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 15 21:10:09.894938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894075 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-host-slash\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.894938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894142 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-run-systemd\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.894938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894195 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-lib-modules\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.894938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894255 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-var-lib-kubelet\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.894938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894315 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-host-run-netns\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.894938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894343 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/3b20afb1-f155-4609-b0d1-bd613650e660-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.894938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894367 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-var-lib-kubelet\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.894938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894374 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/3b20afb1-f155-4609-b0d1-bd613650e660-cni-binary-copy\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.894938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894385 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-ovnkube-script-lib\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.894938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894401 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-host-run-netns\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.894938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894455 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a532ccab-82b5-417e-9d76-d1fb436f0e1f-etc-selinux\") pod \"aws-ebs-csi-driver-node-zd52j\" (UID: \"a532ccab-82b5-417e-9d76-d1fb436f0e1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:09.894938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894479 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f39096b7-3b12-4822-80cf-829be2c84725-konnectivity-ca\") pod \"konnectivity-agent-mgqkb\" (UID: \"f39096b7-3b12-4822-80cf-829be2c84725\") " pod="kube-system/konnectivity-agent-mgqkb" Jul 15 21:10:09.894938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894617 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-node-log\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.894938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894671 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-env-overrides\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.894938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894675 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-node-log\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.894938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894706 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b20afb1-f155-4609-b0d1-bd613650e660-os-release\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.895943 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894772 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-host-var-lib-cni-bin\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.895943 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894791 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ab1393c4-a46e-42bc-b5f1-c434a8190156-iptables-alerter-script\") pod \"iptables-alerter-7fqlq\" (UID: \"ab1393c4-a46e-42bc-b5f1-c434a8190156\") " pod="openshift-network-operator/iptables-alerter-7fqlq" Jul 15 21:10:09.895943 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894827 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-log-socket\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.895943 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894871 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-etc-modprobe-d\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.895943 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894893 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/3b20afb1-f155-4609-b0d1-bd613650e660-os-release\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.895943 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894909 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-etc-kubernetes\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.895943 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894929 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-log-socket\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.895943 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894963 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab1393c4-a46e-42bc-b5f1-c434a8190156-host-slash\") pod \"iptables-alerter-7fqlq\" (UID: \"ab1393c4-a46e-42bc-b5f1-c434a8190156\") " pod="openshift-network-operator/iptables-alerter-7fqlq" Jul 15 21:10:09.895943 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.894995 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-run-ovn\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.895943 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895020 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-var-lib-openvswitch\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.895943 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895027 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-etc-modprobe-d\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.895943 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895048 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rxdlf\" (UniqueName: \"kubernetes.io/projected/3b20afb1-f155-4609-b0d1-bd613650e660-kube-api-access-rxdlf\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.895943 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895070 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-run-ovn\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.895943 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895075 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-var-lib-openvswitch\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.895943 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895070 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-env-overrides\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.895943 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895110 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/577cd1c7-c14a-49b2-9b2a-a127f263029f-multus-daemon-config\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.895943 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895141 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/3b20afb1-f155-4609-b0d1-bd613650e660-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.896774 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895228 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a532ccab-82b5-417e-9d76-d1fb436f0e1f-socket-dir\") pod \"aws-ebs-csi-driver-node-zd52j\" (UID: \"a532ccab-82b5-417e-9d76-d1fb436f0e1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:09.896774 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895266 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c64k2\" (UniqueName: \"kubernetes.io/projected/a532ccab-82b5-417e-9d76-d1fb436f0e1f-kube-api-access-c64k2\") pod \"aws-ebs-csi-driver-node-zd52j\" (UID: \"a532ccab-82b5-417e-9d76-d1fb436f0e1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:09.896774 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895297 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-etc-openvswitch\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.896774 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895325 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-host-run-ovn-kubernetes\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.896774 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895347 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.896774 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895342 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-etc-openvswitch\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.896774 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895375 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b20afb1-f155-4609-b0d1-bd613650e660-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.896774 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895381 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-host-run-ovn-kubernetes\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.896774 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895397 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-ovnkube-script-lib\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.896774 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895402 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a532ccab-82b5-417e-9d76-d1fb436f0e1f-registration-dir\") pod \"aws-ebs-csi-driver-node-zd52j\" (UID: \"a532ccab-82b5-417e-9d76-d1fb436f0e1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:09.896774 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895404 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.896774 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895450 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-etc-sysctl-d\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.896774 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895470 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-host-cni-netd\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.896774 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895499 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/3b20afb1-f155-4609-b0d1-bd613650e660-tuning-conf-dir\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.896774 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895506 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xzcnl\" (UniqueName: \"kubernetes.io/projected/577cd1c7-c14a-49b2-9b2a-a127f263029f-kube-api-access-xzcnl\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.896774 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895541 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/377a9efa-ef13-4550-b2fe-1de53fb91619-etc-tuned\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.897543 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895557 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-host-cni-netd\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.897543 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895591 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/377a9efa-ef13-4550-b2fe-1de53fb91619-etc-sysctl-d\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.897543 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895564 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-systemd-units\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.897543 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895610 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-systemd-units\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.897543 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895624 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-os-release\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.897543 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895647 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-host-run-netns\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.897543 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895664 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-multus-conf-dir\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.897543 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895686 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f39096b7-3b12-4822-80cf-829be2c84725-agent-certs\") pod \"konnectivity-agent-mgqkb\" (UID: \"f39096b7-3b12-4822-80cf-829be2c84725\") " pod="kube-system/konnectivity-agent-mgqkb" Jul 15 21:10:09.897543 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895729 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-ovnkube-config\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.897543 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895755 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kj877\" (UniqueName: \"kubernetes.io/projected/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-kube-api-access-kj877\") pod \"network-metrics-daemon-mct98\" (UID: \"5c81bb07-fdbf-43fc-9554-e3d0ed0312e9\") " pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:09.897543 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895779 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-multus-socket-dir-parent\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.897543 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895805 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-host-var-lib-cni-multus\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.897543 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895828 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2zqwc\" (UniqueName: \"kubernetes.io/projected/ffad0e67-b489-4cb5-9e92-f36f166c613a-kube-api-access-2zqwc\") pod \"node-ca-n2lsq\" (UID: \"ffad0e67-b489-4cb5-9e92-f36f166c613a\") " pod="openshift-image-registry/node-ca-n2lsq" Jul 15 21:10:09.897543 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895851 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bb7hs\" (UniqueName: \"kubernetes.io/projected/ab1393c4-a46e-42bc-b5f1-c434a8190156-kube-api-access-bb7hs\") pod \"iptables-alerter-7fqlq\" (UID: \"ab1393c4-a46e-42bc-b5f1-c434a8190156\") " pod="openshift-network-operator/iptables-alerter-7fqlq" Jul 15 21:10:09.897543 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895891 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/377a9efa-ef13-4550-b2fe-1de53fb91619-tmp\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.897543 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895952 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-cnibin\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.897543 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.895985 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-kubelet-config\") pod \"global-pull-secret-syncer-jl9zp\" (UID: \"ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7\") " pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:09.898182 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.896003 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ffad0e67-b489-4cb5-9e92-f36f166c613a-serviceca\") pod \"node-ca-n2lsq\" (UID: \"ffad0e67-b489-4cb5-9e92-f36f166c613a\") " pod="openshift-image-registry/node-ca-n2lsq" Jul 15 21:10:09.898182 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.896264 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-ovnkube-config\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.898182 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.898000 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/377a9efa-ef13-4550-b2fe-1de53fb91619-etc-tuned\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.898182 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.898161 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-ovn-node-metrics-cert\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.898349 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.898333 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/377a9efa-ef13-4550-b2fe-1de53fb91619-tmp\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.902547 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:09.902513 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:10:09.902646 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:09.902550 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:10:09.902646 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:09.902563 2572 projected.go:196] Error preparing data for projected volume kube-api-access-hmqzf for pod openshift-network-diagnostics/network-check-target-6nvzk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:10:09.902646 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:09.902634 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf podName:2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:10.402613084 +0000 UTC m=+3.223930406 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-hmqzf" (UniqueName: "kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf") pod "network-check-target-6nvzk" (UID: "2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:10:09.906112 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.906091 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kthtb\" (UniqueName: \"kubernetes.io/projected/19ebe52b-28dc-4b7b-af2d-0779b13a9b62-kube-api-access-kthtb\") pod \"ovnkube-node-dsl2f\" (UID: \"19ebe52b-28dc-4b7b-af2d-0779b13a9b62\") " pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:09.908176 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.908152 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kj877\" (UniqueName: \"kubernetes.io/projected/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-kube-api-access-kj877\") pod \"network-metrics-daemon-mct98\" (UID: \"5c81bb07-fdbf-43fc-9554-e3d0ed0312e9\") " pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:09.908569 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.908545 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rxdlf\" (UniqueName: \"kubernetes.io/projected/3b20afb1-f155-4609-b0d1-bd613650e660-kube-api-access-rxdlf\") pod \"multus-additional-cni-plugins-w7wc8\" (UID: \"3b20afb1-f155-4609-b0d1-bd613650e660\") " pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:09.909013 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.908990 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-899cw\" (UniqueName: \"kubernetes.io/projected/377a9efa-ef13-4550-b2fe-1de53fb91619-kube-api-access-899cw\") pod \"tuned-sxn79\" (UID: \"377a9efa-ef13-4550-b2fe-1de53fb91619\") " pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:09.909098 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.909021 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sfbtl\" (UniqueName: \"kubernetes.io/projected/a7c003a0-a90e-4f42-bde8-8106b42cbdb6-kube-api-access-sfbtl\") pod \"node-resolver-mlpzt\" (UID: \"a7c003a0-a90e-4f42-bde8-8106b42cbdb6\") " pod="openshift-dns/node-resolver-mlpzt" Jul 15 21:10:09.996689 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.996655 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/577cd1c7-c14a-49b2-9b2a-a127f263029f-cni-binary-copy\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.996915 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.996696 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-host-run-k8s-cni-cncf-io\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.996915 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.996725 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-host-var-lib-kubelet\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.996915 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.996747 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-host-run-multus-certs\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.996915 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.996768 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-dbus\") pod \"global-pull-secret-syncer-jl9zp\" (UID: \"ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7\") " pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:09.996915 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.996791 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-host-var-lib-kubelet\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.996915 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.996813 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret\") pod \"global-pull-secret-syncer-jl9zp\" (UID: \"ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7\") " pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:09.996915 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.996792 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-host-run-k8s-cni-cncf-io\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.996915 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:09.996895 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:10:09.997308 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.996915 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a532ccab-82b5-417e-9d76-d1fb436f0e1f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zd52j\" (UID: \"a532ccab-82b5-417e-9d76-d1fb436f0e1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:09.997308 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.996927 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-host-run-multus-certs\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.997308 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:09.996942 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret podName:ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:10.496929953 +0000 UTC m=+3.318247279 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret") pod "global-pull-secret-syncer-jl9zp" (UID: "ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:10:09.997308 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.996977 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/a532ccab-82b5-417e-9d76-d1fb436f0e1f-kubelet-dir\") pod \"aws-ebs-csi-driver-node-zd52j\" (UID: \"a532ccab-82b5-417e-9d76-d1fb436f0e1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:09.997308 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.996989 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a532ccab-82b5-417e-9d76-d1fb436f0e1f-device-dir\") pod \"aws-ebs-csi-driver-node-zd52j\" (UID: \"a532ccab-82b5-417e-9d76-d1fb436f0e1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:09.997308 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997016 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a532ccab-82b5-417e-9d76-d1fb436f0e1f-etc-selinux\") pod \"aws-ebs-csi-driver-node-zd52j\" (UID: \"a532ccab-82b5-417e-9d76-d1fb436f0e1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:09.997308 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997038 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f39096b7-3b12-4822-80cf-829be2c84725-konnectivity-ca\") pod \"konnectivity-agent-mgqkb\" (UID: \"f39096b7-3b12-4822-80cf-829be2c84725\") " pod="kube-system/konnectivity-agent-mgqkb" Jul 15 21:10:09.997308 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997065 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-host-var-lib-cni-bin\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.997308 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997089 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ab1393c4-a46e-42bc-b5f1-c434a8190156-iptables-alerter-script\") pod \"iptables-alerter-7fqlq\" (UID: \"ab1393c4-a46e-42bc-b5f1-c434a8190156\") " pod="openshift-network-operator/iptables-alerter-7fqlq" Jul 15 21:10:09.997308 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997095 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/a532ccab-82b5-417e-9d76-d1fb436f0e1f-device-dir\") pod \"aws-ebs-csi-driver-node-zd52j\" (UID: \"a532ccab-82b5-417e-9d76-d1fb436f0e1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:09.997308 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997099 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-dbus\") pod \"global-pull-secret-syncer-jl9zp\" (UID: \"ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7\") " pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:09.997308 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997134 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-host-var-lib-cni-bin\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.997308 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997163 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/a532ccab-82b5-417e-9d76-d1fb436f0e1f-etc-selinux\") pod \"aws-ebs-csi-driver-node-zd52j\" (UID: \"a532ccab-82b5-417e-9d76-d1fb436f0e1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:09.997308 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997167 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-etc-kubernetes\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.997308 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997195 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-etc-kubernetes\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.997308 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997208 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab1393c4-a46e-42bc-b5f1-c434a8190156-host-slash\") pod \"iptables-alerter-7fqlq\" (UID: \"ab1393c4-a46e-42bc-b5f1-c434a8190156\") " pod="openshift-network-operator/iptables-alerter-7fqlq" Jul 15 21:10:09.997860 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997235 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/577cd1c7-c14a-49b2-9b2a-a127f263029f-multus-daemon-config\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.997860 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997260 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a532ccab-82b5-417e-9d76-d1fb436f0e1f-socket-dir\") pod \"aws-ebs-csi-driver-node-zd52j\" (UID: \"a532ccab-82b5-417e-9d76-d1fb436f0e1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:09.997860 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997300 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c64k2\" (UniqueName: \"kubernetes.io/projected/a532ccab-82b5-417e-9d76-d1fb436f0e1f-kube-api-access-c64k2\") pod \"aws-ebs-csi-driver-node-zd52j\" (UID: \"a532ccab-82b5-417e-9d76-d1fb436f0e1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:09.997860 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997311 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/ab1393c4-a46e-42bc-b5f1-c434a8190156-host-slash\") pod \"iptables-alerter-7fqlq\" (UID: \"ab1393c4-a46e-42bc-b5f1-c434a8190156\") " pod="openshift-network-operator/iptables-alerter-7fqlq" Jul 15 21:10:09.997860 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997328 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a532ccab-82b5-417e-9d76-d1fb436f0e1f-registration-dir\") pod \"aws-ebs-csi-driver-node-zd52j\" (UID: \"a532ccab-82b5-417e-9d76-d1fb436f0e1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:09.997860 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997453 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/577cd1c7-c14a-49b2-9b2a-a127f263029f-cni-binary-copy\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.997860 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997450 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/a532ccab-82b5-417e-9d76-d1fb436f0e1f-socket-dir\") pod \"aws-ebs-csi-driver-node-zd52j\" (UID: \"a532ccab-82b5-417e-9d76-d1fb436f0e1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:09.997860 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997480 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xzcnl\" (UniqueName: \"kubernetes.io/projected/577cd1c7-c14a-49b2-9b2a-a127f263029f-kube-api-access-xzcnl\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.997860 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997520 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-os-release\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.997860 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997542 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/a532ccab-82b5-417e-9d76-d1fb436f0e1f-registration-dir\") pod \"aws-ebs-csi-driver-node-zd52j\" (UID: \"a532ccab-82b5-417e-9d76-d1fb436f0e1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:09.997860 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997582 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-host-run-netns\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.997860 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997605 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-multus-conf-dir\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.997860 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997623 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/f39096b7-3b12-4822-80cf-829be2c84725-konnectivity-ca\") pod \"konnectivity-agent-mgqkb\" (UID: \"f39096b7-3b12-4822-80cf-829be2c84725\") " pod="kube-system/konnectivity-agent-mgqkb" Jul 15 21:10:09.997860 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997693 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-os-release\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.997860 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997706 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/ab1393c4-a46e-42bc-b5f1-c434a8190156-iptables-alerter-script\") pod \"iptables-alerter-7fqlq\" (UID: \"ab1393c4-a46e-42bc-b5f1-c434a8190156\") " pod="openshift-network-operator/iptables-alerter-7fqlq" Jul 15 21:10:09.997860 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997627 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f39096b7-3b12-4822-80cf-829be2c84725-agent-certs\") pod \"konnectivity-agent-mgqkb\" (UID: \"f39096b7-3b12-4822-80cf-829be2c84725\") " pod="kube-system/konnectivity-agent-mgqkb" Jul 15 21:10:09.997860 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997734 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/577cd1c7-c14a-49b2-9b2a-a127f263029f-multus-daemon-config\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.997860 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997739 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-host-run-netns\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.998616 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997760 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-multus-socket-dir-parent\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.998616 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997770 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-multus-conf-dir\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.998616 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997786 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-host-var-lib-cni-multus\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.998616 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997812 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2zqwc\" (UniqueName: \"kubernetes.io/projected/ffad0e67-b489-4cb5-9e92-f36f166c613a-kube-api-access-2zqwc\") pod \"node-ca-n2lsq\" (UID: \"ffad0e67-b489-4cb5-9e92-f36f166c613a\") " pod="openshift-image-registry/node-ca-n2lsq" Jul 15 21:10:09.998616 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997827 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-multus-socket-dir-parent\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.998616 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997841 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bb7hs\" (UniqueName: \"kubernetes.io/projected/ab1393c4-a46e-42bc-b5f1-c434a8190156-kube-api-access-bb7hs\") pod \"iptables-alerter-7fqlq\" (UID: \"ab1393c4-a46e-42bc-b5f1-c434a8190156\") " pod="openshift-network-operator/iptables-alerter-7fqlq" Jul 15 21:10:09.998616 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997868 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-cnibin\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.998616 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997892 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-kubelet-config\") pod \"global-pull-secret-syncer-jl9zp\" (UID: \"ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7\") " pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:09.998616 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997916 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ffad0e67-b489-4cb5-9e92-f36f166c613a-serviceca\") pod \"node-ca-n2lsq\" (UID: \"ffad0e67-b489-4cb5-9e92-f36f166c613a\") " pod="openshift-image-registry/node-ca-n2lsq" Jul 15 21:10:09.998616 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997941 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-cnibin\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.998616 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997963 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-multus-cni-dir\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.998616 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997990 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-system-cni-dir\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.998616 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997994 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-kubelet-config\") pod \"global-pull-secret-syncer-jl9zp\" (UID: \"ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7\") " pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:09.998616 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.998020 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-hostroot\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.998616 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.998046 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ffad0e67-b489-4cb5-9e92-f36f166c613a-host\") pod \"node-ca-n2lsq\" (UID: \"ffad0e67-b489-4cb5-9e92-f36f166c613a\") " pod="openshift-image-registry/node-ca-n2lsq" Jul 15 21:10:09.998616 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.998055 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-multus-cni-dir\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.998616 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.998072 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a532ccab-82b5-417e-9d76-d1fb436f0e1f-sys-fs\") pod \"aws-ebs-csi-driver-node-zd52j\" (UID: \"a532ccab-82b5-417e-9d76-d1fb436f0e1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:09.998616 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.998094 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/ffad0e67-b489-4cb5-9e92-f36f166c613a-host\") pod \"node-ca-n2lsq\" (UID: \"ffad0e67-b489-4cb5-9e92-f36f166c613a\") " pod="openshift-image-registry/node-ca-n2lsq" Jul 15 21:10:09.999235 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.998098 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-hostroot\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.999235 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.997867 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-host-var-lib-cni-multus\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.999235 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.998138 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/a532ccab-82b5-417e-9d76-d1fb436f0e1f-sys-fs\") pod \"aws-ebs-csi-driver-node-zd52j\" (UID: \"a532ccab-82b5-417e-9d76-d1fb436f0e1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:09.999235 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.998139 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/577cd1c7-c14a-49b2-9b2a-a127f263029f-system-cni-dir\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:09.999235 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:09.998406 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/ffad0e67-b489-4cb5-9e92-f36f166c613a-serviceca\") pod \"node-ca-n2lsq\" (UID: \"ffad0e67-b489-4cb5-9e92-f36f166c613a\") " pod="openshift-image-registry/node-ca-n2lsq" Jul 15 21:10:10.000501 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.000477 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/f39096b7-3b12-4822-80cf-829be2c84725-agent-certs\") pod \"konnectivity-agent-mgqkb\" (UID: \"f39096b7-3b12-4822-80cf-829be2c84725\") " pod="kube-system/konnectivity-agent-mgqkb" Jul 15 21:10:10.012982 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.012956 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c64k2\" (UniqueName: \"kubernetes.io/projected/a532ccab-82b5-417e-9d76-d1fb436f0e1f-kube-api-access-c64k2\") pod \"aws-ebs-csi-driver-node-zd52j\" (UID: \"a532ccab-82b5-417e-9d76-d1fb436f0e1f\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:10.013179 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.013157 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2zqwc\" (UniqueName: \"kubernetes.io/projected/ffad0e67-b489-4cb5-9e92-f36f166c613a-kube-api-access-2zqwc\") pod \"node-ca-n2lsq\" (UID: \"ffad0e67-b489-4cb5-9e92-f36f166c613a\") " pod="openshift-image-registry/node-ca-n2lsq" Jul 15 21:10:10.013223 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.013157 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bb7hs\" (UniqueName: \"kubernetes.io/projected/ab1393c4-a46e-42bc-b5f1-c434a8190156-kube-api-access-bb7hs\") pod \"iptables-alerter-7fqlq\" (UID: \"ab1393c4-a46e-42bc-b5f1-c434a8190156\") " pod="openshift-network-operator/iptables-alerter-7fqlq" Jul 15 21:10:10.013622 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.013599 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xzcnl\" (UniqueName: \"kubernetes.io/projected/577cd1c7-c14a-49b2-9b2a-a127f263029f-kube-api-access-xzcnl\") pod \"multus-xjxpc\" (UID: \"577cd1c7-c14a-49b2-9b2a-a127f263029f\") " pod="openshift-multus/multus-xjxpc" Jul 15 21:10:10.084786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.084698 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-sxn79" Jul 15 21:10:10.090934 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.090914 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:10.099300 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.099277 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-mlpzt" Jul 15 21:10:10.105129 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.105113 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-w7wc8" Jul 15 21:10:10.110824 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.110806 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-xjxpc" Jul 15 21:10:10.122473 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.122453 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-n2lsq" Jul 15 21:10:10.128255 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.128237 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-mgqkb" Jul 15 21:10:10.133937 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.133918 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" Jul 15 21:10:10.140434 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.140418 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-7fqlq" Jul 15 21:10:10.251924 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.251889 2572 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 15 21:10:10.401068 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.400988 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs\") pod \"network-metrics-daemon-mct98\" (UID: \"5c81bb07-fdbf-43fc-9554-e3d0ed0312e9\") " pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:10.401208 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:10.401140 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:10:10.401208 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:10.401204 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs podName:5c81bb07-fdbf-43fc-9554-e3d0ed0312e9 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:11.401183862 +0000 UTC m=+4.222501171 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs") pod "network-metrics-daemon-mct98" (UID: "5c81bb07-fdbf-43fc-9554-e3d0ed0312e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:10:10.474753 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:10.474700 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b20afb1_f155_4609_b0d1_bd613650e660.slice/crio-f0199c47bfab3a06e0a58a6b6a44c7689a1f6cd9722d29c2747bd374461b7aa8 WatchSource:0}: Error finding container f0199c47bfab3a06e0a58a6b6a44c7689a1f6cd9722d29c2747bd374461b7aa8: Status 404 returned error can't find the container with id f0199c47bfab3a06e0a58a6b6a44c7689a1f6cd9722d29c2747bd374461b7aa8 Jul 15 21:10:10.476416 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:10.476273 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podab1393c4_a46e_42bc_b5f1_c434a8190156.slice/crio-8ca7ca7e89b911630f28111fd150befb791a4934956cfedb1c9d4ab3c419fd34 WatchSource:0}: Error finding container 8ca7ca7e89b911630f28111fd150befb791a4934956cfedb1c9d4ab3c419fd34: Status 404 returned error can't find the container with id 8ca7ca7e89b911630f28111fd150befb791a4934956cfedb1c9d4ab3c419fd34 Jul 15 21:10:10.479624 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:10.479591 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod19ebe52b_28dc_4b7b_af2d_0779b13a9b62.slice/crio-fdbfe35cd0098538a27d2b14e058f8f54b14c34f55ad846b90de23d6812837a8 WatchSource:0}: Error finding container fdbfe35cd0098538a27d2b14e058f8f54b14c34f55ad846b90de23d6812837a8: Status 404 returned error can't find the container with id fdbfe35cd0098538a27d2b14e058f8f54b14c34f55ad846b90de23d6812837a8 Jul 15 21:10:10.481441 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:10.481418 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda7c003a0_a90e_4f42_bde8_8106b42cbdb6.slice/crio-1d9c0c40a0ca33133f8900362eb1889620240ea4f935cf44fbc494e80e0fac7d WatchSource:0}: Error finding container 1d9c0c40a0ca33133f8900362eb1889620240ea4f935cf44fbc494e80e0fac7d: Status 404 returned error can't find the container with id 1d9c0c40a0ca33133f8900362eb1889620240ea4f935cf44fbc494e80e0fac7d Jul 15 21:10:10.482296 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:10.482245 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podffad0e67_b489_4cb5_9e92_f36f166c613a.slice/crio-09d95aa1655063be86ebe52d305380f509e99c4dc67cc4e38a6fc488ff15ad93 WatchSource:0}: Error finding container 09d95aa1655063be86ebe52d305380f509e99c4dc67cc4e38a6fc488ff15ad93: Status 404 returned error can't find the container with id 09d95aa1655063be86ebe52d305380f509e99c4dc67cc4e38a6fc488ff15ad93 Jul 15 21:10:10.483543 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:10.483498 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod377a9efa_ef13_4550_b2fe_1de53fb91619.slice/crio-ba975761fe3aaa4f8251623b215891a34d0ff606f7f15387151f772195794aca WatchSource:0}: Error finding container ba975761fe3aaa4f8251623b215891a34d0ff606f7f15387151f772195794aca: Status 404 returned error can't find the container with id ba975761fe3aaa4f8251623b215891a34d0ff606f7f15387151f772195794aca Jul 15 21:10:10.484074 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:10.484052 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda532ccab_82b5_417e_9d76_d1fb436f0e1f.slice/crio-a77f9d69a7d9f4872364e5f775f629598261541be0eb0b2e8d03a99f986855fe WatchSource:0}: Error finding container a77f9d69a7d9f4872364e5f775f629598261541be0eb0b2e8d03a99f986855fe: Status 404 returned error can't find the container with id a77f9d69a7d9f4872364e5f775f629598261541be0eb0b2e8d03a99f986855fe Jul 15 21:10:10.487839 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:10:10.487331 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod577cd1c7_c14a_49b2_9b2a_a127f263029f.slice/crio-ad21c2363267e6e740ae63568f55ba1d131ff9f77938c81e3cd9ec946eb2a554 WatchSource:0}: Error finding container ad21c2363267e6e740ae63568f55ba1d131ff9f77938c81e3cd9ec946eb2a554: Status 404 returned error can't find the container with id ad21c2363267e6e740ae63568f55ba1d131ff9f77938c81e3cd9ec946eb2a554 Jul 15 21:10:10.502211 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.502180 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmqzf\" (UniqueName: \"kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf\") pod \"network-check-target-6nvzk\" (UID: \"2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05\") " pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:10.502314 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.502262 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret\") pod \"global-pull-secret-syncer-jl9zp\" (UID: \"ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7\") " pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:10.502367 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:10.502323 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:10:10.502367 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:10.502344 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:10:10.502367 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:10.502357 2572 projected.go:196] Error preparing data for projected volume kube-api-access-hmqzf for pod openshift-network-diagnostics/network-check-target-6nvzk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:10:10.502367 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:10.502356 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:10:10.502617 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:10.502418 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf podName:2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:11.502398464 +0000 UTC m=+4.323715783 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmqzf" (UniqueName: "kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf") pod "network-check-target-6nvzk" (UID: "2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:10:10.502617 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:10.502439 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret podName:ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:11.502430131 +0000 UTC m=+4.323747446 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret") pod "global-pull-secret-syncer-jl9zp" (UID: "ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:10:10.845435 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.845339 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 21:05:09 +0000 UTC" deadline="2028-01-29 10:19:10.581557303 +0000 UTC" Jul 15 21:10:10.845435 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.845388 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="13501h8m59.736173451s" Jul 15 21:10:10.955044 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.954882 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:10.955156 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:10.955137 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:10.962358 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.962329 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xjxpc" event={"ID":"577cd1c7-c14a-49b2-9b2a-a127f263029f","Type":"ContainerStarted","Data":"ad21c2363267e6e740ae63568f55ba1d131ff9f77938c81e3cd9ec946eb2a554"} Jul 15 21:10:10.963891 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.963861 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mgqkb" event={"ID":"f39096b7-3b12-4822-80cf-829be2c84725","Type":"ContainerStarted","Data":"eba9fb3d51ccf9a6de60bf92daeb9306c5e359f0efed75f0f196041640b884aa"} Jul 15 21:10:10.965953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.965909 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" event={"ID":"a532ccab-82b5-417e-9d76-d1fb436f0e1f","Type":"ContainerStarted","Data":"a77f9d69a7d9f4872364e5f775f629598261541be0eb0b2e8d03a99f986855fe"} Jul 15 21:10:10.967200 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.967175 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n2lsq" event={"ID":"ffad0e67-b489-4cb5-9e92-f36f166c613a","Type":"ContainerStarted","Data":"09d95aa1655063be86ebe52d305380f509e99c4dc67cc4e38a6fc488ff15ad93"} Jul 15 21:10:10.970151 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.970089 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mlpzt" event={"ID":"a7c003a0-a90e-4f42-bde8-8106b42cbdb6","Type":"ContainerStarted","Data":"1d9c0c40a0ca33133f8900362eb1889620240ea4f935cf44fbc494e80e0fac7d"} Jul 15 21:10:10.971649 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.971611 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7fqlq" event={"ID":"ab1393c4-a46e-42bc-b5f1-c434a8190156","Type":"ContainerStarted","Data":"8ca7ca7e89b911630f28111fd150befb791a4934956cfedb1c9d4ab3c419fd34"} Jul 15 21:10:10.975153 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.974462 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-18.ec2.internal" event={"ID":"19a84ea42e04a6bb6b6f4312809222d6","Type":"ContainerStarted","Data":"94134c6af93478fc0a40d192616d6068024479a8418c080983bdafb0c4940e31"} Jul 15 21:10:10.977864 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.977837 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sxn79" event={"ID":"377a9efa-ef13-4550-b2fe-1de53fb91619","Type":"ContainerStarted","Data":"ba975761fe3aaa4f8251623b215891a34d0ff606f7f15387151f772195794aca"} Jul 15 21:10:10.979867 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.979831 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" event={"ID":"19ebe52b-28dc-4b7b-af2d-0779b13a9b62","Type":"ContainerStarted","Data":"fdbfe35cd0098538a27d2b14e058f8f54b14c34f55ad846b90de23d6812837a8"} Jul 15 21:10:10.981467 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.981442 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7wc8" event={"ID":"3b20afb1-f155-4609-b0d1-bd613650e660","Type":"ContainerStarted","Data":"f0199c47bfab3a06e0a58a6b6a44c7689a1f6cd9722d29c2747bd374461b7aa8"} Jul 15 21:10:10.989823 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:10.989772 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-136-18.ec2.internal" podStartSLOduration=1.989755114 podStartE2EDuration="1.989755114s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:10:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:10.989276587 +0000 UTC m=+3.810593906" watchObservedRunningTime="2026-07-15 21:10:10.989755114 +0000 UTC m=+3.811072431" Jul 15 21:10:11.408780 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:11.408683 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs\") pod \"network-metrics-daemon-mct98\" (UID: \"5c81bb07-fdbf-43fc-9554-e3d0ed0312e9\") " pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:11.408938 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:11.408852 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:10:11.408938 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:11.408927 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs podName:5c81bb07-fdbf-43fc-9554-e3d0ed0312e9 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:13.408907592 +0000 UTC m=+6.230224907 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs") pod "network-metrics-daemon-mct98" (UID: "5c81bb07-fdbf-43fc-9554-e3d0ed0312e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:10:11.509816 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:11.509663 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmqzf\" (UniqueName: \"kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf\") pod \"network-check-target-6nvzk\" (UID: \"2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05\") " pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:11.509816 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:11.509741 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret\") pod \"global-pull-secret-syncer-jl9zp\" (UID: \"ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7\") " pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:11.510036 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:11.509871 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:10:11.510036 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:11.509883 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:10:11.510036 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:11.509898 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:10:11.510036 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:11.509913 2572 projected.go:196] Error preparing data for projected volume kube-api-access-hmqzf for pod openshift-network-diagnostics/network-check-target-6nvzk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:10:11.510036 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:11.509954 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret podName:ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:13.509933915 +0000 UTC m=+6.331251225 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret") pod "global-pull-secret-syncer-jl9zp" (UID: "ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:10:11.510036 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:11.509973 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf podName:2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:13.509963726 +0000 UTC m=+6.331281025 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmqzf" (UniqueName: "kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf") pod "network-check-target-6nvzk" (UID: "2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:10:11.845584 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:11.845534 2572 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-14 21:05:09 +0000 UTC" deadline="2028-04-10 02:51:28.770876286 +0000 UTC" Jul 15 21:10:11.845584 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:11.845579 2572 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15221h41m16.925301895s" Jul 15 21:10:11.955704 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:11.955674 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:11.955870 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:11.955785 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:11.955933 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:11.955878 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:11.956027 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:11.956001 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:12.008008 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:12.007795 2572 generic.go:356] "Generic (PLEG): container finished" podID="2320ae40ef41a04718e973c766a6e0c4" containerID="897576b6b5d289e199713bc20420b7469ab7da97d8a0eddb73645052e5ae9572" exitCode=0 Jul 15 21:10:12.008008 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:12.007920 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-18.ec2.internal" event={"ID":"2320ae40ef41a04718e973c766a6e0c4","Type":"ContainerDied","Data":"897576b6b5d289e199713bc20420b7469ab7da97d8a0eddb73645052e5ae9572"} Jul 15 21:10:12.954202 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:12.954165 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:12.954696 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:12.954349 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:13.025479 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:13.025444 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-18.ec2.internal" event={"ID":"2320ae40ef41a04718e973c766a6e0c4","Type":"ContainerStarted","Data":"a4b5778b6a8198df5d6e20c4d917f919ba1bb028fd463d9ad870a535f6f12913"} Jul 15 21:10:13.426930 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:13.426844 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs\") pod \"network-metrics-daemon-mct98\" (UID: \"5c81bb07-fdbf-43fc-9554-e3d0ed0312e9\") " pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:13.427099 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:13.427049 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:10:13.427165 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:13.427110 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs podName:5c81bb07-fdbf-43fc-9554-e3d0ed0312e9 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:17.427092271 +0000 UTC m=+10.248409580 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs") pod "network-metrics-daemon-mct98" (UID: "5c81bb07-fdbf-43fc-9554-e3d0ed0312e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:10:13.527569 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:13.527518 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret\") pod \"global-pull-secret-syncer-jl9zp\" (UID: \"ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7\") " pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:13.527753 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:13.527618 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmqzf\" (UniqueName: \"kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf\") pod \"network-check-target-6nvzk\" (UID: \"2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05\") " pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:13.527821 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:13.527762 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:10:13.527821 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:13.527787 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:10:13.527821 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:13.527800 2572 projected.go:196] Error preparing data for projected volume kube-api-access-hmqzf for pod openshift-network-diagnostics/network-check-target-6nvzk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:10:13.527974 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:13.527857 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf podName:2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:17.52783947 +0000 UTC m=+10.349156764 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmqzf" (UniqueName: "kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf") pod "network-check-target-6nvzk" (UID: "2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:10:13.527974 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:13.527938 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:10:13.527974 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:13.527975 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret podName:ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:17.527964052 +0000 UTC m=+10.349281361 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret") pod "global-pull-secret-syncer-jl9zp" (UID: "ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:10:13.958479 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:13.958440 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:13.958479 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:13.958466 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:13.959046 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:13.958581 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:13.959046 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:13.958982 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:14.955562 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:14.955030 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:14.955562 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:14.955180 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:15.958988 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:15.958498 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:15.958988 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:15.958648 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:15.958988 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:15.958692 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:15.958988 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:15.958819 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:16.954795 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:16.954755 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:16.955021 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:16.954894 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:17.460640 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:17.460600 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs\") pod \"network-metrics-daemon-mct98\" (UID: \"5c81bb07-fdbf-43fc-9554-e3d0ed0312e9\") " pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:17.461065 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:17.460745 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:10:17.461065 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:17.460867 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs podName:5c81bb07-fdbf-43fc-9554-e3d0ed0312e9 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:25.460823744 +0000 UTC m=+18.282141053 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs") pod "network-metrics-daemon-mct98" (UID: "5c81bb07-fdbf-43fc-9554-e3d0ed0312e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:10:17.561789 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:17.561712 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmqzf\" (UniqueName: \"kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf\") pod \"network-check-target-6nvzk\" (UID: \"2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05\") " pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:17.561789 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:17.561792 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret\") pod \"global-pull-secret-syncer-jl9zp\" (UID: \"ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7\") " pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:17.562005 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:17.561917 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:10:17.562005 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:17.561979 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret podName:ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:25.561960138 +0000 UTC m=+18.383277457 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret") pod "global-pull-secret-syncer-jl9zp" (UID: "ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:10:17.562281 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:17.562251 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:10:17.562281 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:17.562280 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:10:17.562462 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:17.562293 2572 projected.go:196] Error preparing data for projected volume kube-api-access-hmqzf for pod openshift-network-diagnostics/network-check-target-6nvzk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:10:17.562462 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:17.562342 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf podName:2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:25.562326035 +0000 UTC m=+18.383643377 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmqzf" (UniqueName: "kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf") pod "network-check-target-6nvzk" (UID: "2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:10:17.958092 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:17.958063 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:17.958275 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:17.958101 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:17.958275 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:17.958181 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:17.958395 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:17.958287 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:18.954749 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:18.954671 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:18.955173 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:18.954847 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:19.957442 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:19.957411 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:19.957909 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:19.957552 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:19.957909 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:19.957569 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:19.957909 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:19.957682 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:20.954326 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:20.954295 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:20.954517 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:20.954407 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:21.954132 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:21.954096 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:21.954591 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:21.954103 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:21.954591 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:21.954234 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:21.954591 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:21.954295 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:22.954862 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:22.954820 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:22.955308 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:22.954960 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:23.955050 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:23.955014 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:23.955560 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:23.955163 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:23.955560 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:23.955202 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:23.955560 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:23.955313 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:24.954271 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:24.954237 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:24.954512 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:24.954361 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:25.525111 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:25.525079 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs\") pod \"network-metrics-daemon-mct98\" (UID: \"5c81bb07-fdbf-43fc-9554-e3d0ed0312e9\") " pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:25.525516 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:25.525217 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:10:25.525516 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:25.525283 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs podName:5c81bb07-fdbf-43fc-9554-e3d0ed0312e9 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:41.525264184 +0000 UTC m=+34.346581484 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs") pod "network-metrics-daemon-mct98" (UID: "5c81bb07-fdbf-43fc-9554-e3d0ed0312e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:10:25.626040 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:25.626009 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret\") pod \"global-pull-secret-syncer-jl9zp\" (UID: \"ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7\") " pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:25.626220 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:25.626067 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmqzf\" (UniqueName: \"kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf\") pod \"network-check-target-6nvzk\" (UID: \"2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05\") " pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:25.626220 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:25.626143 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:10:25.626220 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:25.626175 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:10:25.626220 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:25.626190 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:10:25.626220 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:25.626199 2572 projected.go:196] Error preparing data for projected volume kube-api-access-hmqzf for pod openshift-network-diagnostics/network-check-target-6nvzk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:10:25.626220 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:25.626204 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret podName:ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:41.626189732 +0000 UTC m=+34.447507027 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret") pod "global-pull-secret-syncer-jl9zp" (UID: "ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:10:25.626401 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:25.626238 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf podName:2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05 nodeName:}" failed. No retries permitted until 2026-07-15 21:10:41.626225137 +0000 UTC m=+34.447542448 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmqzf" (UniqueName: "kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf") pod "network-check-target-6nvzk" (UID: "2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:10:25.954850 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:25.954818 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:25.955027 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:25.954822 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:25.955027 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:25.954930 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:25.955106 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:25.955021 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:26.954920 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:26.954888 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:26.955378 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:26.955026 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:27.955541 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:27.955501 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:27.955987 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:27.955626 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:27.955987 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:27.955695 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:27.955987 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:27.955814 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:28.954735 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:28.954700 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:28.954890 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:28.954817 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:29.958801 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:29.958628 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:29.959233 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:29.958669 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:29.959233 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:29.958881 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:29.959233 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:29.958951 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:30.060421 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:30.060381 2572 generic.go:356] "Generic (PLEG): container finished" podID="3b20afb1-f155-4609-b0d1-bd613650e660" containerID="5c48a0485f500675c5468aba3934adfd2196eae3e9ae141b7b81c9c0740976a6" exitCode=0 Jul 15 21:10:30.060617 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:30.060465 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7wc8" event={"ID":"3b20afb1-f155-4609-b0d1-bd613650e660","Type":"ContainerDied","Data":"5c48a0485f500675c5468aba3934adfd2196eae3e9ae141b7b81c9c0740976a6"} Jul 15 21:10:30.062482 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:30.062459 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-xjxpc" event={"ID":"577cd1c7-c14a-49b2-9b2a-a127f263029f","Type":"ContainerStarted","Data":"43c76d078d913183fc8a7676076ace326585ea98ac79567c86f195f8ead32398"} Jul 15 21:10:30.064176 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:30.064151 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-mgqkb" event={"ID":"f39096b7-3b12-4822-80cf-829be2c84725","Type":"ContainerStarted","Data":"08f255856be369be73965652a81b7804048ec7d05b00a2f4f8b8cf2df5a222b9"} Jul 15 21:10:30.067386 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:30.067360 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" event={"ID":"a532ccab-82b5-417e-9d76-d1fb436f0e1f","Type":"ContainerStarted","Data":"9bdc4be9702d2628c138e3984b60300e34f0c372b1dd4f30502a42d97459b1d4"} Jul 15 21:10:30.069815 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:30.069625 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-n2lsq" event={"ID":"ffad0e67-b489-4cb5-9e92-f36f166c613a","Type":"ContainerStarted","Data":"70e5974f4d0e000052a05436a5fbcbf83f436a2d87502438d50b7cbcc606eb79"} Jul 15 21:10:30.071185 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:30.071161 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-mlpzt" event={"ID":"a7c003a0-a90e-4f42-bde8-8106b42cbdb6","Type":"ContainerStarted","Data":"abd6e759ae4301dee40b1088c0099772c23c9707e96c52c463a7565e4273539a"} Jul 15 21:10:30.072660 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:30.072595 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-sxn79" event={"ID":"377a9efa-ef13-4550-b2fe-1de53fb91619","Type":"ContainerStarted","Data":"17dfce29d59bd1c84c35d0ba347d62ee0c24ede04504849159d1454c0bc691f6"} Jul 15 21:10:30.090654 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:30.090596 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-136-18.ec2.internal" podStartSLOduration=21.090583448 podStartE2EDuration="21.090583448s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:10:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:13.049914677 +0000 UTC m=+5.871231995" watchObservedRunningTime="2026-07-15 21:10:30.090583448 +0000 UTC m=+22.911900760" Jul 15 21:10:30.110829 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:30.110791 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-mlpzt" podStartSLOduration=2.947814335 podStartE2EDuration="22.110776149s" totalImagesPullingTime="19.162961814s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:30.110383823 +0000 UTC m=+22.931701141" watchObservedRunningTime="2026-07-15 21:10:30.110776149 +0000 UTC m=+22.932093465" Jul 15 21:10:30.127387 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:30.127350 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-n2lsq" podStartSLOduration=2.9661450240000002 podStartE2EDuration="22.127337085s" totalImagesPullingTime="19.161192061s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:30.127070488 +0000 UTC m=+22.948387805" watchObservedRunningTime="2026-07-15 21:10:30.127337085 +0000 UTC m=+22.948654401" Jul 15 21:10:30.146088 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:30.146047 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-xjxpc" podStartSLOduration=2.918377984 podStartE2EDuration="22.146032987s" totalImagesPullingTime="19.227655003s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:30.145586129 +0000 UTC m=+22.966903446" watchObservedRunningTime="2026-07-15 21:10:30.146032987 +0000 UTC m=+22.967350303" Jul 15 21:10:30.183941 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:30.183883 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-sxn79" podStartSLOduration=3.99673749 podStartE2EDuration="23.183863157s" totalImagesPullingTime="19.187125667s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:30.183742285 +0000 UTC m=+23.005059602" watchObservedRunningTime="2026-07-15 21:10:30.183863157 +0000 UTC m=+23.005180475" Jul 15 21:10:30.184403 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:30.184367 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-mgqkb" podStartSLOduration=7.269497873 podStartE2EDuration="22.184357416s" totalImagesPullingTime="14.914859543s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:30.163650772 +0000 UTC m=+22.984968089" watchObservedRunningTime="2026-07-15 21:10:30.184357416 +0000 UTC m=+23.005674734" Jul 15 21:10:30.954505 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:30.954291 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:30.954690 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:30.954634 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:31.078904 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:31.078881 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsl2f_19ebe52b-28dc-4b7b-af2d-0779b13a9b62/ovn-acl-logging/0.log" Jul 15 21:10:31.079476 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:31.079267 2572 generic.go:356] "Generic (PLEG): container finished" podID="19ebe52b-28dc-4b7b-af2d-0779b13a9b62" containerID="0cbd145bd601e4bd513a96b0e80ba6ed331053d5795b7fd67702e1661fc1996b" exitCode=1 Jul 15 21:10:31.079476 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:31.079301 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" event={"ID":"19ebe52b-28dc-4b7b-af2d-0779b13a9b62","Type":"ContainerStarted","Data":"211c3be43611c63a5ecda2486fe907d7d3a005779428016954ee3d9aeab2035e"} Jul 15 21:10:31.079476 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:31.079420 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" event={"ID":"19ebe52b-28dc-4b7b-af2d-0779b13a9b62","Type":"ContainerStarted","Data":"a429a8b7e590794409573359c546e3cf6121d231538b9755594280aec56cab01"} Jul 15 21:10:31.079476 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:31.079456 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" event={"ID":"19ebe52b-28dc-4b7b-af2d-0779b13a9b62","Type":"ContainerStarted","Data":"2edd2376667b2e181e85bd0e99d81c2cecd46d0bdf462792453efb05ff151201"} Jul 15 21:10:31.079664 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:31.079489 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" event={"ID":"19ebe52b-28dc-4b7b-af2d-0779b13a9b62","Type":"ContainerDied","Data":"0cbd145bd601e4bd513a96b0e80ba6ed331053d5795b7fd67702e1661fc1996b"} Jul 15 21:10:31.079664 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:31.079547 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" event={"ID":"19ebe52b-28dc-4b7b-af2d-0779b13a9b62","Type":"ContainerStarted","Data":"2f9d10f6efd8970c913d948379680c8ae639f3e7004dae639d431f4d2e06beb4"} Jul 15 21:10:31.151206 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:31.151174 2572 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 15 21:10:31.642894 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:31.642864 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-mgqkb" Jul 15 21:10:31.643542 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:31.643508 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-mgqkb" Jul 15 21:10:31.853838 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:31.853733 2572 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-15T21:10:31.151199545Z","UUID":"2d29f109-8fbd-4a24-8c94-bbaed832301b","Handler":null,"Name":"","Endpoint":""} Jul 15 21:10:31.855434 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:31.855413 2572 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 15 21:10:31.855586 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:31.855454 2572 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 15 21:10:31.954833 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:31.954761 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:31.954983 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:31.954762 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:31.954983 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:31.954882 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:31.954983 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:31.954966 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:32.083753 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:32.083715 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" event={"ID":"a532ccab-82b5-417e-9d76-d1fb436f0e1f","Type":"ContainerStarted","Data":"d2037dfd010db8d4ba8dbe1f3e875f8c90a0d881a4fbf5f38c1a1cb8fc9c4510"} Jul 15 21:10:32.085639 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:32.085607 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-7fqlq" event={"ID":"ab1393c4-a46e-42bc-b5f1-c434a8190156","Type":"ContainerStarted","Data":"f036994b969d43ab071ec56eec785f979d69df4f8004d225ec97dc8486ddebaa"} Jul 15 21:10:32.089177 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:32.089148 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsl2f_19ebe52b-28dc-4b7b-af2d-0779b13a9b62/ovn-acl-logging/0.log" Jul 15 21:10:32.090129 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:32.089868 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" event={"ID":"19ebe52b-28dc-4b7b-af2d-0779b13a9b62","Type":"ContainerStarted","Data":"e26927375f9db919ded28045f11cd90c8f42e7a7c1e892fa6253b414a8694700"} Jul 15 21:10:32.090129 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:32.089961 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-mgqkb" Jul 15 21:10:32.090639 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:32.090613 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-mgqkb" Jul 15 21:10:32.103198 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:32.103149 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-7fqlq" podStartSLOduration=4.907204029 podStartE2EDuration="24.103131467s" totalImagesPullingTime="19.195927438s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:32.10224623 +0000 UTC m=+24.923563548" watchObservedRunningTime="2026-07-15 21:10:32.103131467 +0000 UTC m=+24.924448787" Jul 15 21:10:32.954984 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:32.954804 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:32.955249 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:32.955096 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:33.094750 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:33.094710 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" event={"ID":"a532ccab-82b5-417e-9d76-d1fb436f0e1f","Type":"ContainerStarted","Data":"ab642fb920ebb62c4f6cfbbb6b4b7d0764775679f2ef5daae590c093e81ec84f"} Jul 15 21:10:33.954488 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:33.954454 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:33.954736 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:33.954585 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:33.954736 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:33.954645 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:33.954856 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:33.954747 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:34.954507 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:34.954482 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:34.955052 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:34.954598 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:35.101796 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:35.101771 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsl2f_19ebe52b-28dc-4b7b-af2d-0779b13a9b62/ovn-acl-logging/0.log" Jul 15 21:10:35.102162 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:35.102132 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" event={"ID":"19ebe52b-28dc-4b7b-af2d-0779b13a9b62","Type":"ContainerStarted","Data":"8218251c45814d648dd6dfad8cf3e847e8c01342b3d1ff1e7245c6977232ec84"} Jul 15 21:10:35.103782 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:35.103759 2572 generic.go:356] "Generic (PLEG): container finished" podID="3b20afb1-f155-4609-b0d1-bd613650e660" containerID="bef32e1c2e7fc591a659b3c14912a350e8a7377f1ed9e3a35b84a05f12f21a21" exitCode=0 Jul 15 21:10:35.103865 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:35.103800 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7wc8" event={"ID":"3b20afb1-f155-4609-b0d1-bd613650e660","Type":"ContainerDied","Data":"bef32e1c2e7fc591a659b3c14912a350e8a7377f1ed9e3a35b84a05f12f21a21"} Jul 15 21:10:35.139659 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:35.139608 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-zd52j" podStartSLOduration=5.665793067 podStartE2EDuration="27.139592603s" totalImagesPullingTime="21.473799536s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:10:08 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:33.11789374 +0000 UTC m=+25.939211059" watchObservedRunningTime="2026-07-15 21:10:35.139592603 +0000 UTC m=+27.960909920" Jul 15 21:10:35.954297 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:35.954264 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:35.954461 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:35.954389 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:35.954461 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:35.954438 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:35.954555 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:35.954519 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:36.760345 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:36.760138 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mlpzt_a7c003a0-a90e-4f42-bde8-8106b42cbdb6/dns-node-resolver/0.log" Jul 15 21:10:36.954675 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:36.954636 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:36.955099 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:36.954748 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:37.110416 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:37.110390 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsl2f_19ebe52b-28dc-4b7b-af2d-0779b13a9b62/ovn-acl-logging/0.log" Jul 15 21:10:37.110772 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:37.110739 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" event={"ID":"19ebe52b-28dc-4b7b-af2d-0779b13a9b62","Type":"ContainerStarted","Data":"db7fab26b8392715e2456fa1affff4b5eff6cd6f133d550170899b768fec41b9"} Jul 15 21:10:37.111017 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:37.110991 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:37.111095 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:37.111055 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:37.111162 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:37.111102 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:37.111217 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:37.111195 2572 scope.go:117] "RemoveContainer" containerID="0cbd145bd601e4bd513a96b0e80ba6ed331053d5795b7fd67702e1661fc1996b" Jul 15 21:10:37.113039 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:37.113013 2572 generic.go:356] "Generic (PLEG): container finished" podID="3b20afb1-f155-4609-b0d1-bd613650e660" containerID="26ed3c38d2b3d9bd5481b0a15172c58e9c642fb737402f1ad61a0275f6108793" exitCode=0 Jul 15 21:10:37.113132 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:37.113069 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7wc8" event={"ID":"3b20afb1-f155-4609-b0d1-bd613650e660","Type":"ContainerDied","Data":"26ed3c38d2b3d9bd5481b0a15172c58e9c642fb737402f1ad61a0275f6108793"} Jul 15 21:10:37.129476 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:37.129459 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:37.133932 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:37.133918 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:10:37.732795 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:37.732764 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n2lsq_ffad0e67-b489-4cb5-9e92-f36f166c613a/node-ca/0.log" Jul 15 21:10:37.956005 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:37.955974 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:37.956515 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:37.956090 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:37.956515 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:37.956133 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:37.956515 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:37.956248 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:38.119354 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:38.119333 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsl2f_19ebe52b-28dc-4b7b-af2d-0779b13a9b62/ovn-acl-logging/0.log" Jul 15 21:10:38.119719 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:38.119693 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" event={"ID":"19ebe52b-28dc-4b7b-af2d-0779b13a9b62","Type":"ContainerStarted","Data":"cad13dc8b850f5f1401bed579f1762385fff1663536e0075b08ae4762988d913"} Jul 15 21:10:38.122087 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:38.122064 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7wc8" event={"ID":"3b20afb1-f155-4609-b0d1-bd613650e660","Type":"ContainerStarted","Data":"42e57fecc1095998e29e0948e1af1816776b117758dd7799854bdebba52059ff"} Jul 15 21:10:38.157760 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:38.157479 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" podStartSLOduration=11.567341224 podStartE2EDuration="31.157458079s" totalImagesPullingTime="19.590116855s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:38.155580346 +0000 UTC m=+30.976897665" watchObservedRunningTime="2026-07-15 21:10:38.157458079 +0000 UTC m=+30.978775397" Jul 15 21:10:38.561105 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:38.561072 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mct98"] Jul 15 21:10:38.561245 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:38.561190 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:38.561292 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:38.561279 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:38.564121 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:38.564094 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6nvzk"] Jul 15 21:10:38.564252 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:38.564208 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:38.564316 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:38.564297 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:38.564809 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:38.564785 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jl9zp"] Jul 15 21:10:38.564918 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:38.564884 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:38.564999 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:38.564970 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:39.126580 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:39.126544 2572 generic.go:356] "Generic (PLEG): container finished" podID="3b20afb1-f155-4609-b0d1-bd613650e660" containerID="42e57fecc1095998e29e0948e1af1816776b117758dd7799854bdebba52059ff" exitCode=0 Jul 15 21:10:39.127078 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:39.126639 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7wc8" event={"ID":"3b20afb1-f155-4609-b0d1-bd613650e660","Type":"ContainerDied","Data":"42e57fecc1095998e29e0948e1af1816776b117758dd7799854bdebba52059ff"} Jul 15 21:10:39.954832 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:39.954791 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:39.954999 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:39.954911 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:39.954999 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:39.954943 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:39.955122 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:39.955026 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:40.954364 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:40.954330 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:40.954926 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:40.954439 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:41.546133 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:41.546093 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs\") pod \"network-metrics-daemon-mct98\" (UID: \"5c81bb07-fdbf-43fc-9554-e3d0ed0312e9\") " pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:41.546292 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:41.546269 2572 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:10:41.546358 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:41.546350 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs podName:5c81bb07-fdbf-43fc-9554-e3d0ed0312e9 nodeName:}" failed. No retries permitted until 2026-07-15 21:11:13.546329108 +0000 UTC m=+66.367646459 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs") pod "network-metrics-daemon-mct98" (UID: "5c81bb07-fdbf-43fc-9554-e3d0ed0312e9") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 15 21:10:41.647206 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:41.647165 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret\") pod \"global-pull-secret-syncer-jl9zp\" (UID: \"ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7\") " pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:41.647381 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:41.647230 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmqzf\" (UniqueName: \"kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf\") pod \"network-check-target-6nvzk\" (UID: \"2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05\") " pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:41.647381 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:41.647341 2572 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 15 21:10:41.647381 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:41.647355 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 15 21:10:41.647381 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:41.647371 2572 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 15 21:10:41.647381 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:41.647381 2572 projected.go:196] Error preparing data for projected volume kube-api-access-hmqzf for pod openshift-network-diagnostics/network-check-target-6nvzk: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:10:41.647608 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:41.647422 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret podName:ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7 nodeName:}" failed. No retries permitted until 2026-07-15 21:11:13.647401838 +0000 UTC m=+66.468719148 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret") pod "global-pull-secret-syncer-jl9zp" (UID: "ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7") : object "kube-system"/"original-pull-secret" not registered Jul 15 21:10:41.647608 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:41.647442 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf podName:2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05 nodeName:}" failed. No retries permitted until 2026-07-15 21:11:13.647432819 +0000 UTC m=+66.468750121 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-hmqzf" (UniqueName: "kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf") pod "network-check-target-6nvzk" (UID: "2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 15 21:10:41.954442 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:41.954405 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:41.954906 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:41.954454 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:41.954906 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:41.954549 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:41.954906 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:41.954677 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:42.954701 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:42.954671 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:42.955141 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:42.954808 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:43.955098 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:43.955064 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:43.955552 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:43.955175 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:43.955552 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:43.955227 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:43.955552 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:43.955326 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:44.144624 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:44.144587 2572 generic.go:356] "Generic (PLEG): container finished" podID="3b20afb1-f155-4609-b0d1-bd613650e660" containerID="9c08858bb1ddaa609dd2f26056205c0c3a8d7c32fbb36e99574f2a8db9229193" exitCode=0 Jul 15 21:10:44.144624 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:44.144624 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7wc8" event={"ID":"3b20afb1-f155-4609-b0d1-bd613650e660","Type":"ContainerDied","Data":"9c08858bb1ddaa609dd2f26056205c0c3a8d7c32fbb36e99574f2a8db9229193"} Jul 15 21:10:44.954601 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:44.954559 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:44.954795 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:44.954683 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:45.149129 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:45.149096 2572 generic.go:356] "Generic (PLEG): container finished" podID="3b20afb1-f155-4609-b0d1-bd613650e660" containerID="cf5c2033135b8a36b18ccc5bbee97a3c57d619e37a48a767804d0c187ca1d882" exitCode=0 Jul 15 21:10:45.149507 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:45.149140 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7wc8" event={"ID":"3b20afb1-f155-4609-b0d1-bd613650e660","Type":"ContainerDied","Data":"cf5c2033135b8a36b18ccc5bbee97a3c57d619e37a48a767804d0c187ca1d882"} Jul 15 21:10:45.954848 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:45.954673 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:45.955011 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:45.954699 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:45.955011 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:45.954936 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:45.955093 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:45.955017 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:46.154754 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:46.154724 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-w7wc8" event={"ID":"3b20afb1-f155-4609-b0d1-bd613650e660","Type":"ContainerStarted","Data":"c9cb191a822f4c586142f3dd6a9e608694ec0fffaae8b3644455eb8d4edf4c0d"} Jul 15 21:10:46.954558 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:46.954513 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:46.954761 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:46.954631 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:47.956252 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:47.956229 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:47.956665 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:47.956325 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:47.956665 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:47.956344 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:47.956665 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:47.956388 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:48.954588 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:48.954520 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:48.954774 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:48.954673 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:49.954472 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:49.954434 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:49.954997 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:49.954437 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:49.954997 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:49.954565 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:49.954997 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:49.954640 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:50.954982 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:50.954952 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:50.955350 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:50.955062 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:51.954842 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:51.954807 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:51.955039 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:51.954816 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:51.955039 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:51.954917 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:51.955039 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:51.954998 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:52.954589 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:52.954560 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:52.954739 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:52.954673 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:53.954694 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:53.954666 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:53.955099 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:53.954675 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:53.955099 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:53.954764 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:53.955099 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:53.954866 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:54.954014 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:54.953984 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:54.954172 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:54.954077 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:55.955115 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:55.955078 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:55.955577 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:55.955193 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:55.955577 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:55.955255 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:55.955577 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:55.955383 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:56.954768 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:56.954740 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:56.954941 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:56.954843 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:57.955364 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:57.955335 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:57.955748 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:57.955422 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-6nvzk" podUID="2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05" Jul 15 21:10:57.955748 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:57.955460 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:57.955748 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:57.955514 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-mct98" podUID="5c81bb07-fdbf-43fc-9554-e3d0ed0312e9" Jul 15 21:10:58.954483 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:58.954447 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:10:58.954683 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:10:58.954576 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-jl9zp" podUID="ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7" Jul 15 21:10:59.510634 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.510557 2572 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-136-18.ec2.internal" event="NodeReady" Jul 15 21:10:59.511025 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.510668 2572 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 15 21:10:59.555370 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.555297 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-w7wc8" podStartSLOduration=21.492310253 podStartE2EDuration="51.555280355s" totalImagesPullingTime="30.062970102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:10:08 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:10:46.211551086 +0000 UTC m=+39.032868397" watchObservedRunningTime="2026-07-15 21:10:59.555280355 +0000 UTC m=+52.376597675" Jul 15 21:10:59.555744 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.555727 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-image-registry/image-registry-5b87466585-qgbj7"] Jul 15 21:10:59.574743 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.574718 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.581853 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.581835 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-private-configuration\"" Jul 15 21:10:59.582223 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.582206 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"installation-pull-secrets\"" Jul 15 21:10:59.582306 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.582223 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"registry-dockercfg-r7n6n\"" Jul 15 21:10:59.582306 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.582205 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"image-registry-tls\"" Jul 15 21:10:59.585366 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.585344 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b87466585-qgbj7"] Jul 15 21:10:59.587209 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.587189 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"trusted-ca\"" Jul 15 21:10:59.619639 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.619620 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-n9tjd"] Jul 15 21:10:59.642768 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.642749 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-kj99n"] Jul 15 21:10:59.642879 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.642863 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n9tjd" Jul 15 21:10:59.649633 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.649613 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 15 21:10:59.649715 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.649674 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 15 21:10:59.649715 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.649701 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 15 21:10:59.652032 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.652010 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-jhvhm\"" Jul 15 21:10:59.666695 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.666677 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n9tjd"] Jul 15 21:10:59.666792 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.666706 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kj99n"] Jul 15 21:10:59.666852 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.666808 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kj99n" Jul 15 21:10:59.671860 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.671842 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 15 21:10:59.671972 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.671847 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 15 21:10:59.671972 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.671960 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-8zghz\"" Jul 15 21:10:59.672205 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.672189 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 15 21:10:59.672264 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.672197 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 15 21:10:59.687626 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.687604 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fea15078-baa8-47be-af80-abf668aed353-registry-certificates\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.687711 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.687634 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fea15078-baa8-47be-af80-abf668aed353-trusted-ca\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.687755 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.687716 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fea15078-baa8-47be-af80-abf668aed353-ca-trust-extracted\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.687755 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.687739 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2frz9\" (UniqueName: \"kubernetes.io/projected/fea15078-baa8-47be-af80-abf668aed353-kube-api-access-2frz9\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.687843 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.687763 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07cfd1eb-d93a-4d92-937e-e83af131d9ad-cert\") pod \"ingress-canary-n9tjd\" (UID: \"07cfd1eb-d93a-4d92-937e-e83af131d9ad\") " pod="openshift-ingress-canary/ingress-canary-n9tjd" Jul 15 21:10:59.687843 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.687781 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fea15078-baa8-47be-af80-abf668aed353-installation-pull-secrets\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.687843 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.687796 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fea15078-baa8-47be-af80-abf668aed353-registry-tls\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.687980 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.687834 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l46jg\" (UniqueName: \"kubernetes.io/projected/07cfd1eb-d93a-4d92-937e-e83af131d9ad-kube-api-access-l46jg\") pod \"ingress-canary-n9tjd\" (UID: \"07cfd1eb-d93a-4d92-937e-e83af131d9ad\") " pod="openshift-ingress-canary/ingress-canary-n9tjd" Jul 15 21:10:59.687980 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.687871 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fea15078-baa8-47be-af80-abf668aed353-image-registry-private-configuration\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.687980 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.687899 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fea15078-baa8-47be-af80-abf668aed353-bound-sa-token\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.703796 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.703776 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-glplz"] Jul 15 21:10:59.728787 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.728767 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-glplz" Jul 15 21:10:59.738707 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.738689 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-4b2pm\"" Jul 15 21:10:59.740570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.740556 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 15 21:10:59.762054 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.762010 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 15 21:10:59.766205 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.766186 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-glplz"] Jul 15 21:10:59.788830 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.788811 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb6a141f-5ad2-4482-ac78-d164572f90f7-crio-socket\") pod \"insights-runtime-extractor-kj99n\" (UID: \"fb6a141f-5ad2-4482-ac78-d164572f90f7\") " pod="openshift-insights/insights-runtime-extractor-kj99n" Jul 15 21:10:59.788924 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.788840 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5e3cdfd-977c-4695-bf7e-6128e5573e3a-metrics-tls\") pod \"dns-default-glplz\" (UID: \"b5e3cdfd-977c-4695-bf7e-6128e5573e3a\") " pod="openshift-dns/dns-default-glplz" Jul 15 21:10:59.788924 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.788871 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07cfd1eb-d93a-4d92-937e-e83af131d9ad-cert\") pod \"ingress-canary-n9tjd\" (UID: \"07cfd1eb-d93a-4d92-937e-e83af131d9ad\") " pod="openshift-ingress-canary/ingress-canary-n9tjd" Jul 15 21:10:59.788924 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.788903 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fea15078-baa8-47be-af80-abf668aed353-installation-pull-secrets\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.789089 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.788927 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5e3cdfd-977c-4695-bf7e-6128e5573e3a-tmp-dir\") pod \"dns-default-glplz\" (UID: \"b5e3cdfd-977c-4695-bf7e-6128e5573e3a\") " pod="openshift-dns/dns-default-glplz" Jul 15 21:10:59.789089 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.788952 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fea15078-baa8-47be-af80-abf668aed353-registry-tls\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.789089 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.788981 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l46jg\" (UniqueName: \"kubernetes.io/projected/07cfd1eb-d93a-4d92-937e-e83af131d9ad-kube-api-access-l46jg\") pod \"ingress-canary-n9tjd\" (UID: \"07cfd1eb-d93a-4d92-937e-e83af131d9ad\") " pod="openshift-ingress-canary/ingress-canary-n9tjd" Jul 15 21:10:59.789089 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.789005 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fea15078-baa8-47be-af80-abf668aed353-image-registry-private-configuration\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.789089 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.789031 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fea15078-baa8-47be-af80-abf668aed353-bound-sa-token\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.789089 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.789055 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hpmbh\" (UniqueName: \"kubernetes.io/projected/b5e3cdfd-977c-4695-bf7e-6128e5573e3a-kube-api-access-hpmbh\") pod \"dns-default-glplz\" (UID: \"b5e3cdfd-977c-4695-bf7e-6128e5573e3a\") " pod="openshift-dns/dns-default-glplz" Jul 15 21:10:59.789089 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.789085 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fea15078-baa8-47be-af80-abf668aed353-registry-certificates\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.789432 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.789114 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fea15078-baa8-47be-af80-abf668aed353-trusted-ca\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.789432 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.789142 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb6a141f-5ad2-4482-ac78-d164572f90f7-data-volume\") pod \"insights-runtime-extractor-kj99n\" (UID: \"fb6a141f-5ad2-4482-ac78-d164572f90f7\") " pod="openshift-insights/insights-runtime-extractor-kj99n" Jul 15 21:10:59.789432 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.789168 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-z4cvh\" (UniqueName: \"kubernetes.io/projected/fb6a141f-5ad2-4482-ac78-d164572f90f7-kube-api-access-z4cvh\") pod \"insights-runtime-extractor-kj99n\" (UID: \"fb6a141f-5ad2-4482-ac78-d164572f90f7\") " pod="openshift-insights/insights-runtime-extractor-kj99n" Jul 15 21:10:59.789432 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.789192 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b5e3cdfd-977c-4695-bf7e-6128e5573e3a-config-volume\") pod \"dns-default-glplz\" (UID: \"b5e3cdfd-977c-4695-bf7e-6128e5573e3a\") " pod="openshift-dns/dns-default-glplz" Jul 15 21:10:59.789432 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.789246 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb6a141f-5ad2-4482-ac78-d164572f90f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kj99n\" (UID: \"fb6a141f-5ad2-4482-ac78-d164572f90f7\") " pod="openshift-insights/insights-runtime-extractor-kj99n" Jul 15 21:10:59.789432 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.789287 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb6a141f-5ad2-4482-ac78-d164572f90f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kj99n\" (UID: \"fb6a141f-5ad2-4482-ac78-d164572f90f7\") " pod="openshift-insights/insights-runtime-extractor-kj99n" Jul 15 21:10:59.789432 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.789374 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fea15078-baa8-47be-af80-abf668aed353-ca-trust-extracted\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.789432 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.789404 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2frz9\" (UniqueName: \"kubernetes.io/projected/fea15078-baa8-47be-af80-abf668aed353-kube-api-access-2frz9\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.789856 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.789750 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ca-trust-extracted\" (UniqueName: \"kubernetes.io/empty-dir/fea15078-baa8-47be-af80-abf668aed353-ca-trust-extracted\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.790049 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.790023 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-certificates\" (UniqueName: \"kubernetes.io/configmap/fea15078-baa8-47be-af80-abf668aed353-registry-certificates\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.790709 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.790688 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca\" (UniqueName: \"kubernetes.io/configmap/fea15078-baa8-47be-af80-abf668aed353-trusted-ca\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.793284 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.793264 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registry-tls\" (UniqueName: \"kubernetes.io/projected/fea15078-baa8-47be-af80-abf668aed353-registry-tls\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.793284 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.793278 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/07cfd1eb-d93a-4d92-937e-e83af131d9ad-cert\") pod \"ingress-canary-n9tjd\" (UID: \"07cfd1eb-d93a-4d92-937e-e83af131d9ad\") " pod="openshift-ingress-canary/ingress-canary-n9tjd" Jul 15 21:10:59.793405 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.793287 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"installation-pull-secrets\" (UniqueName: \"kubernetes.io/secret/fea15078-baa8-47be-af80-abf668aed353-installation-pull-secrets\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.793405 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.793266 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"image-registry-private-configuration\" (UniqueName: \"kubernetes.io/secret/fea15078-baa8-47be-af80-abf668aed353-image-registry-private-configuration\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.829592 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.829572 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l46jg\" (UniqueName: \"kubernetes.io/projected/07cfd1eb-d93a-4d92-937e-e83af131d9ad-kube-api-access-l46jg\") pod \"ingress-canary-n9tjd\" (UID: \"07cfd1eb-d93a-4d92-937e-e83af131d9ad\") " pod="openshift-ingress-canary/ingress-canary-n9tjd" Jul 15 21:10:59.842303 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.842276 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2frz9\" (UniqueName: \"kubernetes.io/projected/fea15078-baa8-47be-af80-abf668aed353-kube-api-access-2frz9\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.851817 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.851794 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/fea15078-baa8-47be-af80-abf668aed353-bound-sa-token\") pod \"image-registry-5b87466585-qgbj7\" (UID: \"fea15078-baa8-47be-af80-abf668aed353\") " pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.884139 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.884114 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:10:59.893373 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.890961 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5e3cdfd-977c-4695-bf7e-6128e5573e3a-tmp-dir\") pod \"dns-default-glplz\" (UID: \"b5e3cdfd-977c-4695-bf7e-6128e5573e3a\") " pod="openshift-dns/dns-default-glplz" Jul 15 21:10:59.893373 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.891009 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hpmbh\" (UniqueName: \"kubernetes.io/projected/b5e3cdfd-977c-4695-bf7e-6128e5573e3a-kube-api-access-hpmbh\") pod \"dns-default-glplz\" (UID: \"b5e3cdfd-977c-4695-bf7e-6128e5573e3a\") " pod="openshift-dns/dns-default-glplz" Jul 15 21:10:59.893373 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.891051 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb6a141f-5ad2-4482-ac78-d164572f90f7-data-volume\") pod \"insights-runtime-extractor-kj99n\" (UID: \"fb6a141f-5ad2-4482-ac78-d164572f90f7\") " pod="openshift-insights/insights-runtime-extractor-kj99n" Jul 15 21:10:59.893373 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.891085 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-z4cvh\" (UniqueName: \"kubernetes.io/projected/fb6a141f-5ad2-4482-ac78-d164572f90f7-kube-api-access-z4cvh\") pod \"insights-runtime-extractor-kj99n\" (UID: \"fb6a141f-5ad2-4482-ac78-d164572f90f7\") " pod="openshift-insights/insights-runtime-extractor-kj99n" Jul 15 21:10:59.893373 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.891116 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b5e3cdfd-977c-4695-bf7e-6128e5573e3a-config-volume\") pod \"dns-default-glplz\" (UID: \"b5e3cdfd-977c-4695-bf7e-6128e5573e3a\") " pod="openshift-dns/dns-default-glplz" Jul 15 21:10:59.893373 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.891168 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb6a141f-5ad2-4482-ac78-d164572f90f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kj99n\" (UID: \"fb6a141f-5ad2-4482-ac78-d164572f90f7\") " pod="openshift-insights/insights-runtime-extractor-kj99n" Jul 15 21:10:59.893373 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.891205 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb6a141f-5ad2-4482-ac78-d164572f90f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kj99n\" (UID: \"fb6a141f-5ad2-4482-ac78-d164572f90f7\") " pod="openshift-insights/insights-runtime-extractor-kj99n" Jul 15 21:10:59.893373 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.891293 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb6a141f-5ad2-4482-ac78-d164572f90f7-crio-socket\") pod \"insights-runtime-extractor-kj99n\" (UID: \"fb6a141f-5ad2-4482-ac78-d164572f90f7\") " pod="openshift-insights/insights-runtime-extractor-kj99n" Jul 15 21:10:59.893373 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.891321 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5e3cdfd-977c-4695-bf7e-6128e5573e3a-metrics-tls\") pod \"dns-default-glplz\" (UID: \"b5e3cdfd-977c-4695-bf7e-6128e5573e3a\") " pod="openshift-dns/dns-default-glplz" Jul 15 21:10:59.893862 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.893520 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/fb6a141f-5ad2-4482-ac78-d164572f90f7-crio-socket\") pod \"insights-runtime-extractor-kj99n\" (UID: \"fb6a141f-5ad2-4482-ac78-d164572f90f7\") " pod="openshift-insights/insights-runtime-extractor-kj99n" Jul 15 21:10:59.893862 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.893784 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/fb6a141f-5ad2-4482-ac78-d164572f90f7-data-volume\") pod \"insights-runtime-extractor-kj99n\" (UID: \"fb6a141f-5ad2-4482-ac78-d164572f90f7\") " pod="openshift-insights/insights-runtime-extractor-kj99n" Jul 15 21:10:59.893862 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.893835 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/b5e3cdfd-977c-4695-bf7e-6128e5573e3a-tmp-dir\") pod \"dns-default-glplz\" (UID: \"b5e3cdfd-977c-4695-bf7e-6128e5573e3a\") " pod="openshift-dns/dns-default-glplz" Jul 15 21:10:59.894034 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.894009 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/fb6a141f-5ad2-4482-ac78-d164572f90f7-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-kj99n\" (UID: \"fb6a141f-5ad2-4482-ac78-d164572f90f7\") " pod="openshift-insights/insights-runtime-extractor-kj99n" Jul 15 21:10:59.894133 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.894054 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/b5e3cdfd-977c-4695-bf7e-6128e5573e3a-metrics-tls\") pod \"dns-default-glplz\" (UID: \"b5e3cdfd-977c-4695-bf7e-6128e5573e3a\") " pod="openshift-dns/dns-default-glplz" Jul 15 21:10:59.894471 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.894453 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/b5e3cdfd-977c-4695-bf7e-6128e5573e3a-config-volume\") pod \"dns-default-glplz\" (UID: \"b5e3cdfd-977c-4695-bf7e-6128e5573e3a\") " pod="openshift-dns/dns-default-glplz" Jul 15 21:10:59.895982 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.895964 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/fb6a141f-5ad2-4482-ac78-d164572f90f7-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-kj99n\" (UID: \"fb6a141f-5ad2-4482-ac78-d164572f90f7\") " pod="openshift-insights/insights-runtime-extractor-kj99n" Jul 15 21:10:59.906963 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.906945 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-z4cvh\" (UniqueName: \"kubernetes.io/projected/fb6a141f-5ad2-4482-ac78-d164572f90f7-kube-api-access-z4cvh\") pod \"insights-runtime-extractor-kj99n\" (UID: \"fb6a141f-5ad2-4482-ac78-d164572f90f7\") " pod="openshift-insights/insights-runtime-extractor-kj99n" Jul 15 21:10:59.910561 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.910475 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hpmbh\" (UniqueName: \"kubernetes.io/projected/b5e3cdfd-977c-4695-bf7e-6128e5573e3a-kube-api-access-hpmbh\") pod \"dns-default-glplz\" (UID: \"b5e3cdfd-977c-4695-bf7e-6128e5573e3a\") " pod="openshift-dns/dns-default-glplz" Jul 15 21:10:59.951544 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.951495 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-n9tjd" Jul 15 21:10:59.954830 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.954810 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:10:59.955002 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.954978 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:10:59.975633 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.975612 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-kj99n" Jul 15 21:10:59.989101 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.989078 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 21:10:59.989259 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.989078 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 21:10:59.989308 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.989260 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xbx8z\"" Jul 15 21:10:59.989451 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.989438 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 21:10:59.989485 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:10:59.989477 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jtv82\"" Jul 15 21:11:00.037372 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:00.037047 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-glplz" Jul 15 21:11:00.167830 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:11:00.167796 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfea15078_baa8_47be_af80_abf668aed353.slice/crio-459c10f9544292a33b42388a06640e14777ee1641d0cab3dc70c1491ef806ecb WatchSource:0}: Error finding container 459c10f9544292a33b42388a06640e14777ee1641d0cab3dc70c1491ef806ecb: Status 404 returned error can't find the container with id 459c10f9544292a33b42388a06640e14777ee1641d0cab3dc70c1491ef806ecb Jul 15 21:11:00.175071 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:11:00.175048 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod07cfd1eb_d93a_4d92_937e_e83af131d9ad.slice/crio-b028fdf03f35fe97403c6c1f64bad6fa5d4971da836a5bb2d66c085a824b6444 WatchSource:0}: Error finding container b028fdf03f35fe97403c6c1f64bad6fa5d4971da836a5bb2d66c085a824b6444: Status 404 returned error can't find the container with id b028fdf03f35fe97403c6c1f64bad6fa5d4971da836a5bb2d66c085a824b6444 Jul 15 21:11:00.176201 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:00.176177 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-image-registry/image-registry-5b87466585-qgbj7"] Jul 15 21:11:00.177003 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:00.176981 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-n9tjd"] Jul 15 21:11:00.186219 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:00.186194 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n9tjd" event={"ID":"07cfd1eb-d93a-4d92-937e-e83af131d9ad","Type":"ContainerStarted","Data":"b028fdf03f35fe97403c6c1f64bad6fa5d4971da836a5bb2d66c085a824b6444"} Jul 15 21:11:00.187351 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:00.187325 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b87466585-qgbj7" event={"ID":"fea15078-baa8-47be-af80-abf668aed353","Type":"ContainerStarted","Data":"459c10f9544292a33b42388a06640e14777ee1641d0cab3dc70c1491ef806ecb"} Jul 15 21:11:00.200205 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:00.200179 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-kj99n"] Jul 15 21:11:00.203103 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:11:00.203080 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfb6a141f_5ad2_4482_ac78_d164572f90f7.slice/crio-96f87b9bbb3b906253b1cc96e9e39818c4e6356f03a087cb87062e10ae883b5a WatchSource:0}: Error finding container 96f87b9bbb3b906253b1cc96e9e39818c4e6356f03a087cb87062e10ae883b5a: Status 404 returned error can't find the container with id 96f87b9bbb3b906253b1cc96e9e39818c4e6356f03a087cb87062e10ae883b5a Jul 15 21:11:00.212117 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:00.212093 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-glplz"] Jul 15 21:11:00.214430 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:11:00.214406 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb5e3cdfd_977c_4695_bf7e_6128e5573e3a.slice/crio-876e7f69cbb566007efa80be3bd8448c82381702546e18e6ca316862c12ea1d8 WatchSource:0}: Error finding container 876e7f69cbb566007efa80be3bd8448c82381702546e18e6ca316862c12ea1d8: Status 404 returned error can't find the container with id 876e7f69cbb566007efa80be3bd8448c82381702546e18e6ca316862c12ea1d8 Jul 15 21:11:00.955143 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:00.954668 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:11:00.960688 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:00.960454 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 21:11:01.193005 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:01.192948 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-glplz" event={"ID":"b5e3cdfd-977c-4695-bf7e-6128e5573e3a","Type":"ContainerStarted","Data":"876e7f69cbb566007efa80be3bd8448c82381702546e18e6ca316862c12ea1d8"} Jul 15 21:11:01.195587 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:01.195560 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/image-registry-5b87466585-qgbj7" event={"ID":"fea15078-baa8-47be-af80-abf668aed353","Type":"ContainerStarted","Data":"df4032ede2d8aee2e9e5df47f630921691f8bd45efa32fe7e93a7765761803ce"} Jul 15 21:11:01.195851 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:01.195834 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:11:01.197610 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:01.197586 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kj99n" event={"ID":"fb6a141f-5ad2-4482-ac78-d164572f90f7","Type":"ContainerStarted","Data":"96f87b9bbb3b906253b1cc96e9e39818c4e6356f03a087cb87062e10ae883b5a"} Jul 15 21:11:06.212171 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:06.212079 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kj99n" event={"ID":"fb6a141f-5ad2-4482-ac78-d164572f90f7","Type":"ContainerStarted","Data":"1921e1fcf9b00d160640a4b9ac9b0f9d541591c110eea3b7b1edacc68a6d4b5a"} Jul 15 21:11:06.213564 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:06.213541 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-n9tjd" event={"ID":"07cfd1eb-d93a-4d92-937e-e83af131d9ad","Type":"ContainerStarted","Data":"50f5527b209948ba2617142eeec69f67aee44aa537349827d8547b4397b3928f"} Jul 15 21:11:06.215129 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:06.215106 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-glplz" event={"ID":"b5e3cdfd-977c-4695-bf7e-6128e5573e3a","Type":"ContainerStarted","Data":"13f44a2b1c575b6bf8ec2e2157569c51b08f2ad5db1cb0459f4a3de621f1a35c"} Jul 15 21:11:06.215229 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:06.215145 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-glplz" event={"ID":"b5e3cdfd-977c-4695-bf7e-6128e5573e3a","Type":"ContainerStarted","Data":"44ae9d199fb13597e6e1d6851f213d9657411a9f4fc16f43a608c7397ba5e53c"} Jul 15 21:11:06.215229 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:06.215176 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-glplz" Jul 15 21:11:06.236849 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:06.236801 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-n9tjd" podStartSLOduration=1.567127052 podStartE2EDuration="7.236788084s" totalImagesPullingTime="5.669661032s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:06.236553376 +0000 UTC m=+59.057870692" watchObservedRunningTime="2026-07-15 21:11:06.236788084 +0000 UTC m=+59.058105400" Jul 15 21:11:06.237264 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:06.237244 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/image-registry-5b87466585-qgbj7" podStartSLOduration=8.237238669 podStartE2EDuration="8.237238669s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:58 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:01.222739507 +0000 UTC m=+54.044056824" watchObservedRunningTime="2026-07-15 21:11:06.237238669 +0000 UTC m=+59.058555986" Jul 15 21:11:06.259294 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:06.259065 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-glplz" podStartSLOduration=1.628230489 podStartE2EDuration="7.259044432s" totalImagesPullingTime="5.630813943s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:59 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:06.258455455 +0000 UTC m=+59.079772771" watchObservedRunningTime="2026-07-15 21:11:06.259044432 +0000 UTC m=+59.080361750" Jul 15 21:11:09.139626 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:09.139585 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-dsl2f" Jul 15 21:11:10.236937 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:10.236893 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kj99n" event={"ID":"fb6a141f-5ad2-4482-ac78-d164572f90f7","Type":"ContainerStarted","Data":"41093772c0caea820f373768f466c6e475500bd36f2f38f640e661dbd5efa88b"} Jul 15 21:11:13.248834 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:13.248796 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-kj99n" event={"ID":"fb6a141f-5ad2-4482-ac78-d164572f90f7","Type":"ContainerStarted","Data":"e00b3b82311f63cff2fd9e471a534e30773bb05ba33720128e375598cd49ae38"} Jul 15 21:11:13.272619 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:13.272571 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-kj99n" podStartSLOduration=1.483604739 podStartE2EDuration="14.272550705s" totalImagesPullingTime="12.788945966s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:10:59 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:13.271719036 +0000 UTC m=+66.093036354" watchObservedRunningTime="2026-07-15 21:11:13.272550705 +0000 UTC m=+66.093868023" Jul 15 21:11:13.606856 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:13.606822 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs\") pod \"network-metrics-daemon-mct98\" (UID: \"5c81bb07-fdbf-43fc-9554-e3d0ed0312e9\") " pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:11:13.609801 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:13.609776 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 15 21:11:13.619732 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:13.619711 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/5c81bb07-fdbf-43fc-9554-e3d0ed0312e9-metrics-certs\") pod \"network-metrics-daemon-mct98\" (UID: \"5c81bb07-fdbf-43fc-9554-e3d0ed0312e9\") " pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:11:13.708106 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:13.708074 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret\") pod \"global-pull-secret-syncer-jl9zp\" (UID: \"ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7\") " pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:11:13.708242 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:13.708149 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hmqzf\" (UniqueName: \"kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf\") pod \"network-check-target-6nvzk\" (UID: \"2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05\") " pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:11:13.711253 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:13.711233 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 15 21:11:13.713241 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:13.713227 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 15 21:11:13.720866 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:13.720848 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7-original-pull-secret\") pod \"global-pull-secret-syncer-jl9zp\" (UID: \"ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7\") " pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:11:13.721245 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:13.721226 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 15 21:11:13.731059 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:13.731038 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hmqzf\" (UniqueName: \"kubernetes.io/projected/2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05-kube-api-access-hmqzf\") pod \"network-check-target-6nvzk\" (UID: \"2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05\") " pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:11:13.767770 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:13.767747 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-xbx8z\"" Jul 15 21:11:13.775368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:13.775352 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-mct98" Jul 15 21:11:13.775789 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:13.775769 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-jtv82\"" Jul 15 21:11:13.780762 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:13.780748 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:11:13.870208 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:13.870184 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-jl9zp" Jul 15 21:11:13.911470 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:13.911429 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-mct98"] Jul 15 21:11:13.915048 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:11:13.915021 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5c81bb07_fdbf_43fc_9554_e3d0ed0312e9.slice/crio-68c89f5571b270ec7c33767bc5051eaf4d03d2cca9eefd44ae74142817bed261 WatchSource:0}: Error finding container 68c89f5571b270ec7c33767bc5051eaf4d03d2cca9eefd44ae74142817bed261: Status 404 returned error can't find the container with id 68c89f5571b270ec7c33767bc5051eaf4d03d2cca9eefd44ae74142817bed261 Jul 15 21:11:13.930153 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:13.930126 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-6nvzk"] Jul 15 21:11:13.934227 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:11:13.934200 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e66eb0d_7fef_42c5_be50_1f8fb3bd2a05.slice/crio-3fc33368106cfd491ecfe67dc5bcf6d976b6d60a1ca2eee45ebdf30486467e65 WatchSource:0}: Error finding container 3fc33368106cfd491ecfe67dc5bcf6d976b6d60a1ca2eee45ebdf30486467e65: Status 404 returned error can't find the container with id 3fc33368106cfd491ecfe67dc5bcf6d976b6d60a1ca2eee45ebdf30486467e65 Jul 15 21:11:14.010757 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:14.010724 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-jl9zp"] Jul 15 21:11:14.015797 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:11:14.015773 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podca4dbd10_cf3e_4c7b_bb8d_529ce19bd8e7.slice/crio-946edb0217737a7ee1f8a99e2bde203ffcb60450b310846795e6beede727ee2b WatchSource:0}: Error finding container 946edb0217737a7ee1f8a99e2bde203ffcb60450b310846795e6beede727ee2b: Status 404 returned error can't find the container with id 946edb0217737a7ee1f8a99e2bde203ffcb60450b310846795e6beede727ee2b Jul 15 21:11:14.253018 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:14.252939 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jl9zp" event={"ID":"ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7","Type":"ContainerStarted","Data":"946edb0217737a7ee1f8a99e2bde203ffcb60450b310846795e6beede727ee2b"} Jul 15 21:11:14.254106 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:14.254076 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mct98" event={"ID":"5c81bb07-fdbf-43fc-9554-e3d0ed0312e9","Type":"ContainerStarted","Data":"68c89f5571b270ec7c33767bc5051eaf4d03d2cca9eefd44ae74142817bed261"} Jul 15 21:11:14.255130 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:14.255106 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6nvzk" event={"ID":"2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05","Type":"ContainerStarted","Data":"3fc33368106cfd491ecfe67dc5bcf6d976b6d60a1ca2eee45ebdf30486467e65"} Jul 15 21:11:16.223630 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:16.223600 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-glplz" Jul 15 21:11:16.267421 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:16.267385 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mct98" event={"ID":"5c81bb07-fdbf-43fc-9554-e3d0ed0312e9","Type":"ContainerStarted","Data":"27a1c95b8e0cf00dfc65d4cf75b967a7a2db4c484b4af5fc3b06de4864b8b1c1"} Jul 15 21:11:16.267618 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:16.267449 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-mct98" event={"ID":"5c81bb07-fdbf-43fc-9554-e3d0ed0312e9","Type":"ContainerStarted","Data":"f701ecd7291880953c6156091925478f1e7f73a830765153f994e5977b18e33f"} Jul 15 21:11:16.288465 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:16.288351 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-mct98" podStartSLOduration=67.693417785 podStartE2EDuration="1m9.288329182s" totalImagesPullingTime="1.594911397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:16.287634003 +0000 UTC m=+69.108951321" watchObservedRunningTime="2026-07-15 21:11:16.288329182 +0000 UTC m=+69.109646502" Jul 15 21:11:19.280330 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:19.280288 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-jl9zp" event={"ID":"ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7","Type":"ContainerStarted","Data":"11e2159024362b08fb804ce2c7f19c0d87c21d80e260f7805da2f83ba04e8475"} Jul 15 21:11:19.281664 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:19.281635 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-6nvzk" event={"ID":"2e66eb0d-7fef-42c5-be50-1f8fb3bd2a05","Type":"ContainerStarted","Data":"ee0c0f0596e7a0789be8fbddd015fd783a425eca4c1e0f0b23ef54746848bfbb"} Jul 15 21:11:19.281803 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:19.281766 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:11:19.302991 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:19.302920 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-jl9zp" podStartSLOduration=66.648886289 podStartE2EDuration="1m11.302904002s" totalImagesPullingTime="4.654017713s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:10:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:19.30266742 +0000 UTC m=+72.123984716" watchObservedRunningTime="2026-07-15 21:11:19.302904002 +0000 UTC m=+72.124221336" Jul 15 21:11:22.097470 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.097414 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-6nvzk" podStartSLOduration=70.366361631 podStartE2EDuration="1m15.097391834s" totalImagesPullingTime="4.731030203s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:10:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:19.325480419 +0000 UTC m=+72.146797736" watchObservedRunningTime="2026-07-15 21:11:22.097391834 +0000 UTC m=+74.918709177" Jul 15 21:11:22.098227 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.098208 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq"] Jul 15 21:11:22.100136 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.100120 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq" Jul 15 21:11:22.102499 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.102473 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 15 21:11:22.102629 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.102563 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 15 21:11:22.102753 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.102739 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-98wmn\"" Jul 15 21:11:22.102796 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.102777 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 15 21:11:22.104255 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.104234 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 15 21:11:22.104323 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.104283 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 15 21:11:22.116621 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.116598 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq"] Jul 15 21:11:22.126110 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.126093 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-25lbn"] Jul 15 21:11:22.127993 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.127974 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" Jul 15 21:11:22.130633 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.130614 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 15 21:11:22.130633 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.130632 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-vd7cf\"" Jul 15 21:11:22.130788 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.130642 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 15 21:11:22.130788 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.130631 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 15 21:11:22.144253 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.144232 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-25lbn"] Jul 15 21:11:22.169603 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.169582 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jxm8g"] Jul 15 21:11:22.171455 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.171441 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.173978 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.173961 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 15 21:11:22.174079 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.174019 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 15 21:11:22.174079 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.174019 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-6gx47\"" Jul 15 21:11:22.174079 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.174070 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 15 21:11:22.205072 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.205054 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-image-registry/image-registry-5b87466585-qgbj7" Jul 15 21:11:22.268168 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.268136 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dd47478-4846-4283-8c64-ab485c965275-sys\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.268318 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.268184 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wvbbv\" (UniqueName: \"kubernetes.io/projected/1dd47478-4846-4283-8c64-ab485c965275-kube-api-access-wvbbv\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.268318 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.268209 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1dd47478-4846-4283-8c64-ab485c965275-node-exporter-textfile\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.268318 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.268232 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/840a38d8-3264-4a38-b316-67c8ebaa9df9-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-25lbn\" (UID: \"840a38d8-3264-4a38-b316-67c8ebaa9df9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" Jul 15 21:11:22.268318 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.268279 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/840a38d8-3264-4a38-b316-67c8ebaa9df9-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-25lbn\" (UID: \"840a38d8-3264-4a38-b316-67c8ebaa9df9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" Jul 15 21:11:22.268318 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.268310 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/840a38d8-3264-4a38-b316-67c8ebaa9df9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-25lbn\" (UID: \"840a38d8-3264-4a38-b316-67c8ebaa9df9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" Jul 15 21:11:22.268575 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.268347 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/840a38d8-3264-4a38-b316-67c8ebaa9df9-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-25lbn\" (UID: \"840a38d8-3264-4a38-b316-67c8ebaa9df9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" Jul 15 21:11:22.268575 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.268375 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/840a38d8-3264-4a38-b316-67c8ebaa9df9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-25lbn\" (UID: \"840a38d8-3264-4a38-b316-67c8ebaa9df9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" Jul 15 21:11:22.268575 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.268426 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1dd47478-4846-4283-8c64-ab485c965275-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.268575 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.268480 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1dd47478-4846-4283-8c64-ab485c965275-node-exporter-accelerators-collector-config\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.268575 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.268549 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0ac5c7e-e558-438d-bc31-010cf59b10c2-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-qvhqq\" (UID: \"b0ac5c7e-e558-438d-bc31-010cf59b10c2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq" Jul 15 21:11:22.268784 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.268582 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1dd47478-4846-4283-8c64-ab485c965275-node-exporter-tls\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.268784 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.268610 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p95hj\" (UniqueName: \"kubernetes.io/projected/840a38d8-3264-4a38-b316-67c8ebaa9df9-kube-api-access-p95hj\") pod \"kube-state-metrics-785778ff74-25lbn\" (UID: \"840a38d8-3264-4a38-b316-67c8ebaa9df9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" Jul 15 21:11:22.268784 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.268634 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1dd47478-4846-4283-8c64-ab485c965275-root\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.268784 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.268656 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dd47478-4846-4283-8c64-ab485c965275-metrics-client-ca\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.268784 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.268685 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1dd47478-4846-4283-8c64-ab485c965275-node-exporter-wtmp\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.268784 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.268711 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0ac5c7e-e558-438d-bc31-010cf59b10c2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-qvhqq\" (UID: \"b0ac5c7e-e558-438d-bc31-010cf59b10c2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq" Jul 15 21:11:22.268784 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.268768 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0ac5c7e-e558-438d-bc31-010cf59b10c2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-qvhqq\" (UID: \"b0ac5c7e-e558-438d-bc31-010cf59b10c2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq" Jul 15 21:11:22.268990 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.268808 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pstsw\" (UniqueName: \"kubernetes.io/projected/b0ac5c7e-e558-438d-bc31-010cf59b10c2-kube-api-access-pstsw\") pod \"openshift-state-metrics-84bd68b896-qvhqq\" (UID: \"b0ac5c7e-e558-438d-bc31-010cf59b10c2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq" Jul 15 21:11:22.369887 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.369813 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0ac5c7e-e558-438d-bc31-010cf59b10c2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-qvhqq\" (UID: \"b0ac5c7e-e558-438d-bc31-010cf59b10c2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq" Jul 15 21:11:22.369887 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.369858 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0ac5c7e-e558-438d-bc31-010cf59b10c2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-qvhqq\" (UID: \"b0ac5c7e-e558-438d-bc31-010cf59b10c2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq" Jul 15 21:11:22.369887 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.369876 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pstsw\" (UniqueName: \"kubernetes.io/projected/b0ac5c7e-e558-438d-bc31-010cf59b10c2-kube-api-access-pstsw\") pod \"openshift-state-metrics-84bd68b896-qvhqq\" (UID: \"b0ac5c7e-e558-438d-bc31-010cf59b10c2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq" Jul 15 21:11:22.370139 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.369894 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dd47478-4846-4283-8c64-ab485c965275-sys\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.370139 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:11:22.369973 2572 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 15 21:11:22.370139 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:11:22.370040 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b0ac5c7e-e558-438d-bc31-010cf59b10c2-openshift-state-metrics-tls podName:b0ac5c7e-e558-438d-bc31-010cf59b10c2 nodeName:}" failed. No retries permitted until 2026-07-15 21:11:22.870019571 +0000 UTC m=+75.691336879 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/b0ac5c7e-e558-438d-bc31-010cf59b10c2-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-qvhqq" (UID: "b0ac5c7e-e558-438d-bc31-010cf59b10c2") : secret "openshift-state-metrics-tls" not found Jul 15 21:11:22.370139 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.370055 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/1dd47478-4846-4283-8c64-ab485c965275-sys\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.370139 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.370085 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wvbbv\" (UniqueName: \"kubernetes.io/projected/1dd47478-4846-4283-8c64-ab485c965275-kube-api-access-wvbbv\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.370139 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.370116 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1dd47478-4846-4283-8c64-ab485c965275-node-exporter-textfile\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.370437 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.370141 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/840a38d8-3264-4a38-b316-67c8ebaa9df9-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-25lbn\" (UID: \"840a38d8-3264-4a38-b316-67c8ebaa9df9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" Jul 15 21:11:22.370437 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.370169 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/840a38d8-3264-4a38-b316-67c8ebaa9df9-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-25lbn\" (UID: \"840a38d8-3264-4a38-b316-67c8ebaa9df9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" Jul 15 21:11:22.370437 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.370197 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/840a38d8-3264-4a38-b316-67c8ebaa9df9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-25lbn\" (UID: \"840a38d8-3264-4a38-b316-67c8ebaa9df9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" Jul 15 21:11:22.370437 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.370255 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/840a38d8-3264-4a38-b316-67c8ebaa9df9-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-25lbn\" (UID: \"840a38d8-3264-4a38-b316-67c8ebaa9df9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" Jul 15 21:11:22.370437 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.370287 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/840a38d8-3264-4a38-b316-67c8ebaa9df9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-25lbn\" (UID: \"840a38d8-3264-4a38-b316-67c8ebaa9df9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" Jul 15 21:11:22.370710 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.370519 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1dd47478-4846-4283-8c64-ab485c965275-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.370710 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.370566 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/1dd47478-4846-4283-8c64-ab485c965275-node-exporter-textfile\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.370710 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.370616 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1dd47478-4846-4283-8c64-ab485c965275-node-exporter-accelerators-collector-config\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.370710 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.370679 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0ac5c7e-e558-438d-bc31-010cf59b10c2-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-qvhqq\" (UID: \"b0ac5c7e-e558-438d-bc31-010cf59b10c2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq" Jul 15 21:11:22.370916 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.370716 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1dd47478-4846-4283-8c64-ab485c965275-node-exporter-tls\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.370916 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.370760 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p95hj\" (UniqueName: \"kubernetes.io/projected/840a38d8-3264-4a38-b316-67c8ebaa9df9-kube-api-access-p95hj\") pod \"kube-state-metrics-785778ff74-25lbn\" (UID: \"840a38d8-3264-4a38-b316-67c8ebaa9df9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" Jul 15 21:11:22.370916 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:11:22.370789 2572 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 15 21:11:22.370916 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.370800 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1dd47478-4846-4283-8c64-ab485c965275-root\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.370916 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.370828 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dd47478-4846-4283-8c64-ab485c965275-metrics-client-ca\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.370916 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:11:22.370849 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1dd47478-4846-4283-8c64-ab485c965275-node-exporter-tls podName:1dd47478-4846-4283-8c64-ab485c965275 nodeName:}" failed. No retries permitted until 2026-07-15 21:11:22.870830519 +0000 UTC m=+75.692147828 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/1dd47478-4846-4283-8c64-ab485c965275-node-exporter-tls") pod "node-exporter-jxm8g" (UID: "1dd47478-4846-4283-8c64-ab485c965275") : secret "node-exporter-tls" not found Jul 15 21:11:22.370916 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.370881 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1dd47478-4846-4283-8c64-ab485c965275-node-exporter-wtmp\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.371247 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.370967 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/840a38d8-3264-4a38-b316-67c8ebaa9df9-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-25lbn\" (UID: \"840a38d8-3264-4a38-b316-67c8ebaa9df9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" Jul 15 21:11:22.371247 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.371051 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/1dd47478-4846-4283-8c64-ab485c965275-node-exporter-wtmp\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.371345 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.371327 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/1dd47478-4846-4283-8c64-ab485c965275-metrics-client-ca\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.371402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.371390 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/1dd47478-4846-4283-8c64-ab485c965275-root\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.371633 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.371613 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/840a38d8-3264-4a38-b316-67c8ebaa9df9-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-25lbn\" (UID: \"840a38d8-3264-4a38-b316-67c8ebaa9df9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" Jul 15 21:11:22.371724 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.371645 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/b0ac5c7e-e558-438d-bc31-010cf59b10c2-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-qvhqq\" (UID: \"b0ac5c7e-e558-438d-bc31-010cf59b10c2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq" Jul 15 21:11:22.371784 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.371664 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/1dd47478-4846-4283-8c64-ab485c965275-node-exporter-accelerators-collector-config\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.372196 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.372158 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/840a38d8-3264-4a38-b316-67c8ebaa9df9-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-25lbn\" (UID: \"840a38d8-3264-4a38-b316-67c8ebaa9df9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" Jul 15 21:11:22.372794 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.372774 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/b0ac5c7e-e558-438d-bc31-010cf59b10c2-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-qvhqq\" (UID: \"b0ac5c7e-e558-438d-bc31-010cf59b10c2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq" Jul 15 21:11:22.372900 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.372876 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/840a38d8-3264-4a38-b316-67c8ebaa9df9-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-25lbn\" (UID: \"840a38d8-3264-4a38-b316-67c8ebaa9df9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" Jul 15 21:11:22.373252 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.373235 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/1dd47478-4846-4283-8c64-ab485c965275-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.373405 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.373387 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/840a38d8-3264-4a38-b316-67c8ebaa9df9-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-25lbn\" (UID: \"840a38d8-3264-4a38-b316-67c8ebaa9df9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" Jul 15 21:11:22.380357 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.380321 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wvbbv\" (UniqueName: \"kubernetes.io/projected/1dd47478-4846-4283-8c64-ab485c965275-kube-api-access-wvbbv\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.380651 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.380632 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pstsw\" (UniqueName: \"kubernetes.io/projected/b0ac5c7e-e558-438d-bc31-010cf59b10c2-kube-api-access-pstsw\") pod \"openshift-state-metrics-84bd68b896-qvhqq\" (UID: \"b0ac5c7e-e558-438d-bc31-010cf59b10c2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq" Jul 15 21:11:22.380858 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.380839 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p95hj\" (UniqueName: \"kubernetes.io/projected/840a38d8-3264-4a38-b316-67c8ebaa9df9-kube-api-access-p95hj\") pod \"kube-state-metrics-785778ff74-25lbn\" (UID: \"840a38d8-3264-4a38-b316-67c8ebaa9df9\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" Jul 15 21:11:22.435591 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.435564 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" Jul 15 21:11:22.557390 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.557363 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-25lbn"] Jul 15 21:11:22.560437 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:11:22.560410 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod840a38d8_3264_4a38_b316_67c8ebaa9df9.slice/crio-cfd8ea0249d8d9a05ce42ee44f4cdb74f1ef4f465289e2335256021fca3d0225 WatchSource:0}: Error finding container cfd8ea0249d8d9a05ce42ee44f4cdb74f1ef4f465289e2335256021fca3d0225: Status 404 returned error can't find the container with id cfd8ea0249d8d9a05ce42ee44f4cdb74f1ef4f465289e2335256021fca3d0225 Jul 15 21:11:22.875030 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.874998 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1dd47478-4846-4283-8c64-ab485c965275-node-exporter-tls\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.875199 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.875041 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0ac5c7e-e558-438d-bc31-010cf59b10c2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-qvhqq\" (UID: \"b0ac5c7e-e558-438d-bc31-010cf59b10c2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq" Jul 15 21:11:22.877388 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.877364 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/1dd47478-4846-4283-8c64-ab485c965275-node-exporter-tls\") pod \"node-exporter-jxm8g\" (UID: \"1dd47478-4846-4283-8c64-ab485c965275\") " pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:22.877517 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:22.877486 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/b0ac5c7e-e558-438d-bc31-010cf59b10c2-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-qvhqq\" (UID: \"b0ac5c7e-e558-438d-bc31-010cf59b10c2\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq" Jul 15 21:11:23.008424 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:23.008393 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq" Jul 15 21:11:23.080214 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:23.080178 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jxm8g" Jul 15 21:11:23.091353 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:11:23.091317 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1dd47478_4846_4283_8c64_ab485c965275.slice/crio-e550b97f7831031e7152d2b95fc74cc40146a8617b067973feaa239a8a80be0a WatchSource:0}: Error finding container e550b97f7831031e7152d2b95fc74cc40146a8617b067973feaa239a8a80be0a: Status 404 returned error can't find the container with id e550b97f7831031e7152d2b95fc74cc40146a8617b067973feaa239a8a80be0a Jul 15 21:11:23.145057 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:23.144964 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq"] Jul 15 21:11:23.147992 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:11:23.147966 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb0ac5c7e_e558_438d_bc31_010cf59b10c2.slice/crio-f9bf2154883c2bfbbf2bb987f2ff7e203a0e41901f4ee61b445e359c61c06914 WatchSource:0}: Error finding container f9bf2154883c2bfbbf2bb987f2ff7e203a0e41901f4ee61b445e359c61c06914: Status 404 returned error can't find the container with id f9bf2154883c2bfbbf2bb987f2ff7e203a0e41901f4ee61b445e359c61c06914 Jul 15 21:11:23.296780 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:23.296746 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" event={"ID":"840a38d8-3264-4a38-b316-67c8ebaa9df9","Type":"ContainerStarted","Data":"cfd8ea0249d8d9a05ce42ee44f4cdb74f1ef4f465289e2335256021fca3d0225"} Jul 15 21:11:23.299059 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:23.299021 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq" event={"ID":"b0ac5c7e-e558-438d-bc31-010cf59b10c2","Type":"ContainerStarted","Data":"68e0ce197d444854d5f38911c2b9d6a3778e8a70099f4db2124d1ee48856b6e7"} Jul 15 21:11:23.299175 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:23.299077 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq" event={"ID":"b0ac5c7e-e558-438d-bc31-010cf59b10c2","Type":"ContainerStarted","Data":"a65ddba1bd771ab1952a12b7a8d5f498b36719b26fb5f8c2e88f54b42702fa54"} Jul 15 21:11:23.299175 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:23.299107 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq" event={"ID":"b0ac5c7e-e558-438d-bc31-010cf59b10c2","Type":"ContainerStarted","Data":"f9bf2154883c2bfbbf2bb987f2ff7e203a0e41901f4ee61b445e359c61c06914"} Jul 15 21:11:23.300821 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:23.300793 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jxm8g" event={"ID":"1dd47478-4846-4283-8c64-ab485c965275","Type":"ContainerStarted","Data":"e550b97f7831031e7152d2b95fc74cc40146a8617b067973feaa239a8a80be0a"} Jul 15 21:11:24.308136 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:24.308091 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" event={"ID":"840a38d8-3264-4a38-b316-67c8ebaa9df9","Type":"ContainerStarted","Data":"e7631bcf1ef30d20131aa4fbc0e0f201b199294cf61ea4f431013374c801e68b"} Jul 15 21:11:24.308581 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:24.308157 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" event={"ID":"840a38d8-3264-4a38-b316-67c8ebaa9df9","Type":"ContainerStarted","Data":"c73a732f6b0e59c5c1f1514e41b3c12f0c9493dce80886b3e165a1b8feec13c0"} Jul 15 21:11:24.308581 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:24.308179 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" event={"ID":"840a38d8-3264-4a38-b316-67c8ebaa9df9","Type":"ContainerStarted","Data":"0c910e6d1b62d86eaedc2a5abe274efd1e9f4f7014705ec9cf8e219ff4203bd9"} Jul 15 21:11:24.327958 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:24.327911 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-25lbn" podStartSLOduration=1.129816024 podStartE2EDuration="2.327894135s" totalImagesPullingTime="1.198078111s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:24.327249085 +0000 UTC m=+77.148566403" watchObservedRunningTime="2026-07-15 21:11:24.327894135 +0000 UTC m=+77.149211485" Jul 15 21:11:25.312924 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:25.312887 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq" event={"ID":"b0ac5c7e-e558-438d-bc31-010cf59b10c2","Type":"ContainerStarted","Data":"65a4b9374c640910954e5188f884c55eafc83fa49c9a2058d8641e87a85305a4"} Jul 15 21:11:25.314399 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:25.314370 2572 generic.go:356] "Generic (PLEG): container finished" podID="1dd47478-4846-4283-8c64-ab485c965275" containerID="644a4b2dd97b6f5473a47db2a09e4c486fd76ed9fefff412ebe7b3bd1428e571" exitCode=0 Jul 15 21:11:25.314558 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:25.314459 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jxm8g" event={"ID":"1dd47478-4846-4283-8c64-ab485c965275","Type":"ContainerDied","Data":"644a4b2dd97b6f5473a47db2a09e4c486fd76ed9fefff412ebe7b3bd1428e571"} Jul 15 21:11:25.335999 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:25.335812 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-qvhqq" podStartSLOduration=2.054454062 podStartE2EDuration="3.335796798s" totalImagesPullingTime="1.281342736s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:25.334890499 +0000 UTC m=+78.156207816" watchObservedRunningTime="2026-07-15 21:11:25.335796798 +0000 UTC m=+78.157114106" Jul 15 21:11:26.117808 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.117776 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/thanos-querier-6fb85486c7-4zwns"] Jul 15 21:11:26.120115 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.120099 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.122798 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.122767 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-tls\"" Jul 15 21:11:26.122936 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.122817 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-grpc-tls-eka9sa5132ab6\"" Jul 15 21:11:26.122936 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.122835 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-dockercfg-d778n\"" Jul 15 21:11:26.122936 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.122847 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-rules\"" Jul 15 21:11:26.122936 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.122869 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-metrics\"" Jul 15 21:11:26.122936 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.122820 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy\"" Jul 15 21:11:26.122936 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.122820 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"thanos-querier-kube-rbac-proxy-web\"" Jul 15 21:11:26.133156 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.133132 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6fb85486c7-4zwns"] Jul 15 21:11:26.203685 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.203657 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0d7e1f8-1193-49ac-ba6b-e84970375854-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.203685 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.203685 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a0d7e1f8-1193-49ac-ba6b-e84970375854-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.203864 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.203705 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0d7e1f8-1193-49ac-ba6b-e84970375854-metrics-client-ca\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.203864 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.203734 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmfd2\" (UniqueName: \"kubernetes.io/projected/a0d7e1f8-1193-49ac-ba6b-e84970375854-kube-api-access-rmfd2\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.203864 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.203824 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0d7e1f8-1193-49ac-ba6b-e84970375854-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.203864 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.203863 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a0d7e1f8-1193-49ac-ba6b-e84970375854-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.204009 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.203885 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a0d7e1f8-1193-49ac-ba6b-e84970375854-secret-thanos-querier-tls\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.204009 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.203920 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0d7e1f8-1193-49ac-ba6b-e84970375854-secret-grpc-tls\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.304762 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.304730 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0d7e1f8-1193-49ac-ba6b-e84970375854-metrics-client-ca\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.304914 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.304772 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmfd2\" (UniqueName: \"kubernetes.io/projected/a0d7e1f8-1193-49ac-ba6b-e84970375854-kube-api-access-rmfd2\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.304914 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.304817 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0d7e1f8-1193-49ac-ba6b-e84970375854-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.304914 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.304860 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a0d7e1f8-1193-49ac-ba6b-e84970375854-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.304914 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.304892 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a0d7e1f8-1193-49ac-ba6b-e84970375854-secret-thanos-querier-tls\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.305071 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.304924 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0d7e1f8-1193-49ac-ba6b-e84970375854-secret-grpc-tls\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.305071 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.304953 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0d7e1f8-1193-49ac-ba6b-e84970375854-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.305071 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.304977 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a0d7e1f8-1193-49ac-ba6b-e84970375854-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.305625 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.305593 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/a0d7e1f8-1193-49ac-ba6b-e84970375854-metrics-client-ca\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.307782 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.307747 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-tls\" (UniqueName: \"kubernetes.io/secret/a0d7e1f8-1193-49ac-ba6b-e84970375854-secret-thanos-querier-tls\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.307885 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.307747 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/a0d7e1f8-1193-49ac-ba6b-e84970375854-secret-grpc-tls\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.307885 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.307858 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-metrics\" (UniqueName: \"kubernetes.io/secret/a0d7e1f8-1193-49ac-ba6b-e84970375854-secret-thanos-querier-kube-rbac-proxy-metrics\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.307978 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.307962 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/a0d7e1f8-1193-49ac-ba6b-e84970375854-secret-thanos-querier-kube-rbac-proxy\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.308020 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.307981 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-rules\" (UniqueName: \"kubernetes.io/secret/a0d7e1f8-1193-49ac-ba6b-e84970375854-secret-thanos-querier-kube-rbac-proxy-rules\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.308054 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.308031 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-thanos-querier-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/a0d7e1f8-1193-49ac-ba6b-e84970375854-secret-thanos-querier-kube-rbac-proxy-web\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.313845 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.313823 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmfd2\" (UniqueName: \"kubernetes.io/projected/a0d7e1f8-1193-49ac-ba6b-e84970375854-kube-api-access-rmfd2\") pod \"thanos-querier-6fb85486c7-4zwns\" (UID: \"a0d7e1f8-1193-49ac-ba6b-e84970375854\") " pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.341443 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.341405 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jxm8g" event={"ID":"1dd47478-4846-4283-8c64-ab485c965275","Type":"ContainerStarted","Data":"47a83ef03b2eb8adecaf819f150f658fcd23149eee032896009a42966745c6dc"} Jul 15 21:11:26.341598 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.341464 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jxm8g" event={"ID":"1dd47478-4846-4283-8c64-ab485c965275","Type":"ContainerStarted","Data":"ce76e720a9760757dce8ed3a03058d4ee7c757722b5e5656d99931d191337695"} Jul 15 21:11:26.364221 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.364177 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jxm8g" podStartSLOduration=2.841842411 podStartE2EDuration="4.364163497s" totalImagesPullingTime="1.457626953s" totalInitContainerRuntime="64.694133ms" isStatefulPod=true podCreationTimestamp="2026-07-15 21:11:22 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:26.363174766 +0000 UTC m=+79.184492085" watchObservedRunningTime="2026-07-15 21:11:26.364163497 +0000 UTC m=+79.185480866" Jul 15 21:11:26.429119 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.429058 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:26.558707 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.558669 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/thanos-querier-6fb85486c7-4zwns"] Jul 15 21:11:26.561502 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:11:26.561473 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda0d7e1f8_1193_49ac_ba6b_e84970375854.slice/crio-a01d9f34f595b17d20797d289cb5d12516939016670b9d053867c6a423f15a79 WatchSource:0}: Error finding container a01d9f34f595b17d20797d289cb5d12516939016670b9d053867c6a423f15a79: Status 404 returned error can't find the container with id a01d9f34f595b17d20797d289cb5d12516939016670b9d053867c6a423f15a79 Jul 15 21:11:26.855977 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.855941 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-9cwhw"] Jul 15 21:11:26.859483 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.859446 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwhw" Jul 15 21:11:26.862120 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.862094 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-z2fz9\"" Jul 15 21:11:26.872777 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.872755 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 15 21:11:26.878409 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:26.878387 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-9cwhw"] Jul 15 21:11:27.010434 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.010397 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-txcf4\" (UniqueName: \"kubernetes.io/projected/1d514e08-d81e-4b21-a881-2ee86fd26c1b-kube-api-access-txcf4\") pod \"monitoring-plugin-5f68df7f58-9cwhw\" (UID: \"1d514e08-d81e-4b21-a881-2ee86fd26c1b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwhw" Jul 15 21:11:27.010655 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.010442 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d514e08-d81e-4b21-a881-2ee86fd26c1b-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-9cwhw\" (UID: \"1d514e08-d81e-4b21-a881-2ee86fd26c1b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwhw" Jul 15 21:11:27.111398 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.110979 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-txcf4\" (UniqueName: \"kubernetes.io/projected/1d514e08-d81e-4b21-a881-2ee86fd26c1b-kube-api-access-txcf4\") pod \"monitoring-plugin-5f68df7f58-9cwhw\" (UID: \"1d514e08-d81e-4b21-a881-2ee86fd26c1b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwhw" Jul 15 21:11:27.111398 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.111034 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d514e08-d81e-4b21-a881-2ee86fd26c1b-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-9cwhw\" (UID: \"1d514e08-d81e-4b21-a881-2ee86fd26c1b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwhw" Jul 15 21:11:27.111398 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:11:27.111181 2572 secret.go:189] Couldn't get secret openshift-monitoring/monitoring-plugin-cert: secret "monitoring-plugin-cert" not found Jul 15 21:11:27.111398 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:11:27.111249 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/1d514e08-d81e-4b21-a881-2ee86fd26c1b-monitoring-plugin-cert podName:1d514e08-d81e-4b21-a881-2ee86fd26c1b nodeName:}" failed. No retries permitted until 2026-07-15 21:11:27.611227066 +0000 UTC m=+80.432544387 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "monitoring-plugin-cert" (UniqueName: "kubernetes.io/secret/1d514e08-d81e-4b21-a881-2ee86fd26c1b-monitoring-plugin-cert") pod "monitoring-plugin-5f68df7f58-9cwhw" (UID: "1d514e08-d81e-4b21-a881-2ee86fd26c1b") : secret "monitoring-plugin-cert" not found Jul 15 21:11:27.121218 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.121152 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-txcf4\" (UniqueName: \"kubernetes.io/projected/1d514e08-d81e-4b21-a881-2ee86fd26c1b-kube-api-access-txcf4\") pod \"monitoring-plugin-5f68df7f58-9cwhw\" (UID: \"1d514e08-d81e-4b21-a881-2ee86fd26c1b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwhw" Jul 15 21:11:27.347383 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.347343 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" event={"ID":"a0d7e1f8-1193-49ac-ba6b-e84970375854","Type":"ContainerStarted","Data":"a01d9f34f595b17d20797d289cb5d12516939016670b9d053867c6a423f15a79"} Jul 15 21:11:27.396785 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.396714 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-6db76c58c8-spbpv"] Jul 15 21:11:27.399270 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.399251 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.401872 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.401845 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 15 21:11:27.402123 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.402100 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 15 21:11:27.402397 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.402379 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-2k29c\"" Jul 15 21:11:27.402482 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.402380 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 15 21:11:27.402549 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.402498 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 15 21:11:27.402594 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.402550 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 15 21:11:27.411739 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.411706 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 15 21:11:27.413898 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.413875 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6db76c58c8-spbpv"] Jul 15 21:11:27.514948 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.514915 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6mlqw\" (UniqueName: \"kubernetes.io/projected/5cde9d63-279d-4ba2-86c5-87e9bfa17124-kube-api-access-6mlqw\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.515115 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.514979 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5cde9d63-279d-4ba2-86c5-87e9bfa17124-secret-telemeter-client\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.515115 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.515065 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5cde9d63-279d-4ba2-86c5-87e9bfa17124-metrics-client-ca\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.515115 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.515104 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5cde9d63-279d-4ba2-86c5-87e9bfa17124-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.515254 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.515149 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5cde9d63-279d-4ba2-86c5-87e9bfa17124-telemeter-client-tls\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.515375 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.515351 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cde9d63-279d-4ba2-86c5-87e9bfa17124-serving-certs-ca-bundle\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.515499 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.515436 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5cde9d63-279d-4ba2-86c5-87e9bfa17124-federate-client-tls\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.515604 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.515571 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cde9d63-279d-4ba2-86c5-87e9bfa17124-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.616256 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.616220 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5cde9d63-279d-4ba2-86c5-87e9bfa17124-telemeter-client-tls\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.616411 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.616268 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d514e08-d81e-4b21-a881-2ee86fd26c1b-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-9cwhw\" (UID: \"1d514e08-d81e-4b21-a881-2ee86fd26c1b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwhw" Jul 15 21:11:27.616411 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.616308 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cde9d63-279d-4ba2-86c5-87e9bfa17124-serving-certs-ca-bundle\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.616411 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.616336 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5cde9d63-279d-4ba2-86c5-87e9bfa17124-federate-client-tls\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.616411 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.616358 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cde9d63-279d-4ba2-86c5-87e9bfa17124-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.616411 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.616382 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6mlqw\" (UniqueName: \"kubernetes.io/projected/5cde9d63-279d-4ba2-86c5-87e9bfa17124-kube-api-access-6mlqw\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.616411 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.616403 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5cde9d63-279d-4ba2-86c5-87e9bfa17124-secret-telemeter-client\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.616895 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.616451 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5cde9d63-279d-4ba2-86c5-87e9bfa17124-metrics-client-ca\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.616895 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.616479 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5cde9d63-279d-4ba2-86c5-87e9bfa17124-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.617181 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.617153 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cde9d63-279d-4ba2-86c5-87e9bfa17124-serving-certs-ca-bundle\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.617313 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.617291 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/5cde9d63-279d-4ba2-86c5-87e9bfa17124-telemeter-trusted-ca-bundle\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.617693 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.617664 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/5cde9d63-279d-4ba2-86c5-87e9bfa17124-metrics-client-ca\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.619490 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.619461 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/1d514e08-d81e-4b21-a881-2ee86fd26c1b-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-9cwhw\" (UID: \"1d514e08-d81e-4b21-a881-2ee86fd26c1b\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwhw" Jul 15 21:11:27.619490 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.619482 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/5cde9d63-279d-4ba2-86c5-87e9bfa17124-telemeter-client-tls\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.619676 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.619547 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/5cde9d63-279d-4ba2-86c5-87e9bfa17124-federate-client-tls\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.620096 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.620070 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/5cde9d63-279d-4ba2-86c5-87e9bfa17124-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.620212 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.620191 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/5cde9d63-279d-4ba2-86c5-87e9bfa17124-secret-telemeter-client\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.630109 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.630085 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6mlqw\" (UniqueName: \"kubernetes.io/projected/5cde9d63-279d-4ba2-86c5-87e9bfa17124-kube-api-access-6mlqw\") pod \"telemeter-client-6db76c58c8-spbpv\" (UID: \"5cde9d63-279d-4ba2-86c5-87e9bfa17124\") " pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.635589 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.635567 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-c9f895bbb-tjhpr"] Jul 15 21:11:27.638713 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.638688 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:27.641498 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.641469 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 15 21:11:27.641609 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.641501 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 15 21:11:27.641892 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.641842 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 15 21:11:27.642089 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.642023 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-nhpmj\"" Jul 15 21:11:27.642165 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.642147 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 15 21:11:27.642165 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.642157 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 15 21:11:27.642269 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.642243 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 15 21:11:27.642319 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.642289 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 15 21:11:27.647570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.647472 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 15 21:11:27.650609 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.650586 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c9f895bbb-tjhpr"] Jul 15 21:11:27.710367 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.710334 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" Jul 15 21:11:27.769559 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.769446 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwhw" Jul 15 21:11:27.817985 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.817914 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-console-config\") pod \"console-c9f895bbb-tjhpr\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:27.818160 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.818028 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tr2zl\" (UniqueName: \"kubernetes.io/projected/11b68472-691e-4d62-b45b-037cfcde5d0d-kube-api-access-tr2zl\") pod \"console-c9f895bbb-tjhpr\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:27.818160 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.818067 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-oauth-serving-cert\") pod \"console-c9f895bbb-tjhpr\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:27.818160 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.818096 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b68472-691e-4d62-b45b-037cfcde5d0d-console-serving-cert\") pod \"console-c9f895bbb-tjhpr\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:27.818160 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.818128 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-service-ca\") pod \"console-c9f895bbb-tjhpr\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:27.818160 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.818153 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-trusted-ca-bundle\") pod \"console-c9f895bbb-tjhpr\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:27.818414 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.818204 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b68472-691e-4d62-b45b-037cfcde5d0d-console-oauth-config\") pod \"console-c9f895bbb-tjhpr\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:27.854994 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.854914 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-6db76c58c8-spbpv"] Jul 15 21:11:27.861378 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:11:27.861354 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5cde9d63_279d_4ba2_86c5_87e9bfa17124.slice/crio-da6173ffc71ce239c45e16b5227baecb92b0f62854f6392bf065355fb35cfeb7 WatchSource:0}: Error finding container da6173ffc71ce239c45e16b5227baecb92b0f62854f6392bf065355fb35cfeb7: Status 404 returned error can't find the container with id da6173ffc71ce239c45e16b5227baecb92b0f62854f6392bf065355fb35cfeb7 Jul 15 21:11:27.905624 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.905539 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-9cwhw"] Jul 15 21:11:27.908545 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:11:27.908508 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1d514e08_d81e_4b21_a881_2ee86fd26c1b.slice/crio-477ebc2cdfb8ee6179db37bd1e976d3d9355a219a07f07da28c86123a73f86e8 WatchSource:0}: Error finding container 477ebc2cdfb8ee6179db37bd1e976d3d9355a219a07f07da28c86123a73f86e8: Status 404 returned error can't find the container with id 477ebc2cdfb8ee6179db37bd1e976d3d9355a219a07f07da28c86123a73f86e8 Jul 15 21:11:27.918559 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.918520 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-service-ca\") pod \"console-c9f895bbb-tjhpr\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:27.918658 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.918582 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-trusted-ca-bundle\") pod \"console-c9f895bbb-tjhpr\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:27.918658 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.918636 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b68472-691e-4d62-b45b-037cfcde5d0d-console-oauth-config\") pod \"console-c9f895bbb-tjhpr\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:27.918779 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.918661 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-console-config\") pod \"console-c9f895bbb-tjhpr\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:27.918779 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.918732 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tr2zl\" (UniqueName: \"kubernetes.io/projected/11b68472-691e-4d62-b45b-037cfcde5d0d-kube-api-access-tr2zl\") pod \"console-c9f895bbb-tjhpr\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:27.918779 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.918769 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-oauth-serving-cert\") pod \"console-c9f895bbb-tjhpr\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:27.918922 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.918799 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b68472-691e-4d62-b45b-037cfcde5d0d-console-serving-cert\") pod \"console-c9f895bbb-tjhpr\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:27.919284 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.919189 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-service-ca\") pod \"console-c9f895bbb-tjhpr\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:27.919448 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.919422 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-trusted-ca-bundle\") pod \"console-c9f895bbb-tjhpr\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:27.919648 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.919609 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-oauth-serving-cert\") pod \"console-c9f895bbb-tjhpr\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:27.919770 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.919747 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-console-config\") pod \"console-c9f895bbb-tjhpr\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:27.921299 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.921281 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b68472-691e-4d62-b45b-037cfcde5d0d-console-oauth-config\") pod \"console-c9f895bbb-tjhpr\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:27.921469 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.921448 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b68472-691e-4d62-b45b-037cfcde5d0d-console-serving-cert\") pod \"console-c9f895bbb-tjhpr\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:27.926703 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.926679 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tr2zl\" (UniqueName: \"kubernetes.io/projected/11b68472-691e-4d62-b45b-037cfcde5d0d-kube-api-access-tr2zl\") pod \"console-c9f895bbb-tjhpr\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:27.949664 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:27.949638 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:28.352391 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:28.352349 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" event={"ID":"5cde9d63-279d-4ba2-86c5-87e9bfa17124","Type":"ContainerStarted","Data":"da6173ffc71ce239c45e16b5227baecb92b0f62854f6392bf065355fb35cfeb7"} Jul 15 21:11:28.353764 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:28.353739 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwhw" event={"ID":"1d514e08-d81e-4b21-a881-2ee86fd26c1b","Type":"ContainerStarted","Data":"477ebc2cdfb8ee6179db37bd1e976d3d9355a219a07f07da28c86123a73f86e8"} Jul 15 21:11:28.594548 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:28.594498 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-c9f895bbb-tjhpr"] Jul 15 21:11:28.601930 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:11:28.601843 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b68472_691e_4d62_b45b_037cfcde5d0d.slice/crio-9b20a34c2dbc2b083f09859519409ec70581b50b7dba5a404abaf5d25afccd5f WatchSource:0}: Error finding container 9b20a34c2dbc2b083f09859519409ec70581b50b7dba5a404abaf5d25afccd5f: Status 404 returned error can't find the container with id 9b20a34c2dbc2b083f09859519409ec70581b50b7dba5a404abaf5d25afccd5f Jul 15 21:11:29.363257 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:29.363117 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" event={"ID":"a0d7e1f8-1193-49ac-ba6b-e84970375854","Type":"ContainerStarted","Data":"6fde75040424ed0bab7ad544020da03277c7a7454d4740480b39bcfa4448bab2"} Jul 15 21:11:29.363257 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:29.363213 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" event={"ID":"a0d7e1f8-1193-49ac-ba6b-e84970375854","Type":"ContainerStarted","Data":"1907152e806ec55334d0c9a021fbf5fd0d6ac01ef7062acfb07b46e109f2b70b"} Jul 15 21:11:29.363708 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:29.363264 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" event={"ID":"a0d7e1f8-1193-49ac-ba6b-e84970375854","Type":"ContainerStarted","Data":"b349bb3758426b24b897088e870e3896d424478c80ef55427609d931f0ba4d19"} Jul 15 21:11:29.365426 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:29.365388 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9f895bbb-tjhpr" event={"ID":"11b68472-691e-4d62-b45b-037cfcde5d0d","Type":"ContainerStarted","Data":"9b20a34c2dbc2b083f09859519409ec70581b50b7dba5a404abaf5d25afccd5f"} Jul 15 21:11:30.372786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:30.372743 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" event={"ID":"a0d7e1f8-1193-49ac-ba6b-e84970375854","Type":"ContainerStarted","Data":"4a209a78bff253ed36b226464af91ccde20fb10dfcb58835eabfb86a1688b01e"} Jul 15 21:11:30.373217 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:30.372862 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" event={"ID":"a0d7e1f8-1193-49ac-ba6b-e84970375854","Type":"ContainerStarted","Data":"b3332828a3a4a8282890356ef1b935d7c4e3dedc1386b65641039e5c1c61b0a5"} Jul 15 21:11:30.374412 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:30.374375 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" event={"ID":"5cde9d63-279d-4ba2-86c5-87e9bfa17124","Type":"ContainerStarted","Data":"c1cb1da48a9e59613653dae02d0f7af13a463f92290c195871cd5a33345a488c"} Jul 15 21:11:30.375935 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:30.375912 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwhw" event={"ID":"1d514e08-d81e-4b21-a881-2ee86fd26c1b","Type":"ContainerStarted","Data":"f11ca4c6d89160dde71302a9a491c5785938effc69af41f086e83c0dd6fe9c57"} Jul 15 21:11:30.376197 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:30.376175 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwhw" Jul 15 21:11:30.382358 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:30.382335 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwhw" Jul 15 21:11:30.393840 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:30.393792 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-9cwhw" podStartSLOduration=2.19848814 podStartE2EDuration="4.393778782s" totalImagesPullingTime="2.195290642s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:11:26 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:30.392709227 +0000 UTC m=+83.214026544" watchObservedRunningTime="2026-07-15 21:11:30.393778782 +0000 UTC m=+83.215096077" Jul 15 21:11:31.382925 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:31.382900 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" event={"ID":"a0d7e1f8-1193-49ac-ba6b-e84970375854","Type":"ContainerStarted","Data":"50e372afa77ea3090759c254a0a0614c55402ac1ff56069ad8d02b14bd9cf176"} Jul 15 21:11:31.410335 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:31.410284 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" podStartSLOduration=2.02383698 podStartE2EDuration="5.410262333s" totalImagesPullingTime="3.386425353s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:11:26 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:31.408286585 +0000 UTC m=+84.229603902" watchObservedRunningTime="2026-07-15 21:11:31.410262333 +0000 UTC m=+84.231579652" Jul 15 21:11:32.388128 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:32.388094 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9f895bbb-tjhpr" event={"ID":"11b68472-691e-4d62-b45b-037cfcde5d0d","Type":"ContainerStarted","Data":"5ffd2ffc2680d84b43170dd94f32e230ca1d776cfe1b34e4a1630f5ad1978fbd"} Jul 15 21:11:32.390194 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:32.390166 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" event={"ID":"5cde9d63-279d-4ba2-86c5-87e9bfa17124","Type":"ContainerStarted","Data":"741e9076d9dd36ca2dd779f5167ef022edbbb8e6ae1f399b44162c0dc1f85d3d"} Jul 15 21:11:32.390305 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:32.390227 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" event={"ID":"5cde9d63-279d-4ba2-86c5-87e9bfa17124","Type":"ContainerStarted","Data":"ab93b844adde294287f15418fafe05d8501141d14ffb7f6fb0f087501610c634"} Jul 15 21:11:32.390601 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:32.390587 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:32.406211 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:32.406159 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-c9f895bbb-tjhpr" podStartSLOduration=2.669254 podStartE2EDuration="5.406142676s" totalImagesPullingTime="2.736888676s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:11:27 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:32.405427759 +0000 UTC m=+85.226745079" watchObservedRunningTime="2026-07-15 21:11:32.406142676 +0000 UTC m=+85.227459989" Jul 15 21:11:32.428786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:32.428749 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-6db76c58c8-spbpv" podStartSLOduration=1.363060755 podStartE2EDuration="5.428737045s" totalImagesPullingTime="4.06567629s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:11:27 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:32.427929167 +0000 UTC m=+85.249246485" watchObservedRunningTime="2026-07-15 21:11:32.428737045 +0000 UTC m=+85.250054361" Jul 15 21:11:33.079142 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.079109 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c9f895bbb-tjhpr"] Jul 15 21:11:33.112586 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.112552 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-78ff9b8b75-wzk6l"] Jul 15 21:11:33.114847 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.114829 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.127728 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.127702 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78ff9b8b75-wzk6l"] Jul 15 21:11:33.265266 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.265225 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-console-config\") pod \"console-78ff9b8b75-wzk6l\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.265266 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.265262 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-service-ca\") pod \"console-78ff9b8b75-wzk6l\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.265474 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.265283 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6344572-1eaf-4efd-a552-44eee8855866-console-oauth-config\") pod \"console-78ff9b8b75-wzk6l\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.265474 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.265327 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-554kd\" (UniqueName: \"kubernetes.io/projected/e6344572-1eaf-4efd-a552-44eee8855866-kube-api-access-554kd\") pod \"console-78ff9b8b75-wzk6l\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.265474 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.265348 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6344572-1eaf-4efd-a552-44eee8855866-console-serving-cert\") pod \"console-78ff9b8b75-wzk6l\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.265474 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.265362 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-oauth-serving-cert\") pod \"console-78ff9b8b75-wzk6l\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.265474 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.265380 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-trusted-ca-bundle\") pod \"console-78ff9b8b75-wzk6l\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.365992 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.365915 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-554kd\" (UniqueName: \"kubernetes.io/projected/e6344572-1eaf-4efd-a552-44eee8855866-kube-api-access-554kd\") pod \"console-78ff9b8b75-wzk6l\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.365992 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.365957 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6344572-1eaf-4efd-a552-44eee8855866-console-serving-cert\") pod \"console-78ff9b8b75-wzk6l\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.365992 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.365989 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-oauth-serving-cert\") pod \"console-78ff9b8b75-wzk6l\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.366236 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.366018 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-trusted-ca-bundle\") pod \"console-78ff9b8b75-wzk6l\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.366236 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.366061 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-console-config\") pod \"console-78ff9b8b75-wzk6l\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.366236 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.366087 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-service-ca\") pod \"console-78ff9b8b75-wzk6l\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.366387 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.366239 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6344572-1eaf-4efd-a552-44eee8855866-console-oauth-config\") pod \"console-78ff9b8b75-wzk6l\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.366848 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.366825 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-oauth-serving-cert\") pod \"console-78ff9b8b75-wzk6l\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.366952 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.366931 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-service-ca\") pod \"console-78ff9b8b75-wzk6l\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.367002 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.366935 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-console-config\") pod \"console-78ff9b8b75-wzk6l\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.367042 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.367019 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-trusted-ca-bundle\") pod \"console-78ff9b8b75-wzk6l\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.368500 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.368469 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6344572-1eaf-4efd-a552-44eee8855866-console-serving-cert\") pod \"console-78ff9b8b75-wzk6l\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.368894 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.368872 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6344572-1eaf-4efd-a552-44eee8855866-console-oauth-config\") pod \"console-78ff9b8b75-wzk6l\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.373676 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.373645 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-554kd\" (UniqueName: \"kubernetes.io/projected/e6344572-1eaf-4efd-a552-44eee8855866-kube-api-access-554kd\") pod \"console-78ff9b8b75-wzk6l\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.400219 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.400201 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/thanos-querier-6fb85486c7-4zwns" Jul 15 21:11:33.423732 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.423708 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:33.552226 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:33.552192 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-78ff9b8b75-wzk6l"] Jul 15 21:11:33.554947 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:11:33.554918 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode6344572_1eaf_4efd_a552_44eee8855866.slice/crio-2be7353574fff20c2b2ed4f720b5c151331c5ebbd07c84448858c2f8149eaa69 WatchSource:0}: Error finding container 2be7353574fff20c2b2ed4f720b5c151331c5ebbd07c84448858c2f8149eaa69: Status 404 returned error can't find the container with id 2be7353574fff20c2b2ed4f720b5c151331c5ebbd07c84448858c2f8149eaa69 Jul 15 21:11:34.398019 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:34.397973 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78ff9b8b75-wzk6l" event={"ID":"e6344572-1eaf-4efd-a552-44eee8855866","Type":"ContainerStarted","Data":"0a1791ee36db0f41508a740c75059f8b9cc0b818a1574b8ac6bb5df66698429a"} Jul 15 21:11:34.398171 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:34.398035 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78ff9b8b75-wzk6l" event={"ID":"e6344572-1eaf-4efd-a552-44eee8855866","Type":"ContainerStarted","Data":"2be7353574fff20c2b2ed4f720b5c151331c5ebbd07c84448858c2f8149eaa69"} Jul 15 21:11:34.418068 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:34.418016 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-78ff9b8b75-wzk6l" podStartSLOduration=1.417999932 podStartE2EDuration="1.417999932s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:11:33 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:11:34.417400152 +0000 UTC m=+87.238717468" watchObservedRunningTime="2026-07-15 21:11:34.417999932 +0000 UTC m=+87.239317248" Jul 15 21:11:37.950460 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:37.950426 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:43.424184 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:43.424144 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:43.424641 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:43.424207 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:43.429147 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:43.429125 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:43.435664 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:43.435645 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:11:50.286822 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:50.286792 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-6nvzk" Jul 15 21:11:59.418395 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.418324 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-c9f895bbb-tjhpr" podUID="11b68472-691e-4d62-b45b-037cfcde5d0d" containerName="console" containerID="cri-o://5ffd2ffc2680d84b43170dd94f32e230ca1d776cfe1b34e4a1630f5ad1978fbd" gracePeriod=15 Jul 15 21:11:59.653919 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.653897 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:11:59.772519 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.772431 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b68472-691e-4d62-b45b-037cfcde5d0d-console-serving-cert\") pod \"11b68472-691e-4d62-b45b-037cfcde5d0d\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " Jul 15 21:11:59.772519 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.772484 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-tr2zl\" (UniqueName: \"kubernetes.io/projected/11b68472-691e-4d62-b45b-037cfcde5d0d-kube-api-access-tr2zl\") pod \"11b68472-691e-4d62-b45b-037cfcde5d0d\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " Jul 15 21:11:59.772757 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.772555 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-oauth-serving-cert\") pod \"11b68472-691e-4d62-b45b-037cfcde5d0d\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " Jul 15 21:11:59.772757 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.772583 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-service-ca\") pod \"11b68472-691e-4d62-b45b-037cfcde5d0d\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " Jul 15 21:11:59.772757 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.772608 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-trusted-ca-bundle\") pod \"11b68472-691e-4d62-b45b-037cfcde5d0d\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " Jul 15 21:11:59.772757 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.772721 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b68472-691e-4d62-b45b-037cfcde5d0d-console-oauth-config\") pod \"11b68472-691e-4d62-b45b-037cfcde5d0d\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " Jul 15 21:11:59.772942 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.772796 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-console-config\") pod \"11b68472-691e-4d62-b45b-037cfcde5d0d\" (UID: \"11b68472-691e-4d62-b45b-037cfcde5d0d\") " Jul 15 21:11:59.773129 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.773104 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "11b68472-691e-4d62-b45b-037cfcde5d0d" (UID: "11b68472-691e-4d62-b45b-037cfcde5d0d"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:11:59.773198 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.773104 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-service-ca" (OuterVolumeSpecName: "service-ca") pod "11b68472-691e-4d62-b45b-037cfcde5d0d" (UID: "11b68472-691e-4d62-b45b-037cfcde5d0d"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:11:59.773198 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.773157 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-console-config" (OuterVolumeSpecName: "console-config") pod "11b68472-691e-4d62-b45b-037cfcde5d0d" (UID: "11b68472-691e-4d62-b45b-037cfcde5d0d"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:11:59.773313 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.773275 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "11b68472-691e-4d62-b45b-037cfcde5d0d" (UID: "11b68472-691e-4d62-b45b-037cfcde5d0d"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:11:59.774867 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.774841 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11b68472-691e-4d62-b45b-037cfcde5d0d-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "11b68472-691e-4d62-b45b-037cfcde5d0d" (UID: "11b68472-691e-4d62-b45b-037cfcde5d0d"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:11:59.775036 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.775019 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/11b68472-691e-4d62-b45b-037cfcde5d0d-kube-api-access-tr2zl" (OuterVolumeSpecName: "kube-api-access-tr2zl") pod "11b68472-691e-4d62-b45b-037cfcde5d0d" (UID: "11b68472-691e-4d62-b45b-037cfcde5d0d"). InnerVolumeSpecName "kube-api-access-tr2zl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:11:59.775093 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.775038 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/11b68472-691e-4d62-b45b-037cfcde5d0d-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "11b68472-691e-4d62-b45b-037cfcde5d0d" (UID: "11b68472-691e-4d62-b45b-037cfcde5d0d"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:11:59.873648 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.873610 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-oauth-serving-cert\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:11:59.873648 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.873643 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-service-ca\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:11:59.873648 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.873658 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-trusted-ca-bundle\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:11:59.873891 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.873669 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/11b68472-691e-4d62-b45b-037cfcde5d0d-console-oauth-config\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:11:59.873891 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.873681 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/11b68472-691e-4d62-b45b-037cfcde5d0d-console-config\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:11:59.873891 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.873692 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/11b68472-691e-4d62-b45b-037cfcde5d0d-console-serving-cert\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:11:59.873891 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:11:59.873703 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-tr2zl\" (UniqueName: \"kubernetes.io/projected/11b68472-691e-4d62-b45b-037cfcde5d0d-kube-api-access-tr2zl\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:12:00.493111 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:00.493080 2572 generic.go:356] "Generic (PLEG): container finished" podID="11b68472-691e-4d62-b45b-037cfcde5d0d" containerID="5ffd2ffc2680d84b43170dd94f32e230ca1d776cfe1b34e4a1630f5ad1978fbd" exitCode=0 Jul 15 21:12:00.493553 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:00.493122 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-c9f895bbb-tjhpr" Jul 15 21:12:00.493553 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:00.493170 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9f895bbb-tjhpr" event={"ID":"11b68472-691e-4d62-b45b-037cfcde5d0d","Type":"ContainerDied","Data":"5ffd2ffc2680d84b43170dd94f32e230ca1d776cfe1b34e4a1630f5ad1978fbd"} Jul 15 21:12:00.493553 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:00.493223 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-c9f895bbb-tjhpr" event={"ID":"11b68472-691e-4d62-b45b-037cfcde5d0d","Type":"ContainerDied","Data":"9b20a34c2dbc2b083f09859519409ec70581b50b7dba5a404abaf5d25afccd5f"} Jul 15 21:12:00.493553 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:00.493243 2572 scope.go:117] "RemoveContainer" containerID="5ffd2ffc2680d84b43170dd94f32e230ca1d776cfe1b34e4a1630f5ad1978fbd" Jul 15 21:12:00.501166 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:00.501148 2572 scope.go:117] "RemoveContainer" containerID="5ffd2ffc2680d84b43170dd94f32e230ca1d776cfe1b34e4a1630f5ad1978fbd" Jul 15 21:12:00.501410 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:12:00.501393 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5ffd2ffc2680d84b43170dd94f32e230ca1d776cfe1b34e4a1630f5ad1978fbd\": container with ID starting with 5ffd2ffc2680d84b43170dd94f32e230ca1d776cfe1b34e4a1630f5ad1978fbd not found: ID does not exist" containerID="5ffd2ffc2680d84b43170dd94f32e230ca1d776cfe1b34e4a1630f5ad1978fbd" Jul 15 21:12:00.501449 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:00.501417 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5ffd2ffc2680d84b43170dd94f32e230ca1d776cfe1b34e4a1630f5ad1978fbd"} err="failed to get container status \"5ffd2ffc2680d84b43170dd94f32e230ca1d776cfe1b34e4a1630f5ad1978fbd\": rpc error: code = NotFound desc = could not find container \"5ffd2ffc2680d84b43170dd94f32e230ca1d776cfe1b34e4a1630f5ad1978fbd\": container with ID starting with 5ffd2ffc2680d84b43170dd94f32e230ca1d776cfe1b34e4a1630f5ad1978fbd not found: ID does not exist" Jul 15 21:12:00.511319 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:00.511297 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-c9f895bbb-tjhpr"] Jul 15 21:12:00.513441 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:00.513420 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-c9f895bbb-tjhpr"] Jul 15 21:12:01.959325 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:01.959287 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="11b68472-691e-4d62-b45b-037cfcde5d0d" path="/var/lib/kubelet/pods/11b68472-691e-4d62-b45b-037cfcde5d0d/volumes" Jul 15 21:12:57.517279 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.517242 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-66654797dc-mgpq4"] Jul 15 21:12:57.517852 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.517652 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="11b68472-691e-4d62-b45b-037cfcde5d0d" containerName="console" Jul 15 21:12:57.517852 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.517670 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="11b68472-691e-4d62-b45b-037cfcde5d0d" containerName="console" Jul 15 21:12:57.517852 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.517775 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="11b68472-691e-4d62-b45b-037cfcde5d0d" containerName="console" Jul 15 21:12:57.520227 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.520206 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.532833 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.532811 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66654797dc-mgpq4"] Jul 15 21:12:57.629863 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.629830 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-console-config\") pod \"console-66654797dc-mgpq4\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.629863 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.629865 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-service-ca\") pod \"console-66654797dc-mgpq4\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.630069 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.629890 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-44t8m\" (UniqueName: \"kubernetes.io/projected/e44b3ca8-41b4-450f-93bc-6c8ff6040574-kube-api-access-44t8m\") pod \"console-66654797dc-mgpq4\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.630069 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.629908 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e44b3ca8-41b4-450f-93bc-6c8ff6040574-console-oauth-config\") pod \"console-66654797dc-mgpq4\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.630069 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.629983 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-oauth-serving-cert\") pod \"console-66654797dc-mgpq4\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.630069 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.630015 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-trusted-ca-bundle\") pod \"console-66654797dc-mgpq4\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.630069 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.630035 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e44b3ca8-41b4-450f-93bc-6c8ff6040574-console-serving-cert\") pod \"console-66654797dc-mgpq4\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.730823 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.730790 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-console-config\") pod \"console-66654797dc-mgpq4\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.730823 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.730823 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-service-ca\") pod \"console-66654797dc-mgpq4\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.731049 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.730858 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-44t8m\" (UniqueName: \"kubernetes.io/projected/e44b3ca8-41b4-450f-93bc-6c8ff6040574-kube-api-access-44t8m\") pod \"console-66654797dc-mgpq4\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.731049 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.730886 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e44b3ca8-41b4-450f-93bc-6c8ff6040574-console-oauth-config\") pod \"console-66654797dc-mgpq4\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.731049 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.730912 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-oauth-serving-cert\") pod \"console-66654797dc-mgpq4\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.731049 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.730944 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-trusted-ca-bundle\") pod \"console-66654797dc-mgpq4\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.731049 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.730968 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e44b3ca8-41b4-450f-93bc-6c8ff6040574-console-serving-cert\") pod \"console-66654797dc-mgpq4\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.731665 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.731640 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-service-ca\") pod \"console-66654797dc-mgpq4\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.731798 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.731668 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-console-config\") pod \"console-66654797dc-mgpq4\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.731863 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.731792 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-oauth-serving-cert\") pod \"console-66654797dc-mgpq4\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.731863 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.731817 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-trusted-ca-bundle\") pod \"console-66654797dc-mgpq4\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.733391 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.733362 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e44b3ca8-41b4-450f-93bc-6c8ff6040574-console-serving-cert\") pod \"console-66654797dc-mgpq4\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.733497 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.733474 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e44b3ca8-41b4-450f-93bc-6c8ff6040574-console-oauth-config\") pod \"console-66654797dc-mgpq4\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.738373 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.738357 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-44t8m\" (UniqueName: \"kubernetes.io/projected/e44b3ca8-41b4-450f-93bc-6c8ff6040574-kube-api-access-44t8m\") pod \"console-66654797dc-mgpq4\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.829070 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.829043 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:12:57.981029 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:57.980997 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-66654797dc-mgpq4"] Jul 15 21:12:57.984037 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:12:57.984013 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode44b3ca8_41b4_450f_93bc_6c8ff6040574.slice/crio-9a89278bebed13c8f7df90fe481dedd86a9a29be394b420bc3ce95cf7d4730bd WatchSource:0}: Error finding container 9a89278bebed13c8f7df90fe481dedd86a9a29be394b420bc3ce95cf7d4730bd: Status 404 returned error can't find the container with id 9a89278bebed13c8f7df90fe481dedd86a9a29be394b420bc3ce95cf7d4730bd Jul 15 21:12:58.707118 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:58.707077 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66654797dc-mgpq4" event={"ID":"e44b3ca8-41b4-450f-93bc-6c8ff6040574","Type":"ContainerStarted","Data":"4a37429f06e72591ef7873df949fef0910e85b6bb16677524c2b0d3305f0817d"} Jul 15 21:12:58.707479 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:58.707137 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66654797dc-mgpq4" event={"ID":"e44b3ca8-41b4-450f-93bc-6c8ff6040574","Type":"ContainerStarted","Data":"9a89278bebed13c8f7df90fe481dedd86a9a29be394b420bc3ce95cf7d4730bd"} Jul 15 21:12:58.725042 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:12:58.724992 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-66654797dc-mgpq4" podStartSLOduration=1.724974271 podStartE2EDuration="1.724974271s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:12:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:12:58.724562756 +0000 UTC m=+171.545880070" watchObservedRunningTime="2026-07-15 21:12:58.724974271 +0000 UTC m=+171.546291588" Jul 15 21:13:07.829392 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:07.829317 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:13:07.829392 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:07.829373 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:13:07.834228 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:07.834206 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:13:08.746593 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:08.746556 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:13:08.793647 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:08.793613 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78ff9b8b75-wzk6l"] Jul 15 21:13:33.815075 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:33.815010 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-78ff9b8b75-wzk6l" podUID="e6344572-1eaf-4efd-a552-44eee8855866" containerName="console" containerID="cri-o://0a1791ee36db0f41508a740c75059f8b9cc0b818a1574b8ac6bb5df66698429a" gracePeriod=15 Jul 15 21:13:34.055957 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.055934 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:13:34.143430 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.143337 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-trusted-ca-bundle\") pod \"e6344572-1eaf-4efd-a552-44eee8855866\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " Jul 15 21:13:34.143430 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.143391 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6344572-1eaf-4efd-a552-44eee8855866-console-oauth-config\") pod \"e6344572-1eaf-4efd-a552-44eee8855866\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " Jul 15 21:13:34.143632 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.143445 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-console-config\") pod \"e6344572-1eaf-4efd-a552-44eee8855866\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " Jul 15 21:13:34.143632 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.143603 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-oauth-serving-cert\") pod \"e6344572-1eaf-4efd-a552-44eee8855866\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " Jul 15 21:13:34.143716 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.143651 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-service-ca\") pod \"e6344572-1eaf-4efd-a552-44eee8855866\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " Jul 15 21:13:34.143716 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.143701 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6344572-1eaf-4efd-a552-44eee8855866-console-serving-cert\") pod \"e6344572-1eaf-4efd-a552-44eee8855866\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " Jul 15 21:13:34.143811 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.143732 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-554kd\" (UniqueName: \"kubernetes.io/projected/e6344572-1eaf-4efd-a552-44eee8855866-kube-api-access-554kd\") pod \"e6344572-1eaf-4efd-a552-44eee8855866\" (UID: \"e6344572-1eaf-4efd-a552-44eee8855866\") " Jul 15 21:13:34.143862 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.143829 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e6344572-1eaf-4efd-a552-44eee8855866" (UID: "e6344572-1eaf-4efd-a552-44eee8855866"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:13:34.143992 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.143909 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-console-config" (OuterVolumeSpecName: "console-config") pod "e6344572-1eaf-4efd-a552-44eee8855866" (UID: "e6344572-1eaf-4efd-a552-44eee8855866"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:13:34.144058 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.144035 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e6344572-1eaf-4efd-a552-44eee8855866" (UID: "e6344572-1eaf-4efd-a552-44eee8855866"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:13:34.144139 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.144118 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-console-config\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:13:34.144139 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.144140 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-oauth-serving-cert\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:13:34.144290 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.144153 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-trusted-ca-bundle\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:13:34.144290 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.144148 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-service-ca" (OuterVolumeSpecName: "service-ca") pod "e6344572-1eaf-4efd-a552-44eee8855866" (UID: "e6344572-1eaf-4efd-a552-44eee8855866"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:13:34.145858 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.145827 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e6344572-1eaf-4efd-a552-44eee8855866-kube-api-access-554kd" (OuterVolumeSpecName: "kube-api-access-554kd") pod "e6344572-1eaf-4efd-a552-44eee8855866" (UID: "e6344572-1eaf-4efd-a552-44eee8855866"). InnerVolumeSpecName "kube-api-access-554kd". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:13:34.145938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.145864 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6344572-1eaf-4efd-a552-44eee8855866-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e6344572-1eaf-4efd-a552-44eee8855866" (UID: "e6344572-1eaf-4efd-a552-44eee8855866"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:13:34.145938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.145880 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e6344572-1eaf-4efd-a552-44eee8855866-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e6344572-1eaf-4efd-a552-44eee8855866" (UID: "e6344572-1eaf-4efd-a552-44eee8855866"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:13:34.244612 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.244583 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e6344572-1eaf-4efd-a552-44eee8855866-service-ca\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:13:34.244612 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.244608 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e6344572-1eaf-4efd-a552-44eee8855866-console-serving-cert\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:13:34.244612 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.244619 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-554kd\" (UniqueName: \"kubernetes.io/projected/e6344572-1eaf-4efd-a552-44eee8855866-kube-api-access-554kd\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:13:34.244839 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.244629 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e6344572-1eaf-4efd-a552-44eee8855866-console-oauth-config\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:13:34.835253 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.835211 2572 generic.go:356] "Generic (PLEG): container finished" podID="e6344572-1eaf-4efd-a552-44eee8855866" containerID="0a1791ee36db0f41508a740c75059f8b9cc0b818a1574b8ac6bb5df66698429a" exitCode=0 Jul 15 21:13:34.835722 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.835257 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-78ff9b8b75-wzk6l" Jul 15 21:13:34.835722 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.835299 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78ff9b8b75-wzk6l" event={"ID":"e6344572-1eaf-4efd-a552-44eee8855866","Type":"ContainerDied","Data":"0a1791ee36db0f41508a740c75059f8b9cc0b818a1574b8ac6bb5df66698429a"} Jul 15 21:13:34.835722 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.835350 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-78ff9b8b75-wzk6l" event={"ID":"e6344572-1eaf-4efd-a552-44eee8855866","Type":"ContainerDied","Data":"2be7353574fff20c2b2ed4f720b5c151331c5ebbd07c84448858c2f8149eaa69"} Jul 15 21:13:34.835722 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.835371 2572 scope.go:117] "RemoveContainer" containerID="0a1791ee36db0f41508a740c75059f8b9cc0b818a1574b8ac6bb5df66698429a" Jul 15 21:13:34.843839 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.843824 2572 scope.go:117] "RemoveContainer" containerID="0a1791ee36db0f41508a740c75059f8b9cc0b818a1574b8ac6bb5df66698429a" Jul 15 21:13:34.844096 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:13:34.844080 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0a1791ee36db0f41508a740c75059f8b9cc0b818a1574b8ac6bb5df66698429a\": container with ID starting with 0a1791ee36db0f41508a740c75059f8b9cc0b818a1574b8ac6bb5df66698429a not found: ID does not exist" containerID="0a1791ee36db0f41508a740c75059f8b9cc0b818a1574b8ac6bb5df66698429a" Jul 15 21:13:34.844136 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.844106 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0a1791ee36db0f41508a740c75059f8b9cc0b818a1574b8ac6bb5df66698429a"} err="failed to get container status \"0a1791ee36db0f41508a740c75059f8b9cc0b818a1574b8ac6bb5df66698429a\": rpc error: code = NotFound desc = could not find container \"0a1791ee36db0f41508a740c75059f8b9cc0b818a1574b8ac6bb5df66698429a\": container with ID starting with 0a1791ee36db0f41508a740c75059f8b9cc0b818a1574b8ac6bb5df66698429a not found: ID does not exist" Jul 15 21:13:34.855437 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.855415 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-78ff9b8b75-wzk6l"] Jul 15 21:13:34.864589 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.864559 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-78ff9b8b75-wzk6l"] Jul 15 21:13:34.870699 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.870671 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4"] Jul 15 21:13:34.870938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.870927 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e6344572-1eaf-4efd-a552-44eee8855866" containerName="console" Jul 15 21:13:34.871005 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.870940 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e6344572-1eaf-4efd-a552-44eee8855866" containerName="console" Jul 15 21:13:34.871005 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.870997 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e6344572-1eaf-4efd-a552-44eee8855866" containerName="console" Jul 15 21:13:34.873613 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.873598 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4" Jul 15 21:13:34.875993 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.875974 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 21:13:34.875993 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.875974 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 21:13:34.876150 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.876060 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9zpdq\"" Jul 15 21:13:34.882766 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.882748 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4"] Jul 15 21:13:34.949879 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.949842 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q8w7r\" (UniqueName: \"kubernetes.io/projected/0efaff6f-50fe-445b-b2e9-4302d5585308-kube-api-access-q8w7r\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4\" (UID: \"0efaff6f-50fe-445b-b2e9-4302d5585308\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4" Jul 15 21:13:34.950036 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.949906 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0efaff6f-50fe-445b-b2e9-4302d5585308-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4\" (UID: \"0efaff6f-50fe-445b-b2e9-4302d5585308\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4" Jul 15 21:13:34.950036 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:34.949943 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0efaff6f-50fe-445b-b2e9-4302d5585308-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4\" (UID: \"0efaff6f-50fe-445b-b2e9-4302d5585308\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4" Jul 15 21:13:35.050430 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:35.050383 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0efaff6f-50fe-445b-b2e9-4302d5585308-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4\" (UID: \"0efaff6f-50fe-445b-b2e9-4302d5585308\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4" Jul 15 21:13:35.050430 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:35.050436 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0efaff6f-50fe-445b-b2e9-4302d5585308-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4\" (UID: \"0efaff6f-50fe-445b-b2e9-4302d5585308\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4" Jul 15 21:13:35.050704 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:35.050478 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q8w7r\" (UniqueName: \"kubernetes.io/projected/0efaff6f-50fe-445b-b2e9-4302d5585308-kube-api-access-q8w7r\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4\" (UID: \"0efaff6f-50fe-445b-b2e9-4302d5585308\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4" Jul 15 21:13:35.050885 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:35.050863 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0efaff6f-50fe-445b-b2e9-4302d5585308-bundle\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4\" (UID: \"0efaff6f-50fe-445b-b2e9-4302d5585308\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4" Jul 15 21:13:35.050956 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:35.050872 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0efaff6f-50fe-445b-b2e9-4302d5585308-util\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4\" (UID: \"0efaff6f-50fe-445b-b2e9-4302d5585308\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4" Jul 15 21:13:35.058719 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:35.058696 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q8w7r\" (UniqueName: \"kubernetes.io/projected/0efaff6f-50fe-445b-b2e9-4302d5585308-kube-api-access-q8w7r\") pod \"685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4\" (UID: \"0efaff6f-50fe-445b-b2e9-4302d5585308\") " pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4" Jul 15 21:13:35.182582 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:35.182477 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4" Jul 15 21:13:35.304643 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:35.304611 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4"] Jul 15 21:13:35.307539 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:13:35.307494 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0efaff6f_50fe_445b_b2e9_4302d5585308.slice/crio-790bd2bd1a04d0e2b64adfdaefbe09ebc33a1d35405aeba8496cd113a549e900 WatchSource:0}: Error finding container 790bd2bd1a04d0e2b64adfdaefbe09ebc33a1d35405aeba8496cd113a549e900: Status 404 returned error can't find the container with id 790bd2bd1a04d0e2b64adfdaefbe09ebc33a1d35405aeba8496cd113a549e900 Jul 15 21:13:35.839945 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:35.839905 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4" event={"ID":"0efaff6f-50fe-445b-b2e9-4302d5585308","Type":"ContainerStarted","Data":"790bd2bd1a04d0e2b64adfdaefbe09ebc33a1d35405aeba8496cd113a549e900"} Jul 15 21:13:35.959544 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:35.959504 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e6344572-1eaf-4efd-a552-44eee8855866" path="/var/lib/kubelet/pods/e6344572-1eaf-4efd-a552-44eee8855866/volumes" Jul 15 21:13:42.870558 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:42.870504 2572 generic.go:356] "Generic (PLEG): container finished" podID="0efaff6f-50fe-445b-b2e9-4302d5585308" containerID="0e5f9983c25d3fef266fe5576f7d081a7f0e28cbb738f0cd53fb310c15b22cc5" exitCode=0 Jul 15 21:13:42.871003 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:42.870599 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4" event={"ID":"0efaff6f-50fe-445b-b2e9-4302d5585308","Type":"ContainerDied","Data":"0e5f9983c25d3fef266fe5576f7d081a7f0e28cbb738f0cd53fb310c15b22cc5"} Jul 15 21:13:45.884694 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:45.884658 2572 generic.go:356] "Generic (PLEG): container finished" podID="0efaff6f-50fe-445b-b2e9-4302d5585308" containerID="aefe99597eee64c0897f1d033dc00f0d1cec69cb43b0552677efb521dad43d41" exitCode=0 Jul 15 21:13:45.885085 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:45.884708 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4" event={"ID":"0efaff6f-50fe-445b-b2e9-4302d5585308","Type":"ContainerDied","Data":"aefe99597eee64c0897f1d033dc00f0d1cec69cb43b0552677efb521dad43d41"} Jul 15 21:13:52.914236 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:52.914203 2572 generic.go:356] "Generic (PLEG): container finished" podID="0efaff6f-50fe-445b-b2e9-4302d5585308" containerID="663cfb2c1dcb92a027d515353ca0a644eccf15cc3cda77533452cca1cc98e42a" exitCode=0 Jul 15 21:13:52.914592 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:52.914282 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4" event={"ID":"0efaff6f-50fe-445b-b2e9-4302d5585308","Type":"ContainerDied","Data":"663cfb2c1dcb92a027d515353ca0a644eccf15cc3cda77533452cca1cc98e42a"} Jul 15 21:13:54.035376 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:54.035352 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4" Jul 15 21:13:54.116593 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:54.116563 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q8w7r\" (UniqueName: \"kubernetes.io/projected/0efaff6f-50fe-445b-b2e9-4302d5585308-kube-api-access-q8w7r\") pod \"0efaff6f-50fe-445b-b2e9-4302d5585308\" (UID: \"0efaff6f-50fe-445b-b2e9-4302d5585308\") " Jul 15 21:13:54.116753 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:54.116627 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0efaff6f-50fe-445b-b2e9-4302d5585308-util\") pod \"0efaff6f-50fe-445b-b2e9-4302d5585308\" (UID: \"0efaff6f-50fe-445b-b2e9-4302d5585308\") " Jul 15 21:13:54.116753 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:54.116653 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0efaff6f-50fe-445b-b2e9-4302d5585308-bundle\") pod \"0efaff6f-50fe-445b-b2e9-4302d5585308\" (UID: \"0efaff6f-50fe-445b-b2e9-4302d5585308\") " Jul 15 21:13:54.117327 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:54.117300 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0efaff6f-50fe-445b-b2e9-4302d5585308-bundle" (OuterVolumeSpecName: "bundle") pod "0efaff6f-50fe-445b-b2e9-4302d5585308" (UID: "0efaff6f-50fe-445b-b2e9-4302d5585308"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:13:54.118801 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:54.118779 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0efaff6f-50fe-445b-b2e9-4302d5585308-kube-api-access-q8w7r" (OuterVolumeSpecName: "kube-api-access-q8w7r") pod "0efaff6f-50fe-445b-b2e9-4302d5585308" (UID: "0efaff6f-50fe-445b-b2e9-4302d5585308"). InnerVolumeSpecName "kube-api-access-q8w7r". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:13:54.121711 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:54.121685 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0efaff6f-50fe-445b-b2e9-4302d5585308-util" (OuterVolumeSpecName: "util") pod "0efaff6f-50fe-445b-b2e9-4302d5585308" (UID: "0efaff6f-50fe-445b-b2e9-4302d5585308"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:13:54.218070 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:54.217987 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q8w7r\" (UniqueName: \"kubernetes.io/projected/0efaff6f-50fe-445b-b2e9-4302d5585308-kube-api-access-q8w7r\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:13:54.218070 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:54.218016 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0efaff6f-50fe-445b-b2e9-4302d5585308-util\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:13:54.218070 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:54.218025 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0efaff6f-50fe-445b-b2e9-4302d5585308-bundle\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:13:54.922729 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:54.922697 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4" event={"ID":"0efaff6f-50fe-445b-b2e9-4302d5585308","Type":"ContainerDied","Data":"790bd2bd1a04d0e2b64adfdaefbe09ebc33a1d35405aeba8496cd113a549e900"} Jul 15 21:13:54.922890 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:54.922737 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/685f1ed643dcce69727e2826bbf9be585096b4cf774051b5daa5e67540wg2w4" Jul 15 21:13:54.922890 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:54.922745 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="790bd2bd1a04d0e2b64adfdaefbe09ebc33a1d35405aeba8496cd113a549e900" Jul 15 21:13:57.875504 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:57.875471 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-npqrk"] Jul 15 21:13:57.875893 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:57.875798 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0efaff6f-50fe-445b-b2e9-4302d5585308" containerName="pull" Jul 15 21:13:57.875893 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:57.875810 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0efaff6f-50fe-445b-b2e9-4302d5585308" containerName="pull" Jul 15 21:13:57.875893 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:57.875822 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0efaff6f-50fe-445b-b2e9-4302d5585308" containerName="extract" Jul 15 21:13:57.875893 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:57.875827 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0efaff6f-50fe-445b-b2e9-4302d5585308" containerName="extract" Jul 15 21:13:57.875893 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:57.875835 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0efaff6f-50fe-445b-b2e9-4302d5585308" containerName="util" Jul 15 21:13:57.875893 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:57.875841 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0efaff6f-50fe-445b-b2e9-4302d5585308" containerName="util" Jul 15 21:13:57.875893 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:57.875885 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0efaff6f-50fe-445b-b2e9-4302d5585308" containerName="extract" Jul 15 21:13:57.907025 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:57.907002 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-npqrk"] Jul 15 21:13:57.907178 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:57.907089 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-npqrk" Jul 15 21:13:57.916344 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:57.916328 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager-operator\"/\"cert-manager-operator-controller-manager-dockercfg-bjtc8\"" Jul 15 21:13:57.916781 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:57.916765 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:13:57.917007 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:57.916991 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager-operator\"/\"kube-root-ca.crt\"" Jul 15 21:13:58.053923 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:58.053889 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5rp2z\" (UniqueName: \"kubernetes.io/projected/09c6502f-6d5d-4e24-84b8-54615169e0d4-kube-api-access-5rp2z\") pod \"cert-manager-operator-controller-manager-55c444bf86-npqrk\" (UID: \"09c6502f-6d5d-4e24-84b8-54615169e0d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-npqrk" Jul 15 21:13:58.054094 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:58.054057 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09c6502f-6d5d-4e24-84b8-54615169e0d4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-npqrk\" (UID: \"09c6502f-6d5d-4e24-84b8-54615169e0d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-npqrk" Jul 15 21:13:58.155323 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:58.155231 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09c6502f-6d5d-4e24-84b8-54615169e0d4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-npqrk\" (UID: \"09c6502f-6d5d-4e24-84b8-54615169e0d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-npqrk" Jul 15 21:13:58.155323 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:58.155281 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5rp2z\" (UniqueName: \"kubernetes.io/projected/09c6502f-6d5d-4e24-84b8-54615169e0d4-kube-api-access-5rp2z\") pod \"cert-manager-operator-controller-manager-55c444bf86-npqrk\" (UID: \"09c6502f-6d5d-4e24-84b8-54615169e0d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-npqrk" Jul 15 21:13:58.155639 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:58.155620 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/09c6502f-6d5d-4e24-84b8-54615169e0d4-tmp\") pod \"cert-manager-operator-controller-manager-55c444bf86-npqrk\" (UID: \"09c6502f-6d5d-4e24-84b8-54615169e0d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-npqrk" Jul 15 21:13:58.173273 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:58.173240 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5rp2z\" (UniqueName: \"kubernetes.io/projected/09c6502f-6d5d-4e24-84b8-54615169e0d4-kube-api-access-5rp2z\") pod \"cert-manager-operator-controller-manager-55c444bf86-npqrk\" (UID: \"09c6502f-6d5d-4e24-84b8-54615169e0d4\") " pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-npqrk" Jul 15 21:13:58.216082 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:58.216053 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-npqrk" Jul 15 21:13:58.364375 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:58.364350 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-npqrk"] Jul 15 21:13:58.367353 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:13:58.367327 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod09c6502f_6d5d_4e24_84b8_54615169e0d4.slice/crio-d36808e8811c39599e3086f195633afc6b0ea1f5a3e685b07f7cdf5e8b37bdf5 WatchSource:0}: Error finding container d36808e8811c39599e3086f195633afc6b0ea1f5a3e685b07f7cdf5e8b37bdf5: Status 404 returned error can't find the container with id d36808e8811c39599e3086f195633afc6b0ea1f5a3e685b07f7cdf5e8b37bdf5 Jul 15 21:13:58.939096 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:13:58.939063 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-npqrk" event={"ID":"09c6502f-6d5d-4e24-84b8-54615169e0d4","Type":"ContainerStarted","Data":"d36808e8811c39599e3086f195633afc6b0ea1f5a3e685b07f7cdf5e8b37bdf5"} Jul 15 21:14:00.949262 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:00.949228 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-npqrk" event={"ID":"09c6502f-6d5d-4e24-84b8-54615169e0d4","Type":"ContainerStarted","Data":"9869569c1ff1406eda3d93a2df6f4e9e22c1495ad30bc800326dc5fbafd948c3"} Jul 15 21:14:00.969969 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:00.969926 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager-operator/cert-manager-operator-controller-manager-55c444bf86-npqrk" podStartSLOduration=2.078749085 podStartE2EDuration="3.969909034s" totalImagesPullingTime="1.891159949s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:13:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:14:00.968963098 +0000 UTC m=+233.790280416" watchObservedRunningTime="2026-07-15 21:14:00.969909034 +0000 UTC m=+233.791226351" Jul 15 21:14:01.962097 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:01.962065 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x"] Jul 15 21:14:01.964476 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:01.964461 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x" Jul 15 21:14:01.966834 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:01.966812 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 21:14:01.966946 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:01.966857 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 21:14:01.967494 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:01.967477 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9zpdq\"" Jul 15 21:14:01.973363 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:01.973340 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x"] Jul 15 21:14:02.090228 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:02.090187 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0706a62a-b39f-4e63-88a9-6d956b800c77-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x\" (UID: \"0706a62a-b39f-4e63-88a9-6d956b800c77\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x" Jul 15 21:14:02.090403 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:02.090292 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-g76l9\" (UniqueName: \"kubernetes.io/projected/0706a62a-b39f-4e63-88a9-6d956b800c77-kube-api-access-g76l9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x\" (UID: \"0706a62a-b39f-4e63-88a9-6d956b800c77\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x" Jul 15 21:14:02.090403 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:02.090356 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0706a62a-b39f-4e63-88a9-6d956b800c77-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x\" (UID: \"0706a62a-b39f-4e63-88a9-6d956b800c77\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x" Jul 15 21:14:02.191196 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:02.191161 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0706a62a-b39f-4e63-88a9-6d956b800c77-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x\" (UID: \"0706a62a-b39f-4e63-88a9-6d956b800c77\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x" Jul 15 21:14:02.191196 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:02.191204 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-g76l9\" (UniqueName: \"kubernetes.io/projected/0706a62a-b39f-4e63-88a9-6d956b800c77-kube-api-access-g76l9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x\" (UID: \"0706a62a-b39f-4e63-88a9-6d956b800c77\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x" Jul 15 21:14:02.191455 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:02.191238 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0706a62a-b39f-4e63-88a9-6d956b800c77-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x\" (UID: \"0706a62a-b39f-4e63-88a9-6d956b800c77\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x" Jul 15 21:14:02.191585 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:02.191561 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0706a62a-b39f-4e63-88a9-6d956b800c77-bundle\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x\" (UID: \"0706a62a-b39f-4e63-88a9-6d956b800c77\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x" Jul 15 21:14:02.191646 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:02.191585 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0706a62a-b39f-4e63-88a9-6d956b800c77-util\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x\" (UID: \"0706a62a-b39f-4e63-88a9-6d956b800c77\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x" Jul 15 21:14:02.199132 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:02.199110 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-g76l9\" (UniqueName: \"kubernetes.io/projected/0706a62a-b39f-4e63-88a9-6d956b800c77-kube-api-access-g76l9\") pod \"77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x\" (UID: \"0706a62a-b39f-4e63-88a9-6d956b800c77\") " pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x" Jul 15 21:14:02.274182 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:02.274106 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x" Jul 15 21:14:02.402340 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:02.402307 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x"] Jul 15 21:14:02.405662 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:14:02.405626 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0706a62a_b39f_4e63_88a9_6d956b800c77.slice/crio-16213ddf45127af4c1b6989973d20de02dffe574c113595ef108834c518b752e WatchSource:0}: Error finding container 16213ddf45127af4c1b6989973d20de02dffe574c113595ef108834c518b752e: Status 404 returned error can't find the container with id 16213ddf45127af4c1b6989973d20de02dffe574c113595ef108834c518b752e Jul 15 21:14:02.959021 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:02.958981 2572 generic.go:356] "Generic (PLEG): container finished" podID="0706a62a-b39f-4e63-88a9-6d956b800c77" containerID="ab052e57fb8704fbd9fe10fb597ef4dcee464b6239a2afad5099c2fb771c2803" exitCode=0 Jul 15 21:14:02.959185 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:02.959054 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x" event={"ID":"0706a62a-b39f-4e63-88a9-6d956b800c77","Type":"ContainerDied","Data":"ab052e57fb8704fbd9fe10fb597ef4dcee464b6239a2afad5099c2fb771c2803"} Jul 15 21:14:02.959185 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:02.959102 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x" event={"ID":"0706a62a-b39f-4e63-88a9-6d956b800c77","Type":"ContainerStarted","Data":"16213ddf45127af4c1b6989973d20de02dffe574c113595ef108834c518b752e"} Jul 15 21:14:03.574181 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:03.574148 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mslcx"] Jul 15 21:14:03.576282 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:03.576264 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mslcx" Jul 15 21:14:03.578632 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:03.578614 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 15 21:14:03.578737 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:03.578697 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 15 21:14:03.578790 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:03.578770 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-cainjector-dockercfg-5p4j2\"" Jul 15 21:14:03.587366 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:03.587344 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mslcx"] Jul 15 21:14:03.703667 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:03.703635 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zqrdp\" (UniqueName: \"kubernetes.io/projected/9d6b1bad-fc58-4547-90ed-609eaf964b3e-kube-api-access-zqrdp\") pod \"cert-manager-cainjector-559cdd8c87-mslcx\" (UID: \"9d6b1bad-fc58-4547-90ed-609eaf964b3e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mslcx" Jul 15 21:14:03.703841 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:03.703674 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d6b1bad-fc58-4547-90ed-609eaf964b3e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mslcx\" (UID: \"9d6b1bad-fc58-4547-90ed-609eaf964b3e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mslcx" Jul 15 21:14:03.804437 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:03.804406 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zqrdp\" (UniqueName: \"kubernetes.io/projected/9d6b1bad-fc58-4547-90ed-609eaf964b3e-kube-api-access-zqrdp\") pod \"cert-manager-cainjector-559cdd8c87-mslcx\" (UID: \"9d6b1bad-fc58-4547-90ed-609eaf964b3e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mslcx" Jul 15 21:14:03.804437 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:03.804442 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d6b1bad-fc58-4547-90ed-609eaf964b3e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mslcx\" (UID: \"9d6b1bad-fc58-4547-90ed-609eaf964b3e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mslcx" Jul 15 21:14:03.814356 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:03.814331 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/9d6b1bad-fc58-4547-90ed-609eaf964b3e-bound-sa-token\") pod \"cert-manager-cainjector-559cdd8c87-mslcx\" (UID: \"9d6b1bad-fc58-4547-90ed-609eaf964b3e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mslcx" Jul 15 21:14:03.814487 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:03.814471 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zqrdp\" (UniqueName: \"kubernetes.io/projected/9d6b1bad-fc58-4547-90ed-609eaf964b3e-kube-api-access-zqrdp\") pod \"cert-manager-cainjector-559cdd8c87-mslcx\" (UID: \"9d6b1bad-fc58-4547-90ed-609eaf964b3e\") " pod="cert-manager/cert-manager-cainjector-559cdd8c87-mslcx" Jul 15 21:14:03.897419 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:03.897343 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mslcx" Jul 15 21:14:04.038286 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:04.038243 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-cainjector-559cdd8c87-mslcx"] Jul 15 21:14:04.041777 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:14:04.041739 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod9d6b1bad_fc58_4547_90ed_609eaf964b3e.slice/crio-4e5e4ef03221a1f48502b438c6f51b1f066503e479a5f6b16e7de851c09649d7 WatchSource:0}: Error finding container 4e5e4ef03221a1f48502b438c6f51b1f066503e479a5f6b16e7de851c09649d7: Status 404 returned error can't find the container with id 4e5e4ef03221a1f48502b438c6f51b1f066503e479a5f6b16e7de851c09649d7 Jul 15 21:14:04.971500 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:04.971460 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mslcx" event={"ID":"9d6b1bad-fc58-4547-90ed-609eaf964b3e","Type":"ContainerStarted","Data":"4e5e4ef03221a1f48502b438c6f51b1f066503e479a5f6b16e7de851c09649d7"} Jul 15 21:14:06.981438 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:06.981402 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mslcx" event={"ID":"9d6b1bad-fc58-4547-90ed-609eaf964b3e","Type":"ContainerStarted","Data":"14c946cfd9c773e86d69d4e61ec8764ca4ddc575026e55780e9fb0808243d794"} Jul 15 21:14:06.983221 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:06.983193 2572 generic.go:356] "Generic (PLEG): container finished" podID="0706a62a-b39f-4e63-88a9-6d956b800c77" containerID="a1a6b94ddc1c41714e7fe08b17e8707f1201f418b75d2e6bd61d42494e947012" exitCode=0 Jul 15 21:14:06.983339 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:06.983234 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x" event={"ID":"0706a62a-b39f-4e63-88a9-6d956b800c77","Type":"ContainerDied","Data":"a1a6b94ddc1c41714e7fe08b17e8707f1201f418b75d2e6bd61d42494e947012"} Jul 15 21:14:07.000215 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:07.000174 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-cainjector-559cdd8c87-mslcx" podStartSLOduration=1.6191567230000001 podStartE2EDuration="4.000157021s" totalImagesPullingTime="2.381000298s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:14:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:14:07.00002203 +0000 UTC m=+239.821339372" watchObservedRunningTime="2026-07-15 21:14:07.000157021 +0000 UTC m=+239.821474340" Jul 15 21:14:07.988979 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:07.988946 2572 generic.go:356] "Generic (PLEG): container finished" podID="0706a62a-b39f-4e63-88a9-6d956b800c77" containerID="64003f9519573745391fd48808d182d0b9177d5fecddfd1b0e78240378628ec1" exitCode=0 Jul 15 21:14:07.989359 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:07.989027 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x" event={"ID":"0706a62a-b39f-4e63-88a9-6d956b800c77","Type":"ContainerDied","Data":"64003f9519573745391fd48808d182d0b9177d5fecddfd1b0e78240378628ec1"} Jul 15 21:14:09.114014 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:09.113980 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x" Jul 15 21:14:09.150494 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:09.150460 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0706a62a-b39f-4e63-88a9-6d956b800c77-bundle\") pod \"0706a62a-b39f-4e63-88a9-6d956b800c77\" (UID: \"0706a62a-b39f-4e63-88a9-6d956b800c77\") " Jul 15 21:14:09.150494 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:09.150500 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-g76l9\" (UniqueName: \"kubernetes.io/projected/0706a62a-b39f-4e63-88a9-6d956b800c77-kube-api-access-g76l9\") pod \"0706a62a-b39f-4e63-88a9-6d956b800c77\" (UID: \"0706a62a-b39f-4e63-88a9-6d956b800c77\") " Jul 15 21:14:09.150704 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:09.150537 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0706a62a-b39f-4e63-88a9-6d956b800c77-util\") pod \"0706a62a-b39f-4e63-88a9-6d956b800c77\" (UID: \"0706a62a-b39f-4e63-88a9-6d956b800c77\") " Jul 15 21:14:09.150935 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:09.150910 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0706a62a-b39f-4e63-88a9-6d956b800c77-bundle" (OuterVolumeSpecName: "bundle") pod "0706a62a-b39f-4e63-88a9-6d956b800c77" (UID: "0706a62a-b39f-4e63-88a9-6d956b800c77"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:14:09.152607 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:09.152576 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/0706a62a-b39f-4e63-88a9-6d956b800c77-kube-api-access-g76l9" (OuterVolumeSpecName: "kube-api-access-g76l9") pod "0706a62a-b39f-4e63-88a9-6d956b800c77" (UID: "0706a62a-b39f-4e63-88a9-6d956b800c77"). InnerVolumeSpecName "kube-api-access-g76l9". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:14:09.155308 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:09.155288 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/0706a62a-b39f-4e63-88a9-6d956b800c77-util" (OuterVolumeSpecName: "util") pod "0706a62a-b39f-4e63-88a9-6d956b800c77" (UID: "0706a62a-b39f-4e63-88a9-6d956b800c77"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:14:09.251872 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:09.251801 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/0706a62a-b39f-4e63-88a9-6d956b800c77-util\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:14:09.251872 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:09.251826 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/0706a62a-b39f-4e63-88a9-6d956b800c77-bundle\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:14:09.251872 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:09.251835 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-g76l9\" (UniqueName: \"kubernetes.io/projected/0706a62a-b39f-4e63-88a9-6d956b800c77-kube-api-access-g76l9\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:14:09.999304 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:09.999269 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x" event={"ID":"0706a62a-b39f-4e63-88a9-6d956b800c77","Type":"ContainerDied","Data":"16213ddf45127af4c1b6989973d20de02dffe574c113595ef108834c518b752e"} Jul 15 21:14:09.999456 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:09.999306 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/77defbb6647882b321b46d16bdefe62633c3425354d3d93571a1d6a87fdsn4x" Jul 15 21:14:09.999456 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:09.999320 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="16213ddf45127af4c1b6989973d20de02dffe574c113595ef108834c518b752e" Jul 15 21:14:15.525109 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:15.525074 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wvq9b"] Jul 15 21:14:15.525473 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:15.525357 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0706a62a-b39f-4e63-88a9-6d956b800c77" containerName="util" Jul 15 21:14:15.525473 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:15.525367 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0706a62a-b39f-4e63-88a9-6d956b800c77" containerName="util" Jul 15 21:14:15.525473 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:15.525378 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0706a62a-b39f-4e63-88a9-6d956b800c77" containerName="extract" Jul 15 21:14:15.525473 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:15.525384 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0706a62a-b39f-4e63-88a9-6d956b800c77" containerName="extract" Jul 15 21:14:15.525473 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:15.525393 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="0706a62a-b39f-4e63-88a9-6d956b800c77" containerName="pull" Jul 15 21:14:15.525473 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:15.525398 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="0706a62a-b39f-4e63-88a9-6d956b800c77" containerName="pull" Jul 15 21:14:15.525473 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:15.525440 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="0706a62a-b39f-4e63-88a9-6d956b800c77" containerName="extract" Jul 15 21:14:15.527635 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:15.527619 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wvq9b" Jul 15 21:14:15.529908 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:15.529885 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 15 21:14:15.530662 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:15.530647 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-2ml62\"" Jul 15 21:14:15.530742 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:15.530655 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 15 21:14:15.537688 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:15.537666 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wvq9b"] Jul 15 21:14:15.602630 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:15.602603 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b12d9ba-5227-4bd8-80e0-e62c732f3156-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wvq9b\" (UID: \"7b12d9ba-5227-4bd8-80e0-e62c732f3156\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wvq9b" Jul 15 21:14:15.602748 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:15.602656 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8j9l6\" (UniqueName: \"kubernetes.io/projected/7b12d9ba-5227-4bd8-80e0-e62c732f3156-kube-api-access-8j9l6\") pod \"openshift-lws-operator-fd8ccff4c-wvq9b\" (UID: \"7b12d9ba-5227-4bd8-80e0-e62c732f3156\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wvq9b" Jul 15 21:14:15.703592 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:15.703553 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b12d9ba-5227-4bd8-80e0-e62c732f3156-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wvq9b\" (UID: \"7b12d9ba-5227-4bd8-80e0-e62c732f3156\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wvq9b" Jul 15 21:14:15.703809 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:15.703617 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8j9l6\" (UniqueName: \"kubernetes.io/projected/7b12d9ba-5227-4bd8-80e0-e62c732f3156-kube-api-access-8j9l6\") pod \"openshift-lws-operator-fd8ccff4c-wvq9b\" (UID: \"7b12d9ba-5227-4bd8-80e0-e62c732f3156\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wvq9b" Jul 15 21:14:15.703943 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:15.703924 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/7b12d9ba-5227-4bd8-80e0-e62c732f3156-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wvq9b\" (UID: \"7b12d9ba-5227-4bd8-80e0-e62c732f3156\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wvq9b" Jul 15 21:14:15.713767 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:15.713740 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8j9l6\" (UniqueName: \"kubernetes.io/projected/7b12d9ba-5227-4bd8-80e0-e62c732f3156-kube-api-access-8j9l6\") pod \"openshift-lws-operator-fd8ccff4c-wvq9b\" (UID: \"7b12d9ba-5227-4bd8-80e0-e62c732f3156\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wvq9b" Jul 15 21:14:15.835737 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:15.835711 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wvq9b" Jul 15 21:14:15.965743 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:14:15.965715 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod7b12d9ba_5227_4bd8_80e0_e62c732f3156.slice/crio-d541d5aba152ed5e45b8af72436228901db2334dcc0f08c0fb282e42605a8b3c WatchSource:0}: Error finding container d541d5aba152ed5e45b8af72436228901db2334dcc0f08c0fb282e42605a8b3c: Status 404 returned error can't find the container with id d541d5aba152ed5e45b8af72436228901db2334dcc0f08c0fb282e42605a8b3c Jul 15 21:14:15.966411 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:15.966318 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wvq9b"] Jul 15 21:14:16.024029 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:16.023997 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wvq9b" event={"ID":"7b12d9ba-5227-4bd8-80e0-e62c732f3156","Type":"ContainerStarted","Data":"d541d5aba152ed5e45b8af72436228901db2334dcc0f08c0fb282e42605a8b3c"} Jul 15 21:14:20.044284 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:20.044245 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wvq9b" event={"ID":"7b12d9ba-5227-4bd8-80e0-e62c732f3156","Type":"ContainerStarted","Data":"e68cfd6bc3ff1353442833c193a38c01770215a56c60b06119054e22b836d061"} Jul 15 21:14:20.061106 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:20.061053 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wvq9b" podStartSLOduration=1.935838848 podStartE2EDuration="5.061032112s" totalImagesPullingTime="3.125193264s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:14:15 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:14:20.060804893 +0000 UTC m=+252.882122211" watchObservedRunningTime="2026-07-15 21:14:20.061032112 +0000 UTC m=+252.882349427" Jul 15 21:14:22.212299 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:22.212256 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k"] Jul 15 21:14:22.231122 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:22.231096 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k" Jul 15 21:14:22.232985 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:22.232953 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k"] Jul 15 21:14:22.233614 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:22.233593 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"openshift-service-ca.crt\"" Jul 15 21:14:22.234555 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:22.234519 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-marketplace\"/\"kube-root-ca.crt\"" Jul 15 21:14:22.234757 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:22.234737 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-marketplace\"/\"default-dockercfg-9zpdq\"" Jul 15 21:14:22.352079 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:22.352045 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw9lb\" (UniqueName: \"kubernetes.io/projected/ae541c9f-e08a-475d-8ae7-f40a78974673-kube-api-access-pw9lb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k\" (UID: \"ae541c9f-e08a-475d-8ae7-f40a78974673\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k" Jul 15 21:14:22.352239 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:22.352101 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae541c9f-e08a-475d-8ae7-f40a78974673-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k\" (UID: \"ae541c9f-e08a-475d-8ae7-f40a78974673\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k" Jul 15 21:14:22.352239 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:22.352198 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae541c9f-e08a-475d-8ae7-f40a78974673-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k\" (UID: \"ae541c9f-e08a-475d-8ae7-f40a78974673\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k" Jul 15 21:14:22.452742 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:22.452711 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw9lb\" (UniqueName: \"kubernetes.io/projected/ae541c9f-e08a-475d-8ae7-f40a78974673-kube-api-access-pw9lb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k\" (UID: \"ae541c9f-e08a-475d-8ae7-f40a78974673\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k" Jul 15 21:14:22.452908 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:22.452763 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae541c9f-e08a-475d-8ae7-f40a78974673-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k\" (UID: \"ae541c9f-e08a-475d-8ae7-f40a78974673\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k" Jul 15 21:14:22.452908 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:22.452810 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae541c9f-e08a-475d-8ae7-f40a78974673-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k\" (UID: \"ae541c9f-e08a-475d-8ae7-f40a78974673\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k" Jul 15 21:14:22.453123 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:22.453109 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae541c9f-e08a-475d-8ae7-f40a78974673-bundle\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k\" (UID: \"ae541c9f-e08a-475d-8ae7-f40a78974673\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k" Jul 15 21:14:22.453173 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:22.453153 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae541c9f-e08a-475d-8ae7-f40a78974673-util\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k\" (UID: \"ae541c9f-e08a-475d-8ae7-f40a78974673\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k" Jul 15 21:14:22.461070 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:22.461048 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw9lb\" (UniqueName: \"kubernetes.io/projected/ae541c9f-e08a-475d-8ae7-f40a78974673-kube-api-access-pw9lb\") pod \"629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k\" (UID: \"ae541c9f-e08a-475d-8ae7-f40a78974673\") " pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k" Jul 15 21:14:22.540775 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:22.540706 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k" Jul 15 21:14:22.672263 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:22.672226 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k"] Jul 15 21:14:22.676816 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:14:22.676788 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podae541c9f_e08a_475d_8ae7_f40a78974673.slice/crio-3b16ecb65f4b9a0efad5e1bb43e71f17b5ef99a98f1b9da8137e5e6cb1d6c39d WatchSource:0}: Error finding container 3b16ecb65f4b9a0efad5e1bb43e71f17b5ef99a98f1b9da8137e5e6cb1d6c39d: Status 404 returned error can't find the container with id 3b16ecb65f4b9a0efad5e1bb43e71f17b5ef99a98f1b9da8137e5e6cb1d6c39d Jul 15 21:14:23.057352 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:23.057314 2572 generic.go:356] "Generic (PLEG): container finished" podID="ae541c9f-e08a-475d-8ae7-f40a78974673" containerID="7b3bd9543b9f78cbb18e9f1554dd0d98e54abbd8e1fe8d0586bd9be84c5f13d9" exitCode=0 Jul 15 21:14:23.057564 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:23.057360 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k" event={"ID":"ae541c9f-e08a-475d-8ae7-f40a78974673","Type":"ContainerDied","Data":"7b3bd9543b9f78cbb18e9f1554dd0d98e54abbd8e1fe8d0586bd9be84c5f13d9"} Jul 15 21:14:23.057564 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:23.057421 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k" event={"ID":"ae541c9f-e08a-475d-8ae7-f40a78974673","Type":"ContainerStarted","Data":"3b16ecb65f4b9a0efad5e1bb43e71f17b5ef99a98f1b9da8137e5e6cb1d6c39d"} Jul 15 21:14:24.062848 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:24.062814 2572 generic.go:356] "Generic (PLEG): container finished" podID="ae541c9f-e08a-475d-8ae7-f40a78974673" containerID="b204846864debfa7f4e5dff0a15f80a14d5239d94a9403f251b63f5c8ed327f6" exitCode=0 Jul 15 21:14:24.063301 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:24.062874 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k" event={"ID":"ae541c9f-e08a-475d-8ae7-f40a78974673","Type":"ContainerDied","Data":"b204846864debfa7f4e5dff0a15f80a14d5239d94a9403f251b63f5c8ed327f6"} Jul 15 21:14:25.068598 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:25.068562 2572 generic.go:356] "Generic (PLEG): container finished" podID="ae541c9f-e08a-475d-8ae7-f40a78974673" containerID="8a74378bdb2c1dfa3bf4753e56ce208316b478ae564033194407ace6fb86965a" exitCode=0 Jul 15 21:14:25.068962 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:25.068648 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k" event={"ID":"ae541c9f-e08a-475d-8ae7-f40a78974673","Type":"ContainerDied","Data":"8a74378bdb2c1dfa3bf4753e56ce208316b478ae564033194407ace6fb86965a"} Jul 15 21:14:26.209034 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:26.209008 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k" Jul 15 21:14:26.285213 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:26.285185 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae541c9f-e08a-475d-8ae7-f40a78974673-util\") pod \"ae541c9f-e08a-475d-8ae7-f40a78974673\" (UID: \"ae541c9f-e08a-475d-8ae7-f40a78974673\") " Jul 15 21:14:26.285382 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:26.285226 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae541c9f-e08a-475d-8ae7-f40a78974673-bundle\") pod \"ae541c9f-e08a-475d-8ae7-f40a78974673\" (UID: \"ae541c9f-e08a-475d-8ae7-f40a78974673\") " Jul 15 21:14:26.285382 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:26.285275 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pw9lb\" (UniqueName: \"kubernetes.io/projected/ae541c9f-e08a-475d-8ae7-f40a78974673-kube-api-access-pw9lb\") pod \"ae541c9f-e08a-475d-8ae7-f40a78974673\" (UID: \"ae541c9f-e08a-475d-8ae7-f40a78974673\") " Jul 15 21:14:26.285979 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:26.285949 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae541c9f-e08a-475d-8ae7-f40a78974673-bundle" (OuterVolumeSpecName: "bundle") pod "ae541c9f-e08a-475d-8ae7-f40a78974673" (UID: "ae541c9f-e08a-475d-8ae7-f40a78974673"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:14:26.287318 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:26.287297 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/ae541c9f-e08a-475d-8ae7-f40a78974673-kube-api-access-pw9lb" (OuterVolumeSpecName: "kube-api-access-pw9lb") pod "ae541c9f-e08a-475d-8ae7-f40a78974673" (UID: "ae541c9f-e08a-475d-8ae7-f40a78974673"). InnerVolumeSpecName "kube-api-access-pw9lb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:14:26.290808 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:26.290782 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/ae541c9f-e08a-475d-8ae7-f40a78974673-util" (OuterVolumeSpecName: "util") pod "ae541c9f-e08a-475d-8ae7-f40a78974673" (UID: "ae541c9f-e08a-475d-8ae7-f40a78974673"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:14:26.385914 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:26.385840 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pw9lb\" (UniqueName: \"kubernetes.io/projected/ae541c9f-e08a-475d-8ae7-f40a78974673-kube-api-access-pw9lb\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:14:26.385914 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:26.385870 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/ae541c9f-e08a-475d-8ae7-f40a78974673-util\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:14:26.385914 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:26.385882 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/ae541c9f-e08a-475d-8ae7-f40a78974673-bundle\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:14:27.078806 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:27.078768 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k" event={"ID":"ae541c9f-e08a-475d-8ae7-f40a78974673","Type":"ContainerDied","Data":"3b16ecb65f4b9a0efad5e1bb43e71f17b5ef99a98f1b9da8137e5e6cb1d6c39d"} Jul 15 21:14:27.078983 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:27.078818 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-marketplace/629fd74b02459b8d9ee224b8bdbb513172290d80b07a5bf327840796afm6j8k" Jul 15 21:14:27.078983 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:27.078826 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="3b16ecb65f4b9a0efad5e1bb43e71f17b5ef99a98f1b9da8137e5e6cb1d6c39d" Jul 15 21:14:35.948282 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:35.948197 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd"] Jul 15 21:14:35.948739 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:35.948636 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae541c9f-e08a-475d-8ae7-f40a78974673" containerName="pull" Jul 15 21:14:35.948739 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:35.948651 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae541c9f-e08a-475d-8ae7-f40a78974673" containerName="pull" Jul 15 21:14:35.948739 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:35.948674 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae541c9f-e08a-475d-8ae7-f40a78974673" containerName="extract" Jul 15 21:14:35.948739 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:35.948684 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae541c9f-e08a-475d-8ae7-f40a78974673" containerName="extract" Jul 15 21:14:35.948739 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:35.948701 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="ae541c9f-e08a-475d-8ae7-f40a78974673" containerName="util" Jul 15 21:14:35.948739 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:35.948711 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="ae541c9f-e08a-475d-8ae7-f40a78974673" containerName="util" Jul 15 21:14:35.948999 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:35.948785 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="ae541c9f-e08a-475d-8ae7-f40a78974673" containerName="extract" Jul 15 21:14:35.951172 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:35.951152 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" Jul 15 21:14:35.953808 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:35.953769 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 15 21:14:35.953919 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:35.953821 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-7nfqq\"" Jul 15 21:14:35.953919 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:35.953855 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 15 21:14:35.953919 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:35.953773 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 15 21:14:35.954159 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:35.954134 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 15 21:14:35.975587 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:35.975561 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd"] Jul 15 21:14:36.061218 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:36.061180 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b481448b-04bd-48ec-ab41-2cff39511bb9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f656749fc-mtlhd\" (UID: \"b481448b-04bd-48ec-ab41-2cff39511bb9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" Jul 15 21:14:36.061405 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:36.061248 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b481448b-04bd-48ec-ab41-2cff39511bb9-manifests\") pod \"opendatahub-operator-controller-manager-5f656749fc-mtlhd\" (UID: \"b481448b-04bd-48ec-ab41-2cff39511bb9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" Jul 15 21:14:36.061405 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:36.061308 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4gqq8\" (UniqueName: \"kubernetes.io/projected/b481448b-04bd-48ec-ab41-2cff39511bb9-kube-api-access-4gqq8\") pod \"opendatahub-operator-controller-manager-5f656749fc-mtlhd\" (UID: \"b481448b-04bd-48ec-ab41-2cff39511bb9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" Jul 15 21:14:36.061405 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:36.061366 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b481448b-04bd-48ec-ab41-2cff39511bb9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f656749fc-mtlhd\" (UID: \"b481448b-04bd-48ec-ab41-2cff39511bb9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" Jul 15 21:14:36.061405 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:36.061391 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b481448b-04bd-48ec-ab41-2cff39511bb9-tmp\") pod \"opendatahub-operator-controller-manager-5f656749fc-mtlhd\" (UID: \"b481448b-04bd-48ec-ab41-2cff39511bb9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" Jul 15 21:14:36.162574 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:36.162515 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b481448b-04bd-48ec-ab41-2cff39511bb9-manifests\") pod \"opendatahub-operator-controller-manager-5f656749fc-mtlhd\" (UID: \"b481448b-04bd-48ec-ab41-2cff39511bb9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" Jul 15 21:14:36.162574 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:36.162570 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4gqq8\" (UniqueName: \"kubernetes.io/projected/b481448b-04bd-48ec-ab41-2cff39511bb9-kube-api-access-4gqq8\") pod \"opendatahub-operator-controller-manager-5f656749fc-mtlhd\" (UID: \"b481448b-04bd-48ec-ab41-2cff39511bb9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" Jul 15 21:14:36.162798 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:36.162605 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b481448b-04bd-48ec-ab41-2cff39511bb9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f656749fc-mtlhd\" (UID: \"b481448b-04bd-48ec-ab41-2cff39511bb9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" Jul 15 21:14:36.162798 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:36.162625 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b481448b-04bd-48ec-ab41-2cff39511bb9-tmp\") pod \"opendatahub-operator-controller-manager-5f656749fc-mtlhd\" (UID: \"b481448b-04bd-48ec-ab41-2cff39511bb9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" Jul 15 21:14:36.162798 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:36.162669 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b481448b-04bd-48ec-ab41-2cff39511bb9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f656749fc-mtlhd\" (UID: \"b481448b-04bd-48ec-ab41-2cff39511bb9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" Jul 15 21:14:36.162987 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:36.162960 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/b481448b-04bd-48ec-ab41-2cff39511bb9-manifests\") pod \"opendatahub-operator-controller-manager-5f656749fc-mtlhd\" (UID: \"b481448b-04bd-48ec-ab41-2cff39511bb9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" Jul 15 21:14:36.164893 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:36.164869 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/b481448b-04bd-48ec-ab41-2cff39511bb9-tmp\") pod \"opendatahub-operator-controller-manager-5f656749fc-mtlhd\" (UID: \"b481448b-04bd-48ec-ab41-2cff39511bb9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" Jul 15 21:14:36.165008 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:36.164989 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/b481448b-04bd-48ec-ab41-2cff39511bb9-apiservice-cert\") pod \"opendatahub-operator-controller-manager-5f656749fc-mtlhd\" (UID: \"b481448b-04bd-48ec-ab41-2cff39511bb9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" Jul 15 21:14:36.165195 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:36.165176 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/b481448b-04bd-48ec-ab41-2cff39511bb9-webhook-cert\") pod \"opendatahub-operator-controller-manager-5f656749fc-mtlhd\" (UID: \"b481448b-04bd-48ec-ab41-2cff39511bb9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" Jul 15 21:14:36.169963 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:36.169939 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4gqq8\" (UniqueName: \"kubernetes.io/projected/b481448b-04bd-48ec-ab41-2cff39511bb9-kube-api-access-4gqq8\") pod \"opendatahub-operator-controller-manager-5f656749fc-mtlhd\" (UID: \"b481448b-04bd-48ec-ab41-2cff39511bb9\") " pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" Jul 15 21:14:36.263311 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:36.263214 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" Jul 15 21:14:36.401337 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:36.401304 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd"] Jul 15 21:14:36.404577 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:14:36.404540 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb481448b_04bd_48ec_ab41_2cff39511bb9.slice/crio-19576838516d3c58d30bb52e1e854c8e1db3f3e36eab58a472f83dcab7ba7bc9 WatchSource:0}: Error finding container 19576838516d3c58d30bb52e1e854c8e1db3f3e36eab58a472f83dcab7ba7bc9: Status 404 returned error can't find the container with id 19576838516d3c58d30bb52e1e854c8e1db3f3e36eab58a472f83dcab7ba7bc9 Jul 15 21:14:37.128688 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:37.128634 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" event={"ID":"b481448b-04bd-48ec-ab41-2cff39511bb9","Type":"ContainerStarted","Data":"19576838516d3c58d30bb52e1e854c8e1db3f3e36eab58a472f83dcab7ba7bc9"} Jul 15 21:14:40.148118 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:40.148079 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" event={"ID":"b481448b-04bd-48ec-ab41-2cff39511bb9","Type":"ContainerStarted","Data":"22e1198b09acccf71d1bf3bcd3f809f13db834d3c928ac0453ff86b7a9971ae9"} Jul 15 21:14:41.153833 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:41.153802 2572 generic.go:356] "Generic (PLEG): container finished" podID="b481448b-04bd-48ec-ab41-2cff39511bb9" containerID="22e1198b09acccf71d1bf3bcd3f809f13db834d3c928ac0453ff86b7a9971ae9" exitCode=0 Jul 15 21:14:41.154170 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:41.153854 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" event={"ID":"b481448b-04bd-48ec-ab41-2cff39511bb9","Type":"ContainerDied","Data":"22e1198b09acccf71d1bf3bcd3f809f13db834d3c928ac0453ff86b7a9971ae9"} Jul 15 21:14:42.160440 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:42.160404 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" event={"ID":"b481448b-04bd-48ec-ab41-2cff39511bb9","Type":"ContainerStarted","Data":"e20aff4893b841e607e98f8049d1f6f850961ac89581f441e324133d6223f86b"} Jul 15 21:14:42.160816 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:42.160566 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" Jul 15 21:14:42.184680 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:42.184631 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" podStartSLOduration=2.288153828 podStartE2EDuration="7.184615673s" totalImagesPullingTime="3.861600274s" totalInitContainerRuntime="1.034861571s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:14:35 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:14:42.180949273 +0000 UTC m=+275.002266590" watchObservedRunningTime="2026-07-15 21:14:42.184615673 +0000 UTC m=+275.005932989" Jul 15 21:14:53.167137 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:53.167100 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-5f656749fc-mtlhd" Jul 15 21:14:55.833489 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:55.833452 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-59fdd66594-jh2bp"] Jul 15 21:14:55.842215 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:55.842191 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59fdd66594-jh2bp" Jul 15 21:14:55.844865 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:55.844841 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 15 21:14:55.845151 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:55.845126 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 15 21:14:55.845291 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:55.845275 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 15 21:14:55.845902 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:55.845880 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 15 21:14:55.845902 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:55.845895 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-9btzr\"" Jul 15 21:14:55.852900 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:55.852878 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59fdd66594-jh2bp"] Jul 15 21:14:55.936935 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:55.936900 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a-tls-certs\") pod \"kube-auth-proxy-59fdd66594-jh2bp\" (UID: \"3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a\") " pod="openshift-ingress/kube-auth-proxy-59fdd66594-jh2bp" Jul 15 21:14:55.937111 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:55.936956 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pd5ws\" (UniqueName: \"kubernetes.io/projected/3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a-kube-api-access-pd5ws\") pod \"kube-auth-proxy-59fdd66594-jh2bp\" (UID: \"3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a\") " pod="openshift-ingress/kube-auth-proxy-59fdd66594-jh2bp" Jul 15 21:14:55.937111 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:55.937050 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a-tmp\") pod \"kube-auth-proxy-59fdd66594-jh2bp\" (UID: \"3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a\") " pod="openshift-ingress/kube-auth-proxy-59fdd66594-jh2bp" Jul 15 21:14:56.025831 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:56.025798 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hbvv6"] Jul 15 21:14:56.029183 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:56.029165 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hbvv6" Jul 15 21:14:56.032401 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:56.032386 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-dockercfg-l4vfb\"" Jul 15 21:14:56.033861 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:56.033844 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"odh-model-controller-webhook-cert\"" Jul 15 21:14:56.037489 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:56.037468 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a-tmp\") pod \"kube-auth-proxy-59fdd66594-jh2bp\" (UID: \"3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a\") " pod="openshift-ingress/kube-auth-proxy-59fdd66594-jh2bp" Jul 15 21:14:56.037634 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:56.037513 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a-tls-certs\") pod \"kube-auth-proxy-59fdd66594-jh2bp\" (UID: \"3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a\") " pod="openshift-ingress/kube-auth-proxy-59fdd66594-jh2bp" Jul 15 21:14:56.037634 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:56.037556 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pd5ws\" (UniqueName: \"kubernetes.io/projected/3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a-kube-api-access-pd5ws\") pod \"kube-auth-proxy-59fdd66594-jh2bp\" (UID: \"3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a\") " pod="openshift-ingress/kube-auth-proxy-59fdd66594-jh2bp" Jul 15 21:14:56.037747 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:14:56.037643 2572 secret.go:189] Couldn't get secret openshift-ingress/kube-auth-proxy-tls: secret "kube-auth-proxy-tls" not found Jul 15 21:14:56.037747 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:14:56.037720 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a-tls-certs podName:3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a nodeName:}" failed. No retries permitted until 2026-07-15 21:14:56.537699782 +0000 UTC m=+289.359017085 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a-tls-certs") pod "kube-auth-proxy-59fdd66594-jh2bp" (UID: "3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a") : secret "kube-auth-proxy-tls" not found Jul 15 21:14:56.039619 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:56.039601 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a-tmp\") pod \"kube-auth-proxy-59fdd66594-jh2bp\" (UID: \"3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a\") " pod="openshift-ingress/kube-auth-proxy-59fdd66594-jh2bp" Jul 15 21:14:56.049424 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:56.049401 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hbvv6"] Jul 15 21:14:56.057810 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:56.057785 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pd5ws\" (UniqueName: \"kubernetes.io/projected/3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a-kube-api-access-pd5ws\") pod \"kube-auth-proxy-59fdd66594-jh2bp\" (UID: \"3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a\") " pod="openshift-ingress/kube-auth-proxy-59fdd66594-jh2bp" Jul 15 21:14:56.138138 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:56.138065 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/618e6159-0a9a-4d5a-8be8-c574e81d3c0e-cert\") pod \"odh-model-controller-7998c67dc4-hbvv6\" (UID: \"618e6159-0a9a-4d5a-8be8-c574e81d3c0e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hbvv6" Jul 15 21:14:56.138138 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:56.138102 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-p5v9h\" (UniqueName: \"kubernetes.io/projected/618e6159-0a9a-4d5a-8be8-c574e81d3c0e-kube-api-access-p5v9h\") pod \"odh-model-controller-7998c67dc4-hbvv6\" (UID: \"618e6159-0a9a-4d5a-8be8-c574e81d3c0e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hbvv6" Jul 15 21:14:56.238587 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:56.238514 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-p5v9h\" (UniqueName: \"kubernetes.io/projected/618e6159-0a9a-4d5a-8be8-c574e81d3c0e-kube-api-access-p5v9h\") pod \"odh-model-controller-7998c67dc4-hbvv6\" (UID: \"618e6159-0a9a-4d5a-8be8-c574e81d3c0e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hbvv6" Jul 15 21:14:56.238800 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:56.238696 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/618e6159-0a9a-4d5a-8be8-c574e81d3c0e-cert\") pod \"odh-model-controller-7998c67dc4-hbvv6\" (UID: \"618e6159-0a9a-4d5a-8be8-c574e81d3c0e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hbvv6" Jul 15 21:14:56.238882 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:14:56.238809 2572 secret.go:189] Couldn't get secret opendatahub/odh-model-controller-webhook-cert: secret "odh-model-controller-webhook-cert" not found Jul 15 21:14:56.238936 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:14:56.238881 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/618e6159-0a9a-4d5a-8be8-c574e81d3c0e-cert podName:618e6159-0a9a-4d5a-8be8-c574e81d3c0e nodeName:}" failed. No retries permitted until 2026-07-15 21:14:56.738861176 +0000 UTC m=+289.560178477 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/618e6159-0a9a-4d5a-8be8-c574e81d3c0e-cert") pod "odh-model-controller-7998c67dc4-hbvv6" (UID: "618e6159-0a9a-4d5a-8be8-c574e81d3c0e") : secret "odh-model-controller-webhook-cert" not found Jul 15 21:14:56.265544 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:56.265508 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-p5v9h\" (UniqueName: \"kubernetes.io/projected/618e6159-0a9a-4d5a-8be8-c574e81d3c0e-kube-api-access-p5v9h\") pod \"odh-model-controller-7998c67dc4-hbvv6\" (UID: \"618e6159-0a9a-4d5a-8be8-c574e81d3c0e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hbvv6" Jul 15 21:14:56.541446 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:56.541365 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a-tls-certs\") pod \"kube-auth-proxy-59fdd66594-jh2bp\" (UID: \"3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a\") " pod="openshift-ingress/kube-auth-proxy-59fdd66594-jh2bp" Jul 15 21:14:56.543901 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:56.543867 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a-tls-certs\") pod \"kube-auth-proxy-59fdd66594-jh2bp\" (UID: \"3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a\") " pod="openshift-ingress/kube-auth-proxy-59fdd66594-jh2bp" Jul 15 21:14:56.743030 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:56.742985 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/618e6159-0a9a-4d5a-8be8-c574e81d3c0e-cert\") pod \"odh-model-controller-7998c67dc4-hbvv6\" (UID: \"618e6159-0a9a-4d5a-8be8-c574e81d3c0e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hbvv6" Jul 15 21:14:56.745457 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:56.745433 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/618e6159-0a9a-4d5a-8be8-c574e81d3c0e-cert\") pod \"odh-model-controller-7998c67dc4-hbvv6\" (UID: \"618e6159-0a9a-4d5a-8be8-c574e81d3c0e\") " pod="opendatahub/odh-model-controller-7998c67dc4-hbvv6" Jul 15 21:14:56.752305 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:56.752279 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-59fdd66594-jh2bp" Jul 15 21:14:56.906588 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:56.906545 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-59fdd66594-jh2bp"] Jul 15 21:14:56.910014 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:14:56.909984 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c3a6a4a_f0b6_4f5c_befe_6a3ecb6e4d3a.slice/crio-0ddb0f33dfe0a3998149402c694d90e60661284edc8e2d413dc9f0e0294087f9 WatchSource:0}: Error finding container 0ddb0f33dfe0a3998149402c694d90e60661284edc8e2d413dc9f0e0294087f9: Status 404 returned error can't find the container with id 0ddb0f33dfe0a3998149402c694d90e60661284edc8e2d413dc9f0e0294087f9 Jul 15 21:14:56.938543 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:56.938501 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/odh-model-controller-7998c67dc4-hbvv6" Jul 15 21:14:57.099552 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:57.099507 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/odh-model-controller-7998c67dc4-hbvv6"] Jul 15 21:14:57.103257 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:14:57.103215 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod618e6159_0a9a_4d5a_8be8_c574e81d3c0e.slice/crio-1f99a4c4854fb8c154f374c436e7e92aad8327c9ee30a625dbc210a7056f60f8 WatchSource:0}: Error finding container 1f99a4c4854fb8c154f374c436e7e92aad8327c9ee30a625dbc210a7056f60f8: Status 404 returned error can't find the container with id 1f99a4c4854fb8c154f374c436e7e92aad8327c9ee30a625dbc210a7056f60f8 Jul 15 21:14:57.228671 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:57.228635 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hbvv6" event={"ID":"618e6159-0a9a-4d5a-8be8-c574e81d3c0e","Type":"ContainerStarted","Data":"1f99a4c4854fb8c154f374c436e7e92aad8327c9ee30a625dbc210a7056f60f8"} Jul 15 21:14:57.229669 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:57.229640 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59fdd66594-jh2bp" event={"ID":"3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a","Type":"ContainerStarted","Data":"0ddb0f33dfe0a3998149402c694d90e60661284edc8e2d413dc9f0e0294087f9"} Jul 15 21:14:57.343182 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:57.343142 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5jn5d"] Jul 15 21:14:57.347724 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:57.347704 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5jn5d" Jul 15 21:14:57.352708 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:57.352640 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-dockercfg-9vlvv\"" Jul 15 21:14:57.352708 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:57.352664 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"model-serving-api-tls\"" Jul 15 21:14:57.358538 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:57.358503 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5jn5d"] Jul 15 21:14:57.449364 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:57.449324 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd039300-5520-4b70-8b67-5de95af6bbc5-tls-certs\") pod \"model-serving-api-54d89bd5fc-5jn5d\" (UID: \"bd039300-5520-4b70-8b67-5de95af6bbc5\") " pod="opendatahub/model-serving-api-54d89bd5fc-5jn5d" Jul 15 21:14:57.449563 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:57.449371 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-h5l58\" (UniqueName: \"kubernetes.io/projected/bd039300-5520-4b70-8b67-5de95af6bbc5-kube-api-access-h5l58\") pod \"model-serving-api-54d89bd5fc-5jn5d\" (UID: \"bd039300-5520-4b70-8b67-5de95af6bbc5\") " pod="opendatahub/model-serving-api-54d89bd5fc-5jn5d" Jul 15 21:14:57.550481 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:57.550448 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd039300-5520-4b70-8b67-5de95af6bbc5-tls-certs\") pod \"model-serving-api-54d89bd5fc-5jn5d\" (UID: \"bd039300-5520-4b70-8b67-5de95af6bbc5\") " pod="opendatahub/model-serving-api-54d89bd5fc-5jn5d" Jul 15 21:14:57.550663 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:57.550491 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-h5l58\" (UniqueName: \"kubernetes.io/projected/bd039300-5520-4b70-8b67-5de95af6bbc5-kube-api-access-h5l58\") pod \"model-serving-api-54d89bd5fc-5jn5d\" (UID: \"bd039300-5520-4b70-8b67-5de95af6bbc5\") " pod="opendatahub/model-serving-api-54d89bd5fc-5jn5d" Jul 15 21:14:57.550663 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:14:57.550636 2572 secret.go:189] Couldn't get secret opendatahub/model-serving-api-tls: secret "model-serving-api-tls" not found Jul 15 21:14:57.550815 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:14:57.550711 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/bd039300-5520-4b70-8b67-5de95af6bbc5-tls-certs podName:bd039300-5520-4b70-8b67-5de95af6bbc5 nodeName:}" failed. No retries permitted until 2026-07-15 21:14:58.050689807 +0000 UTC m=+290.872007115 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "tls-certs" (UniqueName: "kubernetes.io/secret/bd039300-5520-4b70-8b67-5de95af6bbc5-tls-certs") pod "model-serving-api-54d89bd5fc-5jn5d" (UID: "bd039300-5520-4b70-8b67-5de95af6bbc5") : secret "model-serving-api-tls" not found Jul 15 21:14:57.568479 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:57.568451 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-h5l58\" (UniqueName: \"kubernetes.io/projected/bd039300-5520-4b70-8b67-5de95af6bbc5-kube-api-access-h5l58\") pod \"model-serving-api-54d89bd5fc-5jn5d\" (UID: \"bd039300-5520-4b70-8b67-5de95af6bbc5\") " pod="opendatahub/model-serving-api-54d89bd5fc-5jn5d" Jul 15 21:14:58.055855 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:58.055818 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd039300-5520-4b70-8b67-5de95af6bbc5-tls-certs\") pod \"model-serving-api-54d89bd5fc-5jn5d\" (UID: \"bd039300-5520-4b70-8b67-5de95af6bbc5\") " pod="opendatahub/model-serving-api-54d89bd5fc-5jn5d" Jul 15 21:14:58.058798 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:58.058776 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/bd039300-5520-4b70-8b67-5de95af6bbc5-tls-certs\") pod \"model-serving-api-54d89bd5fc-5jn5d\" (UID: \"bd039300-5520-4b70-8b67-5de95af6bbc5\") " pod="opendatahub/model-serving-api-54d89bd5fc-5jn5d" Jul 15 21:14:58.258841 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:58.258809 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/model-serving-api-54d89bd5fc-5jn5d" Jul 15 21:14:58.418767 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:58.418335 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/model-serving-api-54d89bd5fc-5jn5d"] Jul 15 21:14:58.420951 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:14:58.420921 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbd039300_5520_4b70_8b67_5de95af6bbc5.slice/crio-1876bd4da2a1b6f721c0b7359a0bd21973e96486659551bc572a9a376c097ae5 WatchSource:0}: Error finding container 1876bd4da2a1b6f721c0b7359a0bd21973e96486659551bc572a9a376c097ae5: Status 404 returned error can't find the container with id 1876bd4da2a1b6f721c0b7359a0bd21973e96486659551bc572a9a376c097ae5 Jul 15 21:14:59.244081 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:14:59.244001 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5jn5d" event={"ID":"bd039300-5520-4b70-8b67-5de95af6bbc5","Type":"ContainerStarted","Data":"1876bd4da2a1b6f721c0b7359a0bd21973e96486659551bc572a9a376c097ae5"} Jul 15 21:15:02.262784 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.262745 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-59fdd66594-jh2bp" event={"ID":"3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a","Type":"ContainerStarted","Data":"0a7a235721060fccc8ef8cf5d7980191f3e7b687cac4dc511d483cd26c4e690b"} Jul 15 21:15:02.264360 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.264333 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/odh-model-controller-7998c67dc4-hbvv6" event={"ID":"618e6159-0a9a-4d5a-8be8-c574e81d3c0e","Type":"ContainerStarted","Data":"d5b5fae232005fbe2afaa291f69053677b25093c62fc6fc2e19faa51b0888c04"} Jul 15 21:15:02.264493 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.264435 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/odh-model-controller-7998c67dc4-hbvv6" Jul 15 21:15:02.265783 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.265760 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/model-serving-api-54d89bd5fc-5jn5d" event={"ID":"bd039300-5520-4b70-8b67-5de95af6bbc5","Type":"ContainerStarted","Data":"046cc30f6f4c6490e4f39121b85088e6f6f083da8e94513060758bc7b44ec8e6"} Jul 15 21:15:02.265906 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.265890 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/model-serving-api-54d89bd5fc-5jn5d" Jul 15 21:15:02.331437 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.331388 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-59fdd66594-jh2bp" podStartSLOduration=2.899200638 podStartE2EDuration="7.331369163s" totalImagesPullingTime="4.432168525s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:14:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:15:02.298671898 +0000 UTC m=+295.119989214" watchObservedRunningTime="2026-07-15 21:15:02.331369163 +0000 UTC m=+295.152686481" Jul 15 21:15:02.331747 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.331725 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/odh-model-controller-7998c67dc4-hbvv6" podStartSLOduration=3.096365247 podStartE2EDuration="7.331718653s" totalImagesPullingTime="4.235353406s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:14:55 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:15:02.327967701 +0000 UTC m=+295.149285028" watchObservedRunningTime="2026-07-15 21:15:02.331718653 +0000 UTC m=+295.153035969" Jul 15 21:15:02.360326 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.360280 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/model-serving-api-54d89bd5fc-5jn5d" podStartSLOduration=2.440065484 podStartE2EDuration="5.360265334s" totalImagesPullingTime="2.92019985s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:14:57 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:15:02.357518898 +0000 UTC m=+295.178836215" watchObservedRunningTime="2026-07-15 21:15:02.360265334 +0000 UTC m=+295.181582697" Jul 15 21:15:02.453956 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.453920 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg"] Jul 15 21:15:02.457330 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.457311 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.461885 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.461862 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 15 21:15:02.461986 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.461914 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-26hlg\"" Jul 15 21:15:02.477809 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.477783 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg"] Jul 15 21:15:02.495885 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.495860 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be899bae-85dd-4d5f-8a55-f77825718a5c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.496001 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.495891 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pg7w6\" (UniqueName: \"kubernetes.io/projected/be899bae-85dd-4d5f-8a55-f77825718a5c-kube-api-access-pg7w6\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.496001 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.495917 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be899bae-85dd-4d5f-8a55-f77825718a5c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.496001 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.495935 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be899bae-85dd-4d5f-8a55-f77825718a5c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.496001 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.495973 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be899bae-85dd-4d5f-8a55-f77825718a5c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.496141 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.496014 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be899bae-85dd-4d5f-8a55-f77825718a5c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.496141 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.496058 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be899bae-85dd-4d5f-8a55-f77825718a5c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.496141 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.496085 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be899bae-85dd-4d5f-8a55-f77825718a5c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.496141 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.496103 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be899bae-85dd-4d5f-8a55-f77825718a5c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.596625 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.596587 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be899bae-85dd-4d5f-8a55-f77825718a5c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.596827 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.596684 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be899bae-85dd-4d5f-8a55-f77825718a5c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.596827 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.596710 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pg7w6\" (UniqueName: \"kubernetes.io/projected/be899bae-85dd-4d5f-8a55-f77825718a5c-kube-api-access-pg7w6\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.596827 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.596744 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be899bae-85dd-4d5f-8a55-f77825718a5c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.596827 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.596772 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be899bae-85dd-4d5f-8a55-f77825718a5c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.596827 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.596794 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be899bae-85dd-4d5f-8a55-f77825718a5c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.597171 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.596838 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be899bae-85dd-4d5f-8a55-f77825718a5c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.597171 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.596884 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be899bae-85dd-4d5f-8a55-f77825718a5c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.597171 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.596998 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be899bae-85dd-4d5f-8a55-f77825718a5c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.597330 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.597301 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/be899bae-85dd-4d5f-8a55-f77825718a5c-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.597421 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.597392 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/be899bae-85dd-4d5f-8a55-f77825718a5c-istio-data\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.597482 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.597441 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/be899bae-85dd-4d5f-8a55-f77825718a5c-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.597482 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.597467 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/be899bae-85dd-4d5f-8a55-f77825718a5c-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.597623 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.597545 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/be899bae-85dd-4d5f-8a55-f77825718a5c-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.599015 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.598993 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/be899bae-85dd-4d5f-8a55-f77825718a5c-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.599259 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.599237 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/be899bae-85dd-4d5f-8a55-f77825718a5c-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.629397 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.629364 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pg7w6\" (UniqueName: \"kubernetes.io/projected/be899bae-85dd-4d5f-8a55-f77825718a5c-kube-api-access-pg7w6\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.639330 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.639297 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/be899bae-85dd-4d5f-8a55-f77825718a5c-istio-token\") pod \"data-science-gateway-data-science-gateway-class-7f964fb678b8fcg\" (UID: \"be899bae-85dd-4d5f-8a55-f77825718a5c\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.767280 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.767244 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:02.925926 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:02.925894 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg"] Jul 15 21:15:02.926823 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:15:02.926798 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbe899bae_85dd_4d5f_8a55_f77825718a5c.slice/crio-03abf4b8fe23c251c6d05f4ecc4bdc40aca7c744e6262944b39576c8fc964128 WatchSource:0}: Error finding container 03abf4b8fe23c251c6d05f4ecc4bdc40aca7c744e6262944b39576c8fc964128: Status 404 returned error can't find the container with id 03abf4b8fe23c251c6d05f4ecc4bdc40aca7c744e6262944b39576c8fc964128 Jul 15 21:15:03.272938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.272842 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" event={"ID":"be899bae-85dd-4d5f-8a55-f77825718a5c","Type":"ContainerStarted","Data":"03abf4b8fe23c251c6d05f4ecc4bdc40aca7c744e6262944b39576c8fc964128"} Jul 15 21:15:03.770127 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.770092 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9"] Jul 15 21:15:03.774618 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.774598 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:03.779976 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.779946 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-pqvh8\"" Jul 15 21:15:03.780233 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.780211 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 15 21:15:03.780511 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.780495 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 15 21:15:03.780580 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.780495 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 15 21:15:03.787280 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.787254 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9"] Jul 15 21:15:03.807334 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.807301 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/880fcd1a-4cbd-40a7-99a4-f7e4c8087267-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nzpr9\" (UID: \"880fcd1a-4cbd-40a7-99a4-f7e4c8087267\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:03.807447 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.807353 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9hvqp\" (UniqueName: \"kubernetes.io/projected/880fcd1a-4cbd-40a7-99a4-f7e4c8087267-kube-api-access-9hvqp\") pod \"istiod-openshift-gateway-94bb8fbfd-nzpr9\" (UID: \"880fcd1a-4cbd-40a7-99a4-f7e4c8087267\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:03.807447 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.807373 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/880fcd1a-4cbd-40a7-99a4-f7e4c8087267-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nzpr9\" (UID: \"880fcd1a-4cbd-40a7-99a4-f7e4c8087267\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:03.807639 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.807449 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/880fcd1a-4cbd-40a7-99a4-f7e4c8087267-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nzpr9\" (UID: \"880fcd1a-4cbd-40a7-99a4-f7e4c8087267\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:03.807639 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.807617 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/880fcd1a-4cbd-40a7-99a4-f7e4c8087267-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nzpr9\" (UID: \"880fcd1a-4cbd-40a7-99a4-f7e4c8087267\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:03.807764 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.807664 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/880fcd1a-4cbd-40a7-99a4-f7e4c8087267-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nzpr9\" (UID: \"880fcd1a-4cbd-40a7-99a4-f7e4c8087267\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:03.807764 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.807698 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/880fcd1a-4cbd-40a7-99a4-f7e4c8087267-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nzpr9\" (UID: \"880fcd1a-4cbd-40a7-99a4-f7e4c8087267\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:03.908485 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.908441 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9hvqp\" (UniqueName: \"kubernetes.io/projected/880fcd1a-4cbd-40a7-99a4-f7e4c8087267-kube-api-access-9hvqp\") pod \"istiod-openshift-gateway-94bb8fbfd-nzpr9\" (UID: \"880fcd1a-4cbd-40a7-99a4-f7e4c8087267\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:03.908685 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.908484 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/880fcd1a-4cbd-40a7-99a4-f7e4c8087267-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nzpr9\" (UID: \"880fcd1a-4cbd-40a7-99a4-f7e4c8087267\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:03.908685 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.908521 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/880fcd1a-4cbd-40a7-99a4-f7e4c8087267-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nzpr9\" (UID: \"880fcd1a-4cbd-40a7-99a4-f7e4c8087267\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:03.908685 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.908578 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/880fcd1a-4cbd-40a7-99a4-f7e4c8087267-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nzpr9\" (UID: \"880fcd1a-4cbd-40a7-99a4-f7e4c8087267\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:03.908685 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.908610 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/880fcd1a-4cbd-40a7-99a4-f7e4c8087267-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nzpr9\" (UID: \"880fcd1a-4cbd-40a7-99a4-f7e4c8087267\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:03.908685 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.908641 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/880fcd1a-4cbd-40a7-99a4-f7e4c8087267-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nzpr9\" (UID: \"880fcd1a-4cbd-40a7-99a4-f7e4c8087267\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:03.908685 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.908685 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/880fcd1a-4cbd-40a7-99a4-f7e4c8087267-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nzpr9\" (UID: \"880fcd1a-4cbd-40a7-99a4-f7e4c8087267\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:03.909507 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.909477 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/880fcd1a-4cbd-40a7-99a4-f7e4c8087267-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-nzpr9\" (UID: \"880fcd1a-4cbd-40a7-99a4-f7e4c8087267\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:03.910949 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.910922 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/880fcd1a-4cbd-40a7-99a4-f7e4c8087267-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-nzpr9\" (UID: \"880fcd1a-4cbd-40a7-99a4-f7e4c8087267\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:03.911078 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.911059 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/880fcd1a-4cbd-40a7-99a4-f7e4c8087267-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-nzpr9\" (UID: \"880fcd1a-4cbd-40a7-99a4-f7e4c8087267\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:03.911166 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.911148 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/880fcd1a-4cbd-40a7-99a4-f7e4c8087267-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-nzpr9\" (UID: \"880fcd1a-4cbd-40a7-99a4-f7e4c8087267\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:03.911226 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.911190 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/880fcd1a-4cbd-40a7-99a4-f7e4c8087267-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-nzpr9\" (UID: \"880fcd1a-4cbd-40a7-99a4-f7e4c8087267\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:03.924344 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.924313 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/880fcd1a-4cbd-40a7-99a4-f7e4c8087267-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-nzpr9\" (UID: \"880fcd1a-4cbd-40a7-99a4-f7e4c8087267\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:03.924494 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:03.924476 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9hvqp\" (UniqueName: \"kubernetes.io/projected/880fcd1a-4cbd-40a7-99a4-f7e4c8087267-kube-api-access-9hvqp\") pod \"istiod-openshift-gateway-94bb8fbfd-nzpr9\" (UID: \"880fcd1a-4cbd-40a7-99a4-f7e4c8087267\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:04.083837 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:04.083799 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:04.225420 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:04.225393 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9"] Jul 15 21:15:04.228184 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:15:04.228159 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod880fcd1a_4cbd_40a7_99a4_f7e4c8087267.slice/crio-18db36c0a86273294c67fd8d6dd999375dee4fc6e053cea9512cc2a372e1dac8 WatchSource:0}: Error finding container 18db36c0a86273294c67fd8d6dd999375dee4fc6e053cea9512cc2a372e1dac8: Status 404 returned error can't find the container with id 18db36c0a86273294c67fd8d6dd999375dee4fc6e053cea9512cc2a372e1dac8 Jul 15 21:15:04.284948 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:04.284909 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" event={"ID":"880fcd1a-4cbd-40a7-99a4-f7e4c8087267","Type":"ContainerStarted","Data":"18db36c0a86273294c67fd8d6dd999375dee4fc6e053cea9512cc2a372e1dac8"} Jul 15 21:15:06.293108 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:06.293064 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:15:06.293476 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:06.293164 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:15:06.293476 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:06.293204 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:15:07.027557 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.027502 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pkczm"] Jul 15 21:15:07.031394 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.031369 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkczm" Jul 15 21:15:07.034679 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.034659 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 15 21:15:07.034767 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.034697 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-xqpf7\"" Jul 15 21:15:07.048483 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.048416 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pkczm"] Jul 15 21:15:07.054569 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.054546 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jk4lg"] Jul 15 21:15:07.058283 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.058263 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jk4lg" Jul 15 21:15:07.060990 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.060968 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-webhook-server-cert\"" Jul 15 21:15:07.061387 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.061366 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"llmisvc-controller-manager-dockercfg-lm7fj\"" Jul 15 21:15:07.069722 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.069699 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jk4lg"] Jul 15 21:15:07.145138 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.145109 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c85x8\" (UniqueName: \"kubernetes.io/projected/e4e4cc0f-3383-4920-9017-8683bf6f613c-kube-api-access-c85x8\") pod \"llmisvc-controller-manager-777c6bd7d5-jk4lg\" (UID: \"e4e4cc0f-3383-4920-9017-8683bf6f613c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jk4lg" Jul 15 21:15:07.145316 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.145186 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pzj78\" (UniqueName: \"kubernetes.io/projected/5f45a272-726a-4d39-b171-3018a23be928-kube-api-access-pzj78\") pod \"kserve-controller-manager-d6f4b65b8-pkczm\" (UID: \"5f45a272-726a-4d39-b171-3018a23be928\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkczm" Jul 15 21:15:07.145316 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.145272 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f45a272-726a-4d39-b171-3018a23be928-cert\") pod \"kserve-controller-manager-d6f4b65b8-pkczm\" (UID: \"5f45a272-726a-4d39-b171-3018a23be928\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkczm" Jul 15 21:15:07.145316 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.145313 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4e4cc0f-3383-4920-9017-8683bf6f613c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jk4lg\" (UID: \"e4e4cc0f-3383-4920-9017-8683bf6f613c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jk4lg" Jul 15 21:15:07.245783 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.245748 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c85x8\" (UniqueName: \"kubernetes.io/projected/e4e4cc0f-3383-4920-9017-8683bf6f613c-kube-api-access-c85x8\") pod \"llmisvc-controller-manager-777c6bd7d5-jk4lg\" (UID: \"e4e4cc0f-3383-4920-9017-8683bf6f613c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jk4lg" Jul 15 21:15:07.245971 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.245826 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pzj78\" (UniqueName: \"kubernetes.io/projected/5f45a272-726a-4d39-b171-3018a23be928-kube-api-access-pzj78\") pod \"kserve-controller-manager-d6f4b65b8-pkczm\" (UID: \"5f45a272-726a-4d39-b171-3018a23be928\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkczm" Jul 15 21:15:07.245971 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.245898 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f45a272-726a-4d39-b171-3018a23be928-cert\") pod \"kserve-controller-manager-d6f4b65b8-pkczm\" (UID: \"5f45a272-726a-4d39-b171-3018a23be928\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkczm" Jul 15 21:15:07.245971 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.245935 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4e4cc0f-3383-4920-9017-8683bf6f613c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jk4lg\" (UID: \"e4e4cc0f-3383-4920-9017-8683bf6f613c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jk4lg" Jul 15 21:15:07.248787 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.248738 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/e4e4cc0f-3383-4920-9017-8683bf6f613c-cert\") pod \"llmisvc-controller-manager-777c6bd7d5-jk4lg\" (UID: \"e4e4cc0f-3383-4920-9017-8683bf6f613c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jk4lg" Jul 15 21:15:07.249115 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.249081 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/5f45a272-726a-4d39-b171-3018a23be928-cert\") pod \"kserve-controller-manager-d6f4b65b8-pkczm\" (UID: \"5f45a272-726a-4d39-b171-3018a23be928\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkczm" Jul 15 21:15:07.260515 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.260485 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c85x8\" (UniqueName: \"kubernetes.io/projected/e4e4cc0f-3383-4920-9017-8683bf6f613c-kube-api-access-c85x8\") pod \"llmisvc-controller-manager-777c6bd7d5-jk4lg\" (UID: \"e4e4cc0f-3383-4920-9017-8683bf6f613c\") " pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jk4lg" Jul 15 21:15:07.260654 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.260637 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pzj78\" (UniqueName: \"kubernetes.io/projected/5f45a272-726a-4d39-b171-3018a23be928-kube-api-access-pzj78\") pod \"kserve-controller-manager-d6f4b65b8-pkczm\" (UID: \"5f45a272-726a-4d39-b171-3018a23be928\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkczm" Jul 15 21:15:07.303593 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.303495 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" event={"ID":"be899bae-85dd-4d5f-8a55-f77825718a5c","Type":"ContainerStarted","Data":"69f86261dc0f9105c5400690344b76d31a210130278928dc5cc329aec7d60722"} Jul 15 21:15:07.344136 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.344102 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkczm" Jul 15 21:15:07.357676 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.357618 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" podStartSLOduration=1.994005144 podStartE2EDuration="5.357595973s" totalImagesPullingTime="3.363590829s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:15:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:15:07.355477859 +0000 UTC m=+300.176795177" watchObservedRunningTime="2026-07-15 21:15:07.357595973 +0000 UTC m=+300.178913291" Jul 15 21:15:07.371104 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.371081 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jk4lg" Jul 15 21:15:07.768370 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.768337 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:07.774371 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:07.774333 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:08.070130 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:08.070103 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsl2f_19ebe52b-28dc-4b7b-af2d-0779b13a9b62/ovn-acl-logging/0.log" Jul 15 21:15:08.070272 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:08.070115 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsl2f_19ebe52b-28dc-4b7b-af2d-0779b13a9b62/ovn-acl-logging/0.log" Jul 15 21:15:08.077821 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:08.077796 2572 kubelet.go:1648] "Image garbage collection succeeded" Jul 15 21:15:08.124650 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:08.124608 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:15:08.124752 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:08.124690 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:15:08.201565 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:08.201519 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/llmisvc-controller-manager-777c6bd7d5-jk4lg"] Jul 15 21:15:08.205647 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:15:08.205621 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode4e4cc0f_3383_4920_9017_8683bf6f613c.slice/crio-a2967de5a5eb92a7d5db3510baf1255b690c2487212f0ca3f114ac70e1adebe7 WatchSource:0}: Error finding container a2967de5a5eb92a7d5db3510baf1255b690c2487212f0ca3f114ac70e1adebe7: Status 404 returned error can't find the container with id a2967de5a5eb92a7d5db3510baf1255b690c2487212f0ca3f114ac70e1adebe7 Jul 15 21:15:08.237365 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:08.237340 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-pkczm"] Jul 15 21:15:08.241498 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:15:08.241463 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5f45a272_726a_4d39_b171_3018a23be928.slice/crio-567c24de60e0b14c294b1a48bfb14218fed1eabfe842bc3bc0717620b724a43a WatchSource:0}: Error finding container 567c24de60e0b14c294b1a48bfb14218fed1eabfe842bc3bc0717620b724a43a: Status 404 returned error can't find the container with id 567c24de60e0b14c294b1a48bfb14218fed1eabfe842bc3bc0717620b724a43a Jul 15 21:15:08.310364 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:08.310276 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jk4lg" event={"ID":"e4e4cc0f-3383-4920-9017-8683bf6f613c","Type":"ContainerStarted","Data":"a2967de5a5eb92a7d5db3510baf1255b690c2487212f0ca3f114ac70e1adebe7"} Jul 15 21:15:08.311451 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:08.311417 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkczm" event={"ID":"5f45a272-726a-4d39-b171-3018a23be928","Type":"ContainerStarted","Data":"567c24de60e0b14c294b1a48bfb14218fed1eabfe842bc3bc0717620b724a43a"} Jul 15 21:15:08.312873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:08.312849 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" event={"ID":"880fcd1a-4cbd-40a7-99a4-f7e4c8087267","Type":"ContainerStarted","Data":"31bfec3d973afbd1b801cec01302c5c391bdda8ab88aff06cd185f3cf03ec66b"} Jul 15 21:15:08.313199 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:08.313177 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:08.313311 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:08.313221 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:08.314148 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:08.314132 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-7f964fb678b8fcg" Jul 15 21:15:08.385922 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:08.385863 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" podStartSLOduration=1.491828169 podStartE2EDuration="5.385840774s" totalImagesPullingTime="3.894012605s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:15:03 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:15:08.349512936 +0000 UTC m=+301.170830255" watchObservedRunningTime="2026-07-15 21:15:08.385840774 +0000 UTC m=+301.207158083" Jul 15 21:15:09.323014 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:09.322983 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-nzpr9" Jul 15 21:15:11.333283 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:11.333253 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkczm" event={"ID":"5f45a272-726a-4d39-b171-3018a23be928","Type":"ContainerStarted","Data":"7b737b1ab4514a45febd31e996ce396e50123c5cd4bbe4e1d9b6761586309a38"} Jul 15 21:15:11.333690 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:11.333388 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkczm" Jul 15 21:15:11.370709 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:11.370661 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkczm" podStartSLOduration=1.355094202 podStartE2EDuration="4.370645778s" totalImagesPullingTime="3.015551576s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:15:11.368812741 +0000 UTC m=+304.190130058" watchObservedRunningTime="2026-07-15 21:15:11.370645778 +0000 UTC m=+304.191963094" Jul 15 21:15:12.339685 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:12.339647 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jk4lg" event={"ID":"e4e4cc0f-3383-4920-9017-8683bf6f613c","Type":"ContainerStarted","Data":"3b3d8cb628224f247b7c46f3d5365b13298af4f8e5368336cbb1578d1c298908"} Jul 15 21:15:12.375686 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:12.375633 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jk4lg" podStartSLOduration=2.3269931919999998 podStartE2EDuration="5.375616265s" totalImagesPullingTime="3.048623073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:15:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:15:12.368541698 +0000 UTC m=+305.189859008" watchObservedRunningTime="2026-07-15 21:15:12.375616265 +0000 UTC m=+305.196933582" Jul 15 21:15:13.274863 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:13.274834 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/odh-model-controller-7998c67dc4-hbvv6" Jul 15 21:15:13.276914 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:13.276890 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/model-serving-api-54d89bd5fc-5jn5d" Jul 15 21:15:13.344518 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:13.344488 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jk4lg" Jul 15 21:15:42.345417 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:42.345381 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-pkczm" Jul 15 21:15:44.351137 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:15:44.351109 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/llmisvc-controller-manager-777c6bd7d5-jk4lg" Jul 15 21:16:11.982271 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:11.982199 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv"] Jul 15 21:16:11.984998 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:11.984976 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv" Jul 15 21:16:11.987277 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:11.987255 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 21:16:11.988069 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:11.988053 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-2ggjl\"" Jul 15 21:16:11.988164 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:11.988112 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 21:16:11.994238 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:11.994215 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv"] Jul 15 21:16:12.112938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:12.112900 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/121d8874-50cc-40f4-8153-3d81f3e7d4b3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv\" (UID: \"121d8874-50cc-40f4-8153-3d81f3e7d4b3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv" Jul 15 21:16:12.113114 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:12.112951 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2sh8k\" (UniqueName: \"kubernetes.io/projected/121d8874-50cc-40f4-8153-3d81f3e7d4b3-kube-api-access-2sh8k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv\" (UID: \"121d8874-50cc-40f4-8153-3d81f3e7d4b3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv" Jul 15 21:16:12.113114 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:12.113034 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/121d8874-50cc-40f4-8153-3d81f3e7d4b3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv\" (UID: \"121d8874-50cc-40f4-8153-3d81f3e7d4b3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv" Jul 15 21:16:12.213934 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:12.213904 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/121d8874-50cc-40f4-8153-3d81f3e7d4b3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv\" (UID: \"121d8874-50cc-40f4-8153-3d81f3e7d4b3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv" Jul 15 21:16:12.214074 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:12.213945 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2sh8k\" (UniqueName: \"kubernetes.io/projected/121d8874-50cc-40f4-8153-3d81f3e7d4b3-kube-api-access-2sh8k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv\" (UID: \"121d8874-50cc-40f4-8153-3d81f3e7d4b3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv" Jul 15 21:16:12.214074 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:12.213996 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/121d8874-50cc-40f4-8153-3d81f3e7d4b3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv\" (UID: \"121d8874-50cc-40f4-8153-3d81f3e7d4b3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv" Jul 15 21:16:12.214276 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:12.214258 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/121d8874-50cc-40f4-8153-3d81f3e7d4b3-bundle\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv\" (UID: \"121d8874-50cc-40f4-8153-3d81f3e7d4b3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv" Jul 15 21:16:12.214355 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:12.214338 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/121d8874-50cc-40f4-8153-3d81f3e7d4b3-util\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv\" (UID: \"121d8874-50cc-40f4-8153-3d81f3e7d4b3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv" Jul 15 21:16:12.224202 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:12.224173 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2sh8k\" (UniqueName: \"kubernetes.io/projected/121d8874-50cc-40f4-8153-3d81f3e7d4b3-kube-api-access-2sh8k\") pod \"5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv\" (UID: \"121d8874-50cc-40f4-8153-3d81f3e7d4b3\") " pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv" Jul 15 21:16:12.294466 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:12.294401 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv" Jul 15 21:16:12.421574 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:12.421549 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv"] Jul 15 21:16:12.423801 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:16:12.423778 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod121d8874_50cc_40f4_8153_3d81f3e7d4b3.slice/crio-dcbedf161768b623738f46eaeeb2132f4db2055295dc4a83955f993776c824db WatchSource:0}: Error finding container dcbedf161768b623738f46eaeeb2132f4db2055295dc4a83955f993776c824db: Status 404 returned error can't find the container with id dcbedf161768b623738f46eaeeb2132f4db2055295dc4a83955f993776c824db Jul 15 21:16:12.625632 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:12.625598 2572 generic.go:356] "Generic (PLEG): container finished" podID="121d8874-50cc-40f4-8153-3d81f3e7d4b3" containerID="afa65290aeeee3f6fe74e1a2d0f9ca2fc7ff52f776e5f50d8abe53fd539d455c" exitCode=0 Jul 15 21:16:12.625794 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:12.625636 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv" event={"ID":"121d8874-50cc-40f4-8153-3d81f3e7d4b3","Type":"ContainerDied","Data":"afa65290aeeee3f6fe74e1a2d0f9ca2fc7ff52f776e5f50d8abe53fd539d455c"} Jul 15 21:16:12.625794 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:12.625686 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv" event={"ID":"121d8874-50cc-40f4-8153-3d81f3e7d4b3","Type":"ContainerStarted","Data":"dcbedf161768b623738f46eaeeb2132f4db2055295dc4a83955f993776c824db"} Jul 15 21:16:12.626138 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:12.626123 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:16:12.785343 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:12.785312 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv"] Jul 15 21:16:12.792461 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:12.792433 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv" Jul 15 21:16:12.797250 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:12.797223 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv"] Jul 15 21:16:12.919837 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:12.919757 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9803b5bf-e2bc-4f1a-8623-2d5870a315d6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv\" (UID: \"9803b5bf-e2bc-4f1a-8623-2d5870a315d6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv" Jul 15 21:16:12.919837 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:12.919803 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n4qhx\" (UniqueName: \"kubernetes.io/projected/9803b5bf-e2bc-4f1a-8623-2d5870a315d6-kube-api-access-n4qhx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv\" (UID: \"9803b5bf-e2bc-4f1a-8623-2d5870a315d6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv" Jul 15 21:16:12.920017 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:12.919906 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9803b5bf-e2bc-4f1a-8623-2d5870a315d6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv\" (UID: \"9803b5bf-e2bc-4f1a-8623-2d5870a315d6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv" Jul 15 21:16:13.021081 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.021043 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9803b5bf-e2bc-4f1a-8623-2d5870a315d6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv\" (UID: \"9803b5bf-e2bc-4f1a-8623-2d5870a315d6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv" Jul 15 21:16:13.021518 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.021091 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n4qhx\" (UniqueName: \"kubernetes.io/projected/9803b5bf-e2bc-4f1a-8623-2d5870a315d6-kube-api-access-n4qhx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv\" (UID: \"9803b5bf-e2bc-4f1a-8623-2d5870a315d6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv" Jul 15 21:16:13.021518 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.021178 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9803b5bf-e2bc-4f1a-8623-2d5870a315d6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv\" (UID: \"9803b5bf-e2bc-4f1a-8623-2d5870a315d6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv" Jul 15 21:16:13.021518 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.021493 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9803b5bf-e2bc-4f1a-8623-2d5870a315d6-bundle\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv\" (UID: \"9803b5bf-e2bc-4f1a-8623-2d5870a315d6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv" Jul 15 21:16:13.021668 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.021610 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9803b5bf-e2bc-4f1a-8623-2d5870a315d6-util\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv\" (UID: \"9803b5bf-e2bc-4f1a-8623-2d5870a315d6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv" Jul 15 21:16:13.029582 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.029564 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n4qhx\" (UniqueName: \"kubernetes.io/projected/9803b5bf-e2bc-4f1a-8623-2d5870a315d6-kube-api-access-n4qhx\") pod \"19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv\" (UID: \"9803b5bf-e2bc-4f1a-8623-2d5870a315d6\") " pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv" Jul 15 21:16:13.102669 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.102640 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv" Jul 15 21:16:13.192195 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.192165 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5"] Jul 15 21:16:13.197652 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.197629 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5" Jul 15 21:16:13.206101 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.206033 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5"] Jul 15 21:16:13.235614 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.235592 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv"] Jul 15 21:16:13.238032 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:16:13.238008 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9803b5bf_e2bc_4f1a_8623_2d5870a315d6.slice/crio-ef977ad48c89fb09e8a4bb1c2b18e16ba8714bbcfe5c533de8d95e1cb6d89da4 WatchSource:0}: Error finding container ef977ad48c89fb09e8a4bb1c2b18e16ba8714bbcfe5c533de8d95e1cb6d89da4: Status 404 returned error can't find the container with id ef977ad48c89fb09e8a4bb1c2b18e16ba8714bbcfe5c533de8d95e1cb6d89da4 Jul 15 21:16:13.322904 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.322877 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dt9m4\" (UniqueName: \"kubernetes.io/projected/9eed8dca-392b-4383-bb6c-0a7e52ced5d9-kube-api-access-dt9m4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5\" (UID: \"9eed8dca-392b-4383-bb6c-0a7e52ced5d9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5" Jul 15 21:16:13.323053 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.322934 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9eed8dca-392b-4383-bb6c-0a7e52ced5d9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5\" (UID: \"9eed8dca-392b-4383-bb6c-0a7e52ced5d9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5" Jul 15 21:16:13.323053 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.322956 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9eed8dca-392b-4383-bb6c-0a7e52ced5d9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5\" (UID: \"9eed8dca-392b-4383-bb6c-0a7e52ced5d9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5" Jul 15 21:16:13.423899 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.423872 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dt9m4\" (UniqueName: \"kubernetes.io/projected/9eed8dca-392b-4383-bb6c-0a7e52ced5d9-kube-api-access-dt9m4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5\" (UID: \"9eed8dca-392b-4383-bb6c-0a7e52ced5d9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5" Jul 15 21:16:13.424068 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.423927 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9eed8dca-392b-4383-bb6c-0a7e52ced5d9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5\" (UID: \"9eed8dca-392b-4383-bb6c-0a7e52ced5d9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5" Jul 15 21:16:13.424068 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.423948 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9eed8dca-392b-4383-bb6c-0a7e52ced5d9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5\" (UID: \"9eed8dca-392b-4383-bb6c-0a7e52ced5d9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5" Jul 15 21:16:13.424263 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.424245 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9eed8dca-392b-4383-bb6c-0a7e52ced5d9-bundle\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5\" (UID: \"9eed8dca-392b-4383-bb6c-0a7e52ced5d9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5" Jul 15 21:16:13.424330 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.424290 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9eed8dca-392b-4383-bb6c-0a7e52ced5d9-util\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5\" (UID: \"9eed8dca-392b-4383-bb6c-0a7e52ced5d9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5" Jul 15 21:16:13.431357 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.431332 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dt9m4\" (UniqueName: \"kubernetes.io/projected/9eed8dca-392b-4383-bb6c-0a7e52ced5d9-kube-api-access-dt9m4\") pod \"0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5\" (UID: \"9eed8dca-392b-4383-bb6c-0a7e52ced5d9\") " pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5" Jul 15 21:16:13.509399 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.509366 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5" Jul 15 21:16:13.584925 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.584896 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp"] Jul 15 21:16:13.587472 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.587456 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp" Jul 15 21:16:13.600136 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.600110 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp"] Jul 15 21:16:13.632162 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.632132 2572 generic.go:356] "Generic (PLEG): container finished" podID="121d8874-50cc-40f4-8153-3d81f3e7d4b3" containerID="a452def54a90a875cd475b88ff0c7359b5c0491badea03e189f98e68eb15d5af" exitCode=0 Jul 15 21:16:13.632328 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.632178 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv" event={"ID":"121d8874-50cc-40f4-8153-3d81f3e7d4b3","Type":"ContainerDied","Data":"a452def54a90a875cd475b88ff0c7359b5c0491badea03e189f98e68eb15d5af"} Jul 15 21:16:13.633757 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.633735 2572 generic.go:356] "Generic (PLEG): container finished" podID="9803b5bf-e2bc-4f1a-8623-2d5870a315d6" containerID="5bb6c33aa28cd8e788f19709196adb32c8b85c45c166150e7573585d126fde09" exitCode=0 Jul 15 21:16:13.633830 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.633774 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv" event={"ID":"9803b5bf-e2bc-4f1a-8623-2d5870a315d6","Type":"ContainerDied","Data":"5bb6c33aa28cd8e788f19709196adb32c8b85c45c166150e7573585d126fde09"} Jul 15 21:16:13.633830 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.633821 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv" event={"ID":"9803b5bf-e2bc-4f1a-8623-2d5870a315d6","Type":"ContainerStarted","Data":"ef977ad48c89fb09e8a4bb1c2b18e16ba8714bbcfe5c533de8d95e1cb6d89da4"} Jul 15 21:16:13.650909 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.650887 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5"] Jul 15 21:16:13.662568 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:16:13.662546 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9eed8dca_392b_4383_bb6c_0a7e52ced5d9.slice/crio-b44b8c073d2b60ca26ba5e12cce606b9c222ea99ff2c5a3aa11b772528123447 WatchSource:0}: Error finding container b44b8c073d2b60ca26ba5e12cce606b9c222ea99ff2c5a3aa11b772528123447: Status 404 returned error can't find the container with id b44b8c073d2b60ca26ba5e12cce606b9c222ea99ff2c5a3aa11b772528123447 Jul 15 21:16:13.725851 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.725814 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9759e8f-d109-4c83-9f46-fb2468e41bda-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp\" (UID: \"b9759e8f-d109-4c83-9f46-fb2468e41bda\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp" Jul 15 21:16:13.725851 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.725855 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ggbfc\" (UniqueName: \"kubernetes.io/projected/b9759e8f-d109-4c83-9f46-fb2468e41bda-kube-api-access-ggbfc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp\" (UID: \"b9759e8f-d109-4c83-9f46-fb2468e41bda\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp" Jul 15 21:16:13.726053 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.725948 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9759e8f-d109-4c83-9f46-fb2468e41bda-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp\" (UID: \"b9759e8f-d109-4c83-9f46-fb2468e41bda\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp" Jul 15 21:16:13.827268 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.827238 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9759e8f-d109-4c83-9f46-fb2468e41bda-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp\" (UID: \"b9759e8f-d109-4c83-9f46-fb2468e41bda\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp" Jul 15 21:16:13.827407 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.827273 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ggbfc\" (UniqueName: \"kubernetes.io/projected/b9759e8f-d109-4c83-9f46-fb2468e41bda-kube-api-access-ggbfc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp\" (UID: \"b9759e8f-d109-4c83-9f46-fb2468e41bda\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp" Jul 15 21:16:13.827407 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.827330 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9759e8f-d109-4c83-9f46-fb2468e41bda-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp\" (UID: \"b9759e8f-d109-4c83-9f46-fb2468e41bda\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp" Jul 15 21:16:13.827692 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.827669 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9759e8f-d109-4c83-9f46-fb2468e41bda-bundle\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp\" (UID: \"b9759e8f-d109-4c83-9f46-fb2468e41bda\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp" Jul 15 21:16:13.827692 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.827687 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9759e8f-d109-4c83-9f46-fb2468e41bda-util\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp\" (UID: \"b9759e8f-d109-4c83-9f46-fb2468e41bda\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp" Jul 15 21:16:13.835164 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.835143 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ggbfc\" (UniqueName: \"kubernetes.io/projected/b9759e8f-d109-4c83-9f46-fb2468e41bda-kube-api-access-ggbfc\") pod \"9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp\" (UID: \"b9759e8f-d109-4c83-9f46-fb2468e41bda\") " pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp" Jul 15 21:16:13.901834 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:13.901802 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp" Jul 15 21:16:14.029704 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:14.029678 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp"] Jul 15 21:16:14.031840 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:16:14.031813 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9759e8f_d109_4c83_9f46_fb2468e41bda.slice/crio-b03296abf5f1020ac9a26b627590f8fe3ff6def5e796655018c070ff9511a3ff WatchSource:0}: Error finding container b03296abf5f1020ac9a26b627590f8fe3ff6def5e796655018c070ff9511a3ff: Status 404 returned error can't find the container with id b03296abf5f1020ac9a26b627590f8fe3ff6def5e796655018c070ff9511a3ff Jul 15 21:16:14.641444 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:14.641362 2572 generic.go:356] "Generic (PLEG): container finished" podID="121d8874-50cc-40f4-8153-3d81f3e7d4b3" containerID="dd00b6744c7cfdf82f442cc4a82a244c4a7f78cb87f4af659090b14920fe617c" exitCode=0 Jul 15 21:16:14.641444 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:14.641431 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv" event={"ID":"121d8874-50cc-40f4-8153-3d81f3e7d4b3","Type":"ContainerDied","Data":"dd00b6744c7cfdf82f442cc4a82a244c4a7f78cb87f4af659090b14920fe617c"} Jul 15 21:16:14.642780 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:14.642750 2572 generic.go:356] "Generic (PLEG): container finished" podID="b9759e8f-d109-4c83-9f46-fb2468e41bda" containerID="f2189f6ffcbc2c8dd8b3dd8d8dc4df3823e599f4d858028712dc3efeda26c9e2" exitCode=0 Jul 15 21:16:14.642894 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:14.642829 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp" event={"ID":"b9759e8f-d109-4c83-9f46-fb2468e41bda","Type":"ContainerDied","Data":"f2189f6ffcbc2c8dd8b3dd8d8dc4df3823e599f4d858028712dc3efeda26c9e2"} Jul 15 21:16:14.642894 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:14.642871 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp" event={"ID":"b9759e8f-d109-4c83-9f46-fb2468e41bda","Type":"ContainerStarted","Data":"b03296abf5f1020ac9a26b627590f8fe3ff6def5e796655018c070ff9511a3ff"} Jul 15 21:16:14.644793 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:14.644769 2572 generic.go:356] "Generic (PLEG): container finished" podID="9803b5bf-e2bc-4f1a-8623-2d5870a315d6" containerID="1700a24608f0bc3402e1365527ae03ef883b6db890e361bf3b9834a256447ed2" exitCode=0 Jul 15 21:16:14.644897 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:14.644852 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv" event={"ID":"9803b5bf-e2bc-4f1a-8623-2d5870a315d6","Type":"ContainerDied","Data":"1700a24608f0bc3402e1365527ae03ef883b6db890e361bf3b9834a256447ed2"} Jul 15 21:16:14.646395 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:14.646378 2572 generic.go:356] "Generic (PLEG): container finished" podID="9eed8dca-392b-4383-bb6c-0a7e52ced5d9" containerID="db8534a38053fd668b05dd77d909812d102d9845a9fbf254125cb395deb0e843" exitCode=0 Jul 15 21:16:14.646452 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:14.646436 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5" event={"ID":"9eed8dca-392b-4383-bb6c-0a7e52ced5d9","Type":"ContainerDied","Data":"db8534a38053fd668b05dd77d909812d102d9845a9fbf254125cb395deb0e843"} Jul 15 21:16:14.646486 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:14.646465 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5" event={"ID":"9eed8dca-392b-4383-bb6c-0a7e52ced5d9","Type":"ContainerStarted","Data":"b44b8c073d2b60ca26ba5e12cce606b9c222ea99ff2c5a3aa11b772528123447"} Jul 15 21:16:15.655984 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:15.655961 2572 generic.go:356] "Generic (PLEG): container finished" podID="9803b5bf-e2bc-4f1a-8623-2d5870a315d6" containerID="35b2072f01fd6448db4f59b90c7307a2eb23f1f6259e4c64fcd744a24f4cb428" exitCode=0 Jul 15 21:16:15.656292 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:15.656035 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv" event={"ID":"9803b5bf-e2bc-4f1a-8623-2d5870a315d6","Type":"ContainerDied","Data":"35b2072f01fd6448db4f59b90c7307a2eb23f1f6259e4c64fcd744a24f4cb428"} Jul 15 21:16:15.862557 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:15.862479 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv" Jul 15 21:16:15.944187 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:15.944156 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/121d8874-50cc-40f4-8153-3d81f3e7d4b3-bundle\") pod \"121d8874-50cc-40f4-8153-3d81f3e7d4b3\" (UID: \"121d8874-50cc-40f4-8153-3d81f3e7d4b3\") " Jul 15 21:16:15.944336 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:15.944217 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/121d8874-50cc-40f4-8153-3d81f3e7d4b3-util\") pod \"121d8874-50cc-40f4-8153-3d81f3e7d4b3\" (UID: \"121d8874-50cc-40f4-8153-3d81f3e7d4b3\") " Jul 15 21:16:15.944336 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:15.944271 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2sh8k\" (UniqueName: \"kubernetes.io/projected/121d8874-50cc-40f4-8153-3d81f3e7d4b3-kube-api-access-2sh8k\") pod \"121d8874-50cc-40f4-8153-3d81f3e7d4b3\" (UID: \"121d8874-50cc-40f4-8153-3d81f3e7d4b3\") " Jul 15 21:16:15.944716 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:15.944692 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/121d8874-50cc-40f4-8153-3d81f3e7d4b3-bundle" (OuterVolumeSpecName: "bundle") pod "121d8874-50cc-40f4-8153-3d81f3e7d4b3" (UID: "121d8874-50cc-40f4-8153-3d81f3e7d4b3"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:16:15.946368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:15.946344 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/121d8874-50cc-40f4-8153-3d81f3e7d4b3-kube-api-access-2sh8k" (OuterVolumeSpecName: "kube-api-access-2sh8k") pod "121d8874-50cc-40f4-8153-3d81f3e7d4b3" (UID: "121d8874-50cc-40f4-8153-3d81f3e7d4b3"). InnerVolumeSpecName "kube-api-access-2sh8k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:16:15.949332 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:15.949310 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/121d8874-50cc-40f4-8153-3d81f3e7d4b3-util" (OuterVolumeSpecName: "util") pod "121d8874-50cc-40f4-8153-3d81f3e7d4b3" (UID: "121d8874-50cc-40f4-8153-3d81f3e7d4b3"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:16:16.045747 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:16.045719 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/121d8874-50cc-40f4-8153-3d81f3e7d4b3-bundle\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:16:16.045747 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:16.045744 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/121d8874-50cc-40f4-8153-3d81f3e7d4b3-util\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:16:16.045936 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:16.045757 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2sh8k\" (UniqueName: \"kubernetes.io/projected/121d8874-50cc-40f4-8153-3d81f3e7d4b3-kube-api-access-2sh8k\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:16:16.663226 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:16.663200 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv" Jul 15 21:16:16.663613 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:16.663204 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv" event={"ID":"121d8874-50cc-40f4-8153-3d81f3e7d4b3","Type":"ContainerDied","Data":"dcbedf161768b623738f46eaeeb2132f4db2055295dc4a83955f993776c824db"} Jul 15 21:16:16.663613 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:16.663319 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="dcbedf161768b623738f46eaeeb2132f4db2055295dc4a83955f993776c824db" Jul 15 21:16:16.665082 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:16.665058 2572 generic.go:356] "Generic (PLEG): container finished" podID="b9759e8f-d109-4c83-9f46-fb2468e41bda" containerID="2593894aaa2430e3ee056cff1a4139f5f80df542b63e46e5769b3830ea95b06c" exitCode=0 Jul 15 21:16:16.665226 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:16.665161 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp" event={"ID":"b9759e8f-d109-4c83-9f46-fb2468e41bda","Type":"ContainerDied","Data":"2593894aaa2430e3ee056cff1a4139f5f80df542b63e46e5769b3830ea95b06c"} Jul 15 21:16:16.667155 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:16.667134 2572 generic.go:356] "Generic (PLEG): container finished" podID="9eed8dca-392b-4383-bb6c-0a7e52ced5d9" containerID="67377e62bef8e5e64af8cbbcc900f926e45fab974f3997da76e2d0e9c910b2f9" exitCode=0 Jul 15 21:16:16.667241 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:16.667208 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5" event={"ID":"9eed8dca-392b-4383-bb6c-0a7e52ced5d9","Type":"ContainerDied","Data":"67377e62bef8e5e64af8cbbcc900f926e45fab974f3997da76e2d0e9c910b2f9"} Jul 15 21:16:16.815416 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:16.815388 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv" Jul 15 21:16:16.953236 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:16.953158 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-n4qhx\" (UniqueName: \"kubernetes.io/projected/9803b5bf-e2bc-4f1a-8623-2d5870a315d6-kube-api-access-n4qhx\") pod \"9803b5bf-e2bc-4f1a-8623-2d5870a315d6\" (UID: \"9803b5bf-e2bc-4f1a-8623-2d5870a315d6\") " Jul 15 21:16:16.953236 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:16.953207 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9803b5bf-e2bc-4f1a-8623-2d5870a315d6-util\") pod \"9803b5bf-e2bc-4f1a-8623-2d5870a315d6\" (UID: \"9803b5bf-e2bc-4f1a-8623-2d5870a315d6\") " Jul 15 21:16:16.953391 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:16.953324 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9803b5bf-e2bc-4f1a-8623-2d5870a315d6-bundle\") pod \"9803b5bf-e2bc-4f1a-8623-2d5870a315d6\" (UID: \"9803b5bf-e2bc-4f1a-8623-2d5870a315d6\") " Jul 15 21:16:16.953846 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:16.953818 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9803b5bf-e2bc-4f1a-8623-2d5870a315d6-bundle" (OuterVolumeSpecName: "bundle") pod "9803b5bf-e2bc-4f1a-8623-2d5870a315d6" (UID: "9803b5bf-e2bc-4f1a-8623-2d5870a315d6"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:16:16.955223 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:16.955198 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9803b5bf-e2bc-4f1a-8623-2d5870a315d6-kube-api-access-n4qhx" (OuterVolumeSpecName: "kube-api-access-n4qhx") pod "9803b5bf-e2bc-4f1a-8623-2d5870a315d6" (UID: "9803b5bf-e2bc-4f1a-8623-2d5870a315d6"). InnerVolumeSpecName "kube-api-access-n4qhx". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:16:16.958867 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:16.958836 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9803b5bf-e2bc-4f1a-8623-2d5870a315d6-util" (OuterVolumeSpecName: "util") pod "9803b5bf-e2bc-4f1a-8623-2d5870a315d6" (UID: "9803b5bf-e2bc-4f1a-8623-2d5870a315d6"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:16:17.054914 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:17.054878 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9803b5bf-e2bc-4f1a-8623-2d5870a315d6-util\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:16:17.054914 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:17.054908 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9803b5bf-e2bc-4f1a-8623-2d5870a315d6-bundle\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:16:17.054914 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:17.054916 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-n4qhx\" (UniqueName: \"kubernetes.io/projected/9803b5bf-e2bc-4f1a-8623-2d5870a315d6-kube-api-access-n4qhx\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:16:17.674864 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:17.674836 2572 generic.go:356] "Generic (PLEG): container finished" podID="b9759e8f-d109-4c83-9f46-fb2468e41bda" containerID="e1cee417fa540231d5c0d8b470e50cddaa8c08c46a384485ec57fe58f1d93d73" exitCode=0 Jul 15 21:16:17.675245 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:17.674918 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp" event={"ID":"b9759e8f-d109-4c83-9f46-fb2468e41bda","Type":"ContainerDied","Data":"e1cee417fa540231d5c0d8b470e50cddaa8c08c46a384485ec57fe58f1d93d73"} Jul 15 21:16:17.676703 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:17.676686 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv" Jul 15 21:16:17.676810 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:17.676683 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv" event={"ID":"9803b5bf-e2bc-4f1a-8623-2d5870a315d6","Type":"ContainerDied","Data":"ef977ad48c89fb09e8a4bb1c2b18e16ba8714bbcfe5c533de8d95e1cb6d89da4"} Jul 15 21:16:17.676810 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:17.676787 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="ef977ad48c89fb09e8a4bb1c2b18e16ba8714bbcfe5c533de8d95e1cb6d89da4" Jul 15 21:16:17.678706 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:17.678683 2572 generic.go:356] "Generic (PLEG): container finished" podID="9eed8dca-392b-4383-bb6c-0a7e52ced5d9" containerID="ad7b561a1d490316e2ddc1ec95613379d342db56370b38003fd42c719a04549a" exitCode=0 Jul 15 21:16:17.678807 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:17.678766 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5" event={"ID":"9eed8dca-392b-4383-bb6c-0a7e52ced5d9","Type":"ContainerDied","Data":"ad7b561a1d490316e2ddc1ec95613379d342db56370b38003fd42c719a04549a"} Jul 15 21:16:18.839174 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:18.839153 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5" Jul 15 21:16:18.841219 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:18.841201 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp" Jul 15 21:16:18.969804 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:18.969726 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9759e8f-d109-4c83-9f46-fb2468e41bda-bundle\") pod \"b9759e8f-d109-4c83-9f46-fb2468e41bda\" (UID: \"b9759e8f-d109-4c83-9f46-fb2468e41bda\") " Jul 15 21:16:18.969804 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:18.969798 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9759e8f-d109-4c83-9f46-fb2468e41bda-util\") pod \"b9759e8f-d109-4c83-9f46-fb2468e41bda\" (UID: \"b9759e8f-d109-4c83-9f46-fb2468e41bda\") " Jul 15 21:16:18.969995 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:18.969823 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9eed8dca-392b-4383-bb6c-0a7e52ced5d9-util\") pod \"9eed8dca-392b-4383-bb6c-0a7e52ced5d9\" (UID: \"9eed8dca-392b-4383-bb6c-0a7e52ced5d9\") " Jul 15 21:16:18.969995 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:18.969874 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-ggbfc\" (UniqueName: \"kubernetes.io/projected/b9759e8f-d109-4c83-9f46-fb2468e41bda-kube-api-access-ggbfc\") pod \"b9759e8f-d109-4c83-9f46-fb2468e41bda\" (UID: \"b9759e8f-d109-4c83-9f46-fb2468e41bda\") " Jul 15 21:16:18.969995 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:18.969914 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dt9m4\" (UniqueName: \"kubernetes.io/projected/9eed8dca-392b-4383-bb6c-0a7e52ced5d9-kube-api-access-dt9m4\") pod \"9eed8dca-392b-4383-bb6c-0a7e52ced5d9\" (UID: \"9eed8dca-392b-4383-bb6c-0a7e52ced5d9\") " Jul 15 21:16:18.969995 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:18.969942 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9eed8dca-392b-4383-bb6c-0a7e52ced5d9-bundle\") pod \"9eed8dca-392b-4383-bb6c-0a7e52ced5d9\" (UID: \"9eed8dca-392b-4383-bb6c-0a7e52ced5d9\") " Jul 15 21:16:18.970409 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:18.970382 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9759e8f-d109-4c83-9f46-fb2468e41bda-bundle" (OuterVolumeSpecName: "bundle") pod "b9759e8f-d109-4c83-9f46-fb2468e41bda" (UID: "b9759e8f-d109-4c83-9f46-fb2468e41bda"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:16:18.970517 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:18.970427 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eed8dca-392b-4383-bb6c-0a7e52ced5d9-bundle" (OuterVolumeSpecName: "bundle") pod "9eed8dca-392b-4383-bb6c-0a7e52ced5d9" (UID: "9eed8dca-392b-4383-bb6c-0a7e52ced5d9"). InnerVolumeSpecName "bundle". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:16:18.972460 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:18.972435 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b9759e8f-d109-4c83-9f46-fb2468e41bda-kube-api-access-ggbfc" (OuterVolumeSpecName: "kube-api-access-ggbfc") pod "b9759e8f-d109-4c83-9f46-fb2468e41bda" (UID: "b9759e8f-d109-4c83-9f46-fb2468e41bda"). InnerVolumeSpecName "kube-api-access-ggbfc". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:16:18.972580 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:18.972499 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9eed8dca-392b-4383-bb6c-0a7e52ced5d9-kube-api-access-dt9m4" (OuterVolumeSpecName: "kube-api-access-dt9m4") pod "9eed8dca-392b-4383-bb6c-0a7e52ced5d9" (UID: "9eed8dca-392b-4383-bb6c-0a7e52ced5d9"). InnerVolumeSpecName "kube-api-access-dt9m4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:16:18.976263 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:18.976225 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b9759e8f-d109-4c83-9f46-fb2468e41bda-util" (OuterVolumeSpecName: "util") pod "b9759e8f-d109-4c83-9f46-fb2468e41bda" (UID: "b9759e8f-d109-4c83-9f46-fb2468e41bda"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:16:18.976497 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:18.976476 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9eed8dca-392b-4383-bb6c-0a7e52ced5d9-util" (OuterVolumeSpecName: "util") pod "9eed8dca-392b-4383-bb6c-0a7e52ced5d9" (UID: "9eed8dca-392b-4383-bb6c-0a7e52ced5d9"). InnerVolumeSpecName "util". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:16:19.071474 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:19.071439 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/b9759e8f-d109-4c83-9f46-fb2468e41bda-util\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:16:19.071474 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:19.071471 2572 reconciler_common.go:299] "Volume detached for volume \"util\" (UniqueName: \"kubernetes.io/empty-dir/9eed8dca-392b-4383-bb6c-0a7e52ced5d9-util\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:16:19.071684 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:19.071484 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-ggbfc\" (UniqueName: \"kubernetes.io/projected/b9759e8f-d109-4c83-9f46-fb2468e41bda-kube-api-access-ggbfc\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:16:19.071684 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:19.071497 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dt9m4\" (UniqueName: \"kubernetes.io/projected/9eed8dca-392b-4383-bb6c-0a7e52ced5d9-kube-api-access-dt9m4\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:16:19.071684 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:19.071510 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/9eed8dca-392b-4383-bb6c-0a7e52ced5d9-bundle\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:16:19.071684 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:19.071521 2572 reconciler_common.go:299] "Volume detached for volume \"bundle\" (UniqueName: \"kubernetes.io/empty-dir/b9759e8f-d109-4c83-9f46-fb2468e41bda-bundle\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:16:19.690567 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:19.690518 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp" Jul 15 21:16:19.690567 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:19.690541 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp" event={"ID":"b9759e8f-d109-4c83-9f46-fb2468e41bda","Type":"ContainerDied","Data":"b03296abf5f1020ac9a26b627590f8fe3ff6def5e796655018c070ff9511a3ff"} Jul 15 21:16:19.690814 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:19.690586 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b03296abf5f1020ac9a26b627590f8fe3ff6def5e796655018c070ff9511a3ff" Jul 15 21:16:19.692449 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:19.692418 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5" event={"ID":"9eed8dca-392b-4383-bb6c-0a7e52ced5d9","Type":"ContainerDied","Data":"b44b8c073d2b60ca26ba5e12cce606b9c222ea99ff2c5a3aa11b772528123447"} Jul 15 21:16:19.692449 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:19.692431 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5" Jul 15 21:16:19.692449 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:19.692450 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b44b8c073d2b60ca26ba5e12cce606b9c222ea99ff2c5a3aa11b772528123447" Jul 15 21:16:34.531554 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.531505 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw"] Jul 15 21:16:34.531925 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.531864 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9759e8f-d109-4c83-9f46-fb2468e41bda" containerName="util" Jul 15 21:16:34.531925 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.531875 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9759e8f-d109-4c83-9f46-fb2468e41bda" containerName="util" Jul 15 21:16:34.531925 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.531883 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9eed8dca-392b-4383-bb6c-0a7e52ced5d9" containerName="pull" Jul 15 21:16:34.531925 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.531888 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9eed8dca-392b-4383-bb6c-0a7e52ced5d9" containerName="pull" Jul 15 21:16:34.531925 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.531895 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9759e8f-d109-4c83-9f46-fb2468e41bda" containerName="pull" Jul 15 21:16:34.531925 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.531901 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9759e8f-d109-4c83-9f46-fb2468e41bda" containerName="pull" Jul 15 21:16:34.531925 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.531912 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9803b5bf-e2bc-4f1a-8623-2d5870a315d6" containerName="util" Jul 15 21:16:34.531925 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.531917 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9803b5bf-e2bc-4f1a-8623-2d5870a315d6" containerName="util" Jul 15 21:16:34.531925 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.531923 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9803b5bf-e2bc-4f1a-8623-2d5870a315d6" containerName="extract" Jul 15 21:16:34.531925 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.531928 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9803b5bf-e2bc-4f1a-8623-2d5870a315d6" containerName="extract" Jul 15 21:16:34.532270 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.531937 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="121d8874-50cc-40f4-8153-3d81f3e7d4b3" containerName="pull" Jul 15 21:16:34.532270 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.531942 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="121d8874-50cc-40f4-8153-3d81f3e7d4b3" containerName="pull" Jul 15 21:16:34.532270 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.531947 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b9759e8f-d109-4c83-9f46-fb2468e41bda" containerName="extract" Jul 15 21:16:34.532270 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.531952 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b9759e8f-d109-4c83-9f46-fb2468e41bda" containerName="extract" Jul 15 21:16:34.532270 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.531958 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9eed8dca-392b-4383-bb6c-0a7e52ced5d9" containerName="extract" Jul 15 21:16:34.532270 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.531963 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9eed8dca-392b-4383-bb6c-0a7e52ced5d9" containerName="extract" Jul 15 21:16:34.532270 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.531971 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="121d8874-50cc-40f4-8153-3d81f3e7d4b3" containerName="extract" Jul 15 21:16:34.532270 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.531976 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="121d8874-50cc-40f4-8153-3d81f3e7d4b3" containerName="extract" Jul 15 21:16:34.532270 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.531983 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9803b5bf-e2bc-4f1a-8623-2d5870a315d6" containerName="pull" Jul 15 21:16:34.532270 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.531988 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9803b5bf-e2bc-4f1a-8623-2d5870a315d6" containerName="pull" Jul 15 21:16:34.532270 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.532000 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="121d8874-50cc-40f4-8153-3d81f3e7d4b3" containerName="util" Jul 15 21:16:34.532270 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.532005 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="121d8874-50cc-40f4-8153-3d81f3e7d4b3" containerName="util" Jul 15 21:16:34.532270 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.532010 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9eed8dca-392b-4383-bb6c-0a7e52ced5d9" containerName="util" Jul 15 21:16:34.532270 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.532015 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="9eed8dca-392b-4383-bb6c-0a7e52ced5d9" containerName="util" Jul 15 21:16:34.532270 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.532060 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="121d8874-50cc-40f4-8153-3d81f3e7d4b3" containerName="extract" Jul 15 21:16:34.532270 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.532069 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9eed8dca-392b-4383-bb6c-0a7e52ced5d9" containerName="extract" Jul 15 21:16:34.532270 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.532076 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="9803b5bf-e2bc-4f1a-8623-2d5870a315d6" containerName="extract" Jul 15 21:16:34.532270 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.532082 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b9759e8f-d109-4c83-9f46-fb2468e41bda" containerName="extract" Jul 15 21:16:34.535216 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.535201 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw" Jul 15 21:16:34.538906 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.538884 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jm226\"" Jul 15 21:16:34.539352 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.539335 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 21:16:34.539824 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.539807 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 21:16:34.551697 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.551669 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw"] Jul 15 21:16:34.610511 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.610476 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7hsrl\" (UniqueName: \"kubernetes.io/projected/72a60dde-536e-4e4c-af82-464d3feb1c8c-kube-api-access-7hsrl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tmtjw\" (UID: \"72a60dde-536e-4e4c-af82-464d3feb1c8c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw" Jul 15 21:16:34.610666 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.610558 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72a60dde-536e-4e4c-af82-464d3feb1c8c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tmtjw\" (UID: \"72a60dde-536e-4e4c-af82-464d3feb1c8c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw" Jul 15 21:16:34.711479 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.711434 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72a60dde-536e-4e4c-af82-464d3feb1c8c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tmtjw\" (UID: \"72a60dde-536e-4e4c-af82-464d3feb1c8c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw" Jul 15 21:16:34.711663 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.711518 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7hsrl\" (UniqueName: \"kubernetes.io/projected/72a60dde-536e-4e4c-af82-464d3feb1c8c-kube-api-access-7hsrl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tmtjw\" (UID: \"72a60dde-536e-4e4c-af82-464d3feb1c8c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw" Jul 15 21:16:34.711827 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.711807 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72a60dde-536e-4e4c-af82-464d3feb1c8c-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tmtjw\" (UID: \"72a60dde-536e-4e4c-af82-464d3feb1c8c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw" Jul 15 21:16:34.725592 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.725564 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7hsrl\" (UniqueName: \"kubernetes.io/projected/72a60dde-536e-4e4c-af82-464d3feb1c8c-kube-api-access-7hsrl\") pod \"kuadrant-operator-controller-manager-8684c9ff49-tmtjw\" (UID: \"72a60dde-536e-4e4c-af82-464d3feb1c8c\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw" Jul 15 21:16:34.845153 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.845126 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw" Jul 15 21:16:34.987051 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:34.987030 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw"] Jul 15 21:16:34.989036 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:16:34.989007 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod72a60dde_536e_4e4c_af82_464d3feb1c8c.slice/crio-b61d8819a046389f59cd9b9a554f364aa5cab7d912409d0f4ac2e19fef2a8fdb WatchSource:0}: Error finding container b61d8819a046389f59cd9b9a554f364aa5cab7d912409d0f4ac2e19fef2a8fdb: Status 404 returned error can't find the container with id b61d8819a046389f59cd9b9a554f364aa5cab7d912409d0f4ac2e19fef2a8fdb Jul 15 21:16:35.781469 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:35.781436 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw" event={"ID":"72a60dde-536e-4e4c-af82-464d3feb1c8c","Type":"ContainerStarted","Data":"b61d8819a046389f59cd9b9a554f364aa5cab7d912409d0f4ac2e19fef2a8fdb"} Jul 15 21:16:40.813988 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:40.813953 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw" event={"ID":"72a60dde-536e-4e4c-af82-464d3feb1c8c","Type":"ContainerStarted","Data":"6507ea928c05039f7dc7caaf14fa51f5487058eea6f75f487ad322616ae87a81"} Jul 15 21:16:40.814404 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:40.814074 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw" Jul 15 21:16:40.841150 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:40.841091 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw" podStartSLOduration=1.470803304 podStartE2EDuration="6.841072464s" totalImagesPullingTime="5.37026916s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:16:34 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:16:40.839281357 +0000 UTC m=+393.660598677" watchObservedRunningTime="2026-07-15 21:16:40.841072464 +0000 UTC m=+393.662389783" Jul 15 21:16:41.929322 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:41.929287 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-6bf989c8d4-p4vwj"] Jul 15 21:16:41.933098 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:41.933082 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:41.945214 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:41.945191 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bf989c8d4-p4vwj"] Jul 15 21:16:41.970001 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:41.969976 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b017cca6-c43c-445f-b664-c1d1cfccdbc9-trusted-ca-bundle\") pod \"console-6bf989c8d4-p4vwj\" (UID: \"b017cca6-c43c-445f-b664-c1d1cfccdbc9\") " pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:41.970145 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:41.970010 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b017cca6-c43c-445f-b664-c1d1cfccdbc9-console-serving-cert\") pod \"console-6bf989c8d4-p4vwj\" (UID: \"b017cca6-c43c-445f-b664-c1d1cfccdbc9\") " pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:41.970145 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:41.970034 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b017cca6-c43c-445f-b664-c1d1cfccdbc9-console-oauth-config\") pod \"console-6bf989c8d4-p4vwj\" (UID: \"b017cca6-c43c-445f-b664-c1d1cfccdbc9\") " pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:41.970145 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:41.970049 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ghsrh\" (UniqueName: \"kubernetes.io/projected/b017cca6-c43c-445f-b664-c1d1cfccdbc9-kube-api-access-ghsrh\") pod \"console-6bf989c8d4-p4vwj\" (UID: \"b017cca6-c43c-445f-b664-c1d1cfccdbc9\") " pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:41.970145 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:41.970072 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b017cca6-c43c-445f-b664-c1d1cfccdbc9-service-ca\") pod \"console-6bf989c8d4-p4vwj\" (UID: \"b017cca6-c43c-445f-b664-c1d1cfccdbc9\") " pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:41.970145 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:41.970097 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b017cca6-c43c-445f-b664-c1d1cfccdbc9-oauth-serving-cert\") pod \"console-6bf989c8d4-p4vwj\" (UID: \"b017cca6-c43c-445f-b664-c1d1cfccdbc9\") " pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:41.970345 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:41.970147 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b017cca6-c43c-445f-b664-c1d1cfccdbc9-console-config\") pod \"console-6bf989c8d4-p4vwj\" (UID: \"b017cca6-c43c-445f-b664-c1d1cfccdbc9\") " pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:42.071673 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:42.071631 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b017cca6-c43c-445f-b664-c1d1cfccdbc9-trusted-ca-bundle\") pod \"console-6bf989c8d4-p4vwj\" (UID: \"b017cca6-c43c-445f-b664-c1d1cfccdbc9\") " pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:42.071673 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:42.071679 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b017cca6-c43c-445f-b664-c1d1cfccdbc9-console-serving-cert\") pod \"console-6bf989c8d4-p4vwj\" (UID: \"b017cca6-c43c-445f-b664-c1d1cfccdbc9\") " pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:42.071904 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:42.071710 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b017cca6-c43c-445f-b664-c1d1cfccdbc9-console-oauth-config\") pod \"console-6bf989c8d4-p4vwj\" (UID: \"b017cca6-c43c-445f-b664-c1d1cfccdbc9\") " pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:42.071904 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:42.071734 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ghsrh\" (UniqueName: \"kubernetes.io/projected/b017cca6-c43c-445f-b664-c1d1cfccdbc9-kube-api-access-ghsrh\") pod \"console-6bf989c8d4-p4vwj\" (UID: \"b017cca6-c43c-445f-b664-c1d1cfccdbc9\") " pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:42.071904 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:42.071758 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b017cca6-c43c-445f-b664-c1d1cfccdbc9-service-ca\") pod \"console-6bf989c8d4-p4vwj\" (UID: \"b017cca6-c43c-445f-b664-c1d1cfccdbc9\") " pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:42.071904 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:42.071781 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b017cca6-c43c-445f-b664-c1d1cfccdbc9-oauth-serving-cert\") pod \"console-6bf989c8d4-p4vwj\" (UID: \"b017cca6-c43c-445f-b664-c1d1cfccdbc9\") " pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:42.071904 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:42.071821 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b017cca6-c43c-445f-b664-c1d1cfccdbc9-console-config\") pod \"console-6bf989c8d4-p4vwj\" (UID: \"b017cca6-c43c-445f-b664-c1d1cfccdbc9\") " pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:42.072659 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:42.072625 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/b017cca6-c43c-445f-b664-c1d1cfccdbc9-oauth-serving-cert\") pod \"console-6bf989c8d4-p4vwj\" (UID: \"b017cca6-c43c-445f-b664-c1d1cfccdbc9\") " pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:42.072776 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:42.072752 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/b017cca6-c43c-445f-b664-c1d1cfccdbc9-console-config\") pod \"console-6bf989c8d4-p4vwj\" (UID: \"b017cca6-c43c-445f-b664-c1d1cfccdbc9\") " pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:42.072851 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:42.072795 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/b017cca6-c43c-445f-b664-c1d1cfccdbc9-trusted-ca-bundle\") pod \"console-6bf989c8d4-p4vwj\" (UID: \"b017cca6-c43c-445f-b664-c1d1cfccdbc9\") " pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:42.072911 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:42.072857 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/b017cca6-c43c-445f-b664-c1d1cfccdbc9-service-ca\") pod \"console-6bf989c8d4-p4vwj\" (UID: \"b017cca6-c43c-445f-b664-c1d1cfccdbc9\") " pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:42.074449 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:42.074420 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/b017cca6-c43c-445f-b664-c1d1cfccdbc9-console-serving-cert\") pod \"console-6bf989c8d4-p4vwj\" (UID: \"b017cca6-c43c-445f-b664-c1d1cfccdbc9\") " pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:42.074551 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:42.074508 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/b017cca6-c43c-445f-b664-c1d1cfccdbc9-console-oauth-config\") pod \"console-6bf989c8d4-p4vwj\" (UID: \"b017cca6-c43c-445f-b664-c1d1cfccdbc9\") " pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:42.079662 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:42.079645 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ghsrh\" (UniqueName: \"kubernetes.io/projected/b017cca6-c43c-445f-b664-c1d1cfccdbc9-kube-api-access-ghsrh\") pod \"console-6bf989c8d4-p4vwj\" (UID: \"b017cca6-c43c-445f-b664-c1d1cfccdbc9\") " pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:42.243129 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:42.243044 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:42.385396 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:42.385342 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-6bf989c8d4-p4vwj"] Jul 15 21:16:42.390221 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:16:42.390189 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb017cca6_c43c_445f_b664_c1d1cfccdbc9.slice/crio-dafab731178de51f84182d64d506762f1e4e61659cae33e34140bc5b860c27b5 WatchSource:0}: Error finding container dafab731178de51f84182d64d506762f1e4e61659cae33e34140bc5b860c27b5: Status 404 returned error can't find the container with id dafab731178de51f84182d64d506762f1e4e61659cae33e34140bc5b860c27b5 Jul 15 21:16:42.826095 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:42.826057 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bf989c8d4-p4vwj" event={"ID":"b017cca6-c43c-445f-b664-c1d1cfccdbc9","Type":"ContainerStarted","Data":"06aac8b683c6aca0755baf9b071b3c1917e3c326f0a4f2d2211ed64b441a1ee7"} Jul 15 21:16:42.826326 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:42.826107 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-6bf989c8d4-p4vwj" event={"ID":"b017cca6-c43c-445f-b664-c1d1cfccdbc9","Type":"ContainerStarted","Data":"dafab731178de51f84182d64d506762f1e4e61659cae33e34140bc5b860c27b5"} Jul 15 21:16:42.848111 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:42.848061 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-6bf989c8d4-p4vwj" podStartSLOduration=1.848045621 podStartE2EDuration="1.848045621s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:16:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:16:42.846338154 +0000 UTC m=+395.667655471" watchObservedRunningTime="2026-07-15 21:16:42.848045621 +0000 UTC m=+395.669362937" Jul 15 21:16:51.821381 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:51.821349 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw" Jul 15 21:16:52.243786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:52.243704 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:52.243786 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:52.243779 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:52.248585 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:52.248554 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:52.882397 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:52.882363 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-6bf989c8d4-p4vwj" Jul 15 21:16:52.985227 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:52.985195 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66654797dc-mgpq4"] Jul 15 21:16:53.409710 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.409676 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrbqt"] Jul 15 21:16:53.413003 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.412987 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrbqt" Jul 15 21:16:53.428880 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.428847 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrbqt"] Jul 15 21:16:53.472516 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.472480 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-mrbqt\" (UID: \"1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrbqt" Jul 15 21:16:53.472692 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.472516 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5t8tq\" (UniqueName: \"kubernetes.io/projected/1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e-kube-api-access-5t8tq\") pod \"kuadrant-operator-controller-manager-55467d9f7-mrbqt\" (UID: \"1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrbqt" Jul 15 21:16:53.507868 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.507832 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrbqt"] Jul 15 21:16:53.508130 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:16:53.508110 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-5t8tq], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrbqt" podUID="1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e" Jul 15 21:16:53.573601 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.573564 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-mrbqt\" (UID: \"1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrbqt" Jul 15 21:16:53.573601 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.573606 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5t8tq\" (UniqueName: \"kubernetes.io/projected/1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e-kube-api-access-5t8tq\") pod \"kuadrant-operator-controller-manager-55467d9f7-mrbqt\" (UID: \"1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrbqt" Jul 15 21:16:53.573943 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.573925 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-55467d9f7-mrbqt\" (UID: \"1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrbqt" Jul 15 21:16:53.593853 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.593825 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrbqt"] Jul 15 21:16:53.594385 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.594369 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5t8tq\" (UniqueName: \"kubernetes.io/projected/1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e-kube-api-access-5t8tq\") pod \"kuadrant-operator-controller-manager-55467d9f7-mrbqt\" (UID: \"1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e\") " pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrbqt" Jul 15 21:16:53.602120 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.602096 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrbqt"] Jul 15 21:16:53.613540 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.613498 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw"] Jul 15 21:16:53.613773 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.613733 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw" podUID="72a60dde-536e-4e4c-af82-464d3feb1c8c" containerName="manager" containerID="cri-o://6507ea928c05039f7dc7caaf14fa51f5487058eea6f75f487ad322616ae87a81" gracePeriod=2 Jul 15 21:16:53.620240 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.620216 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw"] Jul 15 21:16:53.655949 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.655920 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486"] Jul 15 21:16:53.656295 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.656283 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="72a60dde-536e-4e4c-af82-464d3feb1c8c" containerName="manager" Jul 15 21:16:53.656341 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.656297 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="72a60dde-536e-4e4c-af82-464d3feb1c8c" containerName="manager" Jul 15 21:16:53.656378 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.656368 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="72a60dde-536e-4e4c-af82-464d3feb1c8c" containerName="manager" Jul 15 21:16:53.658739 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.658715 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486" Jul 15 21:16:53.674082 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.674007 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486"] Jul 15 21:16:53.676724 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.676703 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn"] Jul 15 21:16:53.679384 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.679368 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn" Jul 15 21:16:53.697368 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:16:53.697326 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tmtjw\" is forbidden: User \"system:node:ip-10-0-136-18.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-18.ec2.internal' and this object" podUID="72a60dde-536e-4e4c-af82-464d3feb1c8c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw" Jul 15 21:16:53.699424 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:16:53.699401 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tmtjw\" is forbidden: User \"system:node:ip-10-0-136-18.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-18.ec2.internal' and this object" podUID="72a60dde-536e-4e4c-af82-464d3feb1c8c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw" Jul 15 21:16:53.699581 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.699563 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn"] Jul 15 21:16:53.775892 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.775856 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d92036c-248c-42bd-ab9c-6f40baddd6c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ctmsn\" (UID: \"6d92036c-248c-42bd-ab9c-6f40baddd6c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn" Jul 15 21:16:53.776047 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.775919 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jq5gm\" (UniqueName: \"kubernetes.io/projected/6d92036c-248c-42bd-ab9c-6f40baddd6c1-kube-api-access-jq5gm\") pod \"kuadrant-operator-controller-manager-86878c769f-ctmsn\" (UID: \"6d92036c-248c-42bd-ab9c-6f40baddd6c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn" Jul 15 21:16:53.776047 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.775990 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87dbaca0-a854-4757-8827-0622939af791-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ns486\" (UID: \"87dbaca0-a854-4757-8827-0622939af791\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486" Jul 15 21:16:53.776047 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.776017 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jd4q8\" (UniqueName: \"kubernetes.io/projected/87dbaca0-a854-4757-8827-0622939af791-kube-api-access-jd4q8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ns486\" (UID: \"87dbaca0-a854-4757-8827-0622939af791\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486" Jul 15 21:16:53.847697 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.847673 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw" Jul 15 21:16:53.849974 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:16:53.849950 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tmtjw\" is forbidden: User \"system:node:ip-10-0-136-18.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-18.ec2.internal' and this object" podUID="72a60dde-536e-4e4c-af82-464d3feb1c8c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw" Jul 15 21:16:53.877393 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.877366 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87dbaca0-a854-4757-8827-0622939af791-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ns486\" (UID: \"87dbaca0-a854-4757-8827-0622939af791\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486" Jul 15 21:16:53.877548 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.877401 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jd4q8\" (UniqueName: \"kubernetes.io/projected/87dbaca0-a854-4757-8827-0622939af791-kube-api-access-jd4q8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ns486\" (UID: \"87dbaca0-a854-4757-8827-0622939af791\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486" Jul 15 21:16:53.877548 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.877443 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d92036c-248c-42bd-ab9c-6f40baddd6c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ctmsn\" (UID: \"6d92036c-248c-42bd-ab9c-6f40baddd6c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn" Jul 15 21:16:53.877548 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.877480 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jq5gm\" (UniqueName: \"kubernetes.io/projected/6d92036c-248c-42bd-ab9c-6f40baddd6c1-kube-api-access-jq5gm\") pod \"kuadrant-operator-controller-manager-86878c769f-ctmsn\" (UID: \"6d92036c-248c-42bd-ab9c-6f40baddd6c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn" Jul 15 21:16:53.877831 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.877811 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87dbaca0-a854-4757-8827-0622939af791-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ns486\" (UID: \"87dbaca0-a854-4757-8827-0622939af791\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486" Jul 15 21:16:53.877831 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.877826 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d92036c-248c-42bd-ab9c-6f40baddd6c1-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-ctmsn\" (UID: \"6d92036c-248c-42bd-ab9c-6f40baddd6c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn" Jul 15 21:16:53.884870 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.884848 2572 generic.go:356] "Generic (PLEG): container finished" podID="72a60dde-536e-4e4c-af82-464d3feb1c8c" containerID="6507ea928c05039f7dc7caaf14fa51f5487058eea6f75f487ad322616ae87a81" exitCode=0 Jul 15 21:16:53.885211 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.884888 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw" Jul 15 21:16:53.885211 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.884947 2572 scope.go:117] "RemoveContainer" containerID="6507ea928c05039f7dc7caaf14fa51f5487058eea6f75f487ad322616ae87a81" Jul 15 21:16:53.885211 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.885034 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrbqt" Jul 15 21:16:53.887042 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:16:53.887014 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tmtjw\" is forbidden: User \"system:node:ip-10-0-136-18.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-18.ec2.internal' and this object" podUID="72a60dde-536e-4e4c-af82-464d3feb1c8c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw" Jul 15 21:16:53.888967 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.888946 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jq5gm\" (UniqueName: \"kubernetes.io/projected/6d92036c-248c-42bd-ab9c-6f40baddd6c1-kube-api-access-jq5gm\") pod \"kuadrant-operator-controller-manager-86878c769f-ctmsn\" (UID: \"6d92036c-248c-42bd-ab9c-6f40baddd6c1\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn" Jul 15 21:16:53.889075 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.889008 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jd4q8\" (UniqueName: \"kubernetes.io/projected/87dbaca0-a854-4757-8827-0622939af791-kube-api-access-jd4q8\") pod \"kuadrant-operator-controller-manager-8684c9ff49-ns486\" (UID: \"87dbaca0-a854-4757-8827-0622939af791\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486" Jul 15 21:16:53.889254 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:16:53.889234 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tmtjw\" is forbidden: User \"system:node:ip-10-0-136-18.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-18.ec2.internal' and this object" podUID="72a60dde-536e-4e4c-af82-464d3feb1c8c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw" Jul 15 21:16:53.890902 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:16:53.890879 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-mrbqt\" is forbidden: User \"system:node:ip-10-0-136-18.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-18.ec2.internal' and this object" podUID="1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrbqt" Jul 15 21:16:53.898763 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.898741 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrbqt" Jul 15 21:16:53.900601 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:16:53.900571 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-tmtjw\" is forbidden: User \"system:node:ip-10-0-136-18.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-18.ec2.internal' and this object" podUID="72a60dde-536e-4e4c-af82-464d3feb1c8c" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-tmtjw" Jul 15 21:16:53.901293 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.901279 2572 scope.go:117] "RemoveContainer" containerID="6507ea928c05039f7dc7caaf14fa51f5487058eea6f75f487ad322616ae87a81" Jul 15 21:16:53.901537 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:16:53.901508 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6507ea928c05039f7dc7caaf14fa51f5487058eea6f75f487ad322616ae87a81\": container with ID starting with 6507ea928c05039f7dc7caaf14fa51f5487058eea6f75f487ad322616ae87a81 not found: ID does not exist" containerID="6507ea928c05039f7dc7caaf14fa51f5487058eea6f75f487ad322616ae87a81" Jul 15 21:16:53.901585 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.901548 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6507ea928c05039f7dc7caaf14fa51f5487058eea6f75f487ad322616ae87a81"} err="failed to get container status \"6507ea928c05039f7dc7caaf14fa51f5487058eea6f75f487ad322616ae87a81\": rpc error: code = NotFound desc = could not find container \"6507ea928c05039f7dc7caaf14fa51f5487058eea6f75f487ad322616ae87a81\": container with ID starting with 6507ea928c05039f7dc7caaf14fa51f5487058eea6f75f487ad322616ae87a81 not found: ID does not exist" Jul 15 21:16:53.902121 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:16:53.902104 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-mrbqt\" is forbidden: User \"system:node:ip-10-0-136-18.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-18.ec2.internal' and this object" podUID="1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrbqt" Jul 15 21:16:53.977788 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.977729 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-5t8tq\" (UniqueName: \"kubernetes.io/projected/1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e-kube-api-access-5t8tq\") pod \"1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e\" (UID: \"1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e\") " Jul 15 21:16:53.977788 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.977782 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7hsrl\" (UniqueName: \"kubernetes.io/projected/72a60dde-536e-4e4c-af82-464d3feb1c8c-kube-api-access-7hsrl\") pod \"72a60dde-536e-4e4c-af82-464d3feb1c8c\" (UID: \"72a60dde-536e-4e4c-af82-464d3feb1c8c\") " Jul 15 21:16:53.977964 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.977809 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72a60dde-536e-4e4c-af82-464d3feb1c8c-extensions-socket-volume\") pod \"72a60dde-536e-4e4c-af82-464d3feb1c8c\" (UID: \"72a60dde-536e-4e4c-af82-464d3feb1c8c\") " Jul 15 21:16:53.977964 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.977870 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e-extensions-socket-volume\") pod \"1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e\" (UID: \"1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e\") " Jul 15 21:16:53.978377 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.978154 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e" (UID: "1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:16:53.978491 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.978461 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/72a60dde-536e-4e4c-af82-464d3feb1c8c-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "72a60dde-536e-4e4c-af82-464d3feb1c8c" (UID: "72a60dde-536e-4e4c-af82-464d3feb1c8c"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:16:53.979883 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.979861 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/72a60dde-536e-4e4c-af82-464d3feb1c8c-kube-api-access-7hsrl" (OuterVolumeSpecName: "kube-api-access-7hsrl") pod "72a60dde-536e-4e4c-af82-464d3feb1c8c" (UID: "72a60dde-536e-4e4c-af82-464d3feb1c8c"). InnerVolumeSpecName "kube-api-access-7hsrl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:16:53.980126 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.980105 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e-kube-api-access-5t8tq" (OuterVolumeSpecName: "kube-api-access-5t8tq") pod "1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e" (UID: "1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e"). InnerVolumeSpecName "kube-api-access-5t8tq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:16:53.990288 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.990268 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486" Jul 15 21:16:53.995759 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:53.995742 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn" Jul 15 21:16:54.079747 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:54.079609 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e-extensions-socket-volume\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:16:54.079747 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:54.079641 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-5t8tq\" (UniqueName: \"kubernetes.io/projected/1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e-kube-api-access-5t8tq\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:16:54.079747 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:54.079656 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7hsrl\" (UniqueName: \"kubernetes.io/projected/72a60dde-536e-4e4c-af82-464d3feb1c8c-kube-api-access-7hsrl\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:16:54.079747 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:54.079669 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/72a60dde-536e-4e4c-af82-464d3feb1c8c-extensions-socket-volume\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:16:54.134411 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:54.134384 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486"] Jul 15 21:16:54.136127 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:16:54.136097 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod87dbaca0_a854_4757_8827_0622939af791.slice/crio-01be6ee81879004c2e0e58aa23ecbf3d5f0e3eefc704dad80f26a1f3cd0df88d WatchSource:0}: Error finding container 01be6ee81879004c2e0e58aa23ecbf3d5f0e3eefc704dad80f26a1f3cd0df88d: Status 404 returned error can't find the container with id 01be6ee81879004c2e0e58aa23ecbf3d5f0e3eefc704dad80f26a1f3cd0df88d Jul 15 21:16:54.158194 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:54.158170 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn"] Jul 15 21:16:54.159818 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:16:54.159797 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod6d92036c_248c_42bd_ab9c_6f40baddd6c1.slice/crio-37d108e53f93f1ca8f18b9725f623f22672d5da1d8ebd4cbc9168ca4fc0d0452 WatchSource:0}: Error finding container 37d108e53f93f1ca8f18b9725f623f22672d5da1d8ebd4cbc9168ca4fc0d0452: Status 404 returned error can't find the container with id 37d108e53f93f1ca8f18b9725f623f22672d5da1d8ebd4cbc9168ca4fc0d0452 Jul 15 21:16:54.893723 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:54.893617 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn" event={"ID":"6d92036c-248c-42bd-ab9c-6f40baddd6c1","Type":"ContainerStarted","Data":"89a6afbe90b66a24fff82b790927c5ccd22cc6ff040a5a24c7b9607621aaea14"} Jul 15 21:16:54.893723 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:54.893709 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn" event={"ID":"6d92036c-248c-42bd-ab9c-6f40baddd6c1","Type":"ContainerStarted","Data":"37d108e53f93f1ca8f18b9725f623f22672d5da1d8ebd4cbc9168ca4fc0d0452"} Jul 15 21:16:54.894165 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:54.893736 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn" Jul 15 21:16:54.895223 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:54.895205 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrbqt" Jul 15 21:16:54.895328 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:54.895198 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486" event={"ID":"87dbaca0-a854-4757-8827-0622939af791","Type":"ContainerStarted","Data":"41daa87208776d51414a39b9f078c5c3c3fdb6eebce58e86cee11ff3cd26687b"} Jul 15 21:16:54.895368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:54.895338 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486" Jul 15 21:16:54.895398 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:54.895366 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486" event={"ID":"87dbaca0-a854-4757-8827-0622939af791","Type":"ContainerStarted","Data":"01be6ee81879004c2e0e58aa23ecbf3d5f0e3eefc704dad80f26a1f3cd0df88d"} Jul 15 21:16:54.932936 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:54.932886 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn" podStartSLOduration=1.932871434 podStartE2EDuration="1.932871434s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:16:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:16:54.931237463 +0000 UTC m=+407.752554781" watchObservedRunningTime="2026-07-15 21:16:54.932871434 +0000 UTC m=+407.754188751" Jul 15 21:16:54.941547 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:16:54.941504 2572 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-55467d9f7-mrbqt\" is forbidden: User \"system:node:ip-10-0-136-18.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-136-18.ec2.internal' and this object" podUID="1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e" pod="kuadrant-system/kuadrant-operator-controller-manager-55467d9f7-mrbqt" Jul 15 21:16:54.972769 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:54.972720 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486" podStartSLOduration=1.972702907 podStartE2EDuration="1.972702907s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:16:53 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:16:54.971599698 +0000 UTC m=+407.792917014" watchObservedRunningTime="2026-07-15 21:16:54.972702907 +0000 UTC m=+407.794020223" Jul 15 21:16:55.959895 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:55.959862 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e" path="/var/lib/kubelet/pods/1e9134a2-d5a8-4e77-8cbc-ddcf715aa93e/volumes" Jul 15 21:16:55.960230 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:16:55.960095 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="72a60dde-536e-4e4c-af82-464d3feb1c8c" path="/var/lib/kubelet/pods/72a60dde-536e-4e4c-af82-464d3feb1c8c/volumes" Jul 15 21:17:05.902849 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:05.902819 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn" Jul 15 21:17:05.903225 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:05.902887 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486" Jul 15 21:17:06.008514 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:06.008477 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486"] Jul 15 21:17:06.008771 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:06.008730 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486" podUID="87dbaca0-a854-4757-8827-0622939af791" containerName="manager" containerID="cri-o://41daa87208776d51414a39b9f078c5c3c3fdb6eebce58e86cee11ff3cd26687b" gracePeriod=10 Jul 15 21:17:06.253499 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:06.253468 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486" Jul 15 21:17:06.398104 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:06.398079 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87dbaca0-a854-4757-8827-0622939af791-extensions-socket-volume\") pod \"87dbaca0-a854-4757-8827-0622939af791\" (UID: \"87dbaca0-a854-4757-8827-0622939af791\") " Jul 15 21:17:06.398273 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:06.398183 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jd4q8\" (UniqueName: \"kubernetes.io/projected/87dbaca0-a854-4757-8827-0622939af791-kube-api-access-jd4q8\") pod \"87dbaca0-a854-4757-8827-0622939af791\" (UID: \"87dbaca0-a854-4757-8827-0622939af791\") " Jul 15 21:17:06.398453 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:06.398428 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/87dbaca0-a854-4757-8827-0622939af791-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "87dbaca0-a854-4757-8827-0622939af791" (UID: "87dbaca0-a854-4757-8827-0622939af791"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:17:06.400050 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:06.400027 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/87dbaca0-a854-4757-8827-0622939af791-kube-api-access-jd4q8" (OuterVolumeSpecName: "kube-api-access-jd4q8") pod "87dbaca0-a854-4757-8827-0622939af791" (UID: "87dbaca0-a854-4757-8827-0622939af791"). InnerVolumeSpecName "kube-api-access-jd4q8". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:17:06.499496 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:06.499412 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/87dbaca0-a854-4757-8827-0622939af791-extensions-socket-volume\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:17:06.499496 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:06.499441 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jd4q8\" (UniqueName: \"kubernetes.io/projected/87dbaca0-a854-4757-8827-0622939af791-kube-api-access-jd4q8\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:17:06.958763 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:06.958726 2572 generic.go:356] "Generic (PLEG): container finished" podID="87dbaca0-a854-4757-8827-0622939af791" containerID="41daa87208776d51414a39b9f078c5c3c3fdb6eebce58e86cee11ff3cd26687b" exitCode=0 Jul 15 21:17:06.959185 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:06.958769 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486" Jul 15 21:17:06.959185 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:06.958815 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486" event={"ID":"87dbaca0-a854-4757-8827-0622939af791","Type":"ContainerDied","Data":"41daa87208776d51414a39b9f078c5c3c3fdb6eebce58e86cee11ff3cd26687b"} Jul 15 21:17:06.959185 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:06.958861 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486" event={"ID":"87dbaca0-a854-4757-8827-0622939af791","Type":"ContainerDied","Data":"01be6ee81879004c2e0e58aa23ecbf3d5f0e3eefc704dad80f26a1f3cd0df88d"} Jul 15 21:17:06.959185 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:06.958883 2572 scope.go:117] "RemoveContainer" containerID="41daa87208776d51414a39b9f078c5c3c3fdb6eebce58e86cee11ff3cd26687b" Jul 15 21:17:06.968427 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:06.968411 2572 scope.go:117] "RemoveContainer" containerID="41daa87208776d51414a39b9f078c5c3c3fdb6eebce58e86cee11ff3cd26687b" Jul 15 21:17:06.968705 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:17:06.968687 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"41daa87208776d51414a39b9f078c5c3c3fdb6eebce58e86cee11ff3cd26687b\": container with ID starting with 41daa87208776d51414a39b9f078c5c3c3fdb6eebce58e86cee11ff3cd26687b not found: ID does not exist" containerID="41daa87208776d51414a39b9f078c5c3c3fdb6eebce58e86cee11ff3cd26687b" Jul 15 21:17:06.968766 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:06.968712 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"41daa87208776d51414a39b9f078c5c3c3fdb6eebce58e86cee11ff3cd26687b"} err="failed to get container status \"41daa87208776d51414a39b9f078c5c3c3fdb6eebce58e86cee11ff3cd26687b\": rpc error: code = NotFound desc = could not find container \"41daa87208776d51414a39b9f078c5c3c3fdb6eebce58e86cee11ff3cd26687b\": container with ID starting with 41daa87208776d51414a39b9f078c5c3c3fdb6eebce58e86cee11ff3cd26687b not found: ID does not exist" Jul 15 21:17:06.983024 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:06.983001 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486"] Jul 15 21:17:06.992905 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:06.992881 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-ns486"] Jul 15 21:17:07.961605 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:07.961571 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="87dbaca0-a854-4757-8827-0622939af791" path="/var/lib/kubelet/pods/87dbaca0-a854-4757-8827-0622939af791/volumes" Jul 15 21:17:18.005201 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.005163 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-66654797dc-mgpq4" podUID="e44b3ca8-41b4-450f-93bc-6c8ff6040574" containerName="console" containerID="cri-o://4a37429f06e72591ef7873df949fef0910e85b6bb16677524c2b0d3305f0817d" gracePeriod=15 Jul 15 21:17:18.262885 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.262831 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:17:18.302710 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.302680 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e44b3ca8-41b4-450f-93bc-6c8ff6040574-console-oauth-config\") pod \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " Jul 15 21:17:18.302872 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.302749 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-console-config\") pod \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " Jul 15 21:17:18.302872 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.302780 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-trusted-ca-bundle\") pod \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " Jul 15 21:17:18.302872 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.302796 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e44b3ca8-41b4-450f-93bc-6c8ff6040574-console-serving-cert\") pod \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " Jul 15 21:17:18.302872 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.302824 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-service-ca\") pod \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " Jul 15 21:17:18.302872 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.302863 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-44t8m\" (UniqueName: \"kubernetes.io/projected/e44b3ca8-41b4-450f-93bc-6c8ff6040574-kube-api-access-44t8m\") pod \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " Jul 15 21:17:18.303121 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.302899 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-oauth-serving-cert\") pod \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\" (UID: \"e44b3ca8-41b4-450f-93bc-6c8ff6040574\") " Jul 15 21:17:18.303208 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.303181 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "e44b3ca8-41b4-450f-93bc-6c8ff6040574" (UID: "e44b3ca8-41b4-450f-93bc-6c8ff6040574"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:17:18.303261 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.303182 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-console-config" (OuterVolumeSpecName: "console-config") pod "e44b3ca8-41b4-450f-93bc-6c8ff6040574" (UID: "e44b3ca8-41b4-450f-93bc-6c8ff6040574"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:17:18.303431 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.303405 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "e44b3ca8-41b4-450f-93bc-6c8ff6040574" (UID: "e44b3ca8-41b4-450f-93bc-6c8ff6040574"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:17:18.303588 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.303566 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-service-ca" (OuterVolumeSpecName: "service-ca") pod "e44b3ca8-41b4-450f-93bc-6c8ff6040574" (UID: "e44b3ca8-41b4-450f-93bc-6c8ff6040574"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:17:18.304947 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.304926 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e44b3ca8-41b4-450f-93bc-6c8ff6040574-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "e44b3ca8-41b4-450f-93bc-6c8ff6040574" (UID: "e44b3ca8-41b4-450f-93bc-6c8ff6040574"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:17:18.305031 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.304990 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e44b3ca8-41b4-450f-93bc-6c8ff6040574-kube-api-access-44t8m" (OuterVolumeSpecName: "kube-api-access-44t8m") pod "e44b3ca8-41b4-450f-93bc-6c8ff6040574" (UID: "e44b3ca8-41b4-450f-93bc-6c8ff6040574"). InnerVolumeSpecName "kube-api-access-44t8m". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:17:18.305235 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.305221 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/e44b3ca8-41b4-450f-93bc-6c8ff6040574-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "e44b3ca8-41b4-450f-93bc-6c8ff6040574" (UID: "e44b3ca8-41b4-450f-93bc-6c8ff6040574"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:17:18.404239 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.404209 2572 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-service-ca\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:17:18.404239 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.404235 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-44t8m\" (UniqueName: \"kubernetes.io/projected/e44b3ca8-41b4-450f-93bc-6c8ff6040574-kube-api-access-44t8m\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:17:18.404239 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.404245 2572 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-oauth-serving-cert\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:17:18.404448 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.404254 2572 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/e44b3ca8-41b4-450f-93bc-6c8ff6040574-console-oauth-config\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:17:18.404448 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.404264 2572 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-console-config\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:17:18.404448 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.404274 2572 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e44b3ca8-41b4-450f-93bc-6c8ff6040574-trusted-ca-bundle\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:17:18.404448 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:18.404283 2572 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/e44b3ca8-41b4-450f-93bc-6c8ff6040574-console-serving-cert\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:17:19.019516 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:19.019480 2572 generic.go:356] "Generic (PLEG): container finished" podID="e44b3ca8-41b4-450f-93bc-6c8ff6040574" containerID="4a37429f06e72591ef7873df949fef0910e85b6bb16677524c2b0d3305f0817d" exitCode=0 Jul 15 21:17:19.020033 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:19.019519 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66654797dc-mgpq4" event={"ID":"e44b3ca8-41b4-450f-93bc-6c8ff6040574","Type":"ContainerDied","Data":"4a37429f06e72591ef7873df949fef0910e85b6bb16677524c2b0d3305f0817d"} Jul 15 21:17:19.020033 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:19.019579 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-66654797dc-mgpq4" event={"ID":"e44b3ca8-41b4-450f-93bc-6c8ff6040574","Type":"ContainerDied","Data":"9a89278bebed13c8f7df90fe481dedd86a9a29be394b420bc3ce95cf7d4730bd"} Jul 15 21:17:19.020033 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:19.019598 2572 scope.go:117] "RemoveContainer" containerID="4a37429f06e72591ef7873df949fef0910e85b6bb16677524c2b0d3305f0817d" Jul 15 21:17:19.020033 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:19.019541 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-66654797dc-mgpq4" Jul 15 21:17:19.028721 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:19.028703 2572 scope.go:117] "RemoveContainer" containerID="4a37429f06e72591ef7873df949fef0910e85b6bb16677524c2b0d3305f0817d" Jul 15 21:17:19.028965 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:17:19.028944 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4a37429f06e72591ef7873df949fef0910e85b6bb16677524c2b0d3305f0817d\": container with ID starting with 4a37429f06e72591ef7873df949fef0910e85b6bb16677524c2b0d3305f0817d not found: ID does not exist" containerID="4a37429f06e72591ef7873df949fef0910e85b6bb16677524c2b0d3305f0817d" Jul 15 21:17:19.029031 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:19.028972 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4a37429f06e72591ef7873df949fef0910e85b6bb16677524c2b0d3305f0817d"} err="failed to get container status \"4a37429f06e72591ef7873df949fef0910e85b6bb16677524c2b0d3305f0817d\": rpc error: code = NotFound desc = could not find container \"4a37429f06e72591ef7873df949fef0910e85b6bb16677524c2b0d3305f0817d\": container with ID starting with 4a37429f06e72591ef7873df949fef0910e85b6bb16677524c2b0d3305f0817d not found: ID does not exist" Jul 15 21:17:19.051273 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:19.051250 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-66654797dc-mgpq4"] Jul 15 21:17:19.059104 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:19.059087 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-66654797dc-mgpq4"] Jul 15 21:17:19.960220 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:19.960175 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e44b3ca8-41b4-450f-93bc-6c8ff6040574" path="/var/lib/kubelet/pods/e44b3ca8-41b4-450f-93bc-6c8ff6040574/volumes" Jul 15 21:17:22.463055 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.463020 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5"] Jul 15 21:17:22.463618 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.463599 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="87dbaca0-a854-4757-8827-0622939af791" containerName="manager" Jul 15 21:17:22.463712 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.463620 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="87dbaca0-a854-4757-8827-0622939af791" containerName="manager" Jul 15 21:17:22.463712 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.463638 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e44b3ca8-41b4-450f-93bc-6c8ff6040574" containerName="console" Jul 15 21:17:22.463712 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.463646 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e44b3ca8-41b4-450f-93bc-6c8ff6040574" containerName="console" Jul 15 21:17:22.463863 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.463736 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e44b3ca8-41b4-450f-93bc-6c8ff6040574" containerName="console" Jul 15 21:17:22.463863 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.463754 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="87dbaca0-a854-4757-8827-0622939af791" containerName="manager" Jul 15 21:17:22.466716 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.466694 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.469400 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.469378 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-98fgg\"" Jul 15 21:17:22.484451 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.484431 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5"] Jul 15 21:17:22.539850 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.539815 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c2b87e7-98f6-4a15-a17a-64121e0fb113-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.539981 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.539854 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c2b87e7-98f6-4a15-a17a-64121e0fb113-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.539981 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.539880 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c2b87e7-98f6-4a15-a17a-64121e0fb113-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.539981 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.539963 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c2b87e7-98f6-4a15-a17a-64121e0fb113-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.540104 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.539991 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lbmqz\" (UniqueName: \"kubernetes.io/projected/3c2b87e7-98f6-4a15-a17a-64121e0fb113-kube-api-access-lbmqz\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.540104 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.540038 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2b87e7-98f6-4a15-a17a-64121e0fb113-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.540104 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.540087 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c2b87e7-98f6-4a15-a17a-64121e0fb113-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.540222 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.540153 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2b87e7-98f6-4a15-a17a-64121e0fb113-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.540222 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.540177 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c2b87e7-98f6-4a15-a17a-64121e0fb113-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.641115 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.641079 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2b87e7-98f6-4a15-a17a-64121e0fb113-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.641115 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.641119 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c2b87e7-98f6-4a15-a17a-64121e0fb113-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.641358 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.641137 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c2b87e7-98f6-4a15-a17a-64121e0fb113-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.641358 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.641155 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c2b87e7-98f6-4a15-a17a-64121e0fb113-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.641358 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.641174 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c2b87e7-98f6-4a15-a17a-64121e0fb113-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.641358 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.641216 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c2b87e7-98f6-4a15-a17a-64121e0fb113-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.641358 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.641239 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lbmqz\" (UniqueName: \"kubernetes.io/projected/3c2b87e7-98f6-4a15-a17a-64121e0fb113-kube-api-access-lbmqz\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.641358 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.641293 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2b87e7-98f6-4a15-a17a-64121e0fb113-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.641358 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.641328 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c2b87e7-98f6-4a15-a17a-64121e0fb113-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.641735 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.641564 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2b87e7-98f6-4a15-a17a-64121e0fb113-workload-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.641735 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.641647 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3c2b87e7-98f6-4a15-a17a-64121e0fb113-workload-certs\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.641735 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.641684 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3c2b87e7-98f6-4a15-a17a-64121e0fb113-istio-data\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.641895 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.641813 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3c2b87e7-98f6-4a15-a17a-64121e0fb113-credential-socket\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.642039 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.642015 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3c2b87e7-98f6-4a15-a17a-64121e0fb113-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.647993 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.647967 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3c2b87e7-98f6-4a15-a17a-64121e0fb113-istio-podinfo\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.648287 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.648244 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3c2b87e7-98f6-4a15-a17a-64121e0fb113-istio-envoy\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.650466 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.650442 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lbmqz\" (UniqueName: \"kubernetes.io/projected/3c2b87e7-98f6-4a15-a17a-64121e0fb113-kube-api-access-lbmqz\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.650594 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.650570 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3c2b87e7-98f6-4a15-a17a-64121e0fb113-istio-token\") pod \"maas-default-gateway-openshift-default-5896d4dd49-wj6n5\" (UID: \"3c2b87e7-98f6-4a15-a17a-64121e0fb113\") " pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.776511 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.776427 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:22.926008 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.925985 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5"] Jul 15 21:17:22.928250 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:17:22.928221 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c2b87e7_98f6_4a15_a17a_64121e0fb113.slice/crio-5e9213f22428eb337b3213925a313da6cf2920a2f7e022613cec300434315a64 WatchSource:0}: Error finding container 5e9213f22428eb337b3213925a313da6cf2920a2f7e022613cec300434315a64: Status 404 returned error can't find the container with id 5e9213f22428eb337b3213925a313da6cf2920a2f7e022613cec300434315a64 Jul 15 21:17:22.930356 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.930321 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:17:22.930416 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.930404 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:17:22.930462 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:22.930447 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:17:23.041775 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:23.041685 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" event={"ID":"3c2b87e7-98f6-4a15-a17a-64121e0fb113","Type":"ContainerStarted","Data":"59fe2d2b867b83ec371d2235776604843e75458e35ee17f61da8fb84d54cc4d0"} Jul 15 21:17:23.041775 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:23.041760 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" event={"ID":"3c2b87e7-98f6-4a15-a17a-64121e0fb113","Type":"ContainerStarted","Data":"5e9213f22428eb337b3213925a313da6cf2920a2f7e022613cec300434315a64"} Jul 15 21:17:23.070094 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:23.070034 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" podStartSLOduration=1.070015992 podStartE2EDuration="1.070015992s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:17:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:17:23.067565511 +0000 UTC m=+435.888882834" watchObservedRunningTime="2026-07-15 21:17:23.070015992 +0000 UTC m=+435.891333311" Jul 15 21:17:23.777490 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:23.777453 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:23.782189 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:23.782165 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:24.047341 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:24.047244 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:24.048258 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:24.048236 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:17:24.999506 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:24.999469 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-58cd955675-6bprw"] Jul 15 21:17:25.002370 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:25.002354 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6bprw" Jul 15 21:17:25.004606 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:25.004583 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rf2ts\"" Jul 15 21:17:25.014684 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:25.014660 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6bprw"] Jul 15 21:17:25.066429 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:25.066397 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-sg6vs\" (UniqueName: \"kubernetes.io/projected/fe1619a6-7265-4a5e-bc23-710815f6d136-kube-api-access-sg6vs\") pod \"authorino-58cd955675-6bprw\" (UID: \"fe1619a6-7265-4a5e-bc23-710815f6d136\") " pod="kuadrant-system/authorino-58cd955675-6bprw" Jul 15 21:17:25.167250 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:25.167211 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-sg6vs\" (UniqueName: \"kubernetes.io/projected/fe1619a6-7265-4a5e-bc23-710815f6d136-kube-api-access-sg6vs\") pod \"authorino-58cd955675-6bprw\" (UID: \"fe1619a6-7265-4a5e-bc23-710815f6d136\") " pod="kuadrant-system/authorino-58cd955675-6bprw" Jul 15 21:17:25.176213 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:25.176186 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-sg6vs\" (UniqueName: \"kubernetes.io/projected/fe1619a6-7265-4a5e-bc23-710815f6d136-kube-api-access-sg6vs\") pod \"authorino-58cd955675-6bprw\" (UID: \"fe1619a6-7265-4a5e-bc23-710815f6d136\") " pod="kuadrant-system/authorino-58cd955675-6bprw" Jul 15 21:17:25.311873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:25.311781 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6bprw" Jul 15 21:17:25.445923 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:25.445900 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-58cd955675-6bprw"] Jul 15 21:17:25.447521 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:17:25.447487 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfe1619a6_7265_4a5e_bc23_710815f6d136.slice/crio-55d3fd0403114b148d6a9a45b5744661dd9c87aabf0110bcb6fe21f9445280be WatchSource:0}: Error finding container 55d3fd0403114b148d6a9a45b5744661dd9c87aabf0110bcb6fe21f9445280be: Status 404 returned error can't find the container with id 55d3fd0403114b148d6a9a45b5744661dd9c87aabf0110bcb6fe21f9445280be Jul 15 21:17:26.058489 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:26.058457 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6bprw" event={"ID":"fe1619a6-7265-4a5e-bc23-710815f6d136","Type":"ContainerStarted","Data":"55d3fd0403114b148d6a9a45b5744661dd9c87aabf0110bcb6fe21f9445280be"} Jul 15 21:17:30.081849 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:30.081814 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6bprw" event={"ID":"fe1619a6-7265-4a5e-bc23-710815f6d136","Type":"ContainerStarted","Data":"99d4b57d9635cf5ef7308acd785f15d7661c9d68850211d1366cc06ba349277f"} Jul 15 21:17:30.097486 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:30.097444 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-58cd955675-6bprw" podStartSLOduration=2.50324568 podStartE2EDuration="6.09742965s" totalImagesPullingTime="3.59418397s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:17:24 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:17:30.096914236 +0000 UTC m=+442.918231553" watchObservedRunningTime="2026-07-15 21:17:30.09742965 +0000 UTC m=+442.918746966" Jul 15 21:17:30.151024 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:30.150991 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6bprw"] Jul 15 21:17:32.092379 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:32.092342 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-58cd955675-6bprw" podUID="fe1619a6-7265-4a5e-bc23-710815f6d136" containerName="authorino" containerID="cri-o://99d4b57d9635cf5ef7308acd785f15d7661c9d68850211d1366cc06ba349277f" gracePeriod=30 Jul 15 21:17:32.341335 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:32.341306 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6bprw" Jul 15 21:17:32.435480 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:32.435397 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-sg6vs\" (UniqueName: \"kubernetes.io/projected/fe1619a6-7265-4a5e-bc23-710815f6d136-kube-api-access-sg6vs\") pod \"fe1619a6-7265-4a5e-bc23-710815f6d136\" (UID: \"fe1619a6-7265-4a5e-bc23-710815f6d136\") " Jul 15 21:17:32.437400 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:32.437369 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fe1619a6-7265-4a5e-bc23-710815f6d136-kube-api-access-sg6vs" (OuterVolumeSpecName: "kube-api-access-sg6vs") pod "fe1619a6-7265-4a5e-bc23-710815f6d136" (UID: "fe1619a6-7265-4a5e-bc23-710815f6d136"). InnerVolumeSpecName "kube-api-access-sg6vs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:17:32.537028 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:32.536991 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-sg6vs\" (UniqueName: \"kubernetes.io/projected/fe1619a6-7265-4a5e-bc23-710815f6d136-kube-api-access-sg6vs\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:17:33.099024 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:33.098988 2572 generic.go:356] "Generic (PLEG): container finished" podID="fe1619a6-7265-4a5e-bc23-710815f6d136" containerID="99d4b57d9635cf5ef7308acd785f15d7661c9d68850211d1366cc06ba349277f" exitCode=0 Jul 15 21:17:33.099024 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:33.099024 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-58cd955675-6bprw" Jul 15 21:17:33.099510 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:33.099051 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6bprw" event={"ID":"fe1619a6-7265-4a5e-bc23-710815f6d136","Type":"ContainerDied","Data":"99d4b57d9635cf5ef7308acd785f15d7661c9d68850211d1366cc06ba349277f"} Jul 15 21:17:33.099510 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:33.099081 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-58cd955675-6bprw" event={"ID":"fe1619a6-7265-4a5e-bc23-710815f6d136","Type":"ContainerDied","Data":"55d3fd0403114b148d6a9a45b5744661dd9c87aabf0110bcb6fe21f9445280be"} Jul 15 21:17:33.099510 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:33.099097 2572 scope.go:117] "RemoveContainer" containerID="99d4b57d9635cf5ef7308acd785f15d7661c9d68850211d1366cc06ba349277f" Jul 15 21:17:33.108211 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:33.108191 2572 scope.go:117] "RemoveContainer" containerID="99d4b57d9635cf5ef7308acd785f15d7661c9d68850211d1366cc06ba349277f" Jul 15 21:17:33.108458 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:17:33.108440 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"99d4b57d9635cf5ef7308acd785f15d7661c9d68850211d1366cc06ba349277f\": container with ID starting with 99d4b57d9635cf5ef7308acd785f15d7661c9d68850211d1366cc06ba349277f not found: ID does not exist" containerID="99d4b57d9635cf5ef7308acd785f15d7661c9d68850211d1366cc06ba349277f" Jul 15 21:17:33.108499 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:33.108466 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"99d4b57d9635cf5ef7308acd785f15d7661c9d68850211d1366cc06ba349277f"} err="failed to get container status \"99d4b57d9635cf5ef7308acd785f15d7661c9d68850211d1366cc06ba349277f\": rpc error: code = NotFound desc = could not find container \"99d4b57d9635cf5ef7308acd785f15d7661c9d68850211d1366cc06ba349277f\": container with ID starting with 99d4b57d9635cf5ef7308acd785f15d7661c9d68850211d1366cc06ba349277f not found: ID does not exist" Jul 15 21:17:33.122384 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:33.122360 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-58cd955675-6bprw"] Jul 15 21:17:33.130964 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:33.130941 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-58cd955675-6bprw"] Jul 15 21:17:33.960237 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:33.960207 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fe1619a6-7265-4a5e-bc23-710815f6d136" path="/var/lib/kubelet/pods/fe1619a6-7265-4a5e-bc23-710815f6d136/volumes" Jul 15 21:17:58.445267 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.445230 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nms5g"] Jul 15 21:17:58.445715 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.445621 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fe1619a6-7265-4a5e-bc23-710815f6d136" containerName="authorino" Jul 15 21:17:58.445715 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.445633 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="fe1619a6-7265-4a5e-bc23-710815f6d136" containerName="authorino" Jul 15 21:17:58.445715 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.445705 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="fe1619a6-7265-4a5e-bc23-710815f6d136" containerName="authorino" Jul 15 21:17:58.450506 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.450487 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nms5g" Jul 15 21:17:58.453838 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.453812 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-authorino-dockercfg-rf2ts\"" Jul 15 21:17:58.462233 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.462212 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nms5g"] Jul 15 21:17:58.469232 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.469212 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l8gwj\" (UniqueName: \"kubernetes.io/projected/239d12ae-1ecb-4ab9-87a1-ff59b29846ed-kube-api-access-l8gwj\") pod \"authorino-5d4b67c446-nms5g\" (UID: \"239d12ae-1ecb-4ab9-87a1-ff59b29846ed\") " pod="kuadrant-system/authorino-5d4b67c446-nms5g" Jul 15 21:17:58.570759 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.570721 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l8gwj\" (UniqueName: \"kubernetes.io/projected/239d12ae-1ecb-4ab9-87a1-ff59b29846ed-kube-api-access-l8gwj\") pod \"authorino-5d4b67c446-nms5g\" (UID: \"239d12ae-1ecb-4ab9-87a1-ff59b29846ed\") " pod="kuadrant-system/authorino-5d4b67c446-nms5g" Jul 15 21:17:58.582176 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.582144 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l8gwj\" (UniqueName: \"kubernetes.io/projected/239d12ae-1ecb-4ab9-87a1-ff59b29846ed-kube-api-access-l8gwj\") pod \"authorino-5d4b67c446-nms5g\" (UID: \"239d12ae-1ecb-4ab9-87a1-ff59b29846ed\") " pod="kuadrant-system/authorino-5d4b67c446-nms5g" Jul 15 21:17:58.714914 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.714816 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nms5g"] Jul 15 21:17:58.715140 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.715121 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nms5g" Jul 15 21:17:58.764050 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.764012 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-f764d6654-bnlqm"] Jul 15 21:17:58.767970 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.767942 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f764d6654-bnlqm" Jul 15 21:17:58.782207 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.782172 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-f764d6654-bnlqm"] Jul 15 21:17:58.866361 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.866338 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nms5g"] Jul 15 21:17:58.868174 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:17:58.868142 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod239d12ae_1ecb_4ab9_87a1_ff59b29846ed.slice/crio-abe0172e2d53927a6b530822ee2b70ce8e9067591e0f8f5cdc0635cbb7cdb101 WatchSource:0}: Error finding container abe0172e2d53927a6b530822ee2b70ce8e9067591e0f8f5cdc0635cbb7cdb101: Status 404 returned error can't find the container with id abe0172e2d53927a6b530822ee2b70ce8e9067591e0f8f5cdc0635cbb7cdb101 Jul 15 21:17:58.873317 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.873294 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jwwgl\" (UniqueName: \"kubernetes.io/projected/88071f8f-73b1-401b-9303-8e2e761457e6-kube-api-access-jwwgl\") pod \"authorino-f764d6654-bnlqm\" (UID: \"88071f8f-73b1-401b-9303-8e2e761457e6\") " pod="kuadrant-system/authorino-f764d6654-bnlqm" Jul 15 21:17:58.888389 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.888367 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f764d6654-bnlqm"] Jul 15 21:17:58.888631 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:17:58.888613 2572 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[kube-api-access-jwwgl], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/authorino-f764d6654-bnlqm" podUID="88071f8f-73b1-401b-9303-8e2e761457e6" Jul 15 21:17:58.922832 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.922796 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-5c9cd4d68b-f9xph"] Jul 15 21:17:58.925560 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.925514 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c9cd4d68b-f9xph" Jul 15 21:17:58.927980 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.927954 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-server-cert\"" Jul 15 21:17:58.939020 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.938998 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c9cd4d68b-f9xph"] Jul 15 21:17:58.973812 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.973740 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jwwgl\" (UniqueName: \"kubernetes.io/projected/88071f8f-73b1-401b-9303-8e2e761457e6-kube-api-access-jwwgl\") pod \"authorino-f764d6654-bnlqm\" (UID: \"88071f8f-73b1-401b-9303-8e2e761457e6\") " pod="kuadrant-system/authorino-f764d6654-bnlqm" Jul 15 21:17:58.973812 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.973783 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f2653ac-07b9-4cc2-9251-1f083cad8dcd-tls-cert\") pod \"authorino-5c9cd4d68b-f9xph\" (UID: \"6f2653ac-07b9-4cc2-9251-1f083cad8dcd\") " pod="kuadrant-system/authorino-5c9cd4d68b-f9xph" Jul 15 21:17:58.973965 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.973822 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bnqbk\" (UniqueName: \"kubernetes.io/projected/6f2653ac-07b9-4cc2-9251-1f083cad8dcd-kube-api-access-bnqbk\") pod \"authorino-5c9cd4d68b-f9xph\" (UID: \"6f2653ac-07b9-4cc2-9251-1f083cad8dcd\") " pod="kuadrant-system/authorino-5c9cd4d68b-f9xph" Jul 15 21:17:58.982250 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:58.982224 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jwwgl\" (UniqueName: \"kubernetes.io/projected/88071f8f-73b1-401b-9303-8e2e761457e6-kube-api-access-jwwgl\") pod \"authorino-f764d6654-bnlqm\" (UID: \"88071f8f-73b1-401b-9303-8e2e761457e6\") " pod="kuadrant-system/authorino-f764d6654-bnlqm" Jul 15 21:17:59.074855 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:59.074821 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f2653ac-07b9-4cc2-9251-1f083cad8dcd-tls-cert\") pod \"authorino-5c9cd4d68b-f9xph\" (UID: \"6f2653ac-07b9-4cc2-9251-1f083cad8dcd\") " pod="kuadrant-system/authorino-5c9cd4d68b-f9xph" Jul 15 21:17:59.075017 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:59.074864 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bnqbk\" (UniqueName: \"kubernetes.io/projected/6f2653ac-07b9-4cc2-9251-1f083cad8dcd-kube-api-access-bnqbk\") pod \"authorino-5c9cd4d68b-f9xph\" (UID: \"6f2653ac-07b9-4cc2-9251-1f083cad8dcd\") " pod="kuadrant-system/authorino-5c9cd4d68b-f9xph" Jul 15 21:17:59.077215 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:59.077199 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f2653ac-07b9-4cc2-9251-1f083cad8dcd-tls-cert\") pod \"authorino-5c9cd4d68b-f9xph\" (UID: \"6f2653ac-07b9-4cc2-9251-1f083cad8dcd\") " pod="kuadrant-system/authorino-5c9cd4d68b-f9xph" Jul 15 21:17:59.087457 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:59.087438 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bnqbk\" (UniqueName: \"kubernetes.io/projected/6f2653ac-07b9-4cc2-9251-1f083cad8dcd-kube-api-access-bnqbk\") pod \"authorino-5c9cd4d68b-f9xph\" (UID: \"6f2653ac-07b9-4cc2-9251-1f083cad8dcd\") " pod="kuadrant-system/authorino-5c9cd4d68b-f9xph" Jul 15 21:17:59.235364 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:59.235272 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c9cd4d68b-f9xph" Jul 15 21:17:59.237941 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:59.237914 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-nms5g" event={"ID":"239d12ae-1ecb-4ab9-87a1-ff59b29846ed","Type":"ContainerStarted","Data":"abe0172e2d53927a6b530822ee2b70ce8e9067591e0f8f5cdc0635cbb7cdb101"} Jul 15 21:17:59.238051 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:59.237930 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f764d6654-bnlqm" Jul 15 21:17:59.244269 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:59.244249 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f764d6654-bnlqm" Jul 15 21:17:59.277275 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:59.277248 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jwwgl\" (UniqueName: \"kubernetes.io/projected/88071f8f-73b1-401b-9303-8e2e761457e6-kube-api-access-jwwgl\") pod \"88071f8f-73b1-401b-9303-8e2e761457e6\" (UID: \"88071f8f-73b1-401b-9303-8e2e761457e6\") " Jul 15 21:17:59.279258 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:59.279223 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/88071f8f-73b1-401b-9303-8e2e761457e6-kube-api-access-jwwgl" (OuterVolumeSpecName: "kube-api-access-jwwgl") pod "88071f8f-73b1-401b-9303-8e2e761457e6" (UID: "88071f8f-73b1-401b-9303-8e2e761457e6"). InnerVolumeSpecName "kube-api-access-jwwgl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:17:59.378112 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:59.378081 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jwwgl\" (UniqueName: \"kubernetes.io/projected/88071f8f-73b1-401b-9303-8e2e761457e6-kube-api-access-jwwgl\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:17:59.389277 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:17:59.389254 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-5c9cd4d68b-f9xph"] Jul 15 21:17:59.391433 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:17:59.391411 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-pod6f2653ac_07b9_4cc2_9251_1f083cad8dcd.slice/crio-4a6755ebeda2b28716f090e39c88549479346f0ac771e9d05a93d194544ea9f5 WatchSource:0}: Error finding container 4a6755ebeda2b28716f090e39c88549479346f0ac771e9d05a93d194544ea9f5: Status 404 returned error can't find the container with id 4a6755ebeda2b28716f090e39c88549479346f0ac771e9d05a93d194544ea9f5 Jul 15 21:18:00.250405 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:00.250296 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-nms5g" event={"ID":"239d12ae-1ecb-4ab9-87a1-ff59b29846ed","Type":"ContainerStarted","Data":"5188ba34c99b8ee5b67d2ffa849cdc01fa7418c3bc416f9ceb8c258da4ffcffb"} Jul 15 21:18:00.250405 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:00.250322 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5d4b67c446-nms5g" podUID="239d12ae-1ecb-4ab9-87a1-ff59b29846ed" containerName="authorino" containerID="cri-o://5188ba34c99b8ee5b67d2ffa849cdc01fa7418c3bc416f9ceb8c258da4ffcffb" gracePeriod=30 Jul 15 21:18:00.252003 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:00.251984 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-f764d6654-bnlqm" Jul 15 21:18:00.252114 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:00.252018 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c9cd4d68b-f9xph" event={"ID":"6f2653ac-07b9-4cc2-9251-1f083cad8dcd","Type":"ContainerStarted","Data":"60131ac9ef21664e5d5676b5dba345395eec8d6e2844225985e426f56b75de5b"} Jul 15 21:18:00.252114 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:00.252048 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c9cd4d68b-f9xph" event={"ID":"6f2653ac-07b9-4cc2-9251-1f083cad8dcd","Type":"ContainerStarted","Data":"4a6755ebeda2b28716f090e39c88549479346f0ac771e9d05a93d194544ea9f5"} Jul 15 21:18:00.269183 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:00.269144 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5d4b67c446-nms5g" podStartSLOduration=1.495694309 podStartE2EDuration="2.269131027s" totalImagesPullingTime="773.436718ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:18:00.266774883 +0000 UTC m=+473.088092199" watchObservedRunningTime="2026-07-15 21:18:00.269131027 +0000 UTC m=+473.090448344" Jul 15 21:18:00.295450 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:00.295422 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-f764d6654-bnlqm"] Jul 15 21:18:00.298778 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:00.298757 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-f764d6654-bnlqm"] Jul 15 21:18:00.313913 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:00.313870 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-5c9cd4d68b-f9xph" podStartSLOduration=1.987255295 podStartE2EDuration="2.3138562s" totalImagesPullingTime="326.600905ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:17:58 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:18:00.312449562 +0000 UTC m=+473.133766891" watchObservedRunningTime="2026-07-15 21:18:00.3138562 +0000 UTC m=+473.135173541" Jul 15 21:18:00.487883 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:00.487860 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nms5g" Jul 15 21:18:00.589780 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:00.589750 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l8gwj\" (UniqueName: \"kubernetes.io/projected/239d12ae-1ecb-4ab9-87a1-ff59b29846ed-kube-api-access-l8gwj\") pod \"239d12ae-1ecb-4ab9-87a1-ff59b29846ed\" (UID: \"239d12ae-1ecb-4ab9-87a1-ff59b29846ed\") " Jul 15 21:18:00.591875 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:00.591848 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/239d12ae-1ecb-4ab9-87a1-ff59b29846ed-kube-api-access-l8gwj" (OuterVolumeSpecName: "kube-api-access-l8gwj") pod "239d12ae-1ecb-4ab9-87a1-ff59b29846ed" (UID: "239d12ae-1ecb-4ab9-87a1-ff59b29846ed"). InnerVolumeSpecName "kube-api-access-l8gwj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:18:00.691322 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:00.691285 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l8gwj\" (UniqueName: \"kubernetes.io/projected/239d12ae-1ecb-4ab9-87a1-ff59b29846ed-kube-api-access-l8gwj\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:18:01.259783 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:01.259749 2572 generic.go:356] "Generic (PLEG): container finished" podID="239d12ae-1ecb-4ab9-87a1-ff59b29846ed" containerID="5188ba34c99b8ee5b67d2ffa849cdc01fa7418c3bc416f9ceb8c258da4ffcffb" exitCode=0 Jul 15 21:18:01.260240 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:01.259797 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5d4b67c446-nms5g" Jul 15 21:18:01.260240 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:01.259832 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-nms5g" event={"ID":"239d12ae-1ecb-4ab9-87a1-ff59b29846ed","Type":"ContainerDied","Data":"5188ba34c99b8ee5b67d2ffa849cdc01fa7418c3bc416f9ceb8c258da4ffcffb"} Jul 15 21:18:01.260240 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:01.259870 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5d4b67c446-nms5g" event={"ID":"239d12ae-1ecb-4ab9-87a1-ff59b29846ed","Type":"ContainerDied","Data":"abe0172e2d53927a6b530822ee2b70ce8e9067591e0f8f5cdc0635cbb7cdb101"} Jul 15 21:18:01.260240 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:01.259886 2572 scope.go:117] "RemoveContainer" containerID="5188ba34c99b8ee5b67d2ffa849cdc01fa7418c3bc416f9ceb8c258da4ffcffb" Jul 15 21:18:01.271515 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:01.271495 2572 scope.go:117] "RemoveContainer" containerID="5188ba34c99b8ee5b67d2ffa849cdc01fa7418c3bc416f9ceb8c258da4ffcffb" Jul 15 21:18:01.271933 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:18:01.271908 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5188ba34c99b8ee5b67d2ffa849cdc01fa7418c3bc416f9ceb8c258da4ffcffb\": container with ID starting with 5188ba34c99b8ee5b67d2ffa849cdc01fa7418c3bc416f9ceb8c258da4ffcffb not found: ID does not exist" containerID="5188ba34c99b8ee5b67d2ffa849cdc01fa7418c3bc416f9ceb8c258da4ffcffb" Jul 15 21:18:01.272021 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:01.271943 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5188ba34c99b8ee5b67d2ffa849cdc01fa7418c3bc416f9ceb8c258da4ffcffb"} err="failed to get container status \"5188ba34c99b8ee5b67d2ffa849cdc01fa7418c3bc416f9ceb8c258da4ffcffb\": rpc error: code = NotFound desc = could not find container \"5188ba34c99b8ee5b67d2ffa849cdc01fa7418c3bc416f9ceb8c258da4ffcffb\": container with ID starting with 5188ba34c99b8ee5b67d2ffa849cdc01fa7418c3bc416f9ceb8c258da4ffcffb not found: ID does not exist" Jul 15 21:18:01.284823 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:01.284798 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nms5g"] Jul 15 21:18:01.289038 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:01.289014 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5d4b67c446-nms5g"] Jul 15 21:18:01.961230 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:01.961193 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="239d12ae-1ecb-4ab9-87a1-ff59b29846ed" path="/var/lib/kubelet/pods/239d12ae-1ecb-4ab9-87a1-ff59b29846ed/volumes" Jul 15 21:18:01.961558 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:01.961545 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="88071f8f-73b1-401b-9303-8e2e761457e6" path="/var/lib/kubelet/pods/88071f8f-73b1-401b-9303-8e2e761457e6/volumes" Jul 15 21:18:41.434126 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:41.434086 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-q6n6d"] Jul 15 21:18:41.434744 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:41.434680 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="239d12ae-1ecb-4ab9-87a1-ff59b29846ed" containerName="authorino" Jul 15 21:18:41.434744 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:41.434702 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="239d12ae-1ecb-4ab9-87a1-ff59b29846ed" containerName="authorino" Jul 15 21:18:41.434865 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:41.434805 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="239d12ae-1ecb-4ab9-87a1-ff59b29846ed" containerName="authorino" Jul 15 21:18:41.437883 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:41.437862 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-q6n6d" Jul 15 21:18:41.440357 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:41.440330 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"payload-processing-plugins\"" Jul 15 21:18:41.440357 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:41.440349 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"payload-processing-dockercfg-pslj9\"" Jul 15 21:18:41.450359 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:41.450316 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e611f0d4-45ac-48d3-8da2-8308a85d41eb-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-q6n6d\" (UID: \"e611f0d4-45ac-48d3-8da2-8308a85d41eb\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-q6n6d" Jul 15 21:18:41.450483 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:41.450467 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-q6n6d"] Jul 15 21:18:41.450553 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:41.450465 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nqc47\" (UniqueName: \"kubernetes.io/projected/e611f0d4-45ac-48d3-8da2-8308a85d41eb-kube-api-access-nqc47\") pod \"payload-pre-processing-74584bb9f8-q6n6d\" (UID: \"e611f0d4-45ac-48d3-8da2-8308a85d41eb\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-q6n6d" Jul 15 21:18:41.551166 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:41.551129 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e611f0d4-45ac-48d3-8da2-8308a85d41eb-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-q6n6d\" (UID: \"e611f0d4-45ac-48d3-8da2-8308a85d41eb\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-q6n6d" Jul 15 21:18:41.551318 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:41.551197 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nqc47\" (UniqueName: \"kubernetes.io/projected/e611f0d4-45ac-48d3-8da2-8308a85d41eb-kube-api-access-nqc47\") pod \"payload-pre-processing-74584bb9f8-q6n6d\" (UID: \"e611f0d4-45ac-48d3-8da2-8308a85d41eb\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-q6n6d" Jul 15 21:18:41.551984 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:41.551966 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"plugins-config-volume\" (UniqueName: \"kubernetes.io/configmap/e611f0d4-45ac-48d3-8da2-8308a85d41eb-plugins-config-volume\") pod \"payload-pre-processing-74584bb9f8-q6n6d\" (UID: \"e611f0d4-45ac-48d3-8da2-8308a85d41eb\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-q6n6d" Jul 15 21:18:41.559772 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:41.559748 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nqc47\" (UniqueName: \"kubernetes.io/projected/e611f0d4-45ac-48d3-8da2-8308a85d41eb-kube-api-access-nqc47\") pod \"payload-pre-processing-74584bb9f8-q6n6d\" (UID: \"e611f0d4-45ac-48d3-8da2-8308a85d41eb\") " pod="openshift-ingress/payload-pre-processing-74584bb9f8-q6n6d" Jul 15 21:18:41.748231 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:41.748146 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/payload-pre-processing-74584bb9f8-q6n6d" Jul 15 21:18:41.884198 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:41.884173 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/payload-pre-processing-74584bb9f8-q6n6d"] Jul 15 21:18:41.886640 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:18:41.886599 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode611f0d4_45ac_48d3_8da2_8308a85d41eb.slice/crio-0e9af45e465c45fac87fa6ccb0a8fe2b5a6a053b2b05da6fa6f3a25454e7fa55 WatchSource:0}: Error finding container 0e9af45e465c45fac87fa6ccb0a8fe2b5a6a053b2b05da6fa6f3a25454e7fa55: Status 404 returned error can't find the container with id 0e9af45e465c45fac87fa6ccb0a8fe2b5a6a053b2b05da6fa6f3a25454e7fa55 Jul 15 21:18:42.488792 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:42.488756 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-q6n6d" event={"ID":"e611f0d4-45ac-48d3-8da2-8308a85d41eb","Type":"ContainerStarted","Data":"0e9af45e465c45fac87fa6ccb0a8fe2b5a6a053b2b05da6fa6f3a25454e7fa55"} Jul 15 21:18:43.495565 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:43.495518 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/payload-pre-processing-74584bb9f8-q6n6d" event={"ID":"e611f0d4-45ac-48d3-8da2-8308a85d41eb","Type":"ContainerStarted","Data":"1d87b8f2cbe3bde9afbe95cb7bd785b199310666fe2519dc0309a8da8587fdcb"} Jul 15 21:18:43.495922 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:43.495676 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-q6n6d" Jul 15 21:18:43.512517 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:43.512466 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/payload-pre-processing-74584bb9f8-q6n6d" podStartSLOduration=1.122989967 podStartE2EDuration="2.512448765s" totalImagesPullingTime="1.389458798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:18:41 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:18:43.511068495 +0000 UTC m=+516.332385812" watchObservedRunningTime="2026-07-15 21:18:43.512448765 +0000 UTC m=+516.333766081" Jul 15 21:18:49.528969 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:49.528930 2572 generic.go:356] "Generic (PLEG): container finished" podID="3c2b87e7-98f6-4a15-a17a-64121e0fb113" containerID="59fe2d2b867b83ec371d2235776604843e75458e35ee17f61da8fb84d54cc4d0" exitCode=0 Jul 15 21:18:49.528969 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:49.528972 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" event={"ID":"3c2b87e7-98f6-4a15-a17a-64121e0fb113","Type":"ContainerDied","Data":"59fe2d2b867b83ec371d2235776604843e75458e35ee17f61da8fb84d54cc4d0"} Jul 15 21:18:49.529566 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:49.529457 2572 scope.go:117] "RemoveContainer" containerID="59fe2d2b867b83ec371d2235776604843e75458e35ee17f61da8fb84d54cc4d0" Jul 15 21:18:49.530452 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:49.530424 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:18:49.530562 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:49.530491 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:18:49.530562 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:49.530536 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:18:50.536620 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:50.536587 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" event={"ID":"3c2b87e7-98f6-4a15-a17a-64121e0fb113","Type":"ContainerStarted","Data":"0dfe47aa52615840acb8cd7226575896bb3a7d90e8f38bc1b5d654edd5862318"} Jul 15 21:18:50.776894 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:50.776854 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:18:50.778292 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:50.778257 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-wj6n5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 15 21:18:50.778427 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:50.778324 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" podUID="3c2b87e7-98f6-4a15-a17a-64121e0fb113" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 15 21:18:51.777116 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:51.777070 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-wj6n5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 15 21:18:51.777650 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:51.777141 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" podUID="3c2b87e7-98f6-4a15-a17a-64121e0fb113" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 15 21:18:52.777196 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:52.777153 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-wj6n5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 15 21:18:52.777709 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:52.777217 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" podUID="3c2b87e7-98f6-4a15-a17a-64121e0fb113" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 15 21:18:53.777098 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:53.777058 2572 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-5896d4dd49-wj6n5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 15 21:18:53.777393 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:53.777364 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" podUID="3c2b87e7-98f6-4a15-a17a-64121e0fb113" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 15 21:18:54.048249 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:54.048164 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:18:54.502884 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:54.502852 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/payload-pre-processing-74584bb9f8-q6n6d" Jul 15 21:18:54.781415 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:54.781337 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:18:54.782312 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:18:54.782297 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-5896d4dd49-wj6n5" Jul 15 21:19:13.310827 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.310743 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27"] Jul 15 21:19:13.319273 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.319242 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:13.321842 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.321820 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 15 21:19:13.322694 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.322678 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-distinct-simulated-kserve-self-signed-certs\"" Jul 15 21:19:13.322789 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.322680 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-jz2qs\"" Jul 15 21:19:13.322789 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.322718 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 15 21:19:13.330335 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.330311 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27"] Jul 15 21:19:13.459445 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.459404 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b2a7a88-441d-4313-a346-7456fb97f6a3-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l7c27\" (UID: \"1b2a7a88-441d-4313-a346-7456fb97f6a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:13.459640 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.459457 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dxk4g\" (UniqueName: \"kubernetes.io/projected/1b2a7a88-441d-4313-a346-7456fb97f6a3-kube-api-access-dxk4g\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l7c27\" (UID: \"1b2a7a88-441d-4313-a346-7456fb97f6a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:13.459640 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.459589 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b2a7a88-441d-4313-a346-7456fb97f6a3-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l7c27\" (UID: \"1b2a7a88-441d-4313-a346-7456fb97f6a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:13.459640 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.459632 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b2a7a88-441d-4313-a346-7456fb97f6a3-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l7c27\" (UID: \"1b2a7a88-441d-4313-a346-7456fb97f6a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:13.459759 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.459683 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b2a7a88-441d-4313-a346-7456fb97f6a3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l7c27\" (UID: \"1b2a7a88-441d-4313-a346-7456fb97f6a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:13.459805 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.459766 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b2a7a88-441d-4313-a346-7456fb97f6a3-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l7c27\" (UID: \"1b2a7a88-441d-4313-a346-7456fb97f6a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:13.560514 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.560476 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b2a7a88-441d-4313-a346-7456fb97f6a3-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l7c27\" (UID: \"1b2a7a88-441d-4313-a346-7456fb97f6a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:13.560696 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.560546 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dxk4g\" (UniqueName: \"kubernetes.io/projected/1b2a7a88-441d-4313-a346-7456fb97f6a3-kube-api-access-dxk4g\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l7c27\" (UID: \"1b2a7a88-441d-4313-a346-7456fb97f6a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:13.560696 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.560588 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b2a7a88-441d-4313-a346-7456fb97f6a3-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l7c27\" (UID: \"1b2a7a88-441d-4313-a346-7456fb97f6a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:13.560696 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.560616 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b2a7a88-441d-4313-a346-7456fb97f6a3-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l7c27\" (UID: \"1b2a7a88-441d-4313-a346-7456fb97f6a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:13.560696 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.560652 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b2a7a88-441d-4313-a346-7456fb97f6a3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l7c27\" (UID: \"1b2a7a88-441d-4313-a346-7456fb97f6a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:13.560936 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.560722 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b2a7a88-441d-4313-a346-7456fb97f6a3-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l7c27\" (UID: \"1b2a7a88-441d-4313-a346-7456fb97f6a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:13.560936 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.560913 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/1b2a7a88-441d-4313-a346-7456fb97f6a3-model-cache\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l7c27\" (UID: \"1b2a7a88-441d-4313-a346-7456fb97f6a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:13.561206 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.561180 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/1b2a7a88-441d-4313-a346-7456fb97f6a3-home\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l7c27\" (UID: \"1b2a7a88-441d-4313-a346-7456fb97f6a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:13.561332 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.561226 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/1b2a7a88-441d-4313-a346-7456fb97f6a3-tmp-dir\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l7c27\" (UID: \"1b2a7a88-441d-4313-a346-7456fb97f6a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:13.562903 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.562886 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/1b2a7a88-441d-4313-a346-7456fb97f6a3-dshm\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l7c27\" (UID: \"1b2a7a88-441d-4313-a346-7456fb97f6a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:13.563167 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.563148 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/1b2a7a88-441d-4313-a346-7456fb97f6a3-tls-certs\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l7c27\" (UID: \"1b2a7a88-441d-4313-a346-7456fb97f6a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:13.569072 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.569052 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dxk4g\" (UniqueName: \"kubernetes.io/projected/1b2a7a88-441d-4313-a346-7456fb97f6a3-kube-api-access-dxk4g\") pod \"e2e-distinct-simulated-kserve-59975d69f9-l7c27\" (UID: \"1b2a7a88-441d-4313-a346-7456fb97f6a3\") " pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:13.631016 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.630987 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:13.778009 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:13.777931 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27"] Jul 15 21:19:13.780441 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:19:13.780415 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1b2a7a88_441d_4313_a346_7456fb97f6a3.slice/crio-bb1253552bfa19d0fc78d855b6b01a63dac329dafcb9bd71dc0903c694b3572b WatchSource:0}: Error finding container bb1253552bfa19d0fc78d855b6b01a63dac329dafcb9bd71dc0903c694b3572b: Status 404 returned error can't find the container with id bb1253552bfa19d0fc78d855b6b01a63dac329dafcb9bd71dc0903c694b3572b Jul 15 21:19:14.666500 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:14.666378 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" event={"ID":"1b2a7a88-441d-4313-a346-7456fb97f6a3","Type":"ContainerStarted","Data":"bb1253552bfa19d0fc78d855b6b01a63dac329dafcb9bd71dc0903c694b3572b"} Jul 15 21:19:15.673416 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:15.673377 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" event={"ID":"1b2a7a88-441d-4313-a346-7456fb97f6a3","Type":"ContainerStarted","Data":"bbd281f7ea5bf13391c7546bc4d7489eded4f090c5631ea10614e61010021fa0"} Jul 15 21:19:15.697157 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:15.697105 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" podStartSLOduration=1.6509889979999999 podStartE2EDuration="2.697089998s" totalImagesPullingTime="1.046101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:19:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:19:15.694882837 +0000 UTC m=+548.516200154" watchObservedRunningTime="2026-07-15 21:19:15.697089998 +0000 UTC m=+548.518407343" Jul 15 21:19:23.631753 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:23.631712 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:23.632206 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:23.631774 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:23.644298 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:23.644269 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:23.727882 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:23.727853 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-distinct-simulated-kserve-59975d69f9-l7c27" Jul 15 21:19:28.525692 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.525644 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp"] Jul 15 21:19:28.529715 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.529692 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:28.532964 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.532938 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 15 21:19:28.547675 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.547643 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp"] Jul 15 21:19:28.700249 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.700204 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7c51c31-6497-4a83-9611-567efbb3d73c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rzmhp\" (UID: \"e7c51c31-6497-4a83-9611-567efbb3d73c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:28.700519 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.700262 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7c51c31-6497-4a83-9611-567efbb3d73c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rzmhp\" (UID: \"e7c51c31-6497-4a83-9611-567efbb3d73c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:28.700519 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.700285 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7c51c31-6497-4a83-9611-567efbb3d73c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rzmhp\" (UID: \"e7c51c31-6497-4a83-9611-567efbb3d73c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:28.700519 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.700358 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7c51c31-6497-4a83-9611-567efbb3d73c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rzmhp\" (UID: \"e7c51c31-6497-4a83-9611-567efbb3d73c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:28.700519 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.700373 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7c51c31-6497-4a83-9611-567efbb3d73c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rzmhp\" (UID: \"e7c51c31-6497-4a83-9611-567efbb3d73c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:28.700519 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.700388 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rsz9q\" (UniqueName: \"kubernetes.io/projected/e7c51c31-6497-4a83-9611-567efbb3d73c-kube-api-access-rsz9q\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rzmhp\" (UID: \"e7c51c31-6497-4a83-9611-567efbb3d73c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:28.800900 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.800813 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7c51c31-6497-4a83-9611-567efbb3d73c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rzmhp\" (UID: \"e7c51c31-6497-4a83-9611-567efbb3d73c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:28.800900 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.800857 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7c51c31-6497-4a83-9611-567efbb3d73c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rzmhp\" (UID: \"e7c51c31-6497-4a83-9611-567efbb3d73c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:28.801149 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.800937 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7c51c31-6497-4a83-9611-567efbb3d73c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rzmhp\" (UID: \"e7c51c31-6497-4a83-9611-567efbb3d73c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:28.801149 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.800962 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7c51c31-6497-4a83-9611-567efbb3d73c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rzmhp\" (UID: \"e7c51c31-6497-4a83-9611-567efbb3d73c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:28.801149 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.800985 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rsz9q\" (UniqueName: \"kubernetes.io/projected/e7c51c31-6497-4a83-9611-567efbb3d73c-kube-api-access-rsz9q\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rzmhp\" (UID: \"e7c51c31-6497-4a83-9611-567efbb3d73c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:28.801149 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.801047 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7c51c31-6497-4a83-9611-567efbb3d73c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rzmhp\" (UID: \"e7c51c31-6497-4a83-9611-567efbb3d73c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:28.801360 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.801269 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/e7c51c31-6497-4a83-9611-567efbb3d73c-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rzmhp\" (UID: \"e7c51c31-6497-4a83-9611-567efbb3d73c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:28.801360 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.801279 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/e7c51c31-6497-4a83-9611-567efbb3d73c-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rzmhp\" (UID: \"e7c51c31-6497-4a83-9611-567efbb3d73c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:28.801440 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.801387 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/e7c51c31-6497-4a83-9611-567efbb3d73c-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rzmhp\" (UID: \"e7c51c31-6497-4a83-9611-567efbb3d73c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:28.803197 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.803177 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/e7c51c31-6497-4a83-9611-567efbb3d73c-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rzmhp\" (UID: \"e7c51c31-6497-4a83-9611-567efbb3d73c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:28.803473 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.803455 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/e7c51c31-6497-4a83-9611-567efbb3d73c-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rzmhp\" (UID: \"e7c51c31-6497-4a83-9611-567efbb3d73c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:28.809069 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.809043 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rsz9q\" (UniqueName: \"kubernetes.io/projected/e7c51c31-6497-4a83-9611-567efbb3d73c-kube-api-access-rsz9q\") pod \"e2e-trlp-test-simulated-kserve-598466548d-rzmhp\" (UID: \"e7c51c31-6497-4a83-9611-567efbb3d73c\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:28.839816 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.839786 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:28.977305 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:28.977278 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp"] Jul 15 21:19:28.980039 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:19:28.980005 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode7c51c31_6497_4a83_9611_567efbb3d73c.slice/crio-be71347d8c9f5fe466564a9d23238cfd5344f6c3d9d927a4d1299c4f3ffc131e WatchSource:0}: Error finding container be71347d8c9f5fe466564a9d23238cfd5344f6c3d9d927a4d1299c4f3ffc131e: Status 404 returned error can't find the container with id be71347d8c9f5fe466564a9d23238cfd5344f6c3d9d927a4d1299c4f3ffc131e Jul 15 21:19:29.749995 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:29.749957 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" event={"ID":"e7c51c31-6497-4a83-9611-567efbb3d73c","Type":"ContainerStarted","Data":"6b2d6263ad03f9f0d39b58128fb25a6466a721ea986c3c2b194cf6005d0b37d6"} Jul 15 21:19:29.750374 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:29.750014 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" event={"ID":"e7c51c31-6497-4a83-9611-567efbb3d73c","Type":"ContainerStarted","Data":"be71347d8c9f5fe466564a9d23238cfd5344f6c3d9d927a4d1299c4f3ffc131e"} Jul 15 21:19:29.781687 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:29.781633 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" podStartSLOduration=1.625816011 podStartE2EDuration="1.781617903s" totalImagesPullingTime="155.801892ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:19:28 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:19:29.77870848 +0000 UTC m=+562.600025809" watchObservedRunningTime="2026-07-15 21:19:29.781617903 +0000 UTC m=+562.602935268" Jul 15 21:19:38.840550 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:38.840496 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:38.841005 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:38.840593 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:38.853087 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:38.853063 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:19:39.818887 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:19:39.818853 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-rzmhp" Jul 15 21:20:08.107360 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:20:08.107329 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsl2f_19ebe52b-28dc-4b7b-af2d-0779b13a9b62/ovn-acl-logging/0.log" Jul 15 21:20:08.109562 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:20:08.109519 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsl2f_19ebe52b-28dc-4b7b-af2d-0779b13a9b62/ovn-acl-logging/0.log" Jul 15 21:21:58.381993 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:21:58.381951 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c9cd4d68b-f9xph"] Jul 15 21:21:58.382481 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:21:58.382127 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/authorino-5c9cd4d68b-f9xph" podUID="6f2653ac-07b9-4cc2-9251-1f083cad8dcd" containerName="authorino" containerID="cri-o://60131ac9ef21664e5d5676b5dba345395eec8d6e2844225985e426f56b75de5b" gracePeriod=30 Jul 15 21:21:58.574958 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:21:58.574919 2572 generic.go:356] "Generic (PLEG): container finished" podID="6f2653ac-07b9-4cc2-9251-1f083cad8dcd" containerID="60131ac9ef21664e5d5676b5dba345395eec8d6e2844225985e426f56b75de5b" exitCode=0 Jul 15 21:21:58.575148 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:21:58.575084 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c9cd4d68b-f9xph" event={"ID":"6f2653ac-07b9-4cc2-9251-1f083cad8dcd","Type":"ContainerDied","Data":"60131ac9ef21664e5d5676b5dba345395eec8d6e2844225985e426f56b75de5b"} Jul 15 21:21:58.633849 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:21:58.633789 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c9cd4d68b-f9xph" Jul 15 21:21:58.774762 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:21:58.774723 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f2653ac-07b9-4cc2-9251-1f083cad8dcd-tls-cert\") pod \"6f2653ac-07b9-4cc2-9251-1f083cad8dcd\" (UID: \"6f2653ac-07b9-4cc2-9251-1f083cad8dcd\") " Jul 15 21:21:58.774925 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:21:58.774861 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bnqbk\" (UniqueName: \"kubernetes.io/projected/6f2653ac-07b9-4cc2-9251-1f083cad8dcd-kube-api-access-bnqbk\") pod \"6f2653ac-07b9-4cc2-9251-1f083cad8dcd\" (UID: \"6f2653ac-07b9-4cc2-9251-1f083cad8dcd\") " Jul 15 21:21:58.776916 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:21:58.776885 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6f2653ac-07b9-4cc2-9251-1f083cad8dcd-kube-api-access-bnqbk" (OuterVolumeSpecName: "kube-api-access-bnqbk") pod "6f2653ac-07b9-4cc2-9251-1f083cad8dcd" (UID: "6f2653ac-07b9-4cc2-9251-1f083cad8dcd"). InnerVolumeSpecName "kube-api-access-bnqbk". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:21:58.785690 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:21:58.785660 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/6f2653ac-07b9-4cc2-9251-1f083cad8dcd-tls-cert" (OuterVolumeSpecName: "tls-cert") pod "6f2653ac-07b9-4cc2-9251-1f083cad8dcd" (UID: "6f2653ac-07b9-4cc2-9251-1f083cad8dcd"). InnerVolumeSpecName "tls-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 15 21:21:58.875800 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:21:58.875766 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bnqbk\" (UniqueName: \"kubernetes.io/projected/6f2653ac-07b9-4cc2-9251-1f083cad8dcd-kube-api-access-bnqbk\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:21:58.875800 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:21:58.875793 2572 reconciler_common.go:299] "Volume detached for volume \"tls-cert\" (UniqueName: \"kubernetes.io/secret/6f2653ac-07b9-4cc2-9251-1f083cad8dcd-tls-cert\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:21:59.581086 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:21:59.581010 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-5c9cd4d68b-f9xph" Jul 15 21:21:59.581086 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:21:59.581047 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-5c9cd4d68b-f9xph" event={"ID":"6f2653ac-07b9-4cc2-9251-1f083cad8dcd","Type":"ContainerDied","Data":"4a6755ebeda2b28716f090e39c88549479346f0ac771e9d05a93d194544ea9f5"} Jul 15 21:21:59.581563 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:21:59.581099 2572 scope.go:117] "RemoveContainer" containerID="60131ac9ef21664e5d5676b5dba345395eec8d6e2844225985e426f56b75de5b" Jul 15 21:21:59.611139 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:21:59.611108 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/authorino-5c9cd4d68b-f9xph"] Jul 15 21:21:59.614862 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:21:59.614835 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/authorino-5c9cd4d68b-f9xph"] Jul 15 21:21:59.962312 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:21:59.962226 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6f2653ac-07b9-4cc2-9251-1f083cad8dcd" path="/var/lib/kubelet/pods/6f2653ac-07b9-4cc2-9251-1f083cad8dcd/volumes" Jul 15 21:25:08.144917 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:25:08.144887 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsl2f_19ebe52b-28dc-4b7b-af2d-0779b13a9b62/ovn-acl-logging/0.log" Jul 15 21:25:08.146837 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:25:08.146812 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsl2f_19ebe52b-28dc-4b7b-af2d-0779b13a9b62/ovn-acl-logging/0.log" Jul 15 21:28:03.186055 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:28:03.185975 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn"] Jul 15 21:28:03.186626 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:28:03.186176 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn" podUID="6d92036c-248c-42bd-ab9c-6f40baddd6c1" containerName="manager" containerID="cri-o://89a6afbe90b66a24fff82b790927c5ccd22cc6ff040a5a24c7b9607621aaea14" gracePeriod=10 Jul 15 21:28:05.574257 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:28:05.574221 2572 generic.go:356] "Generic (PLEG): container finished" podID="6d92036c-248c-42bd-ab9c-6f40baddd6c1" containerID="89a6afbe90b66a24fff82b790927c5ccd22cc6ff040a5a24c7b9607621aaea14" exitCode=0 Jul 15 21:28:05.574725 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:28:05.574286 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn" event={"ID":"6d92036c-248c-42bd-ab9c-6f40baddd6c1","Type":"ContainerDied","Data":"89a6afbe90b66a24fff82b790927c5ccd22cc6ff040a5a24c7b9607621aaea14"} Jul 15 21:28:05.645580 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:28:05.645517 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn" Jul 15 21:28:05.727164 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:28:05.727086 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d92036c-248c-42bd-ab9c-6f40baddd6c1-extensions-socket-volume\") pod \"6d92036c-248c-42bd-ab9c-6f40baddd6c1\" (UID: \"6d92036c-248c-42bd-ab9c-6f40baddd6c1\") " Jul 15 21:28:05.727323 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:28:05.727164 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jq5gm\" (UniqueName: \"kubernetes.io/projected/6d92036c-248c-42bd-ab9c-6f40baddd6c1-kube-api-access-jq5gm\") pod \"6d92036c-248c-42bd-ab9c-6f40baddd6c1\" (UID: \"6d92036c-248c-42bd-ab9c-6f40baddd6c1\") " Jul 15 21:28:05.727441 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:28:05.727420 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/6d92036c-248c-42bd-ab9c-6f40baddd6c1-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "6d92036c-248c-42bd-ab9c-6f40baddd6c1" (UID: "6d92036c-248c-42bd-ab9c-6f40baddd6c1"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:28:05.727514 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:28:05.727501 2572 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/6d92036c-248c-42bd-ab9c-6f40baddd6c1-extensions-socket-volume\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:28:05.729012 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:28:05.728992 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/6d92036c-248c-42bd-ab9c-6f40baddd6c1-kube-api-access-jq5gm" (OuterVolumeSpecName: "kube-api-access-jq5gm") pod "6d92036c-248c-42bd-ab9c-6f40baddd6c1" (UID: "6d92036c-248c-42bd-ab9c-6f40baddd6c1"). InnerVolumeSpecName "kube-api-access-jq5gm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:28:05.828096 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:28:05.828056 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jq5gm\" (UniqueName: \"kubernetes.io/projected/6d92036c-248c-42bd-ab9c-6f40baddd6c1-kube-api-access-jq5gm\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:28:06.580754 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:28:06.580719 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn" Jul 15 21:28:06.580754 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:28:06.580740 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn" event={"ID":"6d92036c-248c-42bd-ab9c-6f40baddd6c1","Type":"ContainerDied","Data":"37d108e53f93f1ca8f18b9725f623f22672d5da1d8ebd4cbc9168ca4fc0d0452"} Jul 15 21:28:06.581289 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:28:06.580794 2572 scope.go:117] "RemoveContainer" containerID="89a6afbe90b66a24fff82b790927c5ccd22cc6ff040a5a24c7b9607621aaea14" Jul 15 21:28:06.599151 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:28:06.599130 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn"] Jul 15 21:28:06.602799 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:28:06.602777 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-ctmsn"] Jul 15 21:28:07.961058 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:28:07.961033 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="6d92036c-248c-42bd-ab9c-6f40baddd6c1" path="/var/lib/kubelet/pods/6d92036c-248c-42bd-ab9c-6f40baddd6c1/volumes" Jul 15 21:29:04.348274 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.348241 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q98fx"] Jul 15 21:29:04.348759 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.348632 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6f2653ac-07b9-4cc2-9251-1f083cad8dcd" containerName="authorino" Jul 15 21:29:04.348759 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.348645 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6f2653ac-07b9-4cc2-9251-1f083cad8dcd" containerName="authorino" Jul 15 21:29:04.348759 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.348661 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d92036c-248c-42bd-ab9c-6f40baddd6c1" containerName="manager" Jul 15 21:29:04.348759 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.348667 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d92036c-248c-42bd-ab9c-6f40baddd6c1" containerName="manager" Jul 15 21:29:04.348759 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.348720 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6f2653ac-07b9-4cc2-9251-1f083cad8dcd" containerName="authorino" Jul 15 21:29:04.348759 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.348730 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d92036c-248c-42bd-ab9c-6f40baddd6c1" containerName="manager" Jul 15 21:29:04.351801 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.351778 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q98fx" Jul 15 21:29:04.354636 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.354616 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 15 21:29:04.354636 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.354628 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 15 21:29:04.354796 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.354654 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-jm226\"" Jul 15 21:29:04.362962 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.362936 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2js2\" (UniqueName: \"kubernetes.io/projected/03e6e5c8-6866-4998-b09f-93f98d85ccac-kube-api-access-c2js2\") pod \"kuadrant-operator-controller-manager-86878c769f-q98fx\" (UID: \"03e6e5c8-6866-4998-b09f-93f98d85ccac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q98fx" Jul 15 21:29:04.363155 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.363131 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03e6e5c8-6866-4998-b09f-93f98d85ccac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q98fx\" (UID: \"03e6e5c8-6866-4998-b09f-93f98d85ccac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q98fx" Jul 15 21:29:04.365531 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.365503 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q98fx"] Jul 15 21:29:04.464376 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.464333 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2js2\" (UniqueName: \"kubernetes.io/projected/03e6e5c8-6866-4998-b09f-93f98d85ccac-kube-api-access-c2js2\") pod \"kuadrant-operator-controller-manager-86878c769f-q98fx\" (UID: \"03e6e5c8-6866-4998-b09f-93f98d85ccac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q98fx" Jul 15 21:29:04.464579 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.464428 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03e6e5c8-6866-4998-b09f-93f98d85ccac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q98fx\" (UID: \"03e6e5c8-6866-4998-b09f-93f98d85ccac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q98fx" Jul 15 21:29:04.464817 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.464799 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/03e6e5c8-6866-4998-b09f-93f98d85ccac-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-q98fx\" (UID: \"03e6e5c8-6866-4998-b09f-93f98d85ccac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q98fx" Jul 15 21:29:04.477856 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.477828 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2js2\" (UniqueName: \"kubernetes.io/projected/03e6e5c8-6866-4998-b09f-93f98d85ccac-kube-api-access-c2js2\") pod \"kuadrant-operator-controller-manager-86878c769f-q98fx\" (UID: \"03e6e5c8-6866-4998-b09f-93f98d85ccac\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q98fx" Jul 15 21:29:04.661971 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.661887 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q98fx" Jul 15 21:29:04.800747 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.800721 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q98fx"] Jul 15 21:29:04.803642 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:29:04.803619 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod03e6e5c8_6866_4998_b09f_93f98d85ccac.slice/crio-36288668c61e62e309d2aa210612e57924cc37c11a4ef98708e3895e23df0bdf WatchSource:0}: Error finding container 36288668c61e62e309d2aa210612e57924cc37c11a4ef98708e3895e23df0bdf: Status 404 returned error can't find the container with id 36288668c61e62e309d2aa210612e57924cc37c11a4ef98708e3895e23df0bdf Jul 15 21:29:04.891832 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.891801 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q98fx" event={"ID":"03e6e5c8-6866-4998-b09f-93f98d85ccac","Type":"ContainerStarted","Data":"861cbdca0343b0ad60001a13d4890a9c1f540c28d9366ba75434e5d52a370071"} Jul 15 21:29:04.891949 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.891858 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q98fx" Jul 15 21:29:04.891949 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.891874 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q98fx" event={"ID":"03e6e5c8-6866-4998-b09f-93f98d85ccac","Type":"ContainerStarted","Data":"36288668c61e62e309d2aa210612e57924cc37c11a4ef98708e3895e23df0bdf"} Jul 15 21:29:04.917983 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:04.917906 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q98fx" podStartSLOduration=0.917890714 podStartE2EDuration="917.890714ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:29:04 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:29:04.916199736 +0000 UTC m=+1137.737517055" watchObservedRunningTime="2026-07-15 21:29:04.917890714 +0000 UTC m=+1137.739208030" Jul 15 21:29:15.899315 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:29:15.899233 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-q98fx" Jul 15 21:30:00.142030 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:30:00.141952 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735850-x7zfc"] Jul 15 21:30:00.145339 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:30:00.145322 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-x7zfc" Jul 15 21:30:00.148018 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:30:00.147996 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-x6nvd\"" Jul 15 21:30:00.154586 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:30:00.154562 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735850-x7zfc"] Jul 15 21:30:00.155711 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:30:00.155692 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-x7zfc" Jul 15 21:30:00.295235 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:30:00.295208 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-29735850-x7zfc"] Jul 15 21:30:00.297018 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:30:00.296993 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod2e89474a_8519_4c29_abf1_6a09cc0cb5f3.slice/crio-afba7095a1dad2f64ca8aecc28ee0af5ae5fd632d52db0011a2dd4c75644ba2c WatchSource:0}: Error finding container afba7095a1dad2f64ca8aecc28ee0af5ae5fd632d52db0011a2dd4c75644ba2c: Status 404 returned error can't find the container with id afba7095a1dad2f64ca8aecc28ee0af5ae5fd632d52db0011a2dd4c75644ba2c Jul 15 21:30:00.299084 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:30:00.299065 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:30:01.201436 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:30:01.201400 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-x7zfc" event={"ID":"2e89474a-8519-4c29-abf1-6a09cc0cb5f3","Type":"ContainerStarted","Data":"afba7095a1dad2f64ca8aecc28ee0af5ae5fd632d52db0011a2dd4c75644ba2c"} Jul 15 21:30:07.235743 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:30:07.235643 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-x7zfc" event={"ID":"2e89474a-8519-4c29-abf1-6a09cc0cb5f3","Type":"ContainerStarted","Data":"704165df2d64e52780a2e745ecb17e4a5351dee9b0cb27d8a7ba788a677e4055"} Jul 15 21:30:07.252179 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:30:07.252132 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-x7zfc" podStartSLOduration=0.90773965 podStartE2EDuration="7.252118216s" totalImagesPullingTime="6.344378566s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:30:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:30:07.2504615 +0000 UTC m=+1200.071778818" watchObservedRunningTime="2026-07-15 21:30:07.252118216 +0000 UTC m=+1200.073435533" Jul 15 21:30:08.182199 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:30:08.182167 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsl2f_19ebe52b-28dc-4b7b-af2d-0779b13a9b62/ovn-acl-logging/0.log" Jul 15 21:30:08.185222 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:30:08.185193 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsl2f_19ebe52b-28dc-4b7b-af2d-0779b13a9b62/ovn-acl-logging/0.log" Jul 15 21:30:08.242479 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:30:08.242442 2572 generic.go:356] "Generic (PLEG): container finished" podID="2e89474a-8519-4c29-abf1-6a09cc0cb5f3" containerID="704165df2d64e52780a2e745ecb17e4a5351dee9b0cb27d8a7ba788a677e4055" exitCode=0 Jul 15 21:30:08.242881 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:30:08.242519 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-x7zfc" event={"ID":"2e89474a-8519-4c29-abf1-6a09cc0cb5f3","Type":"ContainerDied","Data":"704165df2d64e52780a2e745ecb17e4a5351dee9b0cb27d8a7ba788a677e4055"} Jul 15 21:30:09.378167 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:30:09.378144 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-x7zfc" Jul 15 21:30:10.254035 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:30:10.253945 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-x7zfc" event={"ID":"2e89474a-8519-4c29-abf1-6a09cc0cb5f3","Type":"ContainerDied","Data":"afba7095a1dad2f64ca8aecc28ee0af5ae5fd632d52db0011a2dd4c75644ba2c"} Jul 15 21:30:10.254035 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:30:10.253983 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-29735850-x7zfc" Jul 15 21:30:10.254035 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:30:10.254006 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="afba7095a1dad2f64ca8aecc28ee0af5ae5fd632d52db0011a2dd4c75644ba2c" Jul 15 21:35:08.216892 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:08.216867 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsl2f_19ebe52b-28dc-4b7b-af2d-0779b13a9b62/ovn-acl-logging/0.log" Jul 15 21:35:08.220385 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:08.220365 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsl2f_19ebe52b-28dc-4b7b-af2d-0779b13a9b62/ovn-acl-logging/0.log" Jul 15 21:35:24.068669 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.068629 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6"] Jul 15 21:35:24.069157 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.069011 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="2e89474a-8519-4c29-abf1-6a09cc0cb5f3" containerName="cleanup" Jul 15 21:35:24.069157 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.069022 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="2e89474a-8519-4c29-abf1-6a09cc0cb5f3" containerName="cleanup" Jul 15 21:35:24.069157 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.069102 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="2e89474a-8519-4c29-abf1-6a09cc0cb5f3" containerName="cleanup" Jul 15 21:35:24.071780 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.071760 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.075037 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.075019 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-ca080678-openshift-default-dockercfg-htxx6\"" Jul 15 21:35:24.100449 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.100419 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6"] Jul 15 21:35:24.156902 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.156870 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-envoy\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.157071 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.156910 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2n2sf\" (UniqueName: \"kubernetes.io/projected/aa4a6651-d62c-4aca-b7c4-1150244f3113-kube-api-access-2n2sf\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.157071 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.156994 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-workload-certs\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.157071 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.157051 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-credential-socket\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.157199 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.157155 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa4a6651-d62c-4aca-b7c4-1150244f3113-istiod-ca-cert\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.157199 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.157180 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-podinfo\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.157277 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.157197 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-data\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.157277 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.157266 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-workload-socket\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.157343 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.157296 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-token\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.258424 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.258376 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-envoy\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.258424 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.258424 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2n2sf\" (UniqueName: \"kubernetes.io/projected/aa4a6651-d62c-4aca-b7c4-1150244f3113-kube-api-access-2n2sf\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.258702 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.258455 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-workload-certs\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.258702 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.258487 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-credential-socket\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.258702 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.258618 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa4a6651-d62c-4aca-b7c4-1150244f3113-istiod-ca-cert\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.258702 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.258658 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-podinfo\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.258702 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.258687 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-data\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.258979 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.258748 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-workload-socket\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.258979 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.258777 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-token\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.259558 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.259513 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-credential-socket\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.259943 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.259916 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa4a6651-d62c-4aca-b7c4-1150244f3113-istiod-ca-cert\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.260226 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.260203 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-workload-socket\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.260408 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.260301 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-data\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.260602 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.260577 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-workload-certs\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.262948 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.262914 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-envoy\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.264198 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.264175 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-podinfo\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.273898 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.273853 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-token\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.275646 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.275623 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2n2sf\" (UniqueName: \"kubernetes.io/projected/aa4a6651-d62c-4aca-b7c4-1150244f3113-kube-api-access-2n2sf\") pod \"e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.383356 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.383320 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:24.533482 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.533453 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6"] Jul 15 21:35:24.537972 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:35:24.537946 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaa4a6651_d62c_4aca_b7c4_1150244f3113.slice/crio-c90a49046836aafb7d98028c059f79cf8a899dab27d8372255da2c71f0a0c46c WatchSource:0}: Error finding container c90a49046836aafb7d98028c059f79cf8a899dab27d8372255da2c71f0a0c46c: Status 404 returned error can't find the container with id c90a49046836aafb7d98028c059f79cf8a899dab27d8372255da2c71f0a0c46c Jul 15 21:35:24.540218 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.540188 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:35:24.540294 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.540246 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:35:24.540294 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.540276 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:35:24.948148 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.948111 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" event={"ID":"aa4a6651-d62c-4aca-b7c4-1150244f3113","Type":"ContainerStarted","Data":"d65a7d08b7e9c6343de54c19ff958d91987cc5b5c0ec9b7580334d933a0aa8db"} Jul 15 21:35:24.948349 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.948179 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" event={"ID":"aa4a6651-d62c-4aca-b7c4-1150244f3113","Type":"ContainerStarted","Data":"c90a49046836aafb7d98028c059f79cf8a899dab27d8372255da2c71f0a0c46c"} Jul 15 21:35:24.973452 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:24.973398 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" podStartSLOduration=0.973382853 podStartE2EDuration="973.382853ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:35:24 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:35:24.970458523 +0000 UTC m=+1517.791775841" watchObservedRunningTime="2026-07-15 21:35:24.973382853 +0000 UTC m=+1517.794700236" Jul 15 21:35:25.384402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:25.384369 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:25.389258 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:25.389237 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:25.963021 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:25.962992 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:25.963204 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:25.963065 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:30.355056 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:30.354971 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6"] Jul 15 21:35:30.355452 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:30.355156 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" podUID="aa4a6651-d62c-4aca-b7c4-1150244f3113" containerName="istio-proxy" containerID="cri-o://d65a7d08b7e9c6343de54c19ff958d91987cc5b5c0ec9b7580334d933a0aa8db" gracePeriod=30 Jul 15 21:35:35.508774 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.508746 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:35.563231 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.563148 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-workload-socket\") pod \"aa4a6651-d62c-4aca-b7c4-1150244f3113\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " Jul 15 21:35:35.563231 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.563195 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-envoy\") pod \"aa4a6651-d62c-4aca-b7c4-1150244f3113\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " Jul 15 21:35:35.563231 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.563218 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-credential-socket\") pod \"aa4a6651-d62c-4aca-b7c4-1150244f3113\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " Jul 15 21:35:35.563572 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.563242 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-data\") pod \"aa4a6651-d62c-4aca-b7c4-1150244f3113\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " Jul 15 21:35:35.563572 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.563264 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-podinfo\") pod \"aa4a6651-d62c-4aca-b7c4-1150244f3113\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " Jul 15 21:35:35.563572 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.563302 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-2n2sf\" (UniqueName: \"kubernetes.io/projected/aa4a6651-d62c-4aca-b7c4-1150244f3113-kube-api-access-2n2sf\") pod \"aa4a6651-d62c-4aca-b7c4-1150244f3113\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " Jul 15 21:35:35.563572 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.563385 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-token\") pod \"aa4a6651-d62c-4aca-b7c4-1150244f3113\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " Jul 15 21:35:35.563572 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.563416 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa4a6651-d62c-4aca-b7c4-1150244f3113-istiod-ca-cert\") pod \"aa4a6651-d62c-4aca-b7c4-1150244f3113\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " Jul 15 21:35:35.563572 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.563447 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "aa4a6651-d62c-4aca-b7c4-1150244f3113" (UID: "aa4a6651-d62c-4aca-b7c4-1150244f3113"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:35:35.563871 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.563635 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "aa4a6651-d62c-4aca-b7c4-1150244f3113" (UID: "aa4a6651-d62c-4aca-b7c4-1150244f3113"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:35:35.563871 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.563786 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-workload-socket\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:35:35.563871 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.563805 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-credential-socket\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:35:35.563871 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.563818 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/aa4a6651-d62c-4aca-b7c4-1150244f3113-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "aa4a6651-d62c-4aca-b7c4-1150244f3113" (UID: "aa4a6651-d62c-4aca-b7c4-1150244f3113"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:35:35.564393 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.564365 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-data" (OuterVolumeSpecName: "istio-data") pod "aa4a6651-d62c-4aca-b7c4-1150244f3113" (UID: "aa4a6651-d62c-4aca-b7c4-1150244f3113"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:35:35.565768 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.565741 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "aa4a6651-d62c-4aca-b7c4-1150244f3113" (UID: "aa4a6651-d62c-4aca-b7c4-1150244f3113"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:35:35.565768 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.565758 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa4a6651-d62c-4aca-b7c4-1150244f3113-kube-api-access-2n2sf" (OuterVolumeSpecName: "kube-api-access-2n2sf") pod "aa4a6651-d62c-4aca-b7c4-1150244f3113" (UID: "aa4a6651-d62c-4aca-b7c4-1150244f3113"). InnerVolumeSpecName "kube-api-access-2n2sf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:35:35.565938 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.565885 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-token" (OuterVolumeSpecName: "istio-token") pod "aa4a6651-d62c-4aca-b7c4-1150244f3113" (UID: "aa4a6651-d62c-4aca-b7c4-1150244f3113"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:35:35.566217 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.566193 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "aa4a6651-d62c-4aca-b7c4-1150244f3113" (UID: "aa4a6651-d62c-4aca-b7c4-1150244f3113"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 21:35:35.664316 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.664281 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-workload-certs\") pod \"aa4a6651-d62c-4aca-b7c4-1150244f3113\" (UID: \"aa4a6651-d62c-4aca-b7c4-1150244f3113\") " Jul 15 21:35:35.664572 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.664558 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-envoy\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:35:35.664624 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.664574 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-data\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:35:35.664624 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.664582 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-podinfo\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:35:35.664624 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.664590 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-2n2sf\" (UniqueName: \"kubernetes.io/projected/aa4a6651-d62c-4aca-b7c4-1150244f3113-kube-api-access-2n2sf\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:35:35.664624 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.664599 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/aa4a6651-d62c-4aca-b7c4-1150244f3113-istio-token\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:35:35.664624 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.664607 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/aa4a6651-d62c-4aca-b7c4-1150244f3113-istiod-ca-cert\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:35:35.664781 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.664645 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "aa4a6651-d62c-4aca-b7c4-1150244f3113" (UID: "aa4a6651-d62c-4aca-b7c4-1150244f3113"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:35:35.765903 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:35.765871 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/aa4a6651-d62c-4aca-b7c4-1150244f3113-workload-certs\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:35:36.020853 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:36.020817 2572 generic.go:356] "Generic (PLEG): container finished" podID="aa4a6651-d62c-4aca-b7c4-1150244f3113" containerID="d65a7d08b7e9c6343de54c19ff958d91987cc5b5c0ec9b7580334d933a0aa8db" exitCode=0 Jul 15 21:35:36.020853 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:36.020859 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" Jul 15 21:35:36.021109 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:36.020877 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" event={"ID":"aa4a6651-d62c-4aca-b7c4-1150244f3113","Type":"ContainerDied","Data":"d65a7d08b7e9c6343de54c19ff958d91987cc5b5c0ec9b7580334d933a0aa8db"} Jul 15 21:35:36.021109 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:36.020932 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6" event={"ID":"aa4a6651-d62c-4aca-b7c4-1150244f3113","Type":"ContainerDied","Data":"c90a49046836aafb7d98028c059f79cf8a899dab27d8372255da2c71f0a0c46c"} Jul 15 21:35:36.021109 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:36.020959 2572 scope.go:117] "RemoveContainer" containerID="d65a7d08b7e9c6343de54c19ff958d91987cc5b5c0ec9b7580334d933a0aa8db" Jul 15 21:35:36.030101 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:36.030084 2572 scope.go:117] "RemoveContainer" containerID="d65a7d08b7e9c6343de54c19ff958d91987cc5b5c0ec9b7580334d933a0aa8db" Jul 15 21:35:36.030344 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:35:36.030325 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d65a7d08b7e9c6343de54c19ff958d91987cc5b5c0ec9b7580334d933a0aa8db\": container with ID starting with d65a7d08b7e9c6343de54c19ff958d91987cc5b5c0ec9b7580334d933a0aa8db not found: ID does not exist" containerID="d65a7d08b7e9c6343de54c19ff958d91987cc5b5c0ec9b7580334d933a0aa8db" Jul 15 21:35:36.030428 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:36.030353 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d65a7d08b7e9c6343de54c19ff958d91987cc5b5c0ec9b7580334d933a0aa8db"} err="failed to get container status \"d65a7d08b7e9c6343de54c19ff958d91987cc5b5c0ec9b7580334d933a0aa8db\": rpc error: code = NotFound desc = could not find container \"d65a7d08b7e9c6343de54c19ff958d91987cc5b5c0ec9b7580334d933a0aa8db\": container with ID starting with d65a7d08b7e9c6343de54c19ff958d91987cc5b5c0ec9b7580334d933a0aa8db not found: ID does not exist" Jul 15 21:35:36.047165 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:36.047139 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6"] Jul 15 21:35:36.053273 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:36.053253 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-ca080678-openshift-default-57b77bc54f-6bll6"] Jul 15 21:35:37.150497 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.150461 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt"] Jul 15 21:35:37.151374 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.151339 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa4a6651-d62c-4aca-b7c4-1150244f3113" containerName="istio-proxy" Jul 15 21:35:37.151374 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.151371 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa4a6651-d62c-4aca-b7c4-1150244f3113" containerName="istio-proxy" Jul 15 21:35:37.151576 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.151502 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa4a6651-d62c-4aca-b7c4-1150244f3113" containerName="istio-proxy" Jul 15 21:35:37.156120 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.156098 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.159313 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.159290 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-migrate-c871ea22-gw-openshift-default-dockercfg-hkvf6\"" Jul 15 21:35:37.176980 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.176952 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt"] Jul 15 21:35:37.179571 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.179517 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-data\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.179706 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.179585 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-credential-socket\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.179706 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.179633 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-envoy\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.179706 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.179683 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-workload-socket\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.179900 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.179709 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-token\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.179900 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.179770 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-workload-certs\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.179900 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.179816 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e23fc3e6-d219-4f43-8714-0aff6c577b90-istiod-ca-cert\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.179900 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.179833 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2zfl\" (UniqueName: \"kubernetes.io/projected/e23fc3e6-d219-4f43-8714-0aff6c577b90-kube-api-access-s2zfl\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.179900 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.179854 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-podinfo\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.280896 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.280851 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-workload-socket\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.281093 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.280912 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-token\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.281093 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.280950 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-workload-certs\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.281093 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.280996 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e23fc3e6-d219-4f43-8714-0aff6c577b90-istiod-ca-cert\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.281093 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.281021 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2zfl\" (UniqueName: \"kubernetes.io/projected/e23fc3e6-d219-4f43-8714-0aff6c577b90-kube-api-access-s2zfl\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.281093 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.281054 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-podinfo\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.281379 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.281114 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-data\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.281379 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.281144 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-credential-socket\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.281379 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.281204 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-envoy\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.281379 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.281325 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-workload-socket\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.281659 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.281639 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-data\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.281761 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.281740 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-workload-certs\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.282019 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.282000 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-credential-socket\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.283059 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.282473 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e23fc3e6-d219-4f43-8714-0aff6c577b90-istiod-ca-cert\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.284248 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.284216 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-envoy\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.284628 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.284611 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-podinfo\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.299254 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.299230 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2zfl\" (UniqueName: \"kubernetes.io/projected/e23fc3e6-d219-4f43-8714-0aff6c577b90-kube-api-access-s2zfl\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.301579 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.301559 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-token\") pod \"e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.468307 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.468209 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:37.619319 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.619212 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt"] Jul 15 21:35:37.621993 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:35:37.621957 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode23fc3e6_d219_4f43_8714_0aff6c577b90.slice/crio-f00839fb0ed081a97714a06315680280e78d70216bb4d40117ea73b1d3c5d217 WatchSource:0}: Error finding container f00839fb0ed081a97714a06315680280e78d70216bb4d40117ea73b1d3c5d217: Status 404 returned error can't find the container with id f00839fb0ed081a97714a06315680280e78d70216bb4d40117ea73b1d3c5d217 Jul 15 21:35:37.624103 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.624072 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:35:37.624174 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.624140 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:35:37.624174 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.624170 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:35:37.963953 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:37.963921 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="aa4a6651-d62c-4aca-b7c4-1150244f3113" path="/var/lib/kubelet/pods/aa4a6651-d62c-4aca-b7c4-1150244f3113/volumes" Jul 15 21:35:38.035854 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:38.035814 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" event={"ID":"e23fc3e6-d219-4f43-8714-0aff6c577b90","Type":"ContainerStarted","Data":"550693b35e1c4bfe3169f04751f519c3a2eedd5aff68fb3689913f06c800b838"} Jul 15 21:35:38.036040 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:38.035888 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" event={"ID":"e23fc3e6-d219-4f43-8714-0aff6c577b90","Type":"ContainerStarted","Data":"f00839fb0ed081a97714a06315680280e78d70216bb4d40117ea73b1d3c5d217"} Jul 15 21:35:38.062964 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:38.062917 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" podStartSLOduration=1.06289889 podStartE2EDuration="1.06289889s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:35:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:35:38.059393581 +0000 UTC m=+1530.880710911" watchObservedRunningTime="2026-07-15 21:35:38.06289889 +0000 UTC m=+1530.884216286" Jul 15 21:35:38.468790 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:38.468750 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:38.473781 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:38.473757 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:39.040991 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:39.040962 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:39.041876 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:39.041858 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:42.980385 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:42.980341 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt"] Jul 15 21:35:42.981258 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:42.981226 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" podUID="e23fc3e6-d219-4f43-8714-0aff6c577b90" containerName="istio-proxy" containerID="cri-o://550693b35e1c4bfe3169f04751f519c3a2eedd5aff68fb3689913f06c800b838" gracePeriod=30 Jul 15 21:35:49.109218 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.109183 2572 generic.go:356] "Generic (PLEG): container finished" podID="e23fc3e6-d219-4f43-8714-0aff6c577b90" containerID="550693b35e1c4bfe3169f04751f519c3a2eedd5aff68fb3689913f06c800b838" exitCode=0 Jul 15 21:35:49.109726 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.109253 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" event={"ID":"e23fc3e6-d219-4f43-8714-0aff6c577b90","Type":"ContainerDied","Data":"550693b35e1c4bfe3169f04751f519c3a2eedd5aff68fb3689913f06c800b838"} Jul 15 21:35:49.139679 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.139654 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:49.235378 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.235302 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-credential-socket\") pod \"e23fc3e6-d219-4f43-8714-0aff6c577b90\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " Jul 15 21:35:49.235378 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.235341 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-podinfo\") pod \"e23fc3e6-d219-4f43-8714-0aff6c577b90\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " Jul 15 21:35:49.235378 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.235379 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-workload-socket\") pod \"e23fc3e6-d219-4f43-8714-0aff6c577b90\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " Jul 15 21:35:49.235672 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.235395 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e23fc3e6-d219-4f43-8714-0aff6c577b90-istiod-ca-cert\") pod \"e23fc3e6-d219-4f43-8714-0aff6c577b90\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " Jul 15 21:35:49.235672 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.235432 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-token\") pod \"e23fc3e6-d219-4f43-8714-0aff6c577b90\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " Jul 15 21:35:49.235672 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.235465 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s2zfl\" (UniqueName: \"kubernetes.io/projected/e23fc3e6-d219-4f43-8714-0aff6c577b90-kube-api-access-s2zfl\") pod \"e23fc3e6-d219-4f43-8714-0aff6c577b90\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " Jul 15 21:35:49.235672 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.235487 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-workload-certs\") pod \"e23fc3e6-d219-4f43-8714-0aff6c577b90\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " Jul 15 21:35:49.235672 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.235513 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-envoy\") pod \"e23fc3e6-d219-4f43-8714-0aff6c577b90\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " Jul 15 21:35:49.235672 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.235599 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-data\") pod \"e23fc3e6-d219-4f43-8714-0aff6c577b90\" (UID: \"e23fc3e6-d219-4f43-8714-0aff6c577b90\") " Jul 15 21:35:49.235672 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.235647 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "e23fc3e6-d219-4f43-8714-0aff6c577b90" (UID: "e23fc3e6-d219-4f43-8714-0aff6c577b90"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:35:49.236024 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.235749 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "e23fc3e6-d219-4f43-8714-0aff6c577b90" (UID: "e23fc3e6-d219-4f43-8714-0aff6c577b90"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:35:49.236024 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.235844 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "e23fc3e6-d219-4f43-8714-0aff6c577b90" (UID: "e23fc3e6-d219-4f43-8714-0aff6c577b90"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:35:49.236024 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.235990 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-workload-certs\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:35:49.236024 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.236010 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-credential-socket\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:35:49.236024 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.236025 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-workload-socket\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:35:49.236277 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.236114 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/e23fc3e6-d219-4f43-8714-0aff6c577b90-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "e23fc3e6-d219-4f43-8714-0aff6c577b90" (UID: "e23fc3e6-d219-4f43-8714-0aff6c577b90"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:35:49.236437 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.236415 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-data" (OuterVolumeSpecName: "istio-data") pod "e23fc3e6-d219-4f43-8714-0aff6c577b90" (UID: "e23fc3e6-d219-4f43-8714-0aff6c577b90"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:35:49.237675 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.237652 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "e23fc3e6-d219-4f43-8714-0aff6c577b90" (UID: "e23fc3e6-d219-4f43-8714-0aff6c577b90"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 21:35:49.237810 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.237732 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-token" (OuterVolumeSpecName: "istio-token") pod "e23fc3e6-d219-4f43-8714-0aff6c577b90" (UID: "e23fc3e6-d219-4f43-8714-0aff6c577b90"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:35:49.238063 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.238047 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "e23fc3e6-d219-4f43-8714-0aff6c577b90" (UID: "e23fc3e6-d219-4f43-8714-0aff6c577b90"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:35:49.238118 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.238095 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/e23fc3e6-d219-4f43-8714-0aff6c577b90-kube-api-access-s2zfl" (OuterVolumeSpecName: "kube-api-access-s2zfl") pod "e23fc3e6-d219-4f43-8714-0aff6c577b90" (UID: "e23fc3e6-d219-4f43-8714-0aff6c577b90"). InnerVolumeSpecName "kube-api-access-s2zfl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:35:49.337001 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.336968 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/e23fc3e6-d219-4f43-8714-0aff6c577b90-istiod-ca-cert\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:35:49.337001 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.336995 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-token\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:35:49.337001 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.337005 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s2zfl\" (UniqueName: \"kubernetes.io/projected/e23fc3e6-d219-4f43-8714-0aff6c577b90-kube-api-access-s2zfl\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:35:49.337222 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.337015 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-envoy\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:35:49.337222 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.337024 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-data\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:35:49.337222 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.337032 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/e23fc3e6-d219-4f43-8714-0aff6c577b90-istio-podinfo\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:35:49.543627 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.543550 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf"] Jul 15 21:35:49.544131 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.544109 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e23fc3e6-d219-4f43-8714-0aff6c577b90" containerName="istio-proxy" Jul 15 21:35:49.544131 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.544130 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e23fc3e6-d219-4f43-8714-0aff6c577b90" containerName="istio-proxy" Jul 15 21:35:49.544272 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.544197 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e23fc3e6-d219-4f43-8714-0aff6c577b90" containerName="istio-proxy" Jul 15 21:35:49.546506 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.546490 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.551148 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.551129 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-281d9c60-openshift-default-dockercfg-8psb5\"" Jul 15 21:35:49.566673 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.566635 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf"] Jul 15 21:35:49.639432 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.639402 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istiod-ca-cert\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.639596 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.639436 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-podinfo\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.639596 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.639466 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-credential-socket\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.639596 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.639563 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-envoy\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.639724 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.639671 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-data\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.639724 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.639717 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-workload-certs\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.639832 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.639757 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-workload-socket\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.639832 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.639782 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j89j6\" (UniqueName: \"kubernetes.io/projected/95f7bb36-ed1b-411f-be4a-085c30bf32e5-kube-api-access-j89j6\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.639832 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.639805 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-token\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.740505 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.740466 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-envoy\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.740689 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.740555 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-data\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.740689 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.740589 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-workload-certs\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.740689 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.740629 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-workload-socket\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.740689 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.740658 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j89j6\" (UniqueName: \"kubernetes.io/projected/95f7bb36-ed1b-411f-be4a-085c30bf32e5-kube-api-access-j89j6\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.740897 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.740689 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-token\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.740897 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.740752 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istiod-ca-cert\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.740897 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.740779 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-podinfo\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.740897 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.740825 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-credential-socket\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.741110 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.740996 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-data\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.741110 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.741015 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-workload-certs\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.741271 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.741251 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-credential-socket\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.741344 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.741320 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-workload-socket\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.741498 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.741480 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istiod-ca-cert\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.742761 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.742742 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-envoy\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.743130 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.743108 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-podinfo\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.755623 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.755598 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j89j6\" (UniqueName: \"kubernetes.io/projected/95f7bb36-ed1b-411f-be4a-085c30bf32e5-kube-api-access-j89j6\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.755876 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.755858 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-token\") pod \"e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:49.859116 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:49.859084 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:50.026300 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:50.026273 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf"] Jul 15 21:35:50.028268 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:35:50.028238 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod95f7bb36_ed1b_411f_be4a_085c30bf32e5.slice/crio-6b1320089bfa67ed561e40f47684d0df3b0572c447c56a0265a50e5259e038ec WatchSource:0}: Error finding container 6b1320089bfa67ed561e40f47684d0df3b0572c447c56a0265a50e5259e038ec: Status 404 returned error can't find the container with id 6b1320089bfa67ed561e40f47684d0df3b0572c447c56a0265a50e5259e038ec Jul 15 21:35:50.030481 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:50.030443 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:35:50.030568 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:50.030554 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:35:50.030616 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:50.030599 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:35:50.117334 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:50.117256 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" Jul 15 21:35:50.117334 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:50.117268 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt" event={"ID":"e23fc3e6-d219-4f43-8714-0aff6c577b90","Type":"ContainerDied","Data":"f00839fb0ed081a97714a06315680280e78d70216bb4d40117ea73b1d3c5d217"} Jul 15 21:35:50.117817 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:50.117338 2572 scope.go:117] "RemoveContainer" containerID="550693b35e1c4bfe3169f04751f519c3a2eedd5aff68fb3689913f06c800b838" Jul 15 21:35:50.119362 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:50.119337 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" event={"ID":"95f7bb36-ed1b-411f-be4a-085c30bf32e5","Type":"ContainerStarted","Data":"e48733542e1a1dd48ece2f4581395ac70cc364bf64578597b3a791f042d68a90"} Jul 15 21:35:50.119492 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:50.119387 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" event={"ID":"95f7bb36-ed1b-411f-be4a-085c30bf32e5","Type":"ContainerStarted","Data":"6b1320089bfa67ed561e40f47684d0df3b0572c447c56a0265a50e5259e038ec"} Jul 15 21:35:50.149273 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:50.149236 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt"] Jul 15 21:35:50.161286 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:50.161184 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-migrate-c871ea22-gw-openshift-default-68db6c5f99-mmgtt"] Jul 15 21:35:50.196050 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:50.196001 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" podStartSLOduration=1.195984534 podStartE2EDuration="1.195984534s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:35:49 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:35:50.188536516 +0000 UTC m=+1543.009853823" watchObservedRunningTime="2026-07-15 21:35:50.195984534 +0000 UTC m=+1543.017301851" Jul 15 21:35:50.859497 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:50.859458 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:51.865822 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:51.865790 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:51.962154 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:51.962116 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e23fc3e6-d219-4f43-8714-0aff6c577b90" path="/var/lib/kubelet/pods/e23fc3e6-d219-4f43-8714-0aff6c577b90/volumes" Jul 15 21:35:52.131689 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:52.131598 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:52.132484 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:52.132466 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:35:55.218084 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:55.218040 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf"] Jul 15 21:35:55.218688 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:35:55.218267 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" podUID="95f7bb36-ed1b-411f-be4a-085c30bf32e5" containerName="istio-proxy" containerID="cri-o://e48733542e1a1dd48ece2f4581395ac70cc364bf64578597b3a791f042d68a90" gracePeriod=30 Jul 15 21:36:01.577140 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.577116 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:36:01.654375 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.654298 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-workload-socket\") pod \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " Jul 15 21:36:01.654375 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.654341 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-credential-socket\") pod \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " Jul 15 21:36:01.654375 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.654371 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j89j6\" (UniqueName: \"kubernetes.io/projected/95f7bb36-ed1b-411f-be4a-085c30bf32e5-kube-api-access-j89j6\") pod \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " Jul 15 21:36:01.654667 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.654410 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-workload-certs\") pod \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " Jul 15 21:36:01.654667 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.654455 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istiod-ca-cert\") pod \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " Jul 15 21:36:01.654667 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.654498 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-podinfo\") pod \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " Jul 15 21:36:01.654667 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.654565 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-token\") pod \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " Jul 15 21:36:01.654667 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.654598 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "95f7bb36-ed1b-411f-be4a-085c30bf32e5" (UID: "95f7bb36-ed1b-411f-be4a-085c30bf32e5"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:36:01.654667 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.654610 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-data\") pod \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " Jul 15 21:36:01.654977 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.654646 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "95f7bb36-ed1b-411f-be4a-085c30bf32e5" (UID: "95f7bb36-ed1b-411f-be4a-085c30bf32e5"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:36:01.654977 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.654724 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-envoy\") pod \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\" (UID: \"95f7bb36-ed1b-411f-be4a-085c30bf32e5\") " Jul 15 21:36:01.654977 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.654721 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "95f7bb36-ed1b-411f-be4a-085c30bf32e5" (UID: "95f7bb36-ed1b-411f-be4a-085c30bf32e5"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:36:01.654977 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.654917 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "95f7bb36-ed1b-411f-be4a-085c30bf32e5" (UID: "95f7bb36-ed1b-411f-be4a-085c30bf32e5"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:36:01.655186 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.655060 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-workload-socket\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:36:01.655186 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.655080 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-credential-socket\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:36:01.655186 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.655095 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-workload-certs\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:36:01.655186 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.655108 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istiod-ca-cert\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:36:01.655421 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.655401 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-data" (OuterVolumeSpecName: "istio-data") pod "95f7bb36-ed1b-411f-be4a-085c30bf32e5" (UID: "95f7bb36-ed1b-411f-be4a-085c30bf32e5"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:36:01.656619 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.656599 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95f7bb36-ed1b-411f-be4a-085c30bf32e5-kube-api-access-j89j6" (OuterVolumeSpecName: "kube-api-access-j89j6") pod "95f7bb36-ed1b-411f-be4a-085c30bf32e5" (UID: "95f7bb36-ed1b-411f-be4a-085c30bf32e5"). InnerVolumeSpecName "kube-api-access-j89j6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:36:01.656780 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.656757 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "95f7bb36-ed1b-411f-be4a-085c30bf32e5" (UID: "95f7bb36-ed1b-411f-be4a-085c30bf32e5"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:36:01.657090 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.657073 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "95f7bb36-ed1b-411f-be4a-085c30bf32e5" (UID: "95f7bb36-ed1b-411f-be4a-085c30bf32e5"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 21:36:01.657137 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.657107 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-token" (OuterVolumeSpecName: "istio-token") pod "95f7bb36-ed1b-411f-be4a-085c30bf32e5" (UID: "95f7bb36-ed1b-411f-be4a-085c30bf32e5"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:36:01.756470 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.756445 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-podinfo\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:36:01.756470 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.756467 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-token\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:36:01.756470 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.756476 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-data\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:36:01.756687 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.756483 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/95f7bb36-ed1b-411f-be4a-085c30bf32e5-istio-envoy\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:36:01.756687 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:01.756493 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j89j6\" (UniqueName: \"kubernetes.io/projected/95f7bb36-ed1b-411f-be4a-085c30bf32e5-kube-api-access-j89j6\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:36:02.193651 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:02.193618 2572 generic.go:356] "Generic (PLEG): container finished" podID="95f7bb36-ed1b-411f-be4a-085c30bf32e5" containerID="e48733542e1a1dd48ece2f4581395ac70cc364bf64578597b3a791f042d68a90" exitCode=0 Jul 15 21:36:02.193831 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:02.193680 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" Jul 15 21:36:02.193831 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:02.193679 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" event={"ID":"95f7bb36-ed1b-411f-be4a-085c30bf32e5","Type":"ContainerDied","Data":"e48733542e1a1dd48ece2f4581395ac70cc364bf64578597b3a791f042d68a90"} Jul 15 21:36:02.193923 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:02.193841 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf" event={"ID":"95f7bb36-ed1b-411f-be4a-085c30bf32e5","Type":"ContainerDied","Data":"6b1320089bfa67ed561e40f47684d0df3b0572c447c56a0265a50e5259e038ec"} Jul 15 21:36:02.193923 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:02.193874 2572 scope.go:117] "RemoveContainer" containerID="e48733542e1a1dd48ece2f4581395ac70cc364bf64578597b3a791f042d68a90" Jul 15 21:36:02.202829 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:02.202794 2572 scope.go:117] "RemoveContainer" containerID="e48733542e1a1dd48ece2f4581395ac70cc364bf64578597b3a791f042d68a90" Jul 15 21:36:02.203087 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:36:02.203064 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e48733542e1a1dd48ece2f4581395ac70cc364bf64578597b3a791f042d68a90\": container with ID starting with e48733542e1a1dd48ece2f4581395ac70cc364bf64578597b3a791f042d68a90 not found: ID does not exist" containerID="e48733542e1a1dd48ece2f4581395ac70cc364bf64578597b3a791f042d68a90" Jul 15 21:36:02.203164 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:02.203098 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e48733542e1a1dd48ece2f4581395ac70cc364bf64578597b3a791f042d68a90"} err="failed to get container status \"e48733542e1a1dd48ece2f4581395ac70cc364bf64578597b3a791f042d68a90\": rpc error: code = NotFound desc = could not find container \"e48733542e1a1dd48ece2f4581395ac70cc364bf64578597b3a791f042d68a90\": container with ID starting with e48733542e1a1dd48ece2f4581395ac70cc364bf64578597b3a791f042d68a90 not found: ID does not exist" Jul 15 21:36:02.217460 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:02.217429 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf"] Jul 15 21:36:02.220648 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:02.220589 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-281d9c60-openshift-default-9cf47c7f9-4rkwf"] Jul 15 21:36:03.960584 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:36:03.960549 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="95f7bb36-ed1b-411f-be4a-085c30bf32e5" path="/var/lib/kubelet/pods/95f7bb36-ed1b-411f-be4a-085c30bf32e5/volumes" Jul 15 21:37:38.114646 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.114605 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z"] Jul 15 21:37:38.115207 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.115190 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="95f7bb36-ed1b-411f-be4a-085c30bf32e5" containerName="istio-proxy" Jul 15 21:37:38.115207 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.115208 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="95f7bb36-ed1b-411f-be4a-085c30bf32e5" containerName="istio-proxy" Jul 15 21:37:38.115336 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.115324 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="95f7bb36-ed1b-411f-be4a-085c30bf32e5" containerName="istio-proxy" Jul 15 21:37:38.117796 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.117774 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.121323 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.121297 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-f6e0ed38-openshift-default-dockercfg-r6mrb\"" Jul 15 21:37:38.154869 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.154838 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z"] Jul 15 21:37:38.172373 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.172343 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/208594dc-0a6c-48d4-8725-cbf27d427624-istiod-ca-cert\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.172588 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.172386 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/208594dc-0a6c-48d4-8725-cbf27d427624-istio-podinfo\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.172588 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.172403 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-workload-certs\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.172588 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.172541 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-credential-socket\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.172793 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.172609 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/208594dc-0a6c-48d4-8725-cbf27d427624-istio-token\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.172793 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.172649 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-istio-envoy\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.172793 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.172752 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-istio-data\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.172947 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.172797 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-workload-socket\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.172947 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.172846 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c2xvj\" (UniqueName: \"kubernetes.io/projected/208594dc-0a6c-48d4-8725-cbf27d427624-kube-api-access-c2xvj\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.273995 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.273962 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-istio-data\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.274193 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.274003 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-workload-socket\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.274193 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.274090 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c2xvj\" (UniqueName: \"kubernetes.io/projected/208594dc-0a6c-48d4-8725-cbf27d427624-kube-api-access-c2xvj\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.274193 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.274166 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/208594dc-0a6c-48d4-8725-cbf27d427624-istiod-ca-cert\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.274372 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.274210 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/208594dc-0a6c-48d4-8725-cbf27d427624-istio-podinfo\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.274372 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.274238 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-workload-certs\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.274372 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.274288 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-credential-socket\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.274372 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.274323 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/208594dc-0a6c-48d4-8725-cbf27d427624-istio-token\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.274372 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.274336 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-workload-socket\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.274372 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.274353 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-istio-envoy\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.274710 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.274434 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-istio-data\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.274710 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.274669 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-credential-socket\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.275149 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.275126 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/208594dc-0a6c-48d4-8725-cbf27d427624-istiod-ca-cert\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.275223 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.275202 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-workload-certs\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.276568 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.276543 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-istio-envoy\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.276698 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.276679 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/208594dc-0a6c-48d4-8725-cbf27d427624-istio-podinfo\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.284759 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.284733 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c2xvj\" (UniqueName: \"kubernetes.io/projected/208594dc-0a6c-48d4-8725-cbf27d427624-kube-api-access-c2xvj\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.285986 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.285969 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/208594dc-0a6c-48d4-8725-cbf27d427624-istio-token\") pod \"e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.428376 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.428290 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:38.572377 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.572348 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z"] Jul 15 21:37:38.574891 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:37:38.574861 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod208594dc_0a6c_48d4_8725_cbf27d427624.slice/crio-2114d7aad3c8dd0ff8d10377f11915d28038325d0b387b77ddf56e9ef78704e5 WatchSource:0}: Error finding container 2114d7aad3c8dd0ff8d10377f11915d28038325d0b387b77ddf56e9ef78704e5: Status 404 returned error can't find the container with id 2114d7aad3c8dd0ff8d10377f11915d28038325d0b387b77ddf56e9ef78704e5 Jul 15 21:37:38.577460 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.577428 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:37:38.577575 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.577507 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:37:38.577575 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.577564 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:37:38.702887 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.702809 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" event={"ID":"208594dc-0a6c-48d4-8725-cbf27d427624","Type":"ContainerStarted","Data":"cb93f2aafee9b875cda3d9c67379d6ce16b202346ebf60dddf2340b9d24b37f1"} Jul 15 21:37:38.702887 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.702861 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" event={"ID":"208594dc-0a6c-48d4-8725-cbf27d427624","Type":"ContainerStarted","Data":"2114d7aad3c8dd0ff8d10377f11915d28038325d0b387b77ddf56e9ef78704e5"} Jul 15 21:37:38.726404 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:38.726350 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" podStartSLOduration=0.726332305 podStartE2EDuration="726.332305ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:37:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:37:38.723047299 +0000 UTC m=+1651.544364616" watchObservedRunningTime="2026-07-15 21:37:38.726332305 +0000 UTC m=+1651.547649622" Jul 15 21:37:39.429325 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:39.429296 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:39.430685 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:39.430665 2572 patch_prober.go:28] interesting pod/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Jul 15 21:37:39.430733 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:39.430708 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" podUID="208594dc-0a6c-48d4-8725-cbf27d427624" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Jul 15 21:37:40.433475 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:40.433444 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:40.714763 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:40.714676 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:40.715705 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:40.715678 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:51.781588 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:51.781549 2572 generic.go:356] "Generic (PLEG): container finished" podID="208594dc-0a6c-48d4-8725-cbf27d427624" containerID="cb93f2aafee9b875cda3d9c67379d6ce16b202346ebf60dddf2340b9d24b37f1" exitCode=0 Jul 15 21:37:51.782004 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:51.781609 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" event={"ID":"208594dc-0a6c-48d4-8725-cbf27d427624","Type":"ContainerDied","Data":"cb93f2aafee9b875cda3d9c67379d6ce16b202346ebf60dddf2340b9d24b37f1"} Jul 15 21:37:51.782089 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:51.782074 2572 scope.go:117] "RemoveContainer" containerID="cb93f2aafee9b875cda3d9c67379d6ce16b202346ebf60dddf2340b9d24b37f1" Jul 15 21:37:51.783161 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:51.783132 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:37:51.783238 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:51.783223 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:37:51.783279 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:51.783261 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:37:52.791085 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:52.791048 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" event={"ID":"208594dc-0a6c-48d4-8725-cbf27d427624","Type":"ContainerStarted","Data":"b16699166d587c32d50927d830d2c38c652082972fa7f7a237ef526f6cd40b7c"} Jul 15 21:37:53.429008 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:53.428974 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:53.430237 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:53.430213 2572 patch_prober.go:28] interesting pod/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Jul 15 21:37:53.430362 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:53.430261 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" podUID="208594dc-0a6c-48d4-8725-cbf27d427624" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Jul 15 21:37:54.428980 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:54.428947 2572 patch_prober.go:28] interesting pod/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Jul 15 21:37:54.429373 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:54.429011 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" podUID="208594dc-0a6c-48d4-8725-cbf27d427624" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Jul 15 21:37:55.429205 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:55.429171 2572 patch_prober.go:28] interesting pod/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Jul 15 21:37:55.429615 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:55.429228 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" podUID="208594dc-0a6c-48d4-8725-cbf27d427624" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Jul 15 21:37:55.714917 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:55.714828 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:56.429470 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:56.429429 2572 patch_prober.go:28] interesting pod/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" start-of-body= Jul 15 21:37:56.429884 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:56.429492 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" podUID="208594dc-0a6c-48d4-8725-cbf27d427624" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.54:15021/healthz/ready\": dial tcp 10.134.0.54:15021: connect: connection refused" Jul 15 21:37:57.433613 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:57.433580 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:57.434447 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:57.434429 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:37:59.964521 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:59.964486 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z"] Jul 15 21:37:59.964951 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:37:59.964714 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" podUID="208594dc-0a6c-48d4-8725-cbf27d427624" containerName="istio-proxy" containerID="cri-o://b16699166d587c32d50927d830d2c38c652082972fa7f7a237ef526f6cd40b7c" gracePeriod=30 Jul 15 21:38:05.213918 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.213893 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:38:05.243010 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.242943 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/208594dc-0a6c-48d4-8725-cbf27d427624-istio-token\") pod \"208594dc-0a6c-48d4-8725-cbf27d427624\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " Jul 15 21:38:05.243010 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.243002 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-istio-envoy\") pod \"208594dc-0a6c-48d4-8725-cbf27d427624\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " Jul 15 21:38:05.243201 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.243028 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-credential-socket\") pod \"208594dc-0a6c-48d4-8725-cbf27d427624\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " Jul 15 21:38:05.243201 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.243113 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/208594dc-0a6c-48d4-8725-cbf27d427624-istio-podinfo\") pod \"208594dc-0a6c-48d4-8725-cbf27d427624\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " Jul 15 21:38:05.243201 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.243170 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c2xvj\" (UniqueName: \"kubernetes.io/projected/208594dc-0a6c-48d4-8725-cbf27d427624-kube-api-access-c2xvj\") pod \"208594dc-0a6c-48d4-8725-cbf27d427624\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " Jul 15 21:38:05.243365 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.243203 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-istio-data\") pod \"208594dc-0a6c-48d4-8725-cbf27d427624\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " Jul 15 21:38:05.243365 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.243247 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-workload-certs\") pod \"208594dc-0a6c-48d4-8725-cbf27d427624\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " Jul 15 21:38:05.243365 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.243269 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-workload-socket\") pod \"208594dc-0a6c-48d4-8725-cbf27d427624\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " Jul 15 21:38:05.243365 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.243305 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/208594dc-0a6c-48d4-8725-cbf27d427624-istiod-ca-cert\") pod \"208594dc-0a6c-48d4-8725-cbf27d427624\" (UID: \"208594dc-0a6c-48d4-8725-cbf27d427624\") " Jul 15 21:38:05.243825 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.243796 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "208594dc-0a6c-48d4-8725-cbf27d427624" (UID: "208594dc-0a6c-48d4-8725-cbf27d427624"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:38:05.243931 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.243912 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/208594dc-0a6c-48d4-8725-cbf27d427624-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "208594dc-0a6c-48d4-8725-cbf27d427624" (UID: "208594dc-0a6c-48d4-8725-cbf27d427624"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:38:05.244155 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.244097 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "208594dc-0a6c-48d4-8725-cbf27d427624" (UID: "208594dc-0a6c-48d4-8725-cbf27d427624"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:38:05.244155 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.244105 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "208594dc-0a6c-48d4-8725-cbf27d427624" (UID: "208594dc-0a6c-48d4-8725-cbf27d427624"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:38:05.244376 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.244336 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-istio-data" (OuterVolumeSpecName: "istio-data") pod "208594dc-0a6c-48d4-8725-cbf27d427624" (UID: "208594dc-0a6c-48d4-8725-cbf27d427624"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:38:05.245303 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.245276 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "208594dc-0a6c-48d4-8725-cbf27d427624" (UID: "208594dc-0a6c-48d4-8725-cbf27d427624"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:38:05.245580 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.245546 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/208594dc-0a6c-48d4-8725-cbf27d427624-istio-token" (OuterVolumeSpecName: "istio-token") pod "208594dc-0a6c-48d4-8725-cbf27d427624" (UID: "208594dc-0a6c-48d4-8725-cbf27d427624"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:38:05.245694 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.245671 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/208594dc-0a6c-48d4-8725-cbf27d427624-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "208594dc-0a6c-48d4-8725-cbf27d427624" (UID: "208594dc-0a6c-48d4-8725-cbf27d427624"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 21:38:05.245738 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.245675 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/208594dc-0a6c-48d4-8725-cbf27d427624-kube-api-access-c2xvj" (OuterVolumeSpecName: "kube-api-access-c2xvj") pod "208594dc-0a6c-48d4-8725-cbf27d427624" (UID: "208594dc-0a6c-48d4-8725-cbf27d427624"). InnerVolumeSpecName "kube-api-access-c2xvj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:38:05.344232 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.344200 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c2xvj\" (UniqueName: \"kubernetes.io/projected/208594dc-0a6c-48d4-8725-cbf27d427624-kube-api-access-c2xvj\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:38:05.344232 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.344227 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-istio-data\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:38:05.344232 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.344236 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-workload-certs\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:38:05.344444 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.344244 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-workload-socket\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:38:05.344444 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.344253 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/208594dc-0a6c-48d4-8725-cbf27d427624-istiod-ca-cert\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:38:05.344444 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.344261 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/208594dc-0a6c-48d4-8725-cbf27d427624-istio-token\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:38:05.344444 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.344268 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-istio-envoy\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:38:05.344444 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.344275 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/208594dc-0a6c-48d4-8725-cbf27d427624-credential-socket\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:38:05.344444 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.344283 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/208594dc-0a6c-48d4-8725-cbf27d427624-istio-podinfo\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:38:05.864430 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.864395 2572 generic.go:356] "Generic (PLEG): container finished" podID="208594dc-0a6c-48d4-8725-cbf27d427624" containerID="b16699166d587c32d50927d830d2c38c652082972fa7f7a237ef526f6cd40b7c" exitCode=0 Jul 15 21:38:05.864648 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.864449 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" Jul 15 21:38:05.864648 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.864477 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" event={"ID":"208594dc-0a6c-48d4-8725-cbf27d427624","Type":"ContainerDied","Data":"b16699166d587c32d50927d830d2c38c652082972fa7f7a237ef526f6cd40b7c"} Jul 15 21:38:05.864648 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.864567 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z" event={"ID":"208594dc-0a6c-48d4-8725-cbf27d427624","Type":"ContainerDied","Data":"2114d7aad3c8dd0ff8d10377f11915d28038325d0b387b77ddf56e9ef78704e5"} Jul 15 21:38:05.864648 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.864601 2572 scope.go:117] "RemoveContainer" containerID="b16699166d587c32d50927d830d2c38c652082972fa7f7a237ef526f6cd40b7c" Jul 15 21:38:05.874492 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.874473 2572 scope.go:117] "RemoveContainer" containerID="cb93f2aafee9b875cda3d9c67379d6ce16b202346ebf60dddf2340b9d24b37f1" Jul 15 21:38:05.882550 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.882514 2572 scope.go:117] "RemoveContainer" containerID="b16699166d587c32d50927d830d2c38c652082972fa7f7a237ef526f6cd40b7c" Jul 15 21:38:05.882812 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:38:05.882793 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b16699166d587c32d50927d830d2c38c652082972fa7f7a237ef526f6cd40b7c\": container with ID starting with b16699166d587c32d50927d830d2c38c652082972fa7f7a237ef526f6cd40b7c not found: ID does not exist" containerID="b16699166d587c32d50927d830d2c38c652082972fa7f7a237ef526f6cd40b7c" Jul 15 21:38:05.882865 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.882822 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b16699166d587c32d50927d830d2c38c652082972fa7f7a237ef526f6cd40b7c"} err="failed to get container status \"b16699166d587c32d50927d830d2c38c652082972fa7f7a237ef526f6cd40b7c\": rpc error: code = NotFound desc = could not find container \"b16699166d587c32d50927d830d2c38c652082972fa7f7a237ef526f6cd40b7c\": container with ID starting with b16699166d587c32d50927d830d2c38c652082972fa7f7a237ef526f6cd40b7c not found: ID does not exist" Jul 15 21:38:05.882865 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.882840 2572 scope.go:117] "RemoveContainer" containerID="cb93f2aafee9b875cda3d9c67379d6ce16b202346ebf60dddf2340b9d24b37f1" Jul 15 21:38:05.883073 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:38:05.883057 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cb93f2aafee9b875cda3d9c67379d6ce16b202346ebf60dddf2340b9d24b37f1\": container with ID starting with cb93f2aafee9b875cda3d9c67379d6ce16b202346ebf60dddf2340b9d24b37f1 not found: ID does not exist" containerID="cb93f2aafee9b875cda3d9c67379d6ce16b202346ebf60dddf2340b9d24b37f1" Jul 15 21:38:05.883117 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.883079 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cb93f2aafee9b875cda3d9c67379d6ce16b202346ebf60dddf2340b9d24b37f1"} err="failed to get container status \"cb93f2aafee9b875cda3d9c67379d6ce16b202346ebf60dddf2340b9d24b37f1\": rpc error: code = NotFound desc = could not find container \"cb93f2aafee9b875cda3d9c67379d6ce16b202346ebf60dddf2340b9d24b37f1\": container with ID starting with cb93f2aafee9b875cda3d9c67379d6ce16b202346ebf60dddf2340b9d24b37f1 not found: ID does not exist" Jul 15 21:38:05.886924 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.886904 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z"] Jul 15 21:38:05.890515 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.890491 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-f6e0ed38-openshift-default-694f5b7d9f-c652z"] Jul 15 21:38:05.961403 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:38:05.961366 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="208594dc-0a6c-48d4-8725-cbf27d427624" path="/var/lib/kubelet/pods/208594dc-0a6c-48d4-8725-cbf27d427624/volumes" Jul 15 21:39:14.642003 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.641973 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf"] Jul 15 21:39:14.642459 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.642389 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="208594dc-0a6c-48d4-8725-cbf27d427624" containerName="istio-proxy" Jul 15 21:39:14.642459 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.642401 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="208594dc-0a6c-48d4-8725-cbf27d427624" containerName="istio-proxy" Jul 15 21:39:14.642459 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.642413 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="208594dc-0a6c-48d4-8725-cbf27d427624" containerName="istio-proxy" Jul 15 21:39:14.642459 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.642419 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="208594dc-0a6c-48d4-8725-cbf27d427624" containerName="istio-proxy" Jul 15 21:39:14.642611 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.642496 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="208594dc-0a6c-48d4-8725-cbf27d427624" containerName="istio-proxy" Jul 15 21:39:14.642611 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.642504 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="208594dc-0a6c-48d4-8725-cbf27d427624" containerName="istio-proxy" Jul 15 21:39:14.645646 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.645630 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.652966 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.652941 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-da1123-openshift-default-dockercfg-28w58\"" Jul 15 21:39:14.661505 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.661482 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf"] Jul 15 21:39:14.680233 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.680204 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j8jgq\" (UniqueName: \"kubernetes.io/projected/30471297-af03-4e70-aca1-56e6588c98d4-kube-api-access-j8jgq\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.680383 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.680249 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30471297-af03-4e70-aca1-56e6588c98d4-istio-token\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.680383 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.680314 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-istio-data\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.680383 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.680365 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30471297-af03-4e70-aca1-56e6588c98d4-istio-podinfo\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.680510 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.680384 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30471297-af03-4e70-aca1-56e6588c98d4-istiod-ca-cert\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.680510 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.680409 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-workload-socket\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.680510 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.680504 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-istio-envoy\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.680648 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.680554 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-workload-certs\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.680648 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.680581 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-credential-socket\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.781751 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.781710 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-workload-certs\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.781751 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.781755 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-credential-socket\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.781972 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.781938 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j8jgq\" (UniqueName: \"kubernetes.io/projected/30471297-af03-4e70-aca1-56e6588c98d4-kube-api-access-j8jgq\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.782010 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.781997 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30471297-af03-4e70-aca1-56e6588c98d4-istio-token\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.782089 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.782055 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-istio-data\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.782089 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.782070 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-credential-socket\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.782291 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.782123 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30471297-af03-4e70-aca1-56e6588c98d4-istio-podinfo\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.782291 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.782134 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-workload-certs\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.782291 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.782161 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30471297-af03-4e70-aca1-56e6588c98d4-istiod-ca-cert\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.782291 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.782200 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-workload-socket\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.782291 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.782275 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-istio-envoy\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.782576 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.782396 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-istio-data\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.782648 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.782574 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-workload-socket\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.782876 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.782856 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30471297-af03-4e70-aca1-56e6588c98d4-istiod-ca-cert\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.784494 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.784464 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-istio-envoy\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.784598 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.784562 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30471297-af03-4e70-aca1-56e6588c98d4-istio-podinfo\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.790411 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.790391 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30471297-af03-4e70-aca1-56e6588c98d4-istio-token\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.790503 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.790422 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-j8jgq\" (UniqueName: \"kubernetes.io/projected/30471297-af03-4e70-aca1-56e6588c98d4-kube-api-access-j8jgq\") pod \"e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:14.964378 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:14.964305 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:15.114410 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:15.114383 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf"] Jul 15 21:39:15.115903 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:39:15.115882 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod30471297_af03_4e70_aca1_56e6588c98d4.slice/crio-bce4e64f1980d98431ef34031a02dd187617cf063b867f0977014438ece3b4da WatchSource:0}: Error finding container bce4e64f1980d98431ef34031a02dd187617cf063b867f0977014438ece3b4da: Status 404 returned error can't find the container with id bce4e64f1980d98431ef34031a02dd187617cf063b867f0977014438ece3b4da Jul 15 21:39:15.118258 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:15.118230 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:15.118327 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:15.118293 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:15.118327 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:15.118322 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:15.246548 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:15.245603 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" event={"ID":"30471297-af03-4e70-aca1-56e6588c98d4","Type":"ContainerStarted","Data":"92e0aa618b01a0f1fb4108676f9b5f7c47f592d79cca382d6cf2804e6fbfc481"} Jul 15 21:39:15.246548 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:15.245667 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" event={"ID":"30471297-af03-4e70-aca1-56e6588c98d4","Type":"ContainerStarted","Data":"bce4e64f1980d98431ef34031a02dd187617cf063b867f0977014438ece3b4da"} Jul 15 21:39:15.268135 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:15.267813 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" podStartSLOduration=1.267792507 podStartE2EDuration="1.267792507s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:39:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:39:15.267215817 +0000 UTC m=+1748.088533135" watchObservedRunningTime="2026-07-15 21:39:15.267792507 +0000 UTC m=+1748.089109824" Jul 15 21:39:15.964578 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:15.964544 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:16.970059 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:16.970028 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:17.258127 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:17.258040 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:17.259190 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:17.259169 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:22.367217 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.367177 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh"] Jul 15 21:39:22.377591 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.377567 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.381116 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.381086 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-9625f6-openshift-default-dockercfg-8c7mw\"" Jul 15 21:39:22.390482 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.390456 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh"] Jul 15 21:39:22.454693 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.454653 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vcbqs\" (UniqueName: \"kubernetes.io/projected/b8186487-a117-485a-9e3e-17576343055d-kube-api-access-vcbqs\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.454859 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.454747 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-istio-data\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.454859 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.454786 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8186487-a117-485a-9e3e-17576343055d-istio-podinfo\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.454859 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.454824 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-credential-socket\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.454978 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.454875 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-workload-certs\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.454978 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.454905 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-workload-socket\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.454978 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.454937 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-istio-envoy\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.454978 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.454962 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8186487-a117-485a-9e3e-17576343055d-istiod-ca-cert\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.455106 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.454985 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8186487-a117-485a-9e3e-17576343055d-istio-token\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.556435 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.556404 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-credential-socket\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.556661 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.556448 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-workload-certs\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.556661 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.556464 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-workload-socket\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.556661 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.556489 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-istio-envoy\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.556661 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.556518 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8186487-a117-485a-9e3e-17576343055d-istiod-ca-cert\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.556661 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.556568 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8186487-a117-485a-9e3e-17576343055d-istio-token\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.556661 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.556631 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vcbqs\" (UniqueName: \"kubernetes.io/projected/b8186487-a117-485a-9e3e-17576343055d-kube-api-access-vcbqs\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.557063 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.556682 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-istio-data\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.557063 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.556713 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8186487-a117-485a-9e3e-17576343055d-istio-podinfo\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.557063 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.556861 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-credential-socket\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.557063 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.556909 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-workload-socket\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.557247 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.557132 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-istio-data\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.557247 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.557175 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-workload-certs\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.557313 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.557253 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8186487-a117-485a-9e3e-17576343055d-istiod-ca-cert\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.561772 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.561739 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-istio-envoy\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.565283 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.565260 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8186487-a117-485a-9e3e-17576343055d-istio-podinfo\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.568014 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.567995 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8186487-a117-485a-9e3e-17576343055d-istio-token\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.573286 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.573253 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vcbqs\" (UniqueName: \"kubernetes.io/projected/b8186487-a117-485a-9e3e-17576343055d-kube-api-access-vcbqs\") pod \"e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.703750 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.703669 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:22.889872 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.889823 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh"] Jul 15 21:39:22.893779 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:39:22.893752 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb8186487_a117_485a_9e3e_17576343055d.slice/crio-c2f99343f60fa5d4829853082046faaf7d1500f61d73f282d0b431e059a4e2e1 WatchSource:0}: Error finding container c2f99343f60fa5d4829853082046faaf7d1500f61d73f282d0b431e059a4e2e1: Status 404 returned error can't find the container with id c2f99343f60fa5d4829853082046faaf7d1500f61d73f282d0b431e059a4e2e1 Jul 15 21:39:22.896004 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.895961 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:22.896088 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.896055 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:22.896128 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:22.896107 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:23.301595 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:23.301559 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" event={"ID":"b8186487-a117-485a-9e3e-17576343055d","Type":"ContainerStarted","Data":"a2b5d5c8dba436c87be875882f4827c20a30b85548459a29de6031ae3739f1f1"} Jul 15 21:39:23.301773 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:23.301614 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" event={"ID":"b8186487-a117-485a-9e3e-17576343055d","Type":"ContainerStarted","Data":"c2f99343f60fa5d4829853082046faaf7d1500f61d73f282d0b431e059a4e2e1"} Jul 15 21:39:23.325806 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:23.325760 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" podStartSLOduration=1.3257444010000001 podStartE2EDuration="1.325744401s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:39:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:39:23.32396495 +0000 UTC m=+1756.145282272" watchObservedRunningTime="2026-07-15 21:39:23.325744401 +0000 UTC m=+1756.147061718" Jul 15 21:39:23.704191 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:23.704150 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:23.709641 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:23.709615 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:24.308112 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:24.308082 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:24.309090 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:24.309063 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:27.327127 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:27.327094 2572 generic.go:356] "Generic (PLEG): container finished" podID="30471297-af03-4e70-aca1-56e6588c98d4" containerID="92e0aa618b01a0f1fb4108676f9b5f7c47f592d79cca382d6cf2804e6fbfc481" exitCode=0 Jul 15 21:39:27.327610 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:27.327163 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" event={"ID":"30471297-af03-4e70-aca1-56e6588c98d4","Type":"ContainerDied","Data":"92e0aa618b01a0f1fb4108676f9b5f7c47f592d79cca382d6cf2804e6fbfc481"} Jul 15 21:39:27.327610 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:27.327567 2572 scope.go:117] "RemoveContainer" containerID="92e0aa618b01a0f1fb4108676f9b5f7c47f592d79cca382d6cf2804e6fbfc481" Jul 15 21:39:27.328570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:27.328542 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:27.328638 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:27.328628 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:27.328677 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:27.328663 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:28.334281 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:28.334247 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" event={"ID":"30471297-af03-4e70-aca1-56e6588c98d4","Type":"ContainerStarted","Data":"1e12770a6da87e72ce7717ef23d9578a5ef32cf8faba32f9b722a3c7d1238d6d"} Jul 15 21:39:28.965252 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:28.965210 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:28.966690 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:28.966643 2572 patch_prober.go:28] interesting pod/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Jul 15 21:39:28.966839 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:28.966716 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" podUID="30471297-af03-4e70-aca1-56e6588c98d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Jul 15 21:39:29.965380 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:29.965342 2572 patch_prober.go:28] interesting pod/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Jul 15 21:39:29.965855 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:29.965406 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" podUID="30471297-af03-4e70-aca1-56e6588c98d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Jul 15 21:39:30.965642 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:30.965598 2572 patch_prober.go:28] interesting pod/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Jul 15 21:39:30.966137 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:30.965667 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" podUID="30471297-af03-4e70-aca1-56e6588c98d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Jul 15 21:39:31.965425 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:31.965386 2572 patch_prober.go:28] interesting pod/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" start-of-body= Jul 15 21:39:31.965733 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:31.965700 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" podUID="30471297-af03-4e70-aca1-56e6588c98d4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.55:15021/healthz/ready\": dial tcp 10.134.0.55:15021: connect: connection refused" Jul 15 21:39:32.258132 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:32.258036 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:32.976452 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:32.975028 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:32.978150 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:32.978085 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:39:38.398782 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:38.398692 2572 generic.go:356] "Generic (PLEG): container finished" podID="b8186487-a117-485a-9e3e-17576343055d" containerID="a2b5d5c8dba436c87be875882f4827c20a30b85548459a29de6031ae3739f1f1" exitCode=0 Jul 15 21:39:38.398782 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:38.398768 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" event={"ID":"b8186487-a117-485a-9e3e-17576343055d","Type":"ContainerDied","Data":"a2b5d5c8dba436c87be875882f4827c20a30b85548459a29de6031ae3739f1f1"} Jul 15 21:39:38.399185 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:38.399173 2572 scope.go:117] "RemoveContainer" containerID="a2b5d5c8dba436c87be875882f4827c20a30b85548459a29de6031ae3739f1f1" Jul 15 21:39:38.400229 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:38.400193 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:38.400338 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:38.400282 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:38.400338 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:38.400327 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:39:39.308143 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:39.308108 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:39.405963 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:39.405921 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" event={"ID":"b8186487-a117-485a-9e3e-17576343055d","Type":"ContainerStarted","Data":"95937ae64d7f6792a322743cfed65a8ccda46e85fa0c23a30c5927fb0a6e2fb6"} Jul 15 21:39:39.704062 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:39.704027 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:39.705178 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:39.705156 2572 patch_prober.go:28] interesting pod/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Jul 15 21:39:39.705237 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:39.705218 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" podUID="b8186487-a117-485a-9e3e-17576343055d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Jul 15 21:39:40.704781 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:40.704746 2572 patch_prober.go:28] interesting pod/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Jul 15 21:39:40.705164 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:40.704803 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" podUID="b8186487-a117-485a-9e3e-17576343055d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Jul 15 21:39:41.704900 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:41.704864 2572 patch_prober.go:28] interesting pod/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Jul 15 21:39:41.705284 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:41.704921 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" podUID="b8186487-a117-485a-9e3e-17576343055d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Jul 15 21:39:42.704695 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:42.704657 2572 patch_prober.go:28] interesting pod/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" start-of-body= Jul 15 21:39:42.705073 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:42.704730 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" podUID="b8186487-a117-485a-9e3e-17576343055d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.56:15021/healthz/ready\": dial tcp 10.134.0.56:15021: connect: connection refused" Jul 15 21:39:43.708542 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:43.708501 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:43.708904 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:43.708854 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:39:43.709676 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:39:43.709657 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:40:08.261341 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:40:08.261307 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsl2f_19ebe52b-28dc-4b7b-af2d-0779b13a9b62/ovn-acl-logging/0.log" Jul 15 21:40:08.265762 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:40:08.265742 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsl2f_19ebe52b-28dc-4b7b-af2d-0779b13a9b62/ovn-acl-logging/0.log" Jul 15 21:41:04.660741 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:04.660700 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf"] Jul 15 21:41:04.661262 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:04.660918 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" podUID="30471297-af03-4e70-aca1-56e6588c98d4" containerName="istio-proxy" containerID="cri-o://1e12770a6da87e72ce7717ef23d9578a5ef32cf8faba32f9b722a3c7d1238d6d" gracePeriod=30 Jul 15 21:41:09.921820 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:09.921789 2572 generic.go:356] "Generic (PLEG): container finished" podID="30471297-af03-4e70-aca1-56e6588c98d4" containerID="1e12770a6da87e72ce7717ef23d9578a5ef32cf8faba32f9b722a3c7d1238d6d" exitCode=0 Jul 15 21:41:09.922170 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:09.921823 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" event={"ID":"30471297-af03-4e70-aca1-56e6588c98d4","Type":"ContainerDied","Data":"1e12770a6da87e72ce7717ef23d9578a5ef32cf8faba32f9b722a3c7d1238d6d"} Jul 15 21:41:09.922170 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:09.921932 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" event={"ID":"30471297-af03-4e70-aca1-56e6588c98d4","Type":"ContainerDied","Data":"bce4e64f1980d98431ef34031a02dd187617cf063b867f0977014438ece3b4da"} Jul 15 21:41:09.922170 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:09.921953 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bce4e64f1980d98431ef34031a02dd187617cf063b867f0977014438ece3b4da" Jul 15 21:41:09.922170 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:09.921969 2572 scope.go:117] "RemoveContainer" containerID="92e0aa618b01a0f1fb4108676f9b5f7c47f592d79cca382d6cf2804e6fbfc481" Jul 15 21:41:09.927174 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:09.927121 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:41:10.043048 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.043008 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30471297-af03-4e70-aca1-56e6588c98d4-istiod-ca-cert\") pod \"30471297-af03-4e70-aca1-56e6588c98d4\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " Jul 15 21:41:10.043218 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.043058 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-j8jgq\" (UniqueName: \"kubernetes.io/projected/30471297-af03-4e70-aca1-56e6588c98d4-kube-api-access-j8jgq\") pod \"30471297-af03-4e70-aca1-56e6588c98d4\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " Jul 15 21:41:10.043218 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.043095 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-workload-socket\") pod \"30471297-af03-4e70-aca1-56e6588c98d4\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " Jul 15 21:41:10.043218 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.043176 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-credential-socket\") pod \"30471297-af03-4e70-aca1-56e6588c98d4\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " Jul 15 21:41:10.043373 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.043235 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30471297-af03-4e70-aca1-56e6588c98d4-istio-podinfo\") pod \"30471297-af03-4e70-aca1-56e6588c98d4\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " Jul 15 21:41:10.043373 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.043280 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-istio-data\") pod \"30471297-af03-4e70-aca1-56e6588c98d4\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " Jul 15 21:41:10.043373 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.043327 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30471297-af03-4e70-aca1-56e6588c98d4-istio-token\") pod \"30471297-af03-4e70-aca1-56e6588c98d4\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " Jul 15 21:41:10.043373 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.043353 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "30471297-af03-4e70-aca1-56e6588c98d4" (UID: "30471297-af03-4e70-aca1-56e6588c98d4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:10.043628 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.043377 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-workload-certs\") pod \"30471297-af03-4e70-aca1-56e6588c98d4\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " Jul 15 21:41:10.043628 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.043412 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-istio-envoy\") pod \"30471297-af03-4e70-aca1-56e6588c98d4\" (UID: \"30471297-af03-4e70-aca1-56e6588c98d4\") " Jul 15 21:41:10.043628 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.043435 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/30471297-af03-4e70-aca1-56e6588c98d4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "30471297-af03-4e70-aca1-56e6588c98d4" (UID: "30471297-af03-4e70-aca1-56e6588c98d4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:41:10.043628 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.043518 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "30471297-af03-4e70-aca1-56e6588c98d4" (UID: "30471297-af03-4e70-aca1-56e6588c98d4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:10.043833 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.043748 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "30471297-af03-4e70-aca1-56e6588c98d4" (UID: "30471297-af03-4e70-aca1-56e6588c98d4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:10.043893 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.043835 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-workload-socket\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:10.043893 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.043854 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-credential-socket\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:10.043893 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.043866 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-workload-certs\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:10.043893 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.043880 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/30471297-af03-4e70-aca1-56e6588c98d4-istiod-ca-cert\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:10.044225 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.044198 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-istio-data" (OuterVolumeSpecName: "istio-data") pod "30471297-af03-4e70-aca1-56e6588c98d4" (UID: "30471297-af03-4e70-aca1-56e6588c98d4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:10.045468 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.045441 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30471297-af03-4e70-aca1-56e6588c98d4-kube-api-access-j8jgq" (OuterVolumeSpecName: "kube-api-access-j8jgq") pod "30471297-af03-4e70-aca1-56e6588c98d4" (UID: "30471297-af03-4e70-aca1-56e6588c98d4"). InnerVolumeSpecName "kube-api-access-j8jgq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:41:10.045602 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.045548 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "30471297-af03-4e70-aca1-56e6588c98d4" (UID: "30471297-af03-4e70-aca1-56e6588c98d4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:10.045945 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.045910 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/30471297-af03-4e70-aca1-56e6588c98d4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "30471297-af03-4e70-aca1-56e6588c98d4" (UID: "30471297-af03-4e70-aca1-56e6588c98d4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 21:41:10.045945 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.045921 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/30471297-af03-4e70-aca1-56e6588c98d4-istio-token" (OuterVolumeSpecName: "istio-token") pod "30471297-af03-4e70-aca1-56e6588c98d4" (UID: "30471297-af03-4e70-aca1-56e6588c98d4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:41:10.145425 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.145378 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j8jgq\" (UniqueName: \"kubernetes.io/projected/30471297-af03-4e70-aca1-56e6588c98d4-kube-api-access-j8jgq\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:10.145425 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.145418 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/30471297-af03-4e70-aca1-56e6588c98d4-istio-podinfo\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:10.145425 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.145429 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-istio-data\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:10.145425 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.145437 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/30471297-af03-4e70-aca1-56e6588c98d4-istio-token\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:10.145734 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.145446 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/30471297-af03-4e70-aca1-56e6588c98d4-istio-envoy\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:10.929205 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.929178 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf" Jul 15 21:41:10.964576 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.964521 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf"] Jul 15 21:41:10.970373 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:10.970342 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-da1123-openshift-default-8644cddf9c-xr6mf"] Jul 15 21:41:11.704967 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:11.704928 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh"] Jul 15 21:41:11.705161 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:11.705139 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" podUID="b8186487-a117-485a-9e3e-17576343055d" containerName="istio-proxy" containerID="cri-o://95937ae64d7f6792a322743cfed65a8ccda46e85fa0c23a30c5927fb0a6e2fb6" gracePeriod=30 Jul 15 21:41:11.962165 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:11.962073 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="30471297-af03-4e70-aca1-56e6588c98d4" path="/var/lib/kubelet/pods/30471297-af03-4e70-aca1-56e6588c98d4/volumes" Jul 15 21:41:12.624005 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.623963 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl"] Jul 15 21:41:12.624615 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.624595 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30471297-af03-4e70-aca1-56e6588c98d4" containerName="istio-proxy" Jul 15 21:41:12.624669 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.624619 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="30471297-af03-4e70-aca1-56e6588c98d4" containerName="istio-proxy" Jul 15 21:41:12.624748 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.624736 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="30471297-af03-4e70-aca1-56e6588c98d4" containerName="istio-proxy" Jul 15 21:41:12.624789 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.624752 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="30471297-af03-4e70-aca1-56e6588c98d4" containerName="istio-proxy" Jul 15 21:41:12.628394 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.628366 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.631438 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.631418 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-94c8e7-openshift-default-dockercfg-djthg\"" Jul 15 21:41:12.637395 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.637369 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl"] Jul 15 21:41:12.774266 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.774228 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-workload-socket\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.774266 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.774268 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-istio-data\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.774517 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.774294 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76e76962-b583-4ff1-9449-a4d7977e7812-istio-podinfo\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.774517 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.774316 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-credential-socket\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.774517 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.774362 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76e76962-b583-4ff1-9449-a4d7977e7812-istiod-ca-cert\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.774517 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.774439 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pgc6f\" (UniqueName: \"kubernetes.io/projected/76e76962-b583-4ff1-9449-a4d7977e7812-kube-api-access-pgc6f\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.774517 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.774491 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-workload-certs\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.774789 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.774562 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76e76962-b583-4ff1-9449-a4d7977e7812-istio-token\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.774789 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.774635 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-istio-envoy\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.876063 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.875973 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-istio-envoy\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.876063 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.876043 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-workload-socket\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.876283 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.876069 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-istio-data\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.876283 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.876100 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76e76962-b583-4ff1-9449-a4d7977e7812-istio-podinfo\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.876283 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.876150 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-credential-socket\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.876283 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.876189 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76e76962-b583-4ff1-9449-a4d7977e7812-istiod-ca-cert\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.876283 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.876215 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pgc6f\" (UniqueName: \"kubernetes.io/projected/76e76962-b583-4ff1-9449-a4d7977e7812-kube-api-access-pgc6f\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.876283 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.876241 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-workload-certs\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.876283 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.876284 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76e76962-b583-4ff1-9449-a4d7977e7812-istio-token\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.876673 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.876505 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-istio-data\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.876673 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.876557 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-credential-socket\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.876673 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.876569 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-workload-socket\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.876835 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.876812 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-workload-certs\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.877195 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.877178 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76e76962-b583-4ff1-9449-a4d7977e7812-istiod-ca-cert\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.878279 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.878259 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-istio-envoy\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.878591 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.878574 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76e76962-b583-4ff1-9449-a4d7977e7812-istio-podinfo\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.885019 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.884996 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pgc6f\" (UniqueName: \"kubernetes.io/projected/76e76962-b583-4ff1-9449-a4d7977e7812-kube-api-access-pgc6f\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.885115 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.885039 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76e76962-b583-4ff1-9449-a4d7977e7812-istio-token\") pod \"e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:12.940111 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:12.940075 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:13.081273 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:13.081243 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl"] Jul 15 21:41:13.084569 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:41:13.084515 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod76e76962_b583_4ff1_9449_a4d7977e7812.slice/crio-d134175523b42bb736df98d2d06f26f10c9b383323d81fb8d534cacea40986a2 WatchSource:0}: Error finding container d134175523b42bb736df98d2d06f26f10c9b383323d81fb8d534cacea40986a2: Status 404 returned error can't find the container with id d134175523b42bb736df98d2d06f26f10c9b383323d81fb8d534cacea40986a2 Jul 15 21:41:13.086880 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:13.086849 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:13.086967 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:13.086910 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:13.086967 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:13.086939 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:13.711427 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:13.711385 2572 patch_prober.go:28] interesting pod/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 21:41:13.711620 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:13.711452 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" podUID="b8186487-a117-485a-9e3e-17576343055d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 21:41:13.953937 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:13.953006 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" event={"ID":"76e76962-b583-4ff1-9449-a4d7977e7812","Type":"ContainerStarted","Data":"fbe3aeb4e165ee273924a0b9e3733d2de805c85720ccfe685fc08927e0410e86"} Jul 15 21:41:13.953937 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:13.953120 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" event={"ID":"76e76962-b583-4ff1-9449-a4d7977e7812","Type":"ContainerStarted","Data":"d134175523b42bb736df98d2d06f26f10c9b383323d81fb8d534cacea40986a2"} Jul 15 21:41:13.978946 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:13.978854 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" podStartSLOduration=1.9788399810000001 podStartE2EDuration="1.978839981s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:41:12 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:41:13.976412157 +0000 UTC m=+1866.797729474" watchObservedRunningTime="2026-07-15 21:41:13.978839981 +0000 UTC m=+1866.800157297" Jul 15 21:41:14.940545 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:14.940488 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:14.945069 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:14.945044 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:14.958205 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:14.958179 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:14.959068 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:14.959037 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:16.973753 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:16.973682 2572 generic.go:356] "Generic (PLEG): container finished" podID="b8186487-a117-485a-9e3e-17576343055d" containerID="95937ae64d7f6792a322743cfed65a8ccda46e85fa0c23a30c5927fb0a6e2fb6" exitCode=0 Jul 15 21:41:16.973753 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:16.973724 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" event={"ID":"b8186487-a117-485a-9e3e-17576343055d","Type":"ContainerDied","Data":"95937ae64d7f6792a322743cfed65a8ccda46e85fa0c23a30c5927fb0a6e2fb6"} Jul 15 21:41:16.974162 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:16.973782 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" event={"ID":"b8186487-a117-485a-9e3e-17576343055d","Type":"ContainerDied","Data":"c2f99343f60fa5d4829853082046faaf7d1500f61d73f282d0b431e059a4e2e1"} Jul 15 21:41:16.974162 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:16.973807 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c2f99343f60fa5d4829853082046faaf7d1500f61d73f282d0b431e059a4e2e1" Jul 15 21:41:16.974162 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:16.973825 2572 scope.go:117] "RemoveContainer" containerID="a2b5d5c8dba436c87be875882f4827c20a30b85548459a29de6031ae3739f1f1" Jul 15 21:41:16.976373 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:16.976350 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:41:17.118905 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.118873 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-istio-data\") pod \"b8186487-a117-485a-9e3e-17576343055d\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " Jul 15 21:41:17.119102 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.118922 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8186487-a117-485a-9e3e-17576343055d-istiod-ca-cert\") pod \"b8186487-a117-485a-9e3e-17576343055d\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " Jul 15 21:41:17.119102 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.118959 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-workload-socket\") pod \"b8186487-a117-485a-9e3e-17576343055d\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " Jul 15 21:41:17.119102 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.118981 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-workload-certs\") pod \"b8186487-a117-485a-9e3e-17576343055d\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " Jul 15 21:41:17.119102 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.119007 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8186487-a117-485a-9e3e-17576343055d-istio-token\") pod \"b8186487-a117-485a-9e3e-17576343055d\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " Jul 15 21:41:17.119102 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.119044 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-vcbqs\" (UniqueName: \"kubernetes.io/projected/b8186487-a117-485a-9e3e-17576343055d-kube-api-access-vcbqs\") pod \"b8186487-a117-485a-9e3e-17576343055d\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " Jul 15 21:41:17.119398 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.119147 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8186487-a117-485a-9e3e-17576343055d-istio-podinfo\") pod \"b8186487-a117-485a-9e3e-17576343055d\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " Jul 15 21:41:17.119398 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.119207 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-istio-envoy\") pod \"b8186487-a117-485a-9e3e-17576343055d\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " Jul 15 21:41:17.119398 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.119233 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-credential-socket\") pod \"b8186487-a117-485a-9e3e-17576343055d\" (UID: \"b8186487-a117-485a-9e3e-17576343055d\") " Jul 15 21:41:17.119398 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.119381 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/b8186487-a117-485a-9e3e-17576343055d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "b8186487-a117-485a-9e3e-17576343055d" (UID: "b8186487-a117-485a-9e3e-17576343055d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:41:17.119666 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.119431 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "b8186487-a117-485a-9e3e-17576343055d" (UID: "b8186487-a117-485a-9e3e-17576343055d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:17.119729 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.119716 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-workload-socket\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:17.119788 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.119736 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/b8186487-a117-485a-9e3e-17576343055d-istiod-ca-cert\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:17.119788 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.119767 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-istio-data" (OuterVolumeSpecName: "istio-data") pod "b8186487-a117-485a-9e3e-17576343055d" (UID: "b8186487-a117-485a-9e3e-17576343055d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:17.119939 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.119917 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "b8186487-a117-485a-9e3e-17576343055d" (UID: "b8186487-a117-485a-9e3e-17576343055d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:17.120127 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.120101 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "b8186487-a117-485a-9e3e-17576343055d" (UID: "b8186487-a117-485a-9e3e-17576343055d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:17.121713 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.121635 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/b8186487-a117-485a-9e3e-17576343055d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "b8186487-a117-485a-9e3e-17576343055d" (UID: "b8186487-a117-485a-9e3e-17576343055d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 21:41:17.122004 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.121981 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "b8186487-a117-485a-9e3e-17576343055d" (UID: "b8186487-a117-485a-9e3e-17576343055d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:17.122329 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.122299 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8186487-a117-485a-9e3e-17576343055d-kube-api-access-vcbqs" (OuterVolumeSpecName: "kube-api-access-vcbqs") pod "b8186487-a117-485a-9e3e-17576343055d" (UID: "b8186487-a117-485a-9e3e-17576343055d"). InnerVolumeSpecName "kube-api-access-vcbqs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:41:17.122637 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.122611 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/b8186487-a117-485a-9e3e-17576343055d-istio-token" (OuterVolumeSpecName: "istio-token") pod "b8186487-a117-485a-9e3e-17576343055d" (UID: "b8186487-a117-485a-9e3e-17576343055d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:41:17.220295 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.220253 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-istio-data\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:17.220295 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.220289 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-workload-certs\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:17.220295 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.220298 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/b8186487-a117-485a-9e3e-17576343055d-istio-token\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:17.220295 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.220306 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-vcbqs\" (UniqueName: \"kubernetes.io/projected/b8186487-a117-485a-9e3e-17576343055d-kube-api-access-vcbqs\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:17.220604 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.220314 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/b8186487-a117-485a-9e3e-17576343055d-istio-podinfo\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:17.220604 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.220322 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-istio-envoy\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:17.220604 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.220330 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/b8186487-a117-485a-9e3e-17576343055d-credential-socket\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:17.980253 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:17.980232 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh" Jul 15 21:41:18.017373 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:18.017343 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh"] Jul 15 21:41:18.021766 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:18.021741 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-9625f6-openshift-default-68bb9557b7-pdkjh"] Jul 15 21:41:19.960797 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:19.960755 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="b8186487-a117-485a-9e3e-17576343055d" path="/var/lib/kubelet/pods/b8186487-a117-485a-9e3e-17576343055d/volumes" Jul 15 21:41:21.318479 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.318446 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr"] Jul 15 21:41:21.318870 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.318859 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8186487-a117-485a-9e3e-17576343055d" containerName="istio-proxy" Jul 15 21:41:21.318870 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.318871 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8186487-a117-485a-9e3e-17576343055d" containerName="istio-proxy" Jul 15 21:41:21.318958 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.318892 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="30471297-af03-4e70-aca1-56e6588c98d4" containerName="istio-proxy" Jul 15 21:41:21.318958 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.318897 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="30471297-af03-4e70-aca1-56e6588c98d4" containerName="istio-proxy" Jul 15 21:41:21.319026 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.318969 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8186487-a117-485a-9e3e-17576343055d" containerName="istio-proxy" Jul 15 21:41:21.319026 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.318978 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="b8186487-a117-485a-9e3e-17576343055d" containerName="istio-proxy" Jul 15 21:41:21.324873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.324854 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.327155 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.327135 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-fb8539-openshift-default-dockercfg-9t4jp\"" Jul 15 21:41:21.336515 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.336493 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr"] Jul 15 21:41:21.459990 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.459951 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-envoy\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.459990 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.460003 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-q89rz\" (UniqueName: \"kubernetes.io/projected/d080f1ea-e61f-4d92-943f-b107303e8cc0-kube-api-access-q89rz\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.460245 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.460080 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d080f1ea-e61f-4d92-943f-b107303e8cc0-istiod-ca-cert\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.460245 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.460123 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-token\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.460349 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.460246 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-workload-certs\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.460349 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.460289 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-credential-socket\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.460507 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.460353 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-workload-socket\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.460507 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.460381 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-data\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.460507 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.460408 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-podinfo\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.561873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.561824 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-envoy\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.562071 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.561880 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-q89rz\" (UniqueName: \"kubernetes.io/projected/d080f1ea-e61f-4d92-943f-b107303e8cc0-kube-api-access-q89rz\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.562071 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.561931 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d080f1ea-e61f-4d92-943f-b107303e8cc0-istiod-ca-cert\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.562071 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.561969 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-token\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.562071 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.562066 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-workload-certs\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.562281 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.562098 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-credential-socket\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.562281 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.562147 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-workload-socket\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.562281 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.562179 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-data\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.562281 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.562206 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-podinfo\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.562485 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.562460 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-workload-certs\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.562595 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.562570 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-data\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.562791 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.562632 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-workload-socket\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.562892 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.562825 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-credential-socket\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.562952 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.562845 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d080f1ea-e61f-4d92-943f-b107303e8cc0-istiod-ca-cert\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.564807 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.564786 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-envoy\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.565091 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.565072 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-podinfo\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.570098 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.570040 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-token\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.570386 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.570367 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-q89rz\" (UniqueName: \"kubernetes.io/projected/d080f1ea-e61f-4d92-943f-b107303e8cc0-kube-api-access-q89rz\") pod \"e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.635034 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.635008 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:21.785753 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.785724 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr"] Jul 15 21:41:21.789136 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:41:21.789101 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd080f1ea_e61f_4d92_943f_b107303e8cc0.slice/crio-256e69b0d21543461090c9a9a6d5ba1e73b4ff52a2accf0d23d7151d4a6ffeb4 WatchSource:0}: Error finding container 256e69b0d21543461090c9a9a6d5ba1e73b4ff52a2accf0d23d7151d4a6ffeb4: Status 404 returned error can't find the container with id 256e69b0d21543461090c9a9a6d5ba1e73b4ff52a2accf0d23d7151d4a6ffeb4 Jul 15 21:41:21.791313 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.791283 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:21.791390 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.791346 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:21.791390 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:21.791372 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:22.006718 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:22.006681 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" event={"ID":"d080f1ea-e61f-4d92-943f-b107303e8cc0","Type":"ContainerStarted","Data":"4ed2aafb7042e27c23698f1be350038197d9a1021d08f0a15037562a70d5ab7e"} Jul 15 21:41:22.006909 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:22.006733 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" event={"ID":"d080f1ea-e61f-4d92-943f-b107303e8cc0","Type":"ContainerStarted","Data":"256e69b0d21543461090c9a9a6d5ba1e73b4ff52a2accf0d23d7151d4a6ffeb4"} Jul 15 21:41:22.030299 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:22.030242 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" podStartSLOduration=1.030224868 podStartE2EDuration="1.030224868s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:41:21 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:41:22.028131793 +0000 UTC m=+1874.849449109" watchObservedRunningTime="2026-07-15 21:41:22.030224868 +0000 UTC m=+1874.851542184" Jul 15 21:41:22.635207 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:22.635177 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:22.639811 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:22.639789 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:23.012598 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:23.012498 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:23.013456 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:23.013438 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:23.040377 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:23.040349 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7"] Jul 15 21:41:23.040780 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:23.040765 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="b8186487-a117-485a-9e3e-17576343055d" containerName="istio-proxy" Jul 15 21:41:23.040855 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:23.040786 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="b8186487-a117-485a-9e3e-17576343055d" containerName="istio-proxy" Jul 15 21:41:23.050759 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:23.050729 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7" Jul 15 21:41:23.053162 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:23.053133 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-api-b-fb8539-serving-cert\"" Jul 15 21:41:23.053360 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:23.053338 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-dockercfg-qtwch\"" Jul 15 21:41:23.053453 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:23.053346 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"openshift-service-ca.crt\"" Jul 15 21:41:23.053966 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:23.053949 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"odh-ai-gateway-infra\"/\"kube-root-ca.crt\"" Jul 15 21:41:23.061226 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:23.061191 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7"] Jul 15 21:41:23.176399 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:23.176354 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9c7557f-e3ab-4c30-9880-f70787e3ffe8-openshift-service-ca\") pod \"maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7\" (UID: \"a9c7557f-e3ab-4c30-9880-f70787e3ffe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7" Jul 15 21:41:23.176399 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:23.176401 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-hz856\" (UniqueName: \"kubernetes.io/projected/a9c7557f-e3ab-4c30-9880-f70787e3ffe8-kube-api-access-hz856\") pod \"maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7\" (UID: \"a9c7557f-e3ab-4c30-9880-f70787e3ffe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7" Jul 15 21:41:23.176710 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:23.176585 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9c7557f-e3ab-4c30-9880-f70787e3ffe8-maas-api-tls\") pod \"maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7\" (UID: \"a9c7557f-e3ab-4c30-9880-f70787e3ffe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7" Jul 15 21:41:23.277635 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:23.277512 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9c7557f-e3ab-4c30-9880-f70787e3ffe8-maas-api-tls\") pod \"maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7\" (UID: \"a9c7557f-e3ab-4c30-9880-f70787e3ffe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7" Jul 15 21:41:23.277808 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:41:23.277664 2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-api-b-fb8539-serving-cert: secret "maas-api-e2e-api-b-fb8539-serving-cert" not found Jul 15 21:41:23.277808 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:23.277689 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9c7557f-e3ab-4c30-9880-f70787e3ffe8-openshift-service-ca\") pod \"maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7\" (UID: \"a9c7557f-e3ab-4c30-9880-f70787e3ffe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7" Jul 15 21:41:23.277808 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:23.277718 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-hz856\" (UniqueName: \"kubernetes.io/projected/a9c7557f-e3ab-4c30-9880-f70787e3ffe8-kube-api-access-hz856\") pod \"maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7\" (UID: \"a9c7557f-e3ab-4c30-9880-f70787e3ffe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7" Jul 15 21:41:23.277808 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:41:23.277762 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/a9c7557f-e3ab-4c30-9880-f70787e3ffe8-maas-api-tls podName:a9c7557f-e3ab-4c30-9880-f70787e3ffe8 nodeName:}" failed. No retries permitted until 2026-07-15 21:41:23.777741147 +0000 UTC m=+1876.599058445 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/a9c7557f-e3ab-4c30-9880-f70787e3ffe8-maas-api-tls") pod "maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7" (UID: "a9c7557f-e3ab-4c30-9880-f70787e3ffe8") : secret "maas-api-e2e-api-b-fb8539-serving-cert" not found Jul 15 21:41:23.278892 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:23.278861 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/a9c7557f-e3ab-4c30-9880-f70787e3ffe8-openshift-service-ca\") pod \"maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7\" (UID: \"a9c7557f-e3ab-4c30-9880-f70787e3ffe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7" Jul 15 21:41:23.287344 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:23.287315 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-hz856\" (UniqueName: \"kubernetes.io/projected/a9c7557f-e3ab-4c30-9880-f70787e3ffe8-kube-api-access-hz856\") pod \"maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7\" (UID: \"a9c7557f-e3ab-4c30-9880-f70787e3ffe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7" Jul 15 21:41:23.783282 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:23.783245 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9c7557f-e3ab-4c30-9880-f70787e3ffe8-maas-api-tls\") pod \"maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7\" (UID: \"a9c7557f-e3ab-4c30-9880-f70787e3ffe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7" Jul 15 21:41:23.785687 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:23.785661 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/a9c7557f-e3ab-4c30-9880-f70787e3ffe8-maas-api-tls\") pod \"maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7\" (UID: \"a9c7557f-e3ab-4c30-9880-f70787e3ffe8\") " pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7" Jul 15 21:41:23.966318 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:23.966283 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7" Jul 15 21:41:24.117172 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:24.117146 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7"] Jul 15 21:41:24.122251 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:41:24.122188 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poda9c7557f_e3ab_4c30_9880_f70787e3ffe8.slice/crio-a1bb96d24231545e13b3c707ee33343f03ae366176feeb74126f213bbf0e9622 WatchSource:0}: Error finding container a1bb96d24231545e13b3c707ee33343f03ae366176feeb74126f213bbf0e9622: Status 404 returned error can't find the container with id a1bb96d24231545e13b3c707ee33343f03ae366176feeb74126f213bbf0e9622 Jul 15 21:41:24.123304 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:24.123277 2572 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 15 21:41:25.029214 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:25.029169 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7" event={"ID":"a9c7557f-e3ab-4c30-9880-f70787e3ffe8","Type":"ContainerStarted","Data":"a1bb96d24231545e13b3c707ee33343f03ae366176feeb74126f213bbf0e9622"} Jul 15 21:41:28.050966 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:28.050929 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7" event={"ID":"a9c7557f-e3ab-4c30-9880-f70787e3ffe8","Type":"ContainerStarted","Data":"c2582ea8b2e51ff7fb7b739e50716df6af2a275614f18cfecfaa66217c3d01d0"} Jul 15 21:41:28.051376 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:28.050999 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7" Jul 15 21:41:30.999744 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:30.999658 2572 patch_prober.go:28] interesting pod/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 15 21:41:30.999744 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:30.999717 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" podUID="76e76962-b583-4ff1-9449-a4d7977e7812" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 15 21:41:32.077054 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:32.077018 2572 generic.go:356] "Generic (PLEG): container finished" podID="76e76962-b583-4ff1-9449-a4d7977e7812" containerID="fbe3aeb4e165ee273924a0b9e3733d2de805c85720ccfe685fc08927e0410e86" exitCode=0 Jul 15 21:41:32.077460 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:32.077090 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" event={"ID":"76e76962-b583-4ff1-9449-a4d7977e7812","Type":"ContainerDied","Data":"fbe3aeb4e165ee273924a0b9e3733d2de805c85720ccfe685fc08927e0410e86"} Jul 15 21:41:32.077503 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:32.077485 2572 scope.go:117] "RemoveContainer" containerID="fbe3aeb4e165ee273924a0b9e3733d2de805c85720ccfe685fc08927e0410e86" Jul 15 21:41:32.078592 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:32.078555 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:32.078724 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:32.078640 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:32.078724 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:32.078684 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:32.104987 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:32.104939 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7" podStartSLOduration=5.99461075 podStartE2EDuration="9.104923292s" totalImagesPullingTime="3.110312542s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:41:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:41:28.076154995 +0000 UTC m=+1880.897472313" watchObservedRunningTime="2026-07-15 21:41:32.104923292 +0000 UTC m=+1884.926240609" Jul 15 21:41:33.089004 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:33.088970 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" event={"ID":"76e76962-b583-4ff1-9449-a4d7977e7812","Type":"ContainerStarted","Data":"cce68622c01c907d8f39572e657ea26432618797c6bfa3790d4828e7528a1540"} Jul 15 21:41:33.941288 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:33.941254 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:33.941484 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:33.941462 2572 patch_prober.go:28] interesting pod/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Jul 15 21:41:33.941570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:33.941518 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" podUID="76e76962-b583-4ff1-9449-a4d7977e7812" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Jul 15 21:41:34.081832 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:34.081794 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7" Jul 15 21:41:34.941465 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:34.941422 2572 patch_prober.go:28] interesting pod/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Jul 15 21:41:34.941894 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:34.941492 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" podUID="76e76962-b583-4ff1-9449-a4d7977e7812" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Jul 15 21:41:35.940884 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:35.940849 2572 patch_prober.go:28] interesting pod/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Jul 15 21:41:35.941137 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:35.940899 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" podUID="76e76962-b583-4ff1-9449-a4d7977e7812" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Jul 15 21:41:36.940482 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:36.940447 2572 patch_prober.go:28] interesting pod/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" start-of-body= Jul 15 21:41:36.940890 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:36.940513 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" podUID="76e76962-b583-4ff1-9449-a4d7977e7812" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.57:15021/healthz/ready\": dial tcp 10.134.0.57:15021: connect: connection refused" Jul 15 21:41:37.943897 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:37.943863 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:37.944265 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:37.944119 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:37.944764 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:37.944749 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:42.155258 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:42.155226 2572 generic.go:356] "Generic (PLEG): container finished" podID="d080f1ea-e61f-4d92-943f-b107303e8cc0" containerID="4ed2aafb7042e27c23698f1be350038197d9a1021d08f0a15037562a70d5ab7e" exitCode=0 Jul 15 21:41:42.155712 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:42.155311 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" event={"ID":"d080f1ea-e61f-4d92-943f-b107303e8cc0","Type":"ContainerDied","Data":"4ed2aafb7042e27c23698f1be350038197d9a1021d08f0a15037562a70d5ab7e"} Jul 15 21:41:42.155779 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:42.155766 2572 scope.go:117] "RemoveContainer" containerID="4ed2aafb7042e27c23698f1be350038197d9a1021d08f0a15037562a70d5ab7e" Jul 15 21:41:42.156824 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:42.156800 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:42.156888 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:42.156862 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:42.156925 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:42.156893 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:41:43.163314 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:43.163283 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" event={"ID":"d080f1ea-e61f-4d92-943f-b107303e8cc0","Type":"ContainerStarted","Data":"6706b79cc9a43c21cbe8c04e642d308fba92e3e6a59aeea6552a1362073146f5"} Jul 15 21:41:43.635630 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:43.635591 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:43.635820 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:43.635740 2572 patch_prober.go:28] interesting pod/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Jul 15 21:41:43.635820 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:43.635786 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" podUID="d080f1ea-e61f-4d92-943f-b107303e8cc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Jul 15 21:41:44.636069 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:44.636035 2572 patch_prober.go:28] interesting pod/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Jul 15 21:41:44.636449 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:44.636094 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" podUID="d080f1ea-e61f-4d92-943f-b107303e8cc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Jul 15 21:41:45.635931 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:45.635889 2572 patch_prober.go:28] interesting pod/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Jul 15 21:41:45.636123 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:45.635948 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" podUID="d080f1ea-e61f-4d92-943f-b107303e8cc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Jul 15 21:41:46.635757 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:46.635715 2572 patch_prober.go:28] interesting pod/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" start-of-body= Jul 15 21:41:46.635969 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:46.635784 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" podUID="d080f1ea-e61f-4d92-943f-b107303e8cc0" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.58:15021/healthz/ready\": dial tcp 10.134.0.58:15021: connect: connection refused" Jul 15 21:41:47.639798 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:47.639770 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:47.640213 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:47.640033 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:47.640811 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:47.640792 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:41:49.635487 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:49.635451 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl"] Jul 15 21:41:49.635983 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:49.635672 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" podUID="76e76962-b583-4ff1-9449-a4d7977e7812" containerName="istio-proxy" containerID="cri-o://cce68622c01c907d8f39572e657ea26432618797c6bfa3790d4828e7528a1540" gracePeriod=30 Jul 15 21:41:52.946414 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:52.946372 2572 patch_prober.go:28] interesting pod/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 21:41:52.946907 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:52.946444 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" podUID="76e76962-b583-4ff1-9449-a4d7977e7812" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 21:41:54.892290 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:54.892261 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:54.997452 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:54.997368 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-credential-socket\") pod \"76e76962-b583-4ff1-9449-a4d7977e7812\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " Jul 15 21:41:54.997452 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:54.997407 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-workload-certs\") pod \"76e76962-b583-4ff1-9449-a4d7977e7812\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " Jul 15 21:41:54.997452 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:54.997445 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pgc6f\" (UniqueName: \"kubernetes.io/projected/76e76962-b583-4ff1-9449-a4d7977e7812-kube-api-access-pgc6f\") pod \"76e76962-b583-4ff1-9449-a4d7977e7812\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " Jul 15 21:41:54.997728 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:54.997484 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-istio-data\") pod \"76e76962-b583-4ff1-9449-a4d7977e7812\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " Jul 15 21:41:54.997728 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:54.997506 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76e76962-b583-4ff1-9449-a4d7977e7812-istio-token\") pod \"76e76962-b583-4ff1-9449-a4d7977e7812\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " Jul 15 21:41:54.997728 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:54.997564 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76e76962-b583-4ff1-9449-a4d7977e7812-istiod-ca-cert\") pod \"76e76962-b583-4ff1-9449-a4d7977e7812\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " Jul 15 21:41:54.997728 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:54.997606 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76e76962-b583-4ff1-9449-a4d7977e7812-istio-podinfo\") pod \"76e76962-b583-4ff1-9449-a4d7977e7812\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " Jul 15 21:41:54.997728 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:54.997685 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-workload-socket\") pod \"76e76962-b583-4ff1-9449-a4d7977e7812\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " Jul 15 21:41:54.997728 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:54.997708 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-istio-envoy\") pod \"76e76962-b583-4ff1-9449-a4d7977e7812\" (UID: \"76e76962-b583-4ff1-9449-a4d7977e7812\") " Jul 15 21:41:54.998009 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:54.997742 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "76e76962-b583-4ff1-9449-a4d7977e7812" (UID: "76e76962-b583-4ff1-9449-a4d7977e7812"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:54.998009 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:54.997758 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "76e76962-b583-4ff1-9449-a4d7977e7812" (UID: "76e76962-b583-4ff1-9449-a4d7977e7812"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:54.998009 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:54.997971 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "76e76962-b583-4ff1-9449-a4d7977e7812" (UID: "76e76962-b583-4ff1-9449-a4d7977e7812"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:54.998169 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:54.998062 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/76e76962-b583-4ff1-9449-a4d7977e7812-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "76e76962-b583-4ff1-9449-a4d7977e7812" (UID: "76e76962-b583-4ff1-9449-a4d7977e7812"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:41:54.998222 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:54.998200 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/76e76962-b583-4ff1-9449-a4d7977e7812-istiod-ca-cert\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:54.998280 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:54.998220 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-workload-socket\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:54.998280 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:54.998233 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-credential-socket\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:54.998280 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:54.998247 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-workload-certs\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:54.998630 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:54.998602 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-istio-data" (OuterVolumeSpecName: "istio-data") pod "76e76962-b583-4ff1-9449-a4d7977e7812" (UID: "76e76962-b583-4ff1-9449-a4d7977e7812"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:54.999931 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:54.999903 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76e76962-b583-4ff1-9449-a4d7977e7812-istio-token" (OuterVolumeSpecName: "istio-token") pod "76e76962-b583-4ff1-9449-a4d7977e7812" (UID: "76e76962-b583-4ff1-9449-a4d7977e7812"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:41:55.000031 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:54.999911 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/76e76962-b583-4ff1-9449-a4d7977e7812-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "76e76962-b583-4ff1-9449-a4d7977e7812" (UID: "76e76962-b583-4ff1-9449-a4d7977e7812"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 21:41:55.000118 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:55.000098 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/76e76962-b583-4ff1-9449-a4d7977e7812-kube-api-access-pgc6f" (OuterVolumeSpecName: "kube-api-access-pgc6f") pod "76e76962-b583-4ff1-9449-a4d7977e7812" (UID: "76e76962-b583-4ff1-9449-a4d7977e7812"). InnerVolumeSpecName "kube-api-access-pgc6f". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:41:55.000159 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:55.000121 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "76e76962-b583-4ff1-9449-a4d7977e7812" (UID: "76e76962-b583-4ff1-9449-a4d7977e7812"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:41:55.099566 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:55.099507 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pgc6f\" (UniqueName: \"kubernetes.io/projected/76e76962-b583-4ff1-9449-a4d7977e7812-kube-api-access-pgc6f\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:55.099566 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:55.099558 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-istio-data\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:55.099566 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:55.099572 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/76e76962-b583-4ff1-9449-a4d7977e7812-istio-token\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:55.099794 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:55.099583 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/76e76962-b583-4ff1-9449-a4d7977e7812-istio-podinfo\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:55.099794 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:55.099593 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/76e76962-b583-4ff1-9449-a4d7977e7812-istio-envoy\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:41:55.241480 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:55.241448 2572 generic.go:356] "Generic (PLEG): container finished" podID="76e76962-b583-4ff1-9449-a4d7977e7812" containerID="cce68622c01c907d8f39572e657ea26432618797c6bfa3790d4828e7528a1540" exitCode=0 Jul 15 21:41:55.241635 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:55.241495 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" Jul 15 21:41:55.241635 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:55.241546 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" event={"ID":"76e76962-b583-4ff1-9449-a4d7977e7812","Type":"ContainerDied","Data":"cce68622c01c907d8f39572e657ea26432618797c6bfa3790d4828e7528a1540"} Jul 15 21:41:55.241635 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:55.241599 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl" event={"ID":"76e76962-b583-4ff1-9449-a4d7977e7812","Type":"ContainerDied","Data":"d134175523b42bb736df98d2d06f26f10c9b383323d81fb8d534cacea40986a2"} Jul 15 21:41:55.241635 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:55.241621 2572 scope.go:117] "RemoveContainer" containerID="cce68622c01c907d8f39572e657ea26432618797c6bfa3790d4828e7528a1540" Jul 15 21:41:55.252112 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:55.252096 2572 scope.go:117] "RemoveContainer" containerID="fbe3aeb4e165ee273924a0b9e3733d2de805c85720ccfe685fc08927e0410e86" Jul 15 21:41:55.260607 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:55.260585 2572 scope.go:117] "RemoveContainer" containerID="cce68622c01c907d8f39572e657ea26432618797c6bfa3790d4828e7528a1540" Jul 15 21:41:55.260882 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:41:55.260857 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cce68622c01c907d8f39572e657ea26432618797c6bfa3790d4828e7528a1540\": container with ID starting with cce68622c01c907d8f39572e657ea26432618797c6bfa3790d4828e7528a1540 not found: ID does not exist" containerID="cce68622c01c907d8f39572e657ea26432618797c6bfa3790d4828e7528a1540" Jul 15 21:41:55.260947 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:55.260882 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cce68622c01c907d8f39572e657ea26432618797c6bfa3790d4828e7528a1540"} err="failed to get container status \"cce68622c01c907d8f39572e657ea26432618797c6bfa3790d4828e7528a1540\": rpc error: code = NotFound desc = could not find container \"cce68622c01c907d8f39572e657ea26432618797c6bfa3790d4828e7528a1540\": container with ID starting with cce68622c01c907d8f39572e657ea26432618797c6bfa3790d4828e7528a1540 not found: ID does not exist" Jul 15 21:41:55.260947 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:55.260904 2572 scope.go:117] "RemoveContainer" containerID="fbe3aeb4e165ee273924a0b9e3733d2de805c85720ccfe685fc08927e0410e86" Jul 15 21:41:55.261158 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:41:55.261141 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fbe3aeb4e165ee273924a0b9e3733d2de805c85720ccfe685fc08927e0410e86\": container with ID starting with fbe3aeb4e165ee273924a0b9e3733d2de805c85720ccfe685fc08927e0410e86 not found: ID does not exist" containerID="fbe3aeb4e165ee273924a0b9e3733d2de805c85720ccfe685fc08927e0410e86" Jul 15 21:41:55.261198 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:55.261163 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fbe3aeb4e165ee273924a0b9e3733d2de805c85720ccfe685fc08927e0410e86"} err="failed to get container status \"fbe3aeb4e165ee273924a0b9e3733d2de805c85720ccfe685fc08927e0410e86\": rpc error: code = NotFound desc = could not find container \"fbe3aeb4e165ee273924a0b9e3733d2de805c85720ccfe685fc08927e0410e86\": container with ID starting with fbe3aeb4e165ee273924a0b9e3733d2de805c85720ccfe685fc08927e0410e86 not found: ID does not exist" Jul 15 21:41:55.266366 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:55.266342 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl"] Jul 15 21:41:55.270012 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:55.269990 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-94c8e7-openshift-default-589fc8998c-hz9zl"] Jul 15 21:41:55.961780 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:41:55.961746 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="76e76962-b583-4ff1-9449-a4d7977e7812" path="/var/lib/kubelet/pods/76e76962-b583-4ff1-9449-a4d7977e7812/volumes" Jul 15 21:42:02.388941 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:02.388910 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr"] Jul 15 21:42:02.389331 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:02.389122 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" podUID="d080f1ea-e61f-4d92-943f-b107303e8cc0" containerName="istio-proxy" containerID="cri-o://6706b79cc9a43c21cbe8c04e642d308fba92e3e6a59aeea6552a1362073146f5" gracePeriod=30 Jul 15 21:42:02.642326 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:02.642245 2572 patch_prober.go:28] interesting pod/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 15 21:42:02.642326 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:02.642314 2572 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" podUID="d080f1ea-e61f-4d92-943f-b107303e8cc0" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 15 21:42:03.318376 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.318342 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v"] Jul 15 21:42:03.318812 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.318795 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76e76962-b583-4ff1-9449-a4d7977e7812" containerName="istio-proxy" Jul 15 21:42:03.318875 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.318813 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="76e76962-b583-4ff1-9449-a4d7977e7812" containerName="istio-proxy" Jul 15 21:42:03.318875 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.318856 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="76e76962-b583-4ff1-9449-a4d7977e7812" containerName="istio-proxy" Jul 15 21:42:03.318875 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.318863 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="76e76962-b583-4ff1-9449-a4d7977e7812" containerName="istio-proxy" Jul 15 21:42:03.318978 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.318927 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="76e76962-b583-4ff1-9449-a4d7977e7812" containerName="istio-proxy" Jul 15 21:42:03.318978 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.318938 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="76e76962-b583-4ff1-9449-a4d7977e7812" containerName="istio-proxy" Jul 15 21:42:03.323208 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.323184 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.325781 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.325760 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-543174-openshift-default-dockercfg-9t5p8\"" Jul 15 21:42:03.337704 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.337678 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v"] Jul 15 21:42:03.482356 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.482321 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-workload-socket\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.482761 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.482384 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-token\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.482761 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.482405 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jfmfr\" (UniqueName: \"kubernetes.io/projected/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-kube-api-access-jfmfr\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.482761 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.482448 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-data\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.482761 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.482498 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-envoy\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.482761 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.482514 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-podinfo\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.482761 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.482555 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istiod-ca-cert\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.482761 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.482583 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-workload-certs\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.482761 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.482643 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-credential-socket\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.583829 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.583733 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-workload-socket\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.583829 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.583782 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-token\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.583829 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.583804 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jfmfr\" (UniqueName: \"kubernetes.io/projected/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-kube-api-access-jfmfr\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.584128 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.583841 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-data\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.584128 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.583897 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-envoy\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.584128 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.583924 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-podinfo\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.584128 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.583952 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istiod-ca-cert\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.584128 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.583976 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-workload-certs\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.584356 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.584171 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-credential-socket\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.584356 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.584253 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-workload-socket\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.584464 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.584357 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-data\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.584562 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.584542 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-workload-certs\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.584658 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.584635 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-credential-socket\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.584785 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.584769 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istiod-ca-cert\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.586314 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.586291 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-envoy\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.586445 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.586427 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-podinfo\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.593372 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.593349 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-token\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.593701 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.593677 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jfmfr\" (UniqueName: \"kubernetes.io/projected/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-kube-api-access-jfmfr\") pod \"e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.633982 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.633954 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:03.781236 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.781201 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v"] Jul 15 21:42:03.782691 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:42:03.782653 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod22b6c04a_44e4_4858_be1e_ee2f4952e0f3.slice/crio-26d448f3cab078dd094ea1dd55e474954a220db77dabef478b5e63fe491a15c6 WatchSource:0}: Error finding container 26d448f3cab078dd094ea1dd55e474954a220db77dabef478b5e63fe491a15c6: Status 404 returned error can't find the container with id 26d448f3cab078dd094ea1dd55e474954a220db77dabef478b5e63fe491a15c6 Jul 15 21:42:03.784929 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.784901 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:42:03.784993 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.784964 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:42:03.785035 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:03.784992 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:42:04.296511 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:04.296417 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" event={"ID":"22b6c04a-44e4-4858-be1e-ee2f4952e0f3","Type":"ContainerStarted","Data":"18fc3388615e02325234d580505198cd554c1e98483bed7dd64b6351017e352e"} Jul 15 21:42:04.296511 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:04.296475 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" event={"ID":"22b6c04a-44e4-4858-be1e-ee2f4952e0f3","Type":"ContainerStarted","Data":"26d448f3cab078dd094ea1dd55e474954a220db77dabef478b5e63fe491a15c6"} Jul 15 21:42:04.316964 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:04.316906 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" podStartSLOduration=1.3168912 podStartE2EDuration="1.3168912s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:42:03 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:42:04.314933594 +0000 UTC m=+1917.136250924" watchObservedRunningTime="2026-07-15 21:42:04.3168912 +0000 UTC m=+1917.138208516" Jul 15 21:42:04.634948 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:04.634913 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:04.639942 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:04.639917 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:05.302275 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:05.302242 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:05.303163 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:05.303146 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:05.582094 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:05.582058 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-543174-5748765cf8-hx2nk"] Jul 15 21:42:05.585729 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:05.585710 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-543174-5748765cf8-hx2nk" Jul 15 21:42:05.589089 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:05.589069 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-a-543174-serving-cert\"" Jul 15 21:42:05.597353 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:05.597325 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-543174-5748765cf8-hx2nk"] Jul 15 21:42:05.705078 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:05.705027 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb71a7b2-0ed5-4002-9810-34c5ec92ee8a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-543174-5748765cf8-hx2nk\" (UID: \"bb71a7b2-0ed5-4002-9810-34c5ec92ee8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-543174-5748765cf8-hx2nk" Jul 15 21:42:05.705552 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:05.705135 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8hqqm\" (UniqueName: \"kubernetes.io/projected/bb71a7b2-0ed5-4002-9810-34c5ec92ee8a-kube-api-access-8hqqm\") pod \"maas-api-e2e-shared-a-543174-5748765cf8-hx2nk\" (UID: \"bb71a7b2-0ed5-4002-9810-34c5ec92ee8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-543174-5748765cf8-hx2nk" Jul 15 21:42:05.705552 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:05.705249 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb71a7b2-0ed5-4002-9810-34c5ec92ee8a-maas-api-tls\") pod \"maas-api-e2e-shared-a-543174-5748765cf8-hx2nk\" (UID: \"bb71a7b2-0ed5-4002-9810-34c5ec92ee8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-543174-5748765cf8-hx2nk" Jul 15 21:42:05.806080 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:05.806037 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb71a7b2-0ed5-4002-9810-34c5ec92ee8a-maas-api-tls\") pod \"maas-api-e2e-shared-a-543174-5748765cf8-hx2nk\" (UID: \"bb71a7b2-0ed5-4002-9810-34c5ec92ee8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-543174-5748765cf8-hx2nk" Jul 15 21:42:05.806275 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:05.806151 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb71a7b2-0ed5-4002-9810-34c5ec92ee8a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-543174-5748765cf8-hx2nk\" (UID: \"bb71a7b2-0ed5-4002-9810-34c5ec92ee8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-543174-5748765cf8-hx2nk" Jul 15 21:42:05.806275 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:05.806207 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8hqqm\" (UniqueName: \"kubernetes.io/projected/bb71a7b2-0ed5-4002-9810-34c5ec92ee8a-kube-api-access-8hqqm\") pod \"maas-api-e2e-shared-a-543174-5748765cf8-hx2nk\" (UID: \"bb71a7b2-0ed5-4002-9810-34c5ec92ee8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-543174-5748765cf8-hx2nk" Jul 15 21:42:05.806904 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:05.806877 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/bb71a7b2-0ed5-4002-9810-34c5ec92ee8a-openshift-service-ca\") pod \"maas-api-e2e-shared-a-543174-5748765cf8-hx2nk\" (UID: \"bb71a7b2-0ed5-4002-9810-34c5ec92ee8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-543174-5748765cf8-hx2nk" Jul 15 21:42:05.808598 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:05.808578 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/bb71a7b2-0ed5-4002-9810-34c5ec92ee8a-maas-api-tls\") pod \"maas-api-e2e-shared-a-543174-5748765cf8-hx2nk\" (UID: \"bb71a7b2-0ed5-4002-9810-34c5ec92ee8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-543174-5748765cf8-hx2nk" Jul 15 21:42:05.815442 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:05.815410 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8hqqm\" (UniqueName: \"kubernetes.io/projected/bb71a7b2-0ed5-4002-9810-34c5ec92ee8a-kube-api-access-8hqqm\") pod \"maas-api-e2e-shared-a-543174-5748765cf8-hx2nk\" (UID: \"bb71a7b2-0ed5-4002-9810-34c5ec92ee8a\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-543174-5748765cf8-hx2nk" Jul 15 21:42:05.897800 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:05.897707 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-543174-5748765cf8-hx2nk" Jul 15 21:42:06.046824 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:06.046797 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-a-543174-5748765cf8-hx2nk"] Jul 15 21:42:06.049304 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:42:06.049276 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podbb71a7b2_0ed5_4002_9810_34c5ec92ee8a.slice/crio-5f204869ad0c57f9bb8d0fc3e58961adb08f762da44055d9225f0004992af4c0 WatchSource:0}: Error finding container 5f204869ad0c57f9bb8d0fc3e58961adb08f762da44055d9225f0004992af4c0: Status 404 returned error can't find the container with id 5f204869ad0c57f9bb8d0fc3e58961adb08f762da44055d9225f0004992af4c0 Jul 15 21:42:06.309230 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:06.309140 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-543174-5748765cf8-hx2nk" event={"ID":"bb71a7b2-0ed5-4002-9810-34c5ec92ee8a","Type":"ContainerStarted","Data":"5f204869ad0c57f9bb8d0fc3e58961adb08f762da44055d9225f0004992af4c0"} Jul 15 21:42:07.316124 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.316084 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-543174-5748765cf8-hx2nk" event={"ID":"bb71a7b2-0ed5-4002-9810-34c5ec92ee8a","Type":"ContainerStarted","Data":"a2d84c59eb2cbfd79baf69791bc82e65d79689e59275131bf32bf773226c41df"} Jul 15 21:42:07.334755 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.334707 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-543174-5748765cf8-hx2nk" podStartSLOduration=1.7346422449999999 podStartE2EDuration="2.334691073s" totalImagesPullingTime="600.048828ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:42:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:42:07.333596879 +0000 UTC m=+1920.154914197" watchObservedRunningTime="2026-07-15 21:42:07.334691073 +0000 UTC m=+1920.156008368" Jul 15 21:42:07.645467 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.645444 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:42:07.827073 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.827045 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-podinfo\") pod \"d080f1ea-e61f-4d92-943f-b107303e8cc0\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " Jul 15 21:42:07.827235 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.827089 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-q89rz\" (UniqueName: \"kubernetes.io/projected/d080f1ea-e61f-4d92-943f-b107303e8cc0-kube-api-access-q89rz\") pod \"d080f1ea-e61f-4d92-943f-b107303e8cc0\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " Jul 15 21:42:07.827235 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.827178 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-token\") pod \"d080f1ea-e61f-4d92-943f-b107303e8cc0\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " Jul 15 21:42:07.827235 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.827198 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-workload-socket\") pod \"d080f1ea-e61f-4d92-943f-b107303e8cc0\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " Jul 15 21:42:07.827235 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.827219 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-workload-certs\") pod \"d080f1ea-e61f-4d92-943f-b107303e8cc0\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " Jul 15 21:42:07.827499 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.827241 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-envoy\") pod \"d080f1ea-e61f-4d92-943f-b107303e8cc0\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " Jul 15 21:42:07.827499 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.827258 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-data\") pod \"d080f1ea-e61f-4d92-943f-b107303e8cc0\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " Jul 15 21:42:07.827499 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.827314 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d080f1ea-e61f-4d92-943f-b107303e8cc0-istiod-ca-cert\") pod \"d080f1ea-e61f-4d92-943f-b107303e8cc0\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " Jul 15 21:42:07.827499 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.827421 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-credential-socket\") pod \"d080f1ea-e61f-4d92-943f-b107303e8cc0\" (UID: \"d080f1ea-e61f-4d92-943f-b107303e8cc0\") " Jul 15 21:42:07.827742 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.827514 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "d080f1ea-e61f-4d92-943f-b107303e8cc0" (UID: "d080f1ea-e61f-4d92-943f-b107303e8cc0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:42:07.827742 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.827513 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "d080f1ea-e61f-4d92-943f-b107303e8cc0" (UID: "d080f1ea-e61f-4d92-943f-b107303e8cc0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:42:07.827849 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.827827 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/d080f1ea-e61f-4d92-943f-b107303e8cc0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "d080f1ea-e61f-4d92-943f-b107303e8cc0" (UID: "d080f1ea-e61f-4d92-943f-b107303e8cc0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:42:07.827911 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.827848 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "d080f1ea-e61f-4d92-943f-b107303e8cc0" (UID: "d080f1ea-e61f-4d92-943f-b107303e8cc0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:42:07.827983 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.827964 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d080f1ea-e61f-4d92-943f-b107303e8cc0-istiod-ca-cert\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:42:07.828041 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.827990 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-credential-socket\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:42:07.828041 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.828005 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-workload-socket\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:42:07.828041 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.828020 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-workload-certs\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:42:07.828214 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.828092 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-data" (OuterVolumeSpecName: "istio-data") pod "d080f1ea-e61f-4d92-943f-b107303e8cc0" (UID: "d080f1ea-e61f-4d92-943f-b107303e8cc0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:42:07.829306 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.829281 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d080f1ea-e61f-4d92-943f-b107303e8cc0-kube-api-access-q89rz" (OuterVolumeSpecName: "kube-api-access-q89rz") pod "d080f1ea-e61f-4d92-943f-b107303e8cc0" (UID: "d080f1ea-e61f-4d92-943f-b107303e8cc0"). InnerVolumeSpecName "kube-api-access-q89rz". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:42:07.829449 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.829434 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-token" (OuterVolumeSpecName: "istio-token") pod "d080f1ea-e61f-4d92-943f-b107303e8cc0" (UID: "d080f1ea-e61f-4d92-943f-b107303e8cc0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:42:07.829576 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.829559 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "d080f1ea-e61f-4d92-943f-b107303e8cc0" (UID: "d080f1ea-e61f-4d92-943f-b107303e8cc0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 21:42:07.829747 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.829734 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "d080f1ea-e61f-4d92-943f-b107303e8cc0" (UID: "d080f1ea-e61f-4d92-943f-b107303e8cc0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:42:07.929297 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.929226 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-q89rz\" (UniqueName: \"kubernetes.io/projected/d080f1ea-e61f-4d92-943f-b107303e8cc0-kube-api-access-q89rz\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:42:07.929297 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.929255 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-token\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:42:07.929297 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.929267 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-envoy\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:42:07.929297 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.929275 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-data\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:42:07.929297 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:07.929283 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d080f1ea-e61f-4d92-943f-b107303e8cc0-istio-podinfo\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:42:08.322704 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:08.322663 2572 generic.go:356] "Generic (PLEG): container finished" podID="d080f1ea-e61f-4d92-943f-b107303e8cc0" containerID="6706b79cc9a43c21cbe8c04e642d308fba92e3e6a59aeea6552a1362073146f5" exitCode=0 Jul 15 21:42:08.323159 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:08.322739 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" Jul 15 21:42:08.323159 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:08.322744 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" event={"ID":"d080f1ea-e61f-4d92-943f-b107303e8cc0","Type":"ContainerDied","Data":"6706b79cc9a43c21cbe8c04e642d308fba92e3e6a59aeea6552a1362073146f5"} Jul 15 21:42:08.323159 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:08.322798 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr" event={"ID":"d080f1ea-e61f-4d92-943f-b107303e8cc0","Type":"ContainerDied","Data":"256e69b0d21543461090c9a9a6d5ba1e73b4ff52a2accf0d23d7151d4a6ffeb4"} Jul 15 21:42:08.323159 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:08.322822 2572 scope.go:117] "RemoveContainer" containerID="6706b79cc9a43c21cbe8c04e642d308fba92e3e6a59aeea6552a1362073146f5" Jul 15 21:42:08.323423 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:08.323168 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-543174-5748765cf8-hx2nk" Jul 15 21:42:08.332010 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:08.331995 2572 scope.go:117] "RemoveContainer" containerID="4ed2aafb7042e27c23698f1be350038197d9a1021d08f0a15037562a70d5ab7e" Jul 15 21:42:08.339784 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:08.339772 2572 scope.go:117] "RemoveContainer" containerID="6706b79cc9a43c21cbe8c04e642d308fba92e3e6a59aeea6552a1362073146f5" Jul 15 21:42:08.340040 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:42:08.340017 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6706b79cc9a43c21cbe8c04e642d308fba92e3e6a59aeea6552a1362073146f5\": container with ID starting with 6706b79cc9a43c21cbe8c04e642d308fba92e3e6a59aeea6552a1362073146f5 not found: ID does not exist" containerID="6706b79cc9a43c21cbe8c04e642d308fba92e3e6a59aeea6552a1362073146f5" Jul 15 21:42:08.340112 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:08.340048 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6706b79cc9a43c21cbe8c04e642d308fba92e3e6a59aeea6552a1362073146f5"} err="failed to get container status \"6706b79cc9a43c21cbe8c04e642d308fba92e3e6a59aeea6552a1362073146f5\": rpc error: code = NotFound desc = could not find container \"6706b79cc9a43c21cbe8c04e642d308fba92e3e6a59aeea6552a1362073146f5\": container with ID starting with 6706b79cc9a43c21cbe8c04e642d308fba92e3e6a59aeea6552a1362073146f5 not found: ID does not exist" Jul 15 21:42:08.340112 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:08.340064 2572 scope.go:117] "RemoveContainer" containerID="4ed2aafb7042e27c23698f1be350038197d9a1021d08f0a15037562a70d5ab7e" Jul 15 21:42:08.340370 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:42:08.340350 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4ed2aafb7042e27c23698f1be350038197d9a1021d08f0a15037562a70d5ab7e\": container with ID starting with 4ed2aafb7042e27c23698f1be350038197d9a1021d08f0a15037562a70d5ab7e not found: ID does not exist" containerID="4ed2aafb7042e27c23698f1be350038197d9a1021d08f0a15037562a70d5ab7e" Jul 15 21:42:08.340480 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:08.340376 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4ed2aafb7042e27c23698f1be350038197d9a1021d08f0a15037562a70d5ab7e"} err="failed to get container status \"4ed2aafb7042e27c23698f1be350038197d9a1021d08f0a15037562a70d5ab7e\": rpc error: code = NotFound desc = could not find container \"4ed2aafb7042e27c23698f1be350038197d9a1021d08f0a15037562a70d5ab7e\": container with ID starting with 4ed2aafb7042e27c23698f1be350038197d9a1021d08f0a15037562a70d5ab7e not found: ID does not exist" Jul 15 21:42:08.343458 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:08.343437 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr"] Jul 15 21:42:08.349473 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:08.349450 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-fb8539-openshift-default-59cdbd4cbc-54zqr"] Jul 15 21:42:09.980550 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:09.976480 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d080f1ea-e61f-4d92-943f-b107303e8cc0" path="/var/lib/kubelet/pods/d080f1ea-e61f-4d92-943f-b107303e8cc0/volumes" Jul 15 21:42:11.397426 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.397385 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj"] Jul 15 21:42:11.397860 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.397845 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d080f1ea-e61f-4d92-943f-b107303e8cc0" containerName="istio-proxy" Jul 15 21:42:11.397906 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.397862 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d080f1ea-e61f-4d92-943f-b107303e8cc0" containerName="istio-proxy" Jul 15 21:42:11.397906 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.397875 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d080f1ea-e61f-4d92-943f-b107303e8cc0" containerName="istio-proxy" Jul 15 21:42:11.397906 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.397886 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="d080f1ea-e61f-4d92-943f-b107303e8cc0" containerName="istio-proxy" Jul 15 21:42:11.398001 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.397985 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d080f1ea-e61f-4d92-943f-b107303e8cc0" containerName="istio-proxy" Jul 15 21:42:11.398001 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.397994 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="d080f1ea-e61f-4d92-943f-b107303e8cc0" containerName="istio-proxy" Jul 15 21:42:11.401004 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.400986 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.403360 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.403332 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-915a1c-openshift-default-dockercfg-469rq\"" Jul 15 21:42:11.412734 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.412712 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj"] Jul 15 21:42:11.573516 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.573477 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-data\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.573838 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.573815 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-envoy\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.573995 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.573977 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-credential-socket\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.574154 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.574139 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-token\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.574339 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.574323 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-workload-socket\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.574482 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.574468 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-podinfo\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.574642 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.574625 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nzms7\" (UniqueName: \"kubernetes.io/projected/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-kube-api-access-nzms7\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.574815 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.574799 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-workload-certs\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.574967 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.574952 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istiod-ca-cert\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.675952 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.675854 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istiod-ca-cert\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.677091 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.677065 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-data\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.677600 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.677582 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-envoy\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.678112 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.678093 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-credential-socket\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.678614 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.678596 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-token\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.679158 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.679137 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-workload-socket\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.679711 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.679694 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-podinfo\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.680324 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.676976 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istiod-ca-cert\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.680324 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.677509 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-data\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.680324 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.679633 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-workload-socket\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.680324 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.678456 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-credential-socket\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.681034 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.681013 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-envoy\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.681195 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.680232 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nzms7\" (UniqueName: \"kubernetes.io/projected/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-kube-api-access-nzms7\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.681346 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.681330 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-workload-certs\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.681811 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.681707 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-workload-certs\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.683045 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.683024 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-podinfo\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.687101 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.687077 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-token\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.688462 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.688430 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nzms7\" (UniqueName: \"kubernetes.io/projected/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-kube-api-access-nzms7\") pod \"e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.713277 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.713251 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:11.888636 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.888518 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj"] Jul 15 21:42:11.892417 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:42:11.892379 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod5e27a620_9d0d_47c0_9f26_acdad4fa82e7.slice/crio-3b768bc2128e9605dd0b37e48491ca317f436a674e3445b611f2bf953e25a527 WatchSource:0}: Error finding container 3b768bc2128e9605dd0b37e48491ca317f436a674e3445b611f2bf953e25a527: Status 404 returned error can't find the container with id 3b768bc2128e9605dd0b37e48491ca317f436a674e3445b611f2bf953e25a527 Jul 15 21:42:11.894330 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.894296 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:42:11.894403 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.894380 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:42:11.894501 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:11.894431 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:42:12.354321 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:12.354281 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" event={"ID":"5e27a620-9d0d-47c0-9f26-acdad4fa82e7","Type":"ContainerStarted","Data":"4fd69b4cfa97f6a1c48cbcfabeb5e06253cdbc82900950f74c9e8c5d43ea3bb2"} Jul 15 21:42:12.354549 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:12.354370 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" event={"ID":"5e27a620-9d0d-47c0-9f26-acdad4fa82e7","Type":"ContainerStarted","Data":"3b768bc2128e9605dd0b37e48491ca317f436a674e3445b611f2bf953e25a527"} Jul 15 21:42:12.380436 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:12.380369 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" podStartSLOduration=1.380346906 podStartE2EDuration="1.380346906s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:42:11 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:42:12.375377274 +0000 UTC m=+1925.196694596" watchObservedRunningTime="2026-07-15 21:42:12.380346906 +0000 UTC m=+1925.201664224" Jul 15 21:42:12.714316 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:12.714190 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:12.719150 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:12.719124 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:13.364002 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:13.363965 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:13.367993 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:13.367966 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:13.599666 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:13.599630 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m"] Jul 15 21:42:13.603124 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:13.603104 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m" Jul 15 21:42:13.606686 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:13.606661 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-e2e-shared-b-915a1c-serving-cert\"" Jul 15 21:42:13.624975 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:13.624909 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m"] Jul 15 21:42:13.706972 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:13.706941 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/862f3064-513f-46d5-9d55-d647b81cc0b5-maas-api-tls\") pod \"maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m\" (UID: \"862f3064-513f-46d5-9d55-d647b81cc0b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m" Jul 15 21:42:13.707146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:13.706985 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4zhz5\" (UniqueName: \"kubernetes.io/projected/862f3064-513f-46d5-9d55-d647b81cc0b5-kube-api-access-4zhz5\") pod \"maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m\" (UID: \"862f3064-513f-46d5-9d55-d647b81cc0b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m" Jul 15 21:42:13.707146 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:13.707072 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/862f3064-513f-46d5-9d55-d647b81cc0b5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m\" (UID: \"862f3064-513f-46d5-9d55-d647b81cc0b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m" Jul 15 21:42:13.807513 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:13.807481 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/862f3064-513f-46d5-9d55-d647b81cc0b5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m\" (UID: \"862f3064-513f-46d5-9d55-d647b81cc0b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m" Jul 15 21:42:13.807513 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:13.807549 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/862f3064-513f-46d5-9d55-d647b81cc0b5-maas-api-tls\") pod \"maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m\" (UID: \"862f3064-513f-46d5-9d55-d647b81cc0b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m" Jul 15 21:42:13.807976 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:42:13.807636 2572 secret.go:189] Couldn't get secret odh-ai-gateway-infra/maas-api-e2e-shared-b-915a1c-serving-cert: secret "maas-api-e2e-shared-b-915a1c-serving-cert" not found Jul 15 21:42:13.807976 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:13.807654 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4zhz5\" (UniqueName: \"kubernetes.io/projected/862f3064-513f-46d5-9d55-d647b81cc0b5-kube-api-access-4zhz5\") pod \"maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m\" (UID: \"862f3064-513f-46d5-9d55-d647b81cc0b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m" Jul 15 21:42:13.807976 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:42:13.807689 2572 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/862f3064-513f-46d5-9d55-d647b81cc0b5-maas-api-tls podName:862f3064-513f-46d5-9d55-d647b81cc0b5 nodeName:}" failed. No retries permitted until 2026-07-15 21:42:14.30767236 +0000 UTC m=+1927.128989656 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "maas-api-tls" (UniqueName: "kubernetes.io/secret/862f3064-513f-46d5-9d55-d647b81cc0b5-maas-api-tls") pod "maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m" (UID: "862f3064-513f-46d5-9d55-d647b81cc0b5") : secret "maas-api-e2e-shared-b-915a1c-serving-cert" not found Jul 15 21:42:13.808244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:13.808225 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-service-ca\" (UniqueName: \"kubernetes.io/configmap/862f3064-513f-46d5-9d55-d647b81cc0b5-openshift-service-ca\") pod \"maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m\" (UID: \"862f3064-513f-46d5-9d55-d647b81cc0b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m" Jul 15 21:42:13.817109 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:13.817083 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4zhz5\" (UniqueName: \"kubernetes.io/projected/862f3064-513f-46d5-9d55-d647b81cc0b5-kube-api-access-4zhz5\") pod \"maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m\" (UID: \"862f3064-513f-46d5-9d55-d647b81cc0b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m" Jul 15 21:42:14.312944 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:14.312854 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/862f3064-513f-46d5-9d55-d647b81cc0b5-maas-api-tls\") pod \"maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m\" (UID: \"862f3064-513f-46d5-9d55-d647b81cc0b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m" Jul 15 21:42:14.315635 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:14.315608 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"maas-api-tls\" (UniqueName: \"kubernetes.io/secret/862f3064-513f-46d5-9d55-d647b81cc0b5-maas-api-tls\") pod \"maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m\" (UID: \"862f3064-513f-46d5-9d55-d647b81cc0b5\") " pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m" Jul 15 21:42:14.335876 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:14.335854 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-a-543174-5748765cf8-hx2nk" Jul 15 21:42:14.513682 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:14.513641 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m" Jul 15 21:42:14.659324 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:14.658883 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m"] Jul 15 21:42:14.664562 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:42:14.663856 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod862f3064_513f_46d5_9d55_d647b81cc0b5.slice/crio-d4ecece51952a441042454a440998ba60373ec0c2b3f88c2b7a0c1c60652e5ca WatchSource:0}: Error finding container d4ecece51952a441042454a440998ba60373ec0c2b3f88c2b7a0c1c60652e5ca: Status 404 returned error can't find the container with id d4ecece51952a441042454a440998ba60373ec0c2b3f88c2b7a0c1c60652e5ca Jul 15 21:42:15.378617 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:15.378579 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m" event={"ID":"862f3064-513f-46d5-9d55-d647b81cc0b5","Type":"ContainerStarted","Data":"64708bbd5f89207e03435ec2edb174228d3a73cae18f32d237d7d0e67201562f"} Jul 15 21:42:15.379053 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:15.378644 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m" event={"ID":"862f3064-513f-46d5-9d55-d647b81cc0b5","Type":"ContainerStarted","Data":"d4ecece51952a441042454a440998ba60373ec0c2b3f88c2b7a0c1c60652e5ca"} Jul 15 21:42:15.379053 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:15.378978 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m" Jul 15 21:42:15.399923 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:15.399876 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m" podStartSLOduration=1.871814896 podStartE2EDuration="2.399860434s" totalImagesPullingTime="528.045538ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:42:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:42:15.397153549 +0000 UTC m=+1928.218470867" watchObservedRunningTime="2026-07-15 21:42:15.399860434 +0000 UTC m=+1928.221177751" Jul 15 21:42:17.392777 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:17.392691 2572 generic.go:356] "Generic (PLEG): container finished" podID="22b6c04a-44e4-4858-be1e-ee2f4952e0f3" containerID="18fc3388615e02325234d580505198cd554c1e98483bed7dd64b6351017e352e" exitCode=0 Jul 15 21:42:17.393165 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:17.392767 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" event={"ID":"22b6c04a-44e4-4858-be1e-ee2f4952e0f3","Type":"ContainerDied","Data":"18fc3388615e02325234d580505198cd554c1e98483bed7dd64b6351017e352e"} Jul 15 21:42:17.393165 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:17.393161 2572 scope.go:117] "RemoveContainer" containerID="18fc3388615e02325234d580505198cd554c1e98483bed7dd64b6351017e352e" Jul 15 21:42:17.394204 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:17.394182 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:42:17.394254 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:17.394244 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:42:17.394296 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:17.394276 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:42:18.401199 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:18.401157 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" event={"ID":"22b6c04a-44e4-4858-be1e-ee2f4952e0f3","Type":"ContainerStarted","Data":"1d37d3472186541c6e6355aee047a65d89373140c7987f2acd38ebf19aa298be"} Jul 15 21:42:18.634726 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:18.634687 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:18.635542 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:18.635492 2572 patch_prober.go:28] interesting pod/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Jul 15 21:42:18.635682 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:18.635565 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" podUID="22b6c04a-44e4-4858-be1e-ee2f4952e0f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Jul 15 21:42:19.634346 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:19.634308 2572 patch_prober.go:28] interesting pod/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Jul 15 21:42:19.634821 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:19.634373 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" podUID="22b6c04a-44e4-4858-be1e-ee2f4952e0f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Jul 15 21:42:20.302312 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:20.302285 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:20.635240 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:20.635201 2572 patch_prober.go:28] interesting pod/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Jul 15 21:42:20.635649 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:20.635258 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" podUID="22b6c04a-44e4-4858-be1e-ee2f4952e0f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Jul 15 21:42:21.402325 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:21.402294 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="odh-ai-gateway-infra/maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m" Jul 15 21:42:21.634550 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:21.634500 2572 patch_prober.go:28] interesting pod/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" start-of-body= Jul 15 21:42:21.634771 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:21.634596 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" podUID="22b6c04a-44e4-4858-be1e-ee2f4952e0f3" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.60:15021/healthz/ready\": dial tcp 10.134.0.60:15021: connect: connection refused" Jul 15 21:42:22.638402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:22.638371 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:22.639426 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:22.639401 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:42:27.459315 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:27.459277 2572 generic.go:356] "Generic (PLEG): container finished" podID="5e27a620-9d0d-47c0-9f26-acdad4fa82e7" containerID="4fd69b4cfa97f6a1c48cbcfabeb5e06253cdbc82900950f74c9e8c5d43ea3bb2" exitCode=0 Jul 15 21:42:27.459688 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:27.459336 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" event={"ID":"5e27a620-9d0d-47c0-9f26-acdad4fa82e7","Type":"ContainerDied","Data":"4fd69b4cfa97f6a1c48cbcfabeb5e06253cdbc82900950f74c9e8c5d43ea3bb2"} Jul 15 21:42:27.459846 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:27.459830 2572 scope.go:117] "RemoveContainer" containerID="4fd69b4cfa97f6a1c48cbcfabeb5e06253cdbc82900950f74c9e8c5d43ea3bb2" Jul 15 21:42:27.464083 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:27.464049 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:42:27.464214 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:27.464120 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:42:27.464214 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:27.464152 2572 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236228Ki","pods":"250"} Jul 15 21:42:28.363833 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:28.363789 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:28.474004 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:28.473961 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" event={"ID":"5e27a620-9d0d-47c0-9f26-acdad4fa82e7","Type":"ContainerStarted","Data":"0efc312ca564a5c9869530e0c5a66c0e84519ba746121831606bf64f4c22c86f"} Jul 15 21:42:28.714243 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:28.714156 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:28.715471 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:28.715442 2572 patch_prober.go:28] interesting pod/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body= Jul 15 21:42:28.715607 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:28.715496 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" podUID="5e27a620-9d0d-47c0-9f26-acdad4fa82e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" Jul 15 21:42:29.714028 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:29.713992 2572 patch_prober.go:28] interesting pod/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body= Jul 15 21:42:29.714557 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:29.714050 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" podUID="5e27a620-9d0d-47c0-9f26-acdad4fa82e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" Jul 15 21:42:30.713852 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:30.713818 2572 patch_prober.go:28] interesting pod/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body= Jul 15 21:42:30.714025 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:30.713884 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" podUID="5e27a620-9d0d-47c0-9f26-acdad4fa82e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" Jul 15 21:42:31.713736 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:31.713701 2572 patch_prober.go:28] interesting pod/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" start-of-body= Jul 15 21:42:31.714143 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:31.713763 2572 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" podUID="5e27a620-9d0d-47c0-9f26-acdad4fa82e7" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.62:15021/healthz/ready\": dial tcp 10.134.0.62:15021: connect: connection refused" Jul 15 21:42:32.718373 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:32.718346 2572 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:32.718843 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:32.718821 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:42:32.719507 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:42:32.719489 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:45:00.152349 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.152269 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-f6e0ed38-29735865-kms9l"] Jul 15 21:45:00.155832 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.155816 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-f6e0ed38-29735865-kms9l" Jul 15 21:45:00.163966 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.163944 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"odh-ai-gateway-infra\"/\"maas-api-cleanup-dockercfg-x6nvd\"" Jul 15 21:45:00.165702 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.165680 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-f6e0ed38-29735865-kms9l" Jul 15 21:45:00.168576 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.168553 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-281d9c60-29735865-rv674"] Jul 15 21:45:00.172502 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.172480 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ca080678-29735865-fddbd"] Jul 15 21:45:00.172628 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.172608 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-281d9c60-29735865-rv674" Jul 15 21:45:00.176108 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.176090 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ca080678-29735865-fddbd" Jul 15 21:45:00.206650 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.206517 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-915a1c-29735865-ltzpd"] Jul 15 21:45:00.207413 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.207335 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-281d9c60-29735865-rv674" Jul 15 21:45:00.221476 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.221040 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-915a1c-29735865-ltzpd" Jul 15 21:45:00.224902 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.224747 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ca080678-29735865-fddbd" Jul 15 21:45:00.225500 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.225469 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-f6e0ed38-29735865-kms9l"] Jul 15 21:45:00.235651 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.232252 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94c8e7-29735865-hdfnj"] Jul 15 21:45:00.239716 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.239697 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94c8e7-29735865-hdfnj" Jul 15 21:45:00.246296 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.246270 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ca080678-29735865-fddbd"] Jul 15 21:45:00.253411 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.253365 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-281d9c60-29735865-rv674"] Jul 15 21:45:00.257412 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.257391 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-915a1c-29735865-ltzpd"] Jul 15 21:45:00.262991 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.262920 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94c8e7-29735865-hdfnj"] Jul 15 21:45:00.283689 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.281426 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-9625f6-29735865-qv5l2"] Jul 15 21:45:00.298602 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.297213 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-543174-29735865-qmvq9"] Jul 15 21:45:00.304715 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.304549 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94c8e7-29735865-hdfnj" Jul 15 21:45:00.304816 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.304805 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-915a1c-29735865-ltzpd" Jul 15 21:45:00.304946 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.304889 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-9625f6-29735865-qv5l2" Jul 15 21:45:00.309000 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.308659 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb8539-29735865-qcngd"] Jul 15 21:45:00.309792 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.309441 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-543174-29735865-qmvq9" Jul 15 21:45:00.319609 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.318590 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-c871ea22-29735865-h5zdv"] Jul 15 21:45:00.326361 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.323823 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb8539-29735865-qcngd" Jul 15 21:45:00.328435 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.328300 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-9625f6-29735865-qv5l2" Jul 15 21:45:00.337215 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.337180 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-543174-29735865-qmvq9"] Jul 15 21:45:00.337416 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.337393 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-9625f6-29735865-qv5l2"] Jul 15 21:45:00.337716 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.337687 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb8539-29735865-qcngd"] Jul 15 21:45:00.337858 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.337847 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-c871ea22-29735865-h5zdv"] Jul 15 21:45:00.337960 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.337429 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-c871ea22-29735865-h5zdv" Jul 15 21:45:00.341186 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.341162 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-543174-29735865-qmvq9" Jul 15 21:45:00.385132 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.375352 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb8539-29735865-qcngd" Jul 15 21:45:00.403355 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.403145 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-c871ea22-29735865-h5zdv" Jul 15 21:45:00.535223 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.535120 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-281d9c60-29735865-rv674"] Jul 15 21:45:00.579225 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.579184 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ca080678-29735865-fddbd"] Jul 15 21:45:00.628819 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.628736 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-f6e0ed38-29735865-kms9l"] Jul 15 21:45:00.632964 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.632936 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94c8e7-29735865-hdfnj"] Jul 15 21:45:00.712565 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.712519 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-543174-29735865-qmvq9"] Jul 15 21:45:00.716569 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:45:00.716542 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod748cbeb2_773f_4bfc_a7be_0a4defd4b0e0.slice/crio-c9b66ff07b38f90af76f08d7e85bd25cfbaf4c27503c68fc45694bf1735473e4 WatchSource:0}: Error finding container c9b66ff07b38f90af76f08d7e85bd25cfbaf4c27503c68fc45694bf1735473e4: Status 404 returned error can't find the container with id c9b66ff07b38f90af76f08d7e85bd25cfbaf4c27503c68fc45694bf1735473e4 Jul 15 21:45:00.871652 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.871627 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-915a1c-29735865-ltzpd"] Jul 15 21:45:00.874628 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.874608 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-9625f6-29735865-qv5l2"] Jul 15 21:45:00.933703 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.933659 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-c871ea22-29735865-h5zdv"] Jul 15 21:45:00.936659 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:00.936640 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb8539-29735865-qcngd"] Jul 15 21:45:00.960121 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:45:00.960083 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4e8e273a_a845_4273_92b9_ac4cad0adffc.slice/crio-93ff147bd61b610ef7e4444117e8b8ae0865203486114e4cc36ae3edfc92241d WatchSource:0}: Error finding container 93ff147bd61b610ef7e4444117e8b8ae0865203486114e4cc36ae3edfc92241d: Status 404 returned error can't find the container with id 93ff147bd61b610ef7e4444117e8b8ae0865203486114e4cc36ae3edfc92241d Jul 15 21:45:00.973629 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:45:00.973592 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod44cbe016_b428_41b4_a9de_37b8d00c0f11.slice/crio-c55d3ce3fc29cf8614f9ce0a742d9be883a42eff64b1c871ce51d645902a0ceb WatchSource:0}: Error finding container c55d3ce3fc29cf8614f9ce0a742d9be883a42eff64b1c871ce51d645902a0ceb: Status 404 returned error can't find the container with id c55d3ce3fc29cf8614f9ce0a742d9be883a42eff64b1c871ce51d645902a0ceb Jul 15 21:45:00.973907 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:45:00.973886 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1e59484a_2cab_4c4a_9970_573d3fa4f53f.slice/crio-64ca7b929451688c1a9193de5f02e7312c4ab92c7331ba76ab944af6912c3ee0 WatchSource:0}: Error finding container 64ca7b929451688c1a9193de5f02e7312c4ab92c7331ba76ab944af6912c3ee0: Status 404 returned error can't find the container with id 64ca7b929451688c1a9193de5f02e7312c4ab92c7331ba76ab944af6912c3ee0 Jul 15 21:45:01.396457 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.396424 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-c871ea22-29735865-h5zdv" event={"ID":"44cbe016-b428-41b4-a9de-37b8d00c0f11","Type":"ContainerStarted","Data":"4f259562bb5a5b9f8ed2a96b03cc5e1cd02c26e3e991ac561dc30ef996f0ece7"} Jul 15 21:45:01.396824 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.396514 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-c871ea22-29735865-h5zdv" event={"ID":"44cbe016-b428-41b4-a9de-37b8d00c0f11","Type":"ContainerStarted","Data":"c55d3ce3fc29cf8614f9ce0a742d9be883a42eff64b1c871ce51d645902a0ceb"} Jul 15 21:45:01.397906 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.397884 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-543174-29735865-qmvq9" event={"ID":"748cbeb2-773f-4bfc-a7be-0a4defd4b0e0","Type":"ContainerStarted","Data":"760521b74914b9321ececb88dea6c6bf4a8304ef466c3e0dfceafe1cc2a57a6c"} Jul 15 21:45:01.397998 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.397924 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-543174-29735865-qmvq9" event={"ID":"748cbeb2-773f-4bfc-a7be-0a4defd4b0e0","Type":"ContainerStarted","Data":"c9b66ff07b38f90af76f08d7e85bd25cfbaf4c27503c68fc45694bf1735473e4"} Jul 15 21:45:01.399028 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.399008 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb8539-29735865-qcngd" event={"ID":"1e59484a-2cab-4c4a-9970-573d3fa4f53f","Type":"ContainerStarted","Data":"64ca7b929451688c1a9193de5f02e7312c4ab92c7331ba76ab944af6912c3ee0"} Jul 15 21:45:01.400477 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.400455 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94c8e7-29735865-hdfnj" event={"ID":"42bfd3fa-631a-46ea-aa82-cf59ca78c39a","Type":"ContainerStarted","Data":"b36aa200332cdf68eb37305611ecad650284ce39808de31d59d6eaabffc2bf21"} Jul 15 21:45:01.400572 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.400496 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94c8e7-29735865-hdfnj" event={"ID":"42bfd3fa-631a-46ea-aa82-cf59ca78c39a","Type":"ContainerStarted","Data":"a64504a63d4d3007f21acab753ebf8694d7f459fb16977f2266447572830732b"} Jul 15 21:45:01.401833 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.401810 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ca080678-29735865-fddbd" event={"ID":"f7d60d15-e673-48fb-bbdf-b0d21baad063","Type":"ContainerStarted","Data":"6eb58757854e0e19c2f77b009922c0b16d9cc9f1ae7f0f72357684bfd8c8cd08"} Jul 15 21:45:01.401926 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.401852 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ca080678-29735865-fddbd" event={"ID":"f7d60d15-e673-48fb-bbdf-b0d21baad063","Type":"ContainerStarted","Data":"bf7286b7941c96e8c52e49fa36e7c9b218391097b9c837d95a17888be8f29ca8"} Jul 15 21:45:01.403156 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.403133 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-281d9c60-29735865-rv674" event={"ID":"aa2c532d-a4ed-480a-8581-564fd36ee2d8","Type":"ContainerStarted","Data":"fddd513fabe0fa20264e4cbdf8eddc24660613c031a1933a0dfcabc07d270ec3"} Jul 15 21:45:01.403252 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.403177 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-281d9c60-29735865-rv674" event={"ID":"aa2c532d-a4ed-480a-8581-564fd36ee2d8","Type":"ContainerStarted","Data":"d0ab616bdf38e82652478df09d2c1c35ae75bed27d0ee64f43cfff343e794bfc"} Jul 15 21:45:01.404678 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.404650 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-f6e0ed38-29735865-kms9l" event={"ID":"e58896f3-e27b-44c5-89a9-b583bf8a684a","Type":"ContainerStarted","Data":"6b693f91cc8f917e1d70963284534521e1cec3cf00f010b2cd27236fd469e852"} Jul 15 21:45:01.404791 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.404697 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-f6e0ed38-29735865-kms9l" event={"ID":"e58896f3-e27b-44c5-89a9-b583bf8a684a","Type":"ContainerStarted","Data":"6689b15bc827111ad253b837ff637006fbf990c5e38b9e35f4d21e8aec336dc9"} Jul 15 21:45:01.406097 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.406072 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-9625f6-29735865-qv5l2" event={"ID":"6d33c4b7-c87e-49d7-a5db-0a7b36bf3db2","Type":"ContainerStarted","Data":"f534a631eef19ac0e3526f248a36d93ba2b46772fafbec0b4bfc72d7ebd3c419"} Jul 15 21:45:01.406181 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.406121 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-9625f6-29735865-qv5l2" event={"ID":"6d33c4b7-c87e-49d7-a5db-0a7b36bf3db2","Type":"ContainerStarted","Data":"f83bd38bbfa4a7f16d7f113ebdd03ca6f03c00c56e6c7a299fc7f5a1af7436c6"} Jul 15 21:45:01.407577 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.407557 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-915a1c-29735865-ltzpd" event={"ID":"4e8e273a-a845-4273-92b9-ac4cad0adffc","Type":"ContainerStarted","Data":"a544ea5bdd742d79e8f4f5bea75683be50ab3679e29eb091fe2de88aa0e1971c"} Jul 15 21:45:01.407665 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.407591 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-915a1c-29735865-ltzpd" event={"ID":"4e8e273a-a845-4273-92b9-ac4cad0adffc","Type":"ContainerStarted","Data":"93ff147bd61b610ef7e4444117e8b8ae0865203486114e4cc36ae3edfc92241d"} Jul 15 21:45:01.413604 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.413566 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-c871ea22-29735865-h5zdv" podStartSLOduration=1.413553661 podStartE2EDuration="1.413553661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:01.410948346 +0000 UTC m=+2094.232265664" watchObservedRunningTime="2026-07-15 21:45:01.413553661 +0000 UTC m=+2094.234870979" Jul 15 21:45:01.426069 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.425982 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-915a1c-29735865-ltzpd" podStartSLOduration=1.425967426 podStartE2EDuration="1.425967426s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:01.425684811 +0000 UTC m=+2094.247002129" watchObservedRunningTime="2026-07-15 21:45:01.425967426 +0000 UTC m=+2094.247284745" Jul 15 21:45:01.441236 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.441201 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ca080678-29735865-fddbd" podStartSLOduration=1.441191263 podStartE2EDuration="1.441191263s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:01.440460428 +0000 UTC m=+2094.261777745" watchObservedRunningTime="2026-07-15 21:45:01.441191263 +0000 UTC m=+2094.262508580" Jul 15 21:45:01.454760 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.454720 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-543174-29735865-qmvq9" podStartSLOduration=1.454708835 podStartE2EDuration="1.454708835s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:01.454292427 +0000 UTC m=+2094.275609743" watchObservedRunningTime="2026-07-15 21:45:01.454708835 +0000 UTC m=+2094.276026151" Jul 15 21:45:01.471463 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.471425 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-281d9c60-29735865-rv674" podStartSLOduration=1.4714136340000001 podStartE2EDuration="1.471413634s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:01.469163824 +0000 UTC m=+2094.290481142" watchObservedRunningTime="2026-07-15 21:45:01.471413634 +0000 UTC m=+2094.292730950" Jul 15 21:45:01.485438 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.485398 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-9625f6-29735865-qv5l2" podStartSLOduration=1.485385784 podStartE2EDuration="1.485385784s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:01.484301004 +0000 UTC m=+2094.305618323" watchObservedRunningTime="2026-07-15 21:45:01.485385784 +0000 UTC m=+2094.306703151" Jul 15 21:45:01.502188 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.502137 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-f6e0ed38-29735865-kms9l" podStartSLOduration=1.502120899 podStartE2EDuration="1.502120899s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:01.499745089 +0000 UTC m=+2094.321062407" watchObservedRunningTime="2026-07-15 21:45:01.502120899 +0000 UTC m=+2094.323438218" Jul 15 21:45:01.514997 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:01.514958 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94c8e7-29735865-hdfnj" podStartSLOduration=1.514946933 podStartE2EDuration="1.514946933s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-15 21:45:00 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:45:01.513977792 +0000 UTC m=+2094.335295247" watchObservedRunningTime="2026-07-15 21:45:01.514946933 +0000 UTC m=+2094.336264249" Jul 15 21:45:02.415139 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:02.415106 2572 generic.go:356] "Generic (PLEG): container finished" podID="42bfd3fa-631a-46ea-aa82-cf59ca78c39a" containerID="b36aa200332cdf68eb37305611ecad650284ce39808de31d59d6eaabffc2bf21" exitCode=0 Jul 15 21:45:02.415480 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:02.415187 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94c8e7-29735865-hdfnj" event={"ID":"42bfd3fa-631a-46ea-aa82-cf59ca78c39a","Type":"ContainerDied","Data":"b36aa200332cdf68eb37305611ecad650284ce39808de31d59d6eaabffc2bf21"} Jul 15 21:45:02.416722 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:02.416700 2572 generic.go:356] "Generic (PLEG): container finished" podID="f7d60d15-e673-48fb-bbdf-b0d21baad063" containerID="6eb58757854e0e19c2f77b009922c0b16d9cc9f1ae7f0f72357684bfd8c8cd08" exitCode=0 Jul 15 21:45:02.416816 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:02.416776 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ca080678-29735865-fddbd" event={"ID":"f7d60d15-e673-48fb-bbdf-b0d21baad063","Type":"ContainerDied","Data":"6eb58757854e0e19c2f77b009922c0b16d9cc9f1ae7f0f72357684bfd8c8cd08"} Jul 15 21:45:02.418183 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:02.418163 2572 generic.go:356] "Generic (PLEG): container finished" podID="aa2c532d-a4ed-480a-8581-564fd36ee2d8" containerID="fddd513fabe0fa20264e4cbdf8eddc24660613c031a1933a0dfcabc07d270ec3" exitCode=0 Jul 15 21:45:02.418270 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:02.418236 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-281d9c60-29735865-rv674" event={"ID":"aa2c532d-a4ed-480a-8581-564fd36ee2d8","Type":"ContainerDied","Data":"fddd513fabe0fa20264e4cbdf8eddc24660613c031a1933a0dfcabc07d270ec3"} Jul 15 21:45:02.419636 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:02.419614 2572 generic.go:356] "Generic (PLEG): container finished" podID="e58896f3-e27b-44c5-89a9-b583bf8a684a" containerID="6b693f91cc8f917e1d70963284534521e1cec3cf00f010b2cd27236fd469e852" exitCode=0 Jul 15 21:45:02.419725 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:02.419706 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-f6e0ed38-29735865-kms9l" event={"ID":"e58896f3-e27b-44c5-89a9-b583bf8a684a","Type":"ContainerDied","Data":"6b693f91cc8f917e1d70963284534521e1cec3cf00f010b2cd27236fd469e852"} Jul 15 21:45:02.421466 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:02.421448 2572 generic.go:356] "Generic (PLEG): container finished" podID="6d33c4b7-c87e-49d7-a5db-0a7b36bf3db2" containerID="f534a631eef19ac0e3526f248a36d93ba2b46772fafbec0b4bfc72d7ebd3c419" exitCode=0 Jul 15 21:45:02.421570 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:02.421509 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-9625f6-29735865-qv5l2" event={"ID":"6d33c4b7-c87e-49d7-a5db-0a7b36bf3db2","Type":"ContainerDied","Data":"f534a631eef19ac0e3526f248a36d93ba2b46772fafbec0b4bfc72d7ebd3c419"} Jul 15 21:45:02.422850 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:02.422830 2572 generic.go:356] "Generic (PLEG): container finished" podID="4e8e273a-a845-4273-92b9-ac4cad0adffc" containerID="a544ea5bdd742d79e8f4f5bea75683be50ab3679e29eb091fe2de88aa0e1971c" exitCode=0 Jul 15 21:45:02.422918 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:02.422860 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-915a1c-29735865-ltzpd" event={"ID":"4e8e273a-a845-4273-92b9-ac4cad0adffc","Type":"ContainerDied","Data":"a544ea5bdd742d79e8f4f5bea75683be50ab3679e29eb091fe2de88aa0e1971c"} Jul 15 21:45:02.424279 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:02.424263 2572 generic.go:356] "Generic (PLEG): container finished" podID="44cbe016-b428-41b4-a9de-37b8d00c0f11" containerID="4f259562bb5a5b9f8ed2a96b03cc5e1cd02c26e3e991ac561dc30ef996f0ece7" exitCode=0 Jul 15 21:45:02.424334 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:02.424317 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-c871ea22-29735865-h5zdv" event={"ID":"44cbe016-b428-41b4-a9de-37b8d00c0f11","Type":"ContainerDied","Data":"4f259562bb5a5b9f8ed2a96b03cc5e1cd02c26e3e991ac561dc30ef996f0ece7"} Jul 15 21:45:02.425640 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:02.425623 2572 generic.go:356] "Generic (PLEG): container finished" podID="748cbeb2-773f-4bfc-a7be-0a4defd4b0e0" containerID="760521b74914b9321ececb88dea6c6bf4a8304ef466c3e0dfceafe1cc2a57a6c" exitCode=0 Jul 15 21:45:02.425712 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:02.425688 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-543174-29735865-qmvq9" event={"ID":"748cbeb2-773f-4bfc-a7be-0a4defd4b0e0","Type":"ContainerDied","Data":"760521b74914b9321ececb88dea6c6bf4a8304ef466c3e0dfceafe1cc2a57a6c"} Jul 15 21:45:02.427007 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:02.426985 2572 generic.go:356] "Generic (PLEG): container finished" podID="1e59484a-2cab-4c4a-9970-573d3fa4f53f" containerID="c85443ba6cac0472c52bbe62b84514635a0b6b2ad8531a3b6f148ae87230841f" exitCode=0 Jul 15 21:45:02.427115 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:02.427014 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb8539-29735865-qcngd" event={"ID":"1e59484a-2cab-4c4a-9970-573d3fa4f53f","Type":"ContainerDied","Data":"c85443ba6cac0472c52bbe62b84514635a0b6b2ad8531a3b6f148ae87230841f"} Jul 15 21:45:03.685371 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:03.676856 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-281d9c60-29735865-rv674" Jul 15 21:45:03.691957 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:03.686165 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-543174-29735865-qmvq9" Jul 15 21:45:03.760605 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:03.760579 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-c871ea22-29735865-h5zdv" Jul 15 21:45:03.763273 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:03.763256 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ca080678-29735865-fddbd" Jul 15 21:45:03.765411 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:03.765388 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-f6e0ed38-29735865-kms9l" Jul 15 21:45:03.770401 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:03.770382 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-915a1c-29735865-ltzpd" Jul 15 21:45:03.773059 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:03.773041 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-9625f6-29735865-qv5l2" Jul 15 21:45:03.776078 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:03.776057 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb8539-29735865-qcngd" Jul 15 21:45:03.781402 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:03.781384 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94c8e7-29735865-hdfnj" Jul 15 21:45:04.441097 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.441068 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94c8e7-29735865-hdfnj" Jul 15 21:45:04.441097 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.441082 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-a-94c8e7-29735865-hdfnj" event={"ID":"42bfd3fa-631a-46ea-aa82-cf59ca78c39a","Type":"ContainerDied","Data":"a64504a63d4d3007f21acab753ebf8694d7f459fb16977f2266447572830732b"} Jul 15 21:45:04.441297 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.441129 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="a64504a63d4d3007f21acab753ebf8694d7f459fb16977f2266447572830732b" Jul 15 21:45:04.442469 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.442451 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ca080678-29735865-fddbd" Jul 15 21:45:04.442585 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.442499 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-ait-ca080678-29735865-fddbd" event={"ID":"f7d60d15-e673-48fb-bbdf-b0d21baad063","Type":"ContainerDied","Data":"bf7286b7941c96e8c52e49fa36e7c9b218391097b9c837d95a17888be8f29ca8"} Jul 15 21:45:04.442585 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.442557 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="bf7286b7941c96e8c52e49fa36e7c9b218391097b9c837d95a17888be8f29ca8" Jul 15 21:45:04.443999 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.443980 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-281d9c60-29735865-rv674" Jul 15 21:45:04.444131 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.443976 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-derive-281d9c60-29735865-rv674" event={"ID":"aa2c532d-a4ed-480a-8581-564fd36ee2d8","Type":"ContainerDied","Data":"d0ab616bdf38e82652478df09d2c1c35ae75bed27d0ee64f43cfff343e794bfc"} Jul 15 21:45:04.444131 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.444099 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="d0ab616bdf38e82652478df09d2c1c35ae75bed27d0ee64f43cfff343e794bfc" Jul 15 21:45:04.445420 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.445400 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-f6e0ed38-29735865-kms9l" Jul 15 21:45:04.445513 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.445407 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-mt-f6e0ed38-29735865-kms9l" event={"ID":"e58896f3-e27b-44c5-89a9-b583bf8a684a","Type":"ContainerDied","Data":"6689b15bc827111ad253b837ff637006fbf990c5e38b9e35f4d21e8aec336dc9"} Jul 15 21:45:04.445623 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.445519 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="6689b15bc827111ad253b837ff637006fbf990c5e38b9e35f4d21e8aec336dc9" Jul 15 21:45:04.446816 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.446786 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-9625f6-29735865-qv5l2" event={"ID":"6d33c4b7-c87e-49d7-a5db-0a7b36bf3db2","Type":"ContainerDied","Data":"f83bd38bbfa4a7f16d7f113ebdd03ca6f03c00c56e6c7a299fc7f5a1af7436c6"} Jul 15 21:45:04.446816 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.446801 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-inf-b-9625f6-29735865-qv5l2" Jul 15 21:45:04.446976 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.446826 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="f83bd38bbfa4a7f16d7f113ebdd03ca6f03c00c56e6c7a299fc7f5a1af7436c6" Jul 15 21:45:04.448943 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.448926 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-915a1c-29735865-ltzpd" Jul 15 21:45:04.449042 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.448980 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-b-915a1c-29735865-ltzpd" event={"ID":"4e8e273a-a845-4273-92b9-ac4cad0adffc","Type":"ContainerDied","Data":"93ff147bd61b610ef7e4444117e8b8ae0865203486114e4cc36ae3edfc92241d"} Jul 15 21:45:04.449042 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.449015 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="93ff147bd61b610ef7e4444117e8b8ae0865203486114e4cc36ae3edfc92241d" Jul 15 21:45:04.450640 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.450622 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-c871ea22-29735865-h5zdv" Jul 15 21:45:04.450739 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.450651 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-migrate-c871ea22-29735865-h5zdv" event={"ID":"44cbe016-b428-41b4-a9de-37b8d00c0f11","Type":"ContainerDied","Data":"c55d3ce3fc29cf8614f9ce0a742d9be883a42eff64b1c871ce51d645902a0ceb"} Jul 15 21:45:04.450739 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.450697 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c55d3ce3fc29cf8614f9ce0a742d9be883a42eff64b1c871ce51d645902a0ceb" Jul 15 21:45:04.452003 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.451983 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-543174-29735865-qmvq9" Jul 15 21:45:04.452104 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.452001 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-shared-a-543174-29735865-qmvq9" event={"ID":"748cbeb2-773f-4bfc-a7be-0a4defd4b0e0","Type":"ContainerDied","Data":"c9b66ff07b38f90af76f08d7e85bd25cfbaf4c27503c68fc45694bf1735473e4"} Jul 15 21:45:04.452104 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.452037 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="c9b66ff07b38f90af76f08d7e85bd25cfbaf4c27503c68fc45694bf1735473e4" Jul 15 21:45:04.453281 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.453253 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb8539-29735865-qcngd" event={"ID":"1e59484a-2cab-4c4a-9970-573d3fa4f53f","Type":"ContainerDied","Data":"64ca7b929451688c1a9193de5f02e7312c4ab92c7331ba76ab944af6912c3ee0"} Jul 15 21:45:04.453456 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.453291 2572 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="64ca7b929451688c1a9193de5f02e7312c4ab92c7331ba76ab944af6912c3ee0" Jul 15 21:45:04.453456 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:04.453324 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="odh-ai-gateway-infra/maas-api-key-cleanup-e2e-api-b-fb8539-29735865-qcngd" Jul 15 21:45:08.304746 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:08.304720 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsl2f_19ebe52b-28dc-4b7b-af2d-0779b13a9b62/ovn-acl-logging/0.log" Jul 15 21:45:08.309332 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:45:08.309312 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-dsl2f_19ebe52b-28dc-4b7b-af2d-0779b13a9b62/ovn-acl-logging/0.log" Jul 15 21:46:08.139880 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:46:08.139805 2572 scope.go:117] "RemoveContainer" containerID="95937ae64d7f6792a322743cfed65a8ccda46e85fa0c23a30c5927fb0a6e2fb6" Jul 15 21:46:08.152076 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:46:08.152056 2572 scope.go:117] "RemoveContainer" containerID="1e12770a6da87e72ce7717ef23d9578a5ef32cf8faba32f9b722a3c7d1238d6d" Jul 15 21:48:15.435827 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:15.435792 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v"] Jul 15 21:48:15.436305 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:15.436020 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" podUID="22b6c04a-44e4-4858-be1e-ee2f4952e0f3" containerName="istio-proxy" containerID="cri-o://1d37d3472186541c6e6355aee047a65d89373140c7987f2acd38ebf19aa298be" gracePeriod=30 Jul 15 21:48:20.679335 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.679304 2572 generic.go:356] "Generic (PLEG): container finished" podID="22b6c04a-44e4-4858-be1e-ee2f4952e0f3" containerID="1d37d3472186541c6e6355aee047a65d89373140c7987f2acd38ebf19aa298be" exitCode=0 Jul 15 21:48:20.679687 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.679373 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" event={"ID":"22b6c04a-44e4-4858-be1e-ee2f4952e0f3","Type":"ContainerDied","Data":"1d37d3472186541c6e6355aee047a65d89373140c7987f2acd38ebf19aa298be"} Jul 15 21:48:20.679687 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.679444 2572 scope.go:117] "RemoveContainer" containerID="18fc3388615e02325234d580505198cd554c1e98483bed7dd64b6351017e352e" Jul 15 21:48:20.701009 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.700989 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:48:20.825593 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.825564 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istiod-ca-cert\") pod \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " Jul 15 21:48:20.825780 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.825622 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-data\") pod \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " Jul 15 21:48:20.825780 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.825677 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-workload-certs\") pod \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " Jul 15 21:48:20.825780 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.825701 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-workload-socket\") pod \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " Jul 15 21:48:20.825780 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.825731 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-envoy\") pod \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " Jul 15 21:48:20.825780 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.825753 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-credential-socket\") pod \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " Jul 15 21:48:20.826049 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.825808 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-token\") pod \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " Jul 15 21:48:20.826049 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.825839 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-jfmfr\" (UniqueName: \"kubernetes.io/projected/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-kube-api-access-jfmfr\") pod \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " Jul 15 21:48:20.826049 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.825911 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-podinfo\") pod \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\" (UID: \"22b6c04a-44e4-4858-be1e-ee2f4952e0f3\") " Jul 15 21:48:20.826049 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.826017 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "22b6c04a-44e4-4858-be1e-ee2f4952e0f3" (UID: "22b6c04a-44e4-4858-be1e-ee2f4952e0f3"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:48:20.826261 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.826092 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "22b6c04a-44e4-4858-be1e-ee2f4952e0f3" (UID: "22b6c04a-44e4-4858-be1e-ee2f4952e0f3"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:48:20.826261 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.826165 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "22b6c04a-44e4-4858-be1e-ee2f4952e0f3" (UID: "22b6c04a-44e4-4858-be1e-ee2f4952e0f3"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:48:20.826261 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.826215 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "22b6c04a-44e4-4858-be1e-ee2f4952e0f3" (UID: "22b6c04a-44e4-4858-be1e-ee2f4952e0f3"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:48:20.826410 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.826368 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istiod-ca-cert\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:48:20.826410 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.826393 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-workload-certs\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:48:20.826410 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.826408 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-workload-socket\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:48:20.826603 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.826417 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-data" (OuterVolumeSpecName: "istio-data") pod "22b6c04a-44e4-4858-be1e-ee2f4952e0f3" (UID: "22b6c04a-44e4-4858-be1e-ee2f4952e0f3"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:48:20.826603 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.826424 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-credential-socket\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:48:20.828004 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.827980 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "22b6c04a-44e4-4858-be1e-ee2f4952e0f3" (UID: "22b6c04a-44e4-4858-be1e-ee2f4952e0f3"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:48:20.828110 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.828095 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "22b6c04a-44e4-4858-be1e-ee2f4952e0f3" (UID: "22b6c04a-44e4-4858-be1e-ee2f4952e0f3"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 21:48:20.828371 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.828351 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-token" (OuterVolumeSpecName: "istio-token") pod "22b6c04a-44e4-4858-be1e-ee2f4952e0f3" (UID: "22b6c04a-44e4-4858-be1e-ee2f4952e0f3"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:48:20.828425 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.828407 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-kube-api-access-jfmfr" (OuterVolumeSpecName: "kube-api-access-jfmfr") pod "22b6c04a-44e4-4858-be1e-ee2f4952e0f3" (UID: "22b6c04a-44e4-4858-be1e-ee2f4952e0f3"). InnerVolumeSpecName "kube-api-access-jfmfr". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:48:20.927285 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.927250 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-envoy\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:48:20.927285 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.927280 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-token\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:48:20.927500 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.927295 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-jfmfr\" (UniqueName: \"kubernetes.io/projected/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-kube-api-access-jfmfr\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:48:20.927500 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.927307 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-podinfo\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:48:20.927500 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:20.927316 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/22b6c04a-44e4-4858-be1e-ee2f4952e0f3-istio-data\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:48:21.687285 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:21.687257 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" Jul 15 21:48:21.687751 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:21.687294 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v" event={"ID":"22b6c04a-44e4-4858-be1e-ee2f4952e0f3","Type":"ContainerDied","Data":"26d448f3cab078dd094ea1dd55e474954a220db77dabef478b5e63fe491a15c6"} Jul 15 21:48:21.687751 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:21.687347 2572 scope.go:117] "RemoveContainer" containerID="1d37d3472186541c6e6355aee047a65d89373140c7987f2acd38ebf19aa298be" Jul 15 21:48:21.721173 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:21.721147 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v"] Jul 15 21:48:21.725617 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:21.725596 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-543174-openshift-default-c5dc4d755-gh77v"] Jul 15 21:48:21.961287 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:21.961209 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="22b6c04a-44e4-4858-be1e-ee2f4952e0f3" path="/var/lib/kubelet/pods/22b6c04a-44e4-4858-be1e-ee2f4952e0f3/volumes" Jul 15 21:48:22.168140 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:22.168111 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj"] Jul 15 21:48:22.168354 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:22.168331 2572 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" podUID="5e27a620-9d0d-47c0-9f26-acdad4fa82e7" containerName="istio-proxy" containerID="cri-o://0efc312ca564a5c9869530e0c5a66c0e84519ba746121831606bf64f4c22c86f" gracePeriod=30 Jul 15 21:48:27.428061 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.428037 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:48:27.590500 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.590473 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-envoy\") pod \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " Jul 15 21:48:27.590686 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.590507 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nzms7\" (UniqueName: \"kubernetes.io/projected/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-kube-api-access-nzms7\") pod \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " Jul 15 21:48:27.590686 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.590550 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-podinfo\") pod \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " Jul 15 21:48:27.590686 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.590588 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-workload-socket\") pod \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " Jul 15 21:48:27.590686 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.590607 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-data\") pod \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " Jul 15 21:48:27.590892 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.590770 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istiod-ca-cert\") pod \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " Jul 15 21:48:27.590892 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.590852 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-workload-certs\") pod \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " Jul 15 21:48:27.590892 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.590885 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-token\") pod \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " Jul 15 21:48:27.591046 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.590946 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "5e27a620-9d0d-47c0-9f26-acdad4fa82e7" (UID: "5e27a620-9d0d-47c0-9f26-acdad4fa82e7"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:48:27.591046 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.590986 2572 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-credential-socket\") pod \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\" (UID: \"5e27a620-9d0d-47c0-9f26-acdad4fa82e7\") " Jul 15 21:48:27.591471 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.591176 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "5e27a620-9d0d-47c0-9f26-acdad4fa82e7" (UID: "5e27a620-9d0d-47c0-9f26-acdad4fa82e7"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:48:27.591471 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.591112 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "5e27a620-9d0d-47c0-9f26-acdad4fa82e7" (UID: "5e27a620-9d0d-47c0-9f26-acdad4fa82e7"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 15 21:48:27.591471 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.591375 2572 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-workload-socket\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:48:27.591471 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.591385 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "5e27a620-9d0d-47c0-9f26-acdad4fa82e7" (UID: "5e27a620-9d0d-47c0-9f26-acdad4fa82e7"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:48:27.591471 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.591394 2572 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istiod-ca-cert\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:48:27.591471 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.591434 2572 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-workload-certs\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:48:27.591781 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.591680 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-data" (OuterVolumeSpecName: "istio-data") pod "5e27a620-9d0d-47c0-9f26-acdad4fa82e7" (UID: "5e27a620-9d0d-47c0-9f26-acdad4fa82e7"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:48:27.592898 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.592862 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "5e27a620-9d0d-47c0-9f26-acdad4fa82e7" (UID: "5e27a620-9d0d-47c0-9f26-acdad4fa82e7"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 15 21:48:27.593081 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.593059 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-token" (OuterVolumeSpecName: "istio-token") pod "5e27a620-9d0d-47c0-9f26-acdad4fa82e7" (UID: "5e27a620-9d0d-47c0-9f26-acdad4fa82e7"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:48:27.593213 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.593194 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-kube-api-access-nzms7" (OuterVolumeSpecName: "kube-api-access-nzms7") pod "5e27a620-9d0d-47c0-9f26-acdad4fa82e7" (UID: "5e27a620-9d0d-47c0-9f26-acdad4fa82e7"). InnerVolumeSpecName "kube-api-access-nzms7". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 15 21:48:27.593261 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.593222 2572 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "5e27a620-9d0d-47c0-9f26-acdad4fa82e7" (UID: "5e27a620-9d0d-47c0-9f26-acdad4fa82e7"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 15 21:48:27.692985 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.692955 2572 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-token\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:48:27.692985 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.692984 2572 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-credential-socket\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:48:27.692985 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.692993 2572 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-envoy\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:48:27.693209 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.693021 2572 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nzms7\" (UniqueName: \"kubernetes.io/projected/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-kube-api-access-nzms7\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:48:27.693209 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.693030 2572 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-podinfo\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:48:27.693209 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.693039 2572 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/5e27a620-9d0d-47c0-9f26-acdad4fa82e7-istio-data\") on node \"ip-10-0-136-18.ec2.internal\" DevicePath \"\"" Jul 15 21:48:27.723964 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.723932 2572 generic.go:356] "Generic (PLEG): container finished" podID="5e27a620-9d0d-47c0-9f26-acdad4fa82e7" containerID="0efc312ca564a5c9869530e0c5a66c0e84519ba746121831606bf64f4c22c86f" exitCode=0 Jul 15 21:48:27.724139 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.723985 2572 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" Jul 15 21:48:27.724139 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.724021 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" event={"ID":"5e27a620-9d0d-47c0-9f26-acdad4fa82e7","Type":"ContainerDied","Data":"0efc312ca564a5c9869530e0c5a66c0e84519ba746121831606bf64f4c22c86f"} Jul 15 21:48:27.724139 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.724080 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj" event={"ID":"5e27a620-9d0d-47c0-9f26-acdad4fa82e7","Type":"ContainerDied","Data":"3b768bc2128e9605dd0b37e48491ca317f436a674e3445b611f2bf953e25a527"} Jul 15 21:48:27.724139 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.724103 2572 scope.go:117] "RemoveContainer" containerID="0efc312ca564a5c9869530e0c5a66c0e84519ba746121831606bf64f4c22c86f" Jul 15 21:48:27.733857 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.733835 2572 scope.go:117] "RemoveContainer" containerID="4fd69b4cfa97f6a1c48cbcfabeb5e06253cdbc82900950f74c9e8c5d43ea3bb2" Jul 15 21:48:27.742368 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.742351 2572 scope.go:117] "RemoveContainer" containerID="0efc312ca564a5c9869530e0c5a66c0e84519ba746121831606bf64f4c22c86f" Jul 15 21:48:27.742645 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:48:27.742626 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"0efc312ca564a5c9869530e0c5a66c0e84519ba746121831606bf64f4c22c86f\": container with ID starting with 0efc312ca564a5c9869530e0c5a66c0e84519ba746121831606bf64f4c22c86f not found: ID does not exist" containerID="0efc312ca564a5c9869530e0c5a66c0e84519ba746121831606bf64f4c22c86f" Jul 15 21:48:27.742703 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.742657 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"0efc312ca564a5c9869530e0c5a66c0e84519ba746121831606bf64f4c22c86f"} err="failed to get container status \"0efc312ca564a5c9869530e0c5a66c0e84519ba746121831606bf64f4c22c86f\": rpc error: code = NotFound desc = could not find container \"0efc312ca564a5c9869530e0c5a66c0e84519ba746121831606bf64f4c22c86f\": container with ID starting with 0efc312ca564a5c9869530e0c5a66c0e84519ba746121831606bf64f4c22c86f not found: ID does not exist" Jul 15 21:48:27.742703 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.742683 2572 scope.go:117] "RemoveContainer" containerID="4fd69b4cfa97f6a1c48cbcfabeb5e06253cdbc82900950f74c9e8c5d43ea3bb2" Jul 15 21:48:27.742912 ip-10-0-136-18 kubenswrapper[2572]: E0715 21:48:27.742895 2572 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4fd69b4cfa97f6a1c48cbcfabeb5e06253cdbc82900950f74c9e8c5d43ea3bb2\": container with ID starting with 4fd69b4cfa97f6a1c48cbcfabeb5e06253cdbc82900950f74c9e8c5d43ea3bb2 not found: ID does not exist" containerID="4fd69b4cfa97f6a1c48cbcfabeb5e06253cdbc82900950f74c9e8c5d43ea3bb2" Jul 15 21:48:27.742956 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.742918 2572 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4fd69b4cfa97f6a1c48cbcfabeb5e06253cdbc82900950f74c9e8c5d43ea3bb2"} err="failed to get container status \"4fd69b4cfa97f6a1c48cbcfabeb5e06253cdbc82900950f74c9e8c5d43ea3bb2\": rpc error: code = NotFound desc = could not find container \"4fd69b4cfa97f6a1c48cbcfabeb5e06253cdbc82900950f74c9e8c5d43ea3bb2\": container with ID starting with 4fd69b4cfa97f6a1c48cbcfabeb5e06253cdbc82900950f74c9e8c5d43ea3bb2 not found: ID does not exist" Jul 15 21:48:27.749918 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.749894 2572 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj"] Jul 15 21:48:27.754235 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.754213 2572 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-915a1c-openshift-default-5f998cdd4c-v2qdj"] Jul 15 21:48:27.962389 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:27.962303 2572 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="5e27a620-9d0d-47c0-9f26-acdad4fa82e7" path="/var/lib/kubelet/pods/5e27a620-9d0d-47c0-9f26-acdad4fa82e7/volumes" Jul 15 21:48:28.278825 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:28.278741 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-pkczm_5f45a272-726a-4d39-b171-3018a23be928/manager/0.log" Jul 15 21:48:28.405461 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:28.405431 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jk4lg_e4e4cc0f-3383-4920-9017-8683bf6f613c/manager/0.log" Jul 15 21:48:28.669191 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:28.669165 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5jn5d_bd039300-5520-4b70-8b67-5de95af6bbc5/server/0.log" Jul 15 21:48:28.794069 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:28.794036 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hbvv6_618e6159-0a9a-4d5a-8be8-c574e81d3c0e/manager/0.log" Jul 15 21:48:29.185186 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:29.185159 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f656749fc-mtlhd_b481448b-04bd-48ec-ab41-2cff39511bb9/copy-manifests/0.log" Jul 15 21:48:29.192437 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:29.192405 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f656749fc-mtlhd_b481448b-04bd-48ec-ab41-2cff39511bb9/manager/0.log" Jul 15 21:48:29.935137 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:29.935111 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-api-b-fb8539-6df6cd7b4c-qkbj7_a9c7557f-e3ab-4c30-9880-f70787e3ffe8/maas-api/0.log" Jul 15 21:48:30.633798 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:30.633765 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-a-543174-5748765cf8-hx2nk_bb71a7b2-0ed5-4002-9810-34c5ec92ee8a/maas-api/0.log" Jul 15 21:48:30.750726 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:30.750699 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-e2e-shared-b-915a1c-6c8d968cff-58t2m_862f3064-513f-46d5-9d55-d647b81cc0b5/maas-api/0.log" Jul 15 21:48:30.859479 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:30.859450 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-29735850-x7zfc_2e89474a-8519-4c29-abf1-6a09cc0cb5f3/cleanup/0.log" Jul 15 21:48:31.083827 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:31.083798 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-ait-ca080678-29735865-fddbd_f7d60d15-e673-48fb-bbdf-b0d21baad063/cleanup/0.log" Jul 15 21:48:31.192858 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:31.192824 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-api-a-94c8e7-29735865-hdfnj_42bfd3fa-631a-46ea-aa82-cf59ca78c39a/cleanup/0.log" Jul 15 21:48:31.301929 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:31.301899 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-api-b-fb8539-29735865-qcngd_1e59484a-2cab-4c4a-9970-573d3fa4f53f/cleanup/0.log" Jul 15 21:48:31.415801 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:31.415725 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-derive-281d9c60-29735865-rv674_aa2c532d-a4ed-480a-8581-564fd36ee2d8/cleanup/0.log" Jul 15 21:48:31.640441 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:31.640410 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-inf-b-9625f6-29735865-qv5l2_6d33c4b7-c87e-49d7-a5db-0a7b36bf3db2/cleanup/0.log" Jul 15 21:48:31.747049 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:31.746977 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-migrate-c871ea22-29735865-h5zdv_44cbe016-b428-41b4-a9de-37b8d00c0f11/cleanup/0.log" Jul 15 21:48:31.857674 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:31.857645 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-mt-f6e0ed38-29735865-kms9l_e58896f3-e27b-44c5-89a9-b583bf8a684a/cleanup/0.log" Jul 15 21:48:31.971398 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:31.971374 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-shared-a-543174-29735865-qmvq9_748cbeb2-773f-4bfc-a7be-0a4defd4b0e0/cleanup/0.log" Jul 15 21:48:32.082873 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:32.082828 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/odh-ai-gateway-infra_maas-api-key-cleanup-e2e-shared-b-915a1c-29735865-ltzpd_4e8e273a-a845-4273-92b9-ac4cad0adffc/cleanup/0.log" Jul 15 21:48:33.015332 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:33.015304 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5_9eed8dca-392b-4383-bb6c-0a7e52ced5d9/util/0.log" Jul 15 21:48:33.029119 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:33.029079 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5_9eed8dca-392b-4383-bb6c-0a7e52ced5d9/pull/0.log" Jul 15 21:48:33.036335 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:33.036318 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5_9eed8dca-392b-4383-bb6c-0a7e52ced5d9/extract/0.log" Jul 15 21:48:33.148964 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:33.148937 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv_9803b5bf-e2bc-4f1a-8623-2d5870a315d6/util/0.log" Jul 15 21:48:33.154747 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:33.154723 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv_9803b5bf-e2bc-4f1a-8623-2d5870a315d6/pull/0.log" Jul 15 21:48:33.160326 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:33.160306 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv_9803b5bf-e2bc-4f1a-8623-2d5870a315d6/extract/0.log" Jul 15 21:48:33.272204 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:33.272131 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv_121d8874-50cc-40f4-8153-3d81f3e7d4b3/util/0.log" Jul 15 21:48:33.277804 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:33.277780 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv_121d8874-50cc-40f4-8153-3d81f3e7d4b3/pull/0.log" Jul 15 21:48:33.283394 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:33.283373 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv_121d8874-50cc-40f4-8153-3d81f3e7d4b3/extract/0.log" Jul 15 21:48:33.394072 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:33.394044 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp_b9759e8f-d109-4c83-9f46-fb2468e41bda/util/0.log" Jul 15 21:48:33.400266 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:33.400246 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp_b9759e8f-d109-4c83-9f46-fb2468e41bda/pull/0.log" Jul 15 21:48:33.406252 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:33.406236 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp_b9759e8f-d109-4c83-9f46-fb2468e41bda/extract/0.log" Jul 15 21:48:34.122188 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:34.122157 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-q98fx_03e6e5c8-6866-4998-b09f-93f98d85ccac/manager/0.log" Jul 15 21:48:34.736985 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:34.736953 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678b8fcg_be899bae-85dd-4d5f-8a55-f77825718a5c/istio-proxy/0.log" Jul 15 21:48:34.861651 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:34.861620 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nzpr9_880fcd1a-4cbd-40a7-99a4-f7e4c8087267/discovery/0.log" Jul 15 21:48:34.979627 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:34.979597 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59fdd66594-jh2bp_3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a/kube-auth-proxy/0.log" Jul 15 21:48:35.230682 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:35.230646 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-wj6n5_3c2b87e7-98f6-4a15-a17a-64121e0fb113/istio-proxy/1.log" Jul 15 21:48:35.360212 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:35.360185 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-q6n6d_e611f0d4-45ac-48d3-8da2-8308a85d41eb/payload-pre-processing/0.log" Jul 15 21:48:36.066305 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:36.066276 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-distinct-simulated-kserve-59975d69f9-l7c27_1b2a7a88-441d-4313-a346-7456fb97f6a3/main/0.log" Jul 15 21:48:36.179771 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:36.179738 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-rzmhp_e7c51c31-6497-4a83-9611-567efbb3d73c/main/0.log" Jul 15 21:48:45.214766 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:45.214737 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-jl9zp_ca4dbd10-cf3e-4c7b-bb8d-529ce19bd8e7/global-pull-secret-syncer/0.log" Jul 15 21:48:45.362841 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:45.362812 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-mgqkb_f39096b7-3b12-4822-80cf-829be2c84725/konnectivity-agent/0.log" Jul 15 21:48:45.408828 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:45.408799 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-136-18.ec2.internal_19a84ea42e04a6bb6b6f4312809222d6/haproxy/0.log" Jul 15 21:48:50.093321 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:50.093295 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5_9eed8dca-392b-4383-bb6c-0a7e52ced5d9/extract/0.log" Jul 15 21:48:50.115648 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:50.115618 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5_9eed8dca-392b-4383-bb6c-0a7e52ced5d9/util/0.log" Jul 15 21:48:50.141676 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:50.141653 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_0acee64185f523d1d1272e9af2e4d9333e0dcde792ba30e1fa9605b759mz6g5_9eed8dca-392b-4383-bb6c-0a7e52ced5d9/pull/0.log" Jul 15 21:48:50.169158 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:50.169135 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv_9803b5bf-e2bc-4f1a-8623-2d5870a315d6/extract/0.log" Jul 15 21:48:50.192690 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:50.192664 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv_9803b5bf-e2bc-4f1a-8623-2d5870a315d6/util/0.log" Jul 15 21:48:50.213330 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:50.213304 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_19cb86e64775c5699d5aacf881a09c2d51e7f55f9e1ff096f2a667c5e0lw6dv_9803b5bf-e2bc-4f1a-8623-2d5870a315d6/pull/0.log" Jul 15 21:48:50.243036 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:50.243010 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv_121d8874-50cc-40f4-8153-3d81f3e7d4b3/extract/0.log" Jul 15 21:48:50.264090 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:50.264069 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv_121d8874-50cc-40f4-8153-3d81f3e7d4b3/util/0.log" Jul 15 21:48:50.286481 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:50.286458 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_5fc36eb1065777914bfe0ff85f9a202e2a3bafefb563d9e2994474ed73qhgxv_121d8874-50cc-40f4-8153-3d81f3e7d4b3/pull/0.log" Jul 15 21:48:50.323476 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:50.323420 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp_b9759e8f-d109-4c83-9f46-fb2468e41bda/extract/0.log" Jul 15 21:48:50.345024 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:50.344959 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp_b9759e8f-d109-4c83-9f46-fb2468e41bda/util/0.log" Jul 15 21:48:50.369859 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:50.369833 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_9438e18bbad664a016701a3153a6b421e2d977be7eb0117f80bcf45ef1f5gqp_b9759e8f-d109-4c83-9f46-fb2468e41bda/pull/0.log" Jul 15 21:48:51.015245 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:51.015212 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-q98fx_03e6e5c8-6866-4998-b09f-93f98d85ccac/manager/0.log" Jul 15 21:48:53.112935 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:53.112903 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-25lbn_840a38d8-3264-4a38-b316-67c8ebaa9df9/kube-state-metrics/0.log" Jul 15 21:48:53.137232 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:53.137203 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-25lbn_840a38d8-3264-4a38-b316-67c8ebaa9df9/kube-rbac-proxy-main/0.log" Jul 15 21:48:53.161440 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:53.161417 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-25lbn_840a38d8-3264-4a38-b316-67c8ebaa9df9/kube-rbac-proxy-self/0.log" Jul 15 21:48:53.221838 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:53.221805 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-9cwhw_1d514e08-d81e-4b21-a881-2ee86fd26c1b/monitoring-plugin/0.log" Jul 15 21:48:53.418981 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:53.418909 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jxm8g_1dd47478-4846-4283-8c64-ab485c965275/node-exporter/0.log" Jul 15 21:48:53.441132 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:53.441112 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jxm8g_1dd47478-4846-4283-8c64-ab485c965275/kube-rbac-proxy/0.log" Jul 15 21:48:53.461815 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:53.461796 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jxm8g_1dd47478-4846-4283-8c64-ab485c965275/init-textfile/0.log" Jul 15 21:48:53.490096 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:53.490070 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-qvhqq_b0ac5c7e-e558-438d-bc31-010cf59b10c2/kube-rbac-proxy-main/0.log" Jul 15 21:48:53.513491 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:53.513471 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-qvhqq_b0ac5c7e-e558-438d-bc31-010cf59b10c2/kube-rbac-proxy-self/0.log" Jul 15 21:48:53.543133 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:53.543109 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-qvhqq_b0ac5c7e-e558-438d-bc31-010cf59b10c2/openshift-state-metrics/0.log" Jul 15 21:48:53.824769 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:53.824745 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6db76c58c8-spbpv_5cde9d63-279d-4ba2-86c5-87e9bfa17124/telemeter-client/0.log" Jul 15 21:48:53.848483 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:53.848456 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6db76c58c8-spbpv_5cde9d63-279d-4ba2-86c5-87e9bfa17124/reload/0.log" Jul 15 21:48:53.869966 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:53.869947 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-6db76c58c8-spbpv_5cde9d63-279d-4ba2-86c5-87e9bfa17124/kube-rbac-proxy/0.log" Jul 15 21:48:53.904088 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:53.904067 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fb85486c7-4zwns_a0d7e1f8-1193-49ac-ba6b-e84970375854/thanos-query/0.log" Jul 15 21:48:53.925777 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:53.925753 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fb85486c7-4zwns_a0d7e1f8-1193-49ac-ba6b-e84970375854/kube-rbac-proxy-web/0.log" Jul 15 21:48:53.947732 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:53.947710 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fb85486c7-4zwns_a0d7e1f8-1193-49ac-ba6b-e84970375854/kube-rbac-proxy/0.log" Jul 15 21:48:53.970150 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:53.970131 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fb85486c7-4zwns_a0d7e1f8-1193-49ac-ba6b-e84970375854/prom-label-proxy/0.log" Jul 15 21:48:53.990252 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:53.990231 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fb85486c7-4zwns_a0d7e1f8-1193-49ac-ba6b-e84970375854/kube-rbac-proxy-rules/0.log" Jul 15 21:48:54.011229 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:54.011208 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_thanos-querier-6fb85486c7-4zwns_a0d7e1f8-1193-49ac-ba6b-e84970375854/kube-rbac-proxy-metrics/0.log" Jul 15 21:48:55.294283 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.294242 2572 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl"] Jul 15 21:48:55.294955 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.294890 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="42bfd3fa-631a-46ea-aa82-cf59ca78c39a" containerName="cleanup" Jul 15 21:48:55.294955 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.294909 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="42bfd3fa-631a-46ea-aa82-cf59ca78c39a" containerName="cleanup" Jul 15 21:48:55.294955 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.294926 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="f7d60d15-e673-48fb-bbdf-b0d21baad063" containerName="cleanup" Jul 15 21:48:55.294955 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.294936 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="f7d60d15-e673-48fb-bbdf-b0d21baad063" containerName="cleanup" Jul 15 21:48:55.294955 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.294946 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="748cbeb2-773f-4bfc-a7be-0a4defd4b0e0" containerName="cleanup" Jul 15 21:48:55.294955 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.294951 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="748cbeb2-773f-4bfc-a7be-0a4defd4b0e0" containerName="cleanup" Jul 15 21:48:55.294955 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.294959 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="22b6c04a-44e4-4858-be1e-ee2f4952e0f3" containerName="istio-proxy" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.294967 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="22b6c04a-44e4-4858-be1e-ee2f4952e0f3" containerName="istio-proxy" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.294978 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="e58896f3-e27b-44c5-89a9-b583bf8a684a" containerName="cleanup" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.294984 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="e58896f3-e27b-44c5-89a9-b583bf8a684a" containerName="cleanup" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295000 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="44cbe016-b428-41b4-a9de-37b8d00c0f11" containerName="cleanup" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295006 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="44cbe016-b428-41b4-a9de-37b8d00c0f11" containerName="cleanup" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295020 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="4e8e273a-a845-4273-92b9-ac4cad0adffc" containerName="cleanup" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295025 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="4e8e273a-a845-4273-92b9-ac4cad0adffc" containerName="cleanup" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295032 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e27a620-9d0d-47c0-9f26-acdad4fa82e7" containerName="istio-proxy" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295037 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e27a620-9d0d-47c0-9f26-acdad4fa82e7" containerName="istio-proxy" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295044 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1e59484a-2cab-4c4a-9970-573d3fa4f53f" containerName="cleanup" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295051 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="1e59484a-2cab-4c4a-9970-573d3fa4f53f" containerName="cleanup" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295061 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="5e27a620-9d0d-47c0-9f26-acdad4fa82e7" containerName="istio-proxy" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295067 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="5e27a620-9d0d-47c0-9f26-acdad4fa82e7" containerName="istio-proxy" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295073 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="6d33c4b7-c87e-49d7-a5db-0a7b36bf3db2" containerName="cleanup" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295079 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="6d33c4b7-c87e-49d7-a5db-0a7b36bf3db2" containerName="cleanup" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295087 2572 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="aa2c532d-a4ed-480a-8581-564fd36ee2d8" containerName="cleanup" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295092 2572 state_mem.go:107] "Deleted CPUSet assignment" podUID="aa2c532d-a4ed-480a-8581-564fd36ee2d8" containerName="cleanup" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295156 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="748cbeb2-773f-4bfc-a7be-0a4defd4b0e0" containerName="cleanup" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295165 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="f7d60d15-e673-48fb-bbdf-b0d21baad063" containerName="cleanup" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295173 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="5e27a620-9d0d-47c0-9f26-acdad4fa82e7" containerName="istio-proxy" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295178 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="42bfd3fa-631a-46ea-aa82-cf59ca78c39a" containerName="cleanup" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295184 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="4e8e273a-a845-4273-92b9-ac4cad0adffc" containerName="cleanup" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295191 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="22b6c04a-44e4-4858-be1e-ee2f4952e0f3" containerName="istio-proxy" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295195 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="44cbe016-b428-41b4-a9de-37b8d00c0f11" containerName="cleanup" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295202 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="1e59484a-2cab-4c4a-9970-573d3fa4f53f" containerName="cleanup" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295210 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="aa2c532d-a4ed-480a-8581-564fd36ee2d8" containerName="cleanup" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295217 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="e58896f3-e27b-44c5-89a9-b583bf8a684a" containerName="cleanup" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295224 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="6d33c4b7-c87e-49d7-a5db-0a7b36bf3db2" containerName="cleanup" Jul 15 21:48:55.295244 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.295228 2572 memory_manager.go:368] "RemoveStaleState removing state" podUID="22b6c04a-44e4-4858-be1e-ee2f4952e0f3" containerName="istio-proxy" Jul 15 21:48:55.298485 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.298469 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl" Jul 15 21:48:55.300800 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.300780 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v2496\"/\"openshift-service-ca.crt\"" Jul 15 21:48:55.300913 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.300805 2572 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-v2496\"/\"default-dockercfg-czhdx\"" Jul 15 21:48:55.301381 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.301368 2572 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-v2496\"/\"kube-root-ca.crt\"" Jul 15 21:48:55.308748 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.308730 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl"] Jul 15 21:48:55.439790 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.439757 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/029faef8-4078-4c60-9cca-707fbc414983-sys\") pod \"perf-node-gather-daemonset-d29zl\" (UID: \"029faef8-4078-4c60-9cca-707fbc414983\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl" Jul 15 21:48:55.439969 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.439797 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wmpb5\" (UniqueName: \"kubernetes.io/projected/029faef8-4078-4c60-9cca-707fbc414983-kube-api-access-wmpb5\") pod \"perf-node-gather-daemonset-d29zl\" (UID: \"029faef8-4078-4c60-9cca-707fbc414983\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl" Jul 15 21:48:55.439969 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.439836 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/029faef8-4078-4c60-9cca-707fbc414983-lib-modules\") pod \"perf-node-gather-daemonset-d29zl\" (UID: \"029faef8-4078-4c60-9cca-707fbc414983\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl" Jul 15 21:48:55.439969 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.439911 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/029faef8-4078-4c60-9cca-707fbc414983-podres\") pod \"perf-node-gather-daemonset-d29zl\" (UID: \"029faef8-4078-4c60-9cca-707fbc414983\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl" Jul 15 21:48:55.439969 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.439962 2572 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/029faef8-4078-4c60-9cca-707fbc414983-proc\") pod \"perf-node-gather-daemonset-d29zl\" (UID: \"029faef8-4078-4c60-9cca-707fbc414983\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl" Jul 15 21:48:55.540773 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.540735 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/029faef8-4078-4c60-9cca-707fbc414983-proc\") pod \"perf-node-gather-daemonset-d29zl\" (UID: \"029faef8-4078-4c60-9cca-707fbc414983\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl" Jul 15 21:48:55.540942 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.540806 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/029faef8-4078-4c60-9cca-707fbc414983-sys\") pod \"perf-node-gather-daemonset-d29zl\" (UID: \"029faef8-4078-4c60-9cca-707fbc414983\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl" Jul 15 21:48:55.540942 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.540842 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wmpb5\" (UniqueName: \"kubernetes.io/projected/029faef8-4078-4c60-9cca-707fbc414983-kube-api-access-wmpb5\") pod \"perf-node-gather-daemonset-d29zl\" (UID: \"029faef8-4078-4c60-9cca-707fbc414983\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl" Jul 15 21:48:55.540942 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.540865 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/029faef8-4078-4c60-9cca-707fbc414983-proc\") pod \"perf-node-gather-daemonset-d29zl\" (UID: \"029faef8-4078-4c60-9cca-707fbc414983\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl" Jul 15 21:48:55.540942 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.540921 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/029faef8-4078-4c60-9cca-707fbc414983-sys\") pod \"perf-node-gather-daemonset-d29zl\" (UID: \"029faef8-4078-4c60-9cca-707fbc414983\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl" Jul 15 21:48:55.541187 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.540961 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/029faef8-4078-4c60-9cca-707fbc414983-lib-modules\") pod \"perf-node-gather-daemonset-d29zl\" (UID: \"029faef8-4078-4c60-9cca-707fbc414983\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl" Jul 15 21:48:55.541187 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.541013 2572 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/029faef8-4078-4c60-9cca-707fbc414983-podres\") pod \"perf-node-gather-daemonset-d29zl\" (UID: \"029faef8-4078-4c60-9cca-707fbc414983\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl" Jul 15 21:48:55.541187 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.541111 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/029faef8-4078-4c60-9cca-707fbc414983-lib-modules\") pod \"perf-node-gather-daemonset-d29zl\" (UID: \"029faef8-4078-4c60-9cca-707fbc414983\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl" Jul 15 21:48:55.541187 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.541126 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/029faef8-4078-4c60-9cca-707fbc414983-podres\") pod \"perf-node-gather-daemonset-d29zl\" (UID: \"029faef8-4078-4c60-9cca-707fbc414983\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl" Jul 15 21:48:55.548714 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.548655 2572 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wmpb5\" (UniqueName: \"kubernetes.io/projected/029faef8-4078-4c60-9cca-707fbc414983-kube-api-access-wmpb5\") pod \"perf-node-gather-daemonset-d29zl\" (UID: \"029faef8-4078-4c60-9cca-707fbc414983\") " pod="openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl" Jul 15 21:48:55.609732 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.609705 2572 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl" Jul 15 21:48:55.743814 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.743786 2572 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl"] Jul 15 21:48:55.745311 ip-10-0-136-18 kubenswrapper[2572]: W0715 21:48:55.745285 2572 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pod029faef8_4078_4c60_9cca_707fbc414983.slice/crio-12a89260eccbcb89461cb940d814e6c184d997851b2ba3515590d29d37d7c605 WatchSource:0}: Error finding container 12a89260eccbcb89461cb940d814e6c184d997851b2ba3515590d29d37d7c605: Status 404 returned error can't find the container with id 12a89260eccbcb89461cb940d814e6c184d997851b2ba3515590d29d37d7c605 Jul 15 21:48:55.902860 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.902825 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl" event={"ID":"029faef8-4078-4c60-9cca-707fbc414983","Type":"ContainerStarted","Data":"3807dc503d307612255ad7eec1af1262000b0cc3bc181f085682db70e4315e7e"} Jul 15 21:48:55.902993 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.902887 2572 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl" event={"ID":"029faef8-4078-4c60-9cca-707fbc414983","Type":"ContainerStarted","Data":"12a89260eccbcb89461cb940d814e6c184d997851b2ba3515590d29d37d7c605"} Jul 15 21:48:55.902993 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.902955 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl" Jul 15 21:48:55.920571 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:55.920510 2572 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl" podStartSLOduration=0.920495931 podStartE2EDuration="920.495931ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-15 21:48:55 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-15 21:48:55.917922971 +0000 UTC m=+2328.739240288" watchObservedRunningTime="2026-07-15 21:48:55.920495931 +0000 UTC m=+2328.741813247" Jul 15 21:48:56.326800 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:56.326774 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-console_console-6bf989c8d4-p4vwj_b017cca6-c43c-445f-b664-c1d1cfccdbc9/console/0.log" Jul 15 21:48:57.961484 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:57.961459 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-glplz_b5e3cdfd-977c-4695-bf7e-6128e5573e3a/dns/0.log" Jul 15 21:48:57.983322 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:57.983302 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-glplz_b5e3cdfd-977c-4695-bf7e-6128e5573e3a/kube-rbac-proxy/0.log" Jul 15 21:48:58.054512 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:58.054487 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-mlpzt_a7c003a0-a90e-4f42-bde8-8106b42cbdb6/dns-node-resolver/0.log" Jul 15 21:48:58.617540 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:58.617502 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_image-registry-5b87466585-qgbj7_fea15078-baa8-47be-af80-abf668aed353/registry/0.log" Jul 15 21:48:58.644052 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:58.644022 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-n2lsq_ffad0e67-b489-4cb5-9e92-f36f166c613a/node-ca/0.log" Jul 15 21:48:59.627410 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:59.627336 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678b8fcg_be899bae-85dd-4d5f-8a55-f77825718a5c/istio-proxy/0.log" Jul 15 21:48:59.722891 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:59.722864 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nzpr9_880fcd1a-4cbd-40a7-99a4-f7e4c8087267/discovery/0.log" Jul 15 21:48:59.744174 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:59.744144 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59fdd66594-jh2bp_3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a/kube-auth-proxy/0.log" Jul 15 21:48:59.802498 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:59.802463 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-wj6n5_3c2b87e7-98f6-4a15-a17a-64121e0fb113/istio-proxy/0.log" Jul 15 21:48:59.831417 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:59.831391 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-wj6n5_3c2b87e7-98f6-4a15-a17a-64121e0fb113/istio-proxy/1.log" Jul 15 21:48:59.859792 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:48:59.859764 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-q6n6d_e611f0d4-45ac-48d3-8da2-8308a85d41eb/payload-pre-processing/0.log" Jul 15 21:49:00.608261 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:00.608229 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-n9tjd_07cfd1eb-d93a-4d92-937e-e83af131d9ad/serve-healthcheck-canary/0.log" Jul 15 21:49:01.109702 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:01.109673 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kj99n_fb6a141f-5ad2-4482-ac78-d164572f90f7/kube-rbac-proxy/0.log" Jul 15 21:49:01.130046 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:01.130025 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kj99n_fb6a141f-5ad2-4482-ac78-d164572f90f7/exporter/0.log" Jul 15 21:49:01.150243 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:01.150223 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-kj99n_fb6a141f-5ad2-4482-ac78-d164572f90f7/extractor/0.log" Jul 15 21:49:01.918248 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:01.918224 2572 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-v2496/perf-node-gather-daemonset-d29zl" Jul 15 21:49:03.358904 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:03.358872 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-pkczm_5f45a272-726a-4d39-b171-3018a23be928/manager/0.log" Jul 15 21:49:03.480973 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:03.480938 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_llmisvc-controller-manager-777c6bd7d5-jk4lg_e4e4cc0f-3383-4920-9017-8683bf6f613c/manager/0.log" Jul 15 21:49:03.591052 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:03.591029 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_model-serving-api-54d89bd5fc-5jn5d_bd039300-5520-4b70-8b67-5de95af6bbc5/server/0.log" Jul 15 21:49:03.657420 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:03.657346 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_odh-model-controller-7998c67dc4-hbvv6_618e6159-0a9a-4d5a-8be8-c574e81d3c0e/manager/0.log" Jul 15 21:49:03.817847 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:03.817817 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f656749fc-mtlhd_b481448b-04bd-48ec-ab41-2cff39511bb9/manager/0.log" Jul 15 21:49:03.868518 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:03.868492 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-5f656749fc-mtlhd_b481448b-04bd-48ec-ab41-2cff39511bb9/copy-manifests/0.log" Jul 15 21:49:05.409434 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:05.409359 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-wvq9b_7b12d9ba-5227-4bd8-80e0-e62c732f3156/openshift-lws-operator/0.log" Jul 15 21:49:05.786575 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:05.786468 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678b8fcg_be899bae-85dd-4d5f-8a55-f77825718a5c/istio-proxy/0.log" Jul 15 21:49:05.874846 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:05.874814 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nzpr9_880fcd1a-4cbd-40a7-99a4-f7e4c8087267/discovery/0.log" Jul 15 21:49:05.884417 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:05.884395 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59fdd66594-jh2bp_3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a/kube-auth-proxy/0.log" Jul 15 21:49:05.921989 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:05.921963 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-wj6n5_3c2b87e7-98f6-4a15-a17a-64121e0fb113/istio-proxy/0.log" Jul 15 21:49:05.949904 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:05.949874 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-wj6n5_3c2b87e7-98f6-4a15-a17a-64121e0fb113/istio-proxy/1.log" Jul 15 21:49:05.970494 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:05.970471 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-q6n6d_e611f0d4-45ac-48d3-8da2-8308a85d41eb/payload-pre-processing/0.log" Jul 15 21:49:07.126974 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:07.126944 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-7f964fb678b8fcg_be899bae-85dd-4d5f-8a55-f77825718a5c/istio-proxy/0.log" Jul 15 21:49:07.217748 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:07.217719 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-nzpr9_880fcd1a-4cbd-40a7-99a4-f7e4c8087267/discovery/0.log" Jul 15 21:49:07.230823 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:07.230798 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-59fdd66594-jh2bp_3c3a6a4a-f0b6-4f5c-befe-6a3ecb6e4d3a/kube-auth-proxy/0.log" Jul 15 21:49:07.270859 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:07.270780 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-wj6n5_3c2b87e7-98f6-4a15-a17a-64121e0fb113/istio-proxy/0.log" Jul 15 21:49:07.298621 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:07.298592 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-5896d4dd49-wj6n5_3c2b87e7-98f6-4a15-a17a-64121e0fb113/istio-proxy/1.log" Jul 15 21:49:07.321441 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:07.321415 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_payload-pre-processing-74584bb9f8-q6n6d_e611f0d4-45ac-48d3-8da2-8308a85d41eb/payload-pre-processing/0.log" Jul 15 21:49:11.843465 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:11.843436 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w7wc8_3b20afb1-f155-4609-b0d1-bd613650e660/kube-multus-additional-cni-plugins/0.log" Jul 15 21:49:11.865393 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:11.865368 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w7wc8_3b20afb1-f155-4609-b0d1-bd613650e660/egress-router-binary-copy/0.log" Jul 15 21:49:11.885949 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:11.885930 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w7wc8_3b20afb1-f155-4609-b0d1-bd613650e660/cni-plugins/0.log" Jul 15 21:49:11.906245 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:11.906224 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w7wc8_3b20afb1-f155-4609-b0d1-bd613650e660/bond-cni-plugin/0.log" Jul 15 21:49:11.926640 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:11.926609 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w7wc8_3b20afb1-f155-4609-b0d1-bd613650e660/routeoverride-cni/0.log" Jul 15 21:49:11.947831 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:11.947810 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w7wc8_3b20afb1-f155-4609-b0d1-bd613650e660/whereabouts-cni-bincopy/0.log" Jul 15 21:49:11.967975 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:11.967958 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-w7wc8_3b20afb1-f155-4609-b0d1-bd613650e660/whereabouts-cni/0.log" Jul 15 21:49:12.060588 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:12.060561 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-xjxpc_577cd1c7-c14a-49b2-9b2a-a127f263029f/kube-multus/0.log" Jul 15 21:49:12.167330 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:12.167256 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mct98_5c81bb07-fdbf-43fc-9554-e3d0ed0312e9/network-metrics-daemon/0.log" Jul 15 21:49:12.191385 ip-10-0-136-18 kubenswrapper[2572]: I0715 21:49:12.191361 2572 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-mct98_5c81bb07-fdbf-43fc-9554-e3d0ed0312e9/kube-rbac-proxy/0.log"