Jul 09 17:28:05.767667 ip-10-0-138-5 systemd[1]: Starting Kubernetes Kubelet... Jul 09 17:28:06.274179 ip-10-0-138-5 kubenswrapper[2565]: Flag --container-runtime-endpoint has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 17:28:06.274179 ip-10-0-138-5 kubenswrapper[2565]: Flag --minimum-container-ttl-duration has been deprecated, Use --eviction-hard or --eviction-soft instead. Will be removed in a future version. Jul 09 17:28:06.274179 ip-10-0-138-5 kubenswrapper[2565]: Flag --volume-plugin-dir has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 17:28:06.274179 ip-10-0-138-5 kubenswrapper[2565]: Flag --pod-infra-container-image has been deprecated, will be removed in 1.35. Image garbage collector will get sandbox image information from CRI. Jul 09 17:28:06.274179 ip-10-0-138-5 kubenswrapper[2565]: Flag --system-reserved has been deprecated, This parameter should be set via the config file specified by the Kubelet's --config flag. See https://kubernetes.io/docs/tasks/administer-cluster/kubelet-config-file/ for more information. Jul 09 17:28:06.274179 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.221252 2565 server.go:213] "--pod-infra-container-image will not be pruned by the image garbage collector in kubelet and should also be set in the remote runtime" Jul 09 17:28:06.274179 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226573 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 17:28:06.274179 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226585 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 17:28:06.274179 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226588 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 17:28:06.274179 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226591 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 17:28:06.274179 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226595 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 17:28:06.274179 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226598 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 17:28:06.274179 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226601 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 17:28:06.274179 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226604 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 17:28:06.275003 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226607 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 17:28:06.275003 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226609 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 17:28:06.275003 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226612 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 17:28:06.275003 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226617 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 17:28:06.275003 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226620 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 17:28:06.275003 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226625 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 17:28:06.275003 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226629 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 17:28:06.275003 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226633 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 17:28:06.275003 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226636 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 17:28:06.275003 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226639 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 17:28:06.275003 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226642 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 17:28:06.275003 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226645 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 17:28:06.275003 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226648 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 17:28:06.275003 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226650 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 17:28:06.275003 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226653 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 17:28:06.275003 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226655 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 17:28:06.275003 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226658 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 17:28:06.275003 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226661 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 17:28:06.275003 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226664 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 17:28:06.275003 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226667 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 17:28:06.275582 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226670 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 17:28:06.275582 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226672 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 17:28:06.275582 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226675 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 17:28:06.275582 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226678 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 17:28:06.275582 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226680 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 17:28:06.275582 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226683 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 17:28:06.275582 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226685 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 17:28:06.275582 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226688 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 17:28:06.275582 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226690 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 17:28:06.275582 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226693 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 17:28:06.275582 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226696 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 17:28:06.275582 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226699 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 17:28:06.275582 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226702 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 17:28:06.275582 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226704 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 17:28:06.275582 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226707 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 17:28:06.275582 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226710 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 17:28:06.275582 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226715 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 17:28:06.275582 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226717 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 17:28:06.275582 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226720 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 17:28:06.276096 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226724 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 17:28:06.276096 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226727 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 17:28:06.276096 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226731 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 17:28:06.276096 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226733 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 17:28:06.276096 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226736 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 17:28:06.276096 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226739 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 17:28:06.276096 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226742 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 17:28:06.276096 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226744 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 17:28:06.276096 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226747 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 17:28:06.276096 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226750 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 17:28:06.276096 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226752 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 17:28:06.276096 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226755 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 17:28:06.276096 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226757 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 17:28:06.276096 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226760 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 17:28:06.276096 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226762 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 17:28:06.276096 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226765 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 17:28:06.276096 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226768 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 17:28:06.276096 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226770 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 17:28:06.276096 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226773 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 17:28:06.276096 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226775 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 17:28:06.276675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226777 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 17:28:06.276675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226782 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 17:28:06.276675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226785 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 17:28:06.276675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226788 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 17:28:06.276675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226792 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 17:28:06.276675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226795 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 17:28:06.276675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226797 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 17:28:06.276675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226800 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 17:28:06.276675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226803 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 17:28:06.276675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226806 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 17:28:06.276675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226809 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 17:28:06.276675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226811 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 17:28:06.276675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226815 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 17:28:06.276675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226817 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 17:28:06.276675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226820 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 17:28:06.276675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226822 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 17:28:06.276675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226825 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 17:28:06.276675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226828 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 17:28:06.276675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226830 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 17:28:06.276675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226832 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 17:28:06.277318 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226835 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 17:28:06.277318 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226838 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 17:28:06.277318 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226840 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 17:28:06.277318 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226842 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 17:28:06.277318 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226845 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 17:28:06.277318 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226848 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 17:28:06.277318 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226850 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 17:28:06.277318 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226853 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 17:28:06.277318 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226855 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 17:28:06.277318 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226858 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 17:28:06.277318 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226860 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 17:28:06.277318 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.226863 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 17:28:06.277318 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227569 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 17:28:06.277318 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227575 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 17:28:06.277318 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227578 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 17:28:06.277318 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227581 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 17:28:06.277318 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227584 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 17:28:06.277318 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227588 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 17:28:06.277318 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227591 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 17:28:06.277871 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227594 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 17:28:06.277871 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227597 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 17:28:06.277871 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227599 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 17:28:06.277871 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227602 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 17:28:06.277871 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227605 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 17:28:06.277871 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227607 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 17:28:06.277871 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227610 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 17:28:06.277871 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227612 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 17:28:06.277871 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227615 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 17:28:06.277871 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227619 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 17:28:06.277871 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227623 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 17:28:06.277871 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227626 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 17:28:06.277871 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227629 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 17:28:06.277871 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227632 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 17:28:06.277871 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227635 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 17:28:06.277871 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227638 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 17:28:06.277871 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227641 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 17:28:06.277871 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227643 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 17:28:06.277871 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227646 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 17:28:06.277871 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227649 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 17:28:06.278457 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227652 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 17:28:06.278457 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227654 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 17:28:06.278457 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227657 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 17:28:06.278457 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227660 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 17:28:06.278457 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227663 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 17:28:06.278457 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227666 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 17:28:06.278457 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227669 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 17:28:06.278457 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227672 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 17:28:06.278457 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227675 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 17:28:06.278457 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227677 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 17:28:06.278457 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227679 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 17:28:06.278457 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227683 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 17:28:06.278457 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227685 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 17:28:06.278457 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227688 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 17:28:06.278457 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227690 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 17:28:06.278457 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227693 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 17:28:06.278457 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227695 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 17:28:06.278457 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227698 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 17:28:06.278457 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227700 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 17:28:06.278457 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227703 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 17:28:06.278457 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227705 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 17:28:06.279036 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227708 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 17:28:06.279036 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227711 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 17:28:06.279036 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227714 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 17:28:06.279036 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227718 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 17:28:06.279036 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227722 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 17:28:06.279036 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227724 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 17:28:06.279036 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227727 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 17:28:06.279036 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227730 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 17:28:06.279036 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227733 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 17:28:06.279036 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227736 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 17:28:06.279036 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227739 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 17:28:06.279036 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227741 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 17:28:06.279036 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227744 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 17:28:06.279036 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227746 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 17:28:06.279036 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227749 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 17:28:06.279036 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227751 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 17:28:06.279036 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227754 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 17:28:06.279036 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227756 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 17:28:06.279036 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227759 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 17:28:06.279552 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227761 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 17:28:06.279552 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227764 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 17:28:06.279552 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227766 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 17:28:06.279552 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227769 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 17:28:06.279552 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227772 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 17:28:06.279552 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227775 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 17:28:06.279552 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227778 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 17:28:06.279552 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227780 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 17:28:06.279552 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227784 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 17:28:06.279552 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227786 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 17:28:06.279552 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227789 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 17:28:06.279552 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227793 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 17:28:06.279552 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227796 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 17:28:06.279552 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227799 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 17:28:06.279552 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227802 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 17:28:06.279552 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227805 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 17:28:06.279552 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227808 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 17:28:06.279552 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227811 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 17:28:06.279552 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227814 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 17:28:06.280059 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227816 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 17:28:06.280059 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227819 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 17:28:06.280059 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227822 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 17:28:06.280059 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227824 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 17:28:06.280059 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227827 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 17:28:06.280059 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227829 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 17:28:06.280059 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227832 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 17:28:06.280059 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227834 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 17:28:06.280059 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227837 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 17:28:06.280059 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227839 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 17:28:06.280059 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227841 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 17:28:06.280059 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227844 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 17:28:06.280059 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.227847 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 17:28:06.280059 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228215 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 17:28:06.280059 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228220 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 17:28:06.280059 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228223 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 17:28:06.280059 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228226 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 17:28:06.280059 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228233 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 17:28:06.280059 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228236 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 17:28:06.280568 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228241 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 17:28:06.280568 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228249 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 17:28:06.280568 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228252 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 17:28:06.280568 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228255 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 17:28:06.280568 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228258 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 17:28:06.280568 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228260 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 17:28:06.280568 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228263 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 17:28:06.280568 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228265 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 17:28:06.280568 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228268 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 17:28:06.280568 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228271 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 17:28:06.280568 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228274 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 17:28:06.280568 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228276 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 17:28:06.280568 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228279 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 17:28:06.280568 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228282 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 17:28:06.280568 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228284 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 17:28:06.280568 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228287 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 17:28:06.280568 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228289 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 17:28:06.280568 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228293 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 17:28:06.280568 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228297 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 17:28:06.281127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228301 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 17:28:06.281127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228304 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 17:28:06.281127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228307 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 17:28:06.281127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228310 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 17:28:06.281127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228313 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 17:28:06.281127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228316 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 17:28:06.281127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228318 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 17:28:06.281127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228322 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 17:28:06.281127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228324 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 17:28:06.281127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228327 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 17:28:06.281127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228332 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 17:28:06.281127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228334 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 17:28:06.281127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228351 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 17:28:06.281127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228354 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 17:28:06.281127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228358 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 17:28:06.281127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228361 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 17:28:06.281127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228364 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 17:28:06.281127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228366 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 17:28:06.281127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228369 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 17:28:06.281127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228372 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 17:28:06.281675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228375 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 17:28:06.281675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228377 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 17:28:06.281675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228380 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 17:28:06.281675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228382 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 17:28:06.281675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228385 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 17:28:06.281675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228388 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 17:28:06.281675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228390 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 17:28:06.281675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228393 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 17:28:06.281675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228396 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 17:28:06.281675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228398 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 17:28:06.281675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228401 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 17:28:06.281675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228403 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 17:28:06.281675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228406 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 17:28:06.281675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228409 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 17:28:06.281675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228411 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 17:28:06.281675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228413 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 17:28:06.281675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228416 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 17:28:06.281675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228419 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 17:28:06.281675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228422 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 17:28:06.281675 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228425 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 17:28:06.282220 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228427 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 17:28:06.282220 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228430 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 17:28:06.282220 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228434 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 17:28:06.282220 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228436 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 17:28:06.282220 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228439 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 17:28:06.282220 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228442 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 17:28:06.282220 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228445 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 17:28:06.282220 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228448 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 17:28:06.282220 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228450 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 17:28:06.282220 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228453 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 17:28:06.282220 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228456 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 17:28:06.282220 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228458 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 17:28:06.282220 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228461 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 17:28:06.282220 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228463 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 17:28:06.282220 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228466 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 17:28:06.282220 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228468 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 17:28:06.282220 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228471 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 17:28:06.282220 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228473 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 17:28:06.282220 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228476 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 17:28:06.282220 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228478 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 17:28:07.543343 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228481 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 17:28:07.543343 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228483 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 17:28:07.543343 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228486 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 17:28:07.543343 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228489 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 17:28:07.543343 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228491 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 17:28:07.543343 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228493 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 17:28:07.543343 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228496 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 17:28:07.543343 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228498 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 17:28:07.543343 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228501 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 17:28:07.543343 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228503 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 17:28:07.543343 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228506 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 17:28:07.543343 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228508 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 17:28:07.543343 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228511 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 17:28:07.543343 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.228513 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 17:28:07.543343 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228584 2565 flags.go:64] FLAG: --address="0.0.0.0" Jul 09 17:28:07.543343 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228590 2565 flags.go:64] FLAG: --allowed-unsafe-sysctls="[]" Jul 09 17:28:07.543343 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228597 2565 flags.go:64] FLAG: --anonymous-auth="true" Jul 09 17:28:07.543343 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228602 2565 flags.go:64] FLAG: --application-metrics-count-limit="100" Jul 09 17:28:07.543343 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228608 2565 flags.go:64] FLAG: --authentication-token-webhook="false" Jul 09 17:28:07.543343 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228611 2565 flags.go:64] FLAG: --authentication-token-webhook-cache-ttl="2m0s" Jul 09 17:28:07.543343 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228615 2565 flags.go:64] FLAG: --authorization-mode="AlwaysAllow" Jul 09 17:28:06.304701 ip-10-0-138-5 systemd[1]: Started Kubernetes Kubelet. Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228620 2565 flags.go:64] FLAG: --authorization-webhook-cache-authorized-ttl="5m0s" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228623 2565 flags.go:64] FLAG: --authorization-webhook-cache-unauthorized-ttl="30s" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228626 2565 flags.go:64] FLAG: --boot-id-file="/proc/sys/kernel/random/boot_id" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228630 2565 flags.go:64] FLAG: --bootstrap-kubeconfig="/etc/kubernetes/kubeconfig" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228633 2565 flags.go:64] FLAG: --cert-dir="/var/lib/kubelet/pki" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228636 2565 flags.go:64] FLAG: --cgroup-driver="cgroupfs" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228652 2565 flags.go:64] FLAG: --cgroup-root="" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228656 2565 flags.go:64] FLAG: --cgroups-per-qos="true" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228660 2565 flags.go:64] FLAG: --client-ca-file="" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228663 2565 flags.go:64] FLAG: --cloud-provider="external" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228666 2565 flags.go:64] FLAG: --cluster-dns="[]" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228671 2565 flags.go:64] FLAG: --cluster-domain="" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228673 2565 flags.go:64] FLAG: --config="/etc/kubernetes/kubelet.conf" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228676 2565 flags.go:64] FLAG: --config-dir="/etc/openshift/kubelet.conf.d" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228680 2565 flags.go:64] FLAG: --container-hints="/etc/cadvisor/container_hints.json" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228683 2565 flags.go:64] FLAG: --container-log-max-files="5" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228687 2565 flags.go:64] FLAG: --container-log-max-size="10Mi" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228690 2565 flags.go:64] FLAG: --container-runtime-endpoint="/var/run/crio/crio.sock" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228693 2565 flags.go:64] FLAG: --containerd="/run/containerd/containerd.sock" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228696 2565 flags.go:64] FLAG: --containerd-namespace="k8s.io" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228699 2565 flags.go:64] FLAG: --contention-profiling="false" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228702 2565 flags.go:64] FLAG: --cpu-cfs-quota="true" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228704 2565 flags.go:64] FLAG: --cpu-cfs-quota-period="100ms" Jul 09 17:28:07.568483 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228708 2565 flags.go:64] FLAG: --cpu-manager-policy="none" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228711 2565 flags.go:64] FLAG: --cpu-manager-policy-options="" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228716 2565 flags.go:64] FLAG: --cpu-manager-reconcile-period="10s" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228719 2565 flags.go:64] FLAG: --enable-controller-attach-detach="true" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228722 2565 flags.go:64] FLAG: --enable-debugging-handlers="true" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228725 2565 flags.go:64] FLAG: --enable-load-reader="false" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228729 2565 flags.go:64] FLAG: --enable-server="true" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.228732 2565 flags.go:64] FLAG: --enforce-node-allocatable="[pods]" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229376 2565 flags.go:64] FLAG: --event-burst="100" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229380 2565 flags.go:64] FLAG: --event-qps="50" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229384 2565 flags.go:64] FLAG: --event-storage-age-limit="default=0" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229387 2565 flags.go:64] FLAG: --event-storage-event-limit="default=0" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229390 2565 flags.go:64] FLAG: --eviction-hard="" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229395 2565 flags.go:64] FLAG: --eviction-max-pod-grace-period="0" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229397 2565 flags.go:64] FLAG: --eviction-minimum-reclaim="" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229400 2565 flags.go:64] FLAG: --eviction-pressure-transition-period="5m0s" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229403 2565 flags.go:64] FLAG: --eviction-soft="" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229406 2565 flags.go:64] FLAG: --eviction-soft-grace-period="" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229409 2565 flags.go:64] FLAG: --exit-on-lock-contention="false" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229412 2565 flags.go:64] FLAG: --experimental-allocatable-ignore-eviction="false" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229415 2565 flags.go:64] FLAG: --experimental-mounter-path="" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229418 2565 flags.go:64] FLAG: --fail-cgroupv1="false" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229421 2565 flags.go:64] FLAG: --fail-swap-on="true" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229424 2565 flags.go:64] FLAG: --feature-gates="" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229428 2565 flags.go:64] FLAG: --file-check-frequency="20s" Jul 09 17:28:07.570355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229431 2565 flags.go:64] FLAG: --global-housekeeping-interval="1m0s" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229433 2565 flags.go:64] FLAG: --hairpin-mode="promiscuous-bridge" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229436 2565 flags.go:64] FLAG: --healthz-bind-address="127.0.0.1" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229439 2565 flags.go:64] FLAG: --healthz-port="10248" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229442 2565 flags.go:64] FLAG: --help="false" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229445 2565 flags.go:64] FLAG: --hostname-override="ip-10-0-138-5.ec2.internal" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229448 2565 flags.go:64] FLAG: --housekeeping-interval="10s" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229451 2565 flags.go:64] FLAG: --http-check-frequency="20s" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229454 2565 flags.go:64] FLAG: --image-credential-provider-bin-dir="/usr/libexec/kubelet-image-credential-provider-plugins" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229458 2565 flags.go:64] FLAG: --image-credential-provider-config="/etc/kubernetes/credential-providers/ecr-credential-provider.yaml" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229462 2565 flags.go:64] FLAG: --image-gc-high-threshold="85" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229465 2565 flags.go:64] FLAG: --image-gc-low-threshold="80" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229467 2565 flags.go:64] FLAG: --image-service-endpoint="" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229472 2565 flags.go:64] FLAG: --kernel-memcg-notification="false" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229474 2565 flags.go:64] FLAG: --kube-api-burst="100" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229478 2565 flags.go:64] FLAG: --kube-api-content-type="application/vnd.kubernetes.protobuf" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229481 2565 flags.go:64] FLAG: --kube-api-qps="50" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229484 2565 flags.go:64] FLAG: --kube-reserved="" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229487 2565 flags.go:64] FLAG: --kube-reserved-cgroup="" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229490 2565 flags.go:64] FLAG: --kubeconfig="/var/lib/kubelet/kubeconfig" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229493 2565 flags.go:64] FLAG: --kubelet-cgroups="" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229495 2565 flags.go:64] FLAG: --local-storage-capacity-isolation="true" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229498 2565 flags.go:64] FLAG: --lock-file="" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229501 2565 flags.go:64] FLAG: --log-cadvisor-usage="false" Jul 09 17:28:07.571517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229504 2565 flags.go:64] FLAG: --log-flush-frequency="5s" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229507 2565 flags.go:64] FLAG: --log-json-info-buffer-size="0" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229512 2565 flags.go:64] FLAG: --log-json-split-stream="false" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229515 2565 flags.go:64] FLAG: --log-text-info-buffer-size="0" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229518 2565 flags.go:64] FLAG: --log-text-split-stream="false" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229521 2565 flags.go:64] FLAG: --logging-format="text" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229524 2565 flags.go:64] FLAG: --machine-id-file="/etc/machine-id,/var/lib/dbus/machine-id" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229527 2565 flags.go:64] FLAG: --make-iptables-util-chains="true" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229530 2565 flags.go:64] FLAG: --manifest-url="" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229532 2565 flags.go:64] FLAG: --manifest-url-header="" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229539 2565 flags.go:64] FLAG: --max-housekeeping-interval="15s" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229542 2565 flags.go:64] FLAG: --max-open-files="1000000" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229546 2565 flags.go:64] FLAG: --max-pods="110" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229549 2565 flags.go:64] FLAG: --maximum-dead-containers="-1" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229552 2565 flags.go:64] FLAG: --maximum-dead-containers-per-container="1" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229555 2565 flags.go:64] FLAG: --memory-manager-policy="None" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229557 2565 flags.go:64] FLAG: --minimum-container-ttl-duration="6m0s" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229561 2565 flags.go:64] FLAG: --minimum-image-ttl-duration="2m0s" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229564 2565 flags.go:64] FLAG: --node-ip="0.0.0.0" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229567 2565 flags.go:64] FLAG: --node-labels="node-role.kubernetes.io/worker=,node.openshift.io/os_id=rhel" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229575 2565 flags.go:64] FLAG: --node-status-max-images="50" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229579 2565 flags.go:64] FLAG: --node-status-update-frequency="10s" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229582 2565 flags.go:64] FLAG: --oom-score-adj="-999" Jul 09 17:28:07.572663 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229585 2565 flags.go:64] FLAG: --pod-cidr="" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229589 2565 flags.go:64] FLAG: --pod-infra-container-image="quay.io/openshift-release-dev/ocp-v4.0-art-dev@sha256:b04c0b1f73af4d021dd8f0b51bfeb302c24482c093de5f2c43654ab56c506926" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229595 2565 flags.go:64] FLAG: --pod-manifest-path="" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229598 2565 flags.go:64] FLAG: --pod-max-pids="-1" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229601 2565 flags.go:64] FLAG: --pods-per-core="0" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229604 2565 flags.go:64] FLAG: --port="10250" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229607 2565 flags.go:64] FLAG: --protect-kernel-defaults="false" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229610 2565 flags.go:64] FLAG: --provider-id="aws:///us-east-1a/i-09a737c02269c729d" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229613 2565 flags.go:64] FLAG: --qos-reserved="" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229616 2565 flags.go:64] FLAG: --read-only-port="10255" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229619 2565 flags.go:64] FLAG: --register-node="true" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229622 2565 flags.go:64] FLAG: --register-with-taints="" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229626 2565 flags.go:64] FLAG: --registry-burst="10" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229628 2565 flags.go:64] FLAG: --registry-qps="5" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229631 2565 flags.go:64] FLAG: --reserved-cpus="" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229634 2565 flags.go:64] FLAG: --reserved-memory="" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229638 2565 flags.go:64] FLAG: --resolv-conf="/etc/resolv.conf" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229641 2565 flags.go:64] FLAG: --root-dir="/var/lib/kubelet" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229643 2565 flags.go:64] FLAG: --rotate-certificates="false" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229647 2565 flags.go:64] FLAG: --rotate-server-certificates="false" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229649 2565 flags.go:64] FLAG: --runonce="false" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229652 2565 flags.go:64] FLAG: --runtime-cgroups="/system.slice/crio.service" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229655 2565 flags.go:64] FLAG: --runtime-request-timeout="2m0s" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229658 2565 flags.go:64] FLAG: --seccomp-default="false" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229661 2565 flags.go:64] FLAG: --serialize-image-pulls="true" Jul 09 17:28:07.573389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229663 2565 flags.go:64] FLAG: --storage-driver-buffer-duration="1m0s" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229668 2565 flags.go:64] FLAG: --storage-driver-db="cadvisor" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229671 2565 flags.go:64] FLAG: --storage-driver-host="localhost:8086" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229674 2565 flags.go:64] FLAG: --storage-driver-password="root" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229677 2565 flags.go:64] FLAG: --storage-driver-secure="false" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229680 2565 flags.go:64] FLAG: --storage-driver-table="stats" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229684 2565 flags.go:64] FLAG: --storage-driver-user="root" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229687 2565 flags.go:64] FLAG: --streaming-connection-idle-timeout="4h0m0s" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229690 2565 flags.go:64] FLAG: --sync-frequency="1m0s" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229693 2565 flags.go:64] FLAG: --system-cgroups="" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229696 2565 flags.go:64] FLAG: --system-reserved="cpu=500m,ephemeral-storage=1Gi,memory=1Gi" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229701 2565 flags.go:64] FLAG: --system-reserved-cgroup="" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229704 2565 flags.go:64] FLAG: --tls-cert-file="" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229707 2565 flags.go:64] FLAG: --tls-cipher-suites="[]" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229711 2565 flags.go:64] FLAG: --tls-min-version="" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229714 2565 flags.go:64] FLAG: --tls-private-key-file="" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229717 2565 flags.go:64] FLAG: --topology-manager-policy="none" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229720 2565 flags.go:64] FLAG: --topology-manager-policy-options="" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229722 2565 flags.go:64] FLAG: --topology-manager-scope="container" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229725 2565 flags.go:64] FLAG: --v="2" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229729 2565 flags.go:64] FLAG: --version="false" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229733 2565 flags.go:64] FLAG: --vmodule="" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229736 2565 flags.go:64] FLAG: --volume-plugin-dir="/etc/kubernetes/kubelet-plugins/volume/exec" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.229740 2565 flags.go:64] FLAG: --volume-stats-agg-period="1m0s" Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229855 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 17:28:07.825698 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229859 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 17:28:07.826881 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229863 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 17:28:07.826881 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229867 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 17:28:07.826881 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229870 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 17:28:07.826881 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229873 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 17:28:07.826881 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229876 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 17:28:07.826881 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229879 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 17:28:07.826881 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229882 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 17:28:07.826881 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229886 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 17:28:07.826881 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229889 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 17:28:07.826881 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229891 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 17:28:07.826881 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229894 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 17:28:07.826881 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229896 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 17:28:07.826881 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229901 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 17:28:07.826881 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229903 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 17:28:07.826881 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229906 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 17:28:07.826881 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229909 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 17:28:07.826881 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229912 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 17:28:07.826881 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229915 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 17:28:07.826881 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229917 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 17:28:07.826881 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229920 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 17:28:07.827484 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229922 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 17:28:07.827484 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229925 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 17:28:07.827484 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229928 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 17:28:07.827484 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229930 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 17:28:07.827484 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229933 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 17:28:07.827484 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229935 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 17:28:07.827484 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229938 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 17:28:07.827484 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229941 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 17:28:07.827484 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229943 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 17:28:07.827484 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229945 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 17:28:07.827484 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229948 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 17:28:07.827484 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229950 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 17:28:07.827484 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229953 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 17:28:07.827484 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229955 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 17:28:07.827484 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229958 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 17:28:07.827484 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229960 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 17:28:07.827484 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229963 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 17:28:07.827484 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229965 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 17:28:07.827484 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229968 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 17:28:07.827484 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229971 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 17:28:07.828127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229974 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 17:28:07.828127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229976 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 17:28:07.828127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229978 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 17:28:07.828127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229981 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 17:28:07.828127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229985 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 17:28:07.828127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229987 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 17:28:07.828127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229990 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 17:28:07.828127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229992 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 17:28:07.828127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229995 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 17:28:07.828127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.229998 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 17:28:07.828127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230000 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 17:28:07.828127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230002 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 17:28:07.828127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230005 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 17:28:07.828127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230007 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 17:28:07.828127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230010 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 17:28:07.828127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230013 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 17:28:07.828127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230015 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 17:28:07.828127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230017 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 17:28:07.828127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230020 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 17:28:07.828127 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230022 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 17:28:07.828697 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230025 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 17:28:07.828697 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230027 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 17:28:07.828697 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230029 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 17:28:07.828697 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230032 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 17:28:07.828697 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230034 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 17:28:07.828697 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230037 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 17:28:07.828697 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230039 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 17:28:07.828697 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230042 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 17:28:07.828697 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230044 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 17:28:07.828697 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230046 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 17:28:07.828697 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230050 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 17:28:07.828697 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230055 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 17:28:07.828697 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230058 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 17:28:07.828697 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230061 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 17:28:07.828697 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230063 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 17:28:07.828697 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230066 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 17:28:07.828697 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230071 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 17:28:07.828697 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230074 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 17:28:07.828697 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230076 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 17:28:07.829323 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230079 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 17:28:07.829323 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230082 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 17:28:07.829323 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230085 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 17:28:07.829323 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230088 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 17:28:07.829323 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230090 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 17:28:07.829323 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230093 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 17:28:07.829323 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230096 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 17:28:07.829323 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230098 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 17:28:07.829323 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230100 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 17:28:07.829323 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230103 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 17:28:07.829323 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230105 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 17:28:07.829323 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230108 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 17:28:07.829323 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230110 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 17:28:07.829323 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230113 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 17:28:07.829323 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230116 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 17:28:07.829323 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230118 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 17:28:07.829323 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230121 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 17:28:07.829323 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.230124 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 17:28:07.829875 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.230685 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 17:28:07.829875 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.237647 2565 server.go:529] "Kubelet version" kubeletVersion="v1.34.9" Jul 09 17:28:07.829875 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.237662 2565 server.go:531] "Golang settings" GOGC="" GOMAXPROCS="" GOTRACEBACK="" Jul 09 17:28:07.829875 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.237680 2565 watchdog_linux.go:95] "Systemd watchdog is not enabled" Jul 09 17:28:07.829875 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.237689 2565 watchdog_linux.go:137] "Systemd watchdog is not enabled or the interval is invalid, so health checking will not be started." Jul 09 17:28:07.829875 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237754 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 17:28:07.829875 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237759 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 17:28:07.829875 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237763 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 17:28:07.829875 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237766 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 17:28:07.829875 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237769 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 17:28:07.829875 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237772 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 17:28:07.829875 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237775 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 17:28:07.829875 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237777 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 17:28:07.829875 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237780 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 17:28:07.830366 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237783 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 17:28:07.830366 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237786 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 17:28:07.830366 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237788 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 17:28:07.830366 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237796 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 17:28:07.830366 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237799 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 17:28:07.830366 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237802 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 17:28:07.830366 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237805 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 17:28:07.830366 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237808 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 17:28:07.830366 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237810 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 17:28:07.830366 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237813 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 17:28:07.830366 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237816 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 17:28:07.830366 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237819 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 17:28:07.830366 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237821 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 17:28:07.830366 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237824 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 17:28:07.830366 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237827 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 17:28:07.830366 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237829 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 17:28:07.830366 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237832 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 17:28:07.830366 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237834 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 17:28:07.830366 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237837 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 17:28:07.830366 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237839 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 17:28:07.830977 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237842 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 17:28:07.830977 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237851 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 17:28:07.830977 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237854 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 17:28:07.830977 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237857 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 17:28:07.830977 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237859 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 17:28:07.830977 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237862 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 17:28:07.830977 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237864 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 17:28:07.830977 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237867 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 17:28:07.830977 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237869 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 17:28:07.830977 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237873 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 17:28:07.830977 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237877 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 17:28:07.830977 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237883 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 17:28:07.830977 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237886 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 17:28:07.830977 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237889 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 17:28:07.830977 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237892 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 17:28:07.830977 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237895 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 17:28:07.830977 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237904 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 17:28:07.830977 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237906 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 17:28:07.830977 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237909 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 17:28:07.830977 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237916 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 17:28:07.831565 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237918 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 17:28:07.831565 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237921 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 17:28:07.831565 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237924 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 17:28:07.831565 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237926 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 17:28:07.831565 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237929 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 17:28:07.831565 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237931 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 17:28:07.831565 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237934 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 17:28:07.831565 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237936 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 17:28:07.831565 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237939 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 17:28:07.831565 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237942 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 17:28:07.831565 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237944 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 17:28:07.831565 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237947 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 17:28:07.831565 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237949 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 17:28:07.831565 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237952 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 17:28:07.831565 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237955 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 17:28:07.831565 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237957 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 17:28:07.831565 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237961 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 17:28:07.831565 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237964 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 17:28:07.831565 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237967 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 17:28:07.832073 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237970 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 17:28:07.832073 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237973 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 17:28:07.832073 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237976 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 17:28:07.832073 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237979 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 17:28:07.832073 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237982 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 17:28:07.832073 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237985 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 17:28:07.832073 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237987 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 17:28:07.832073 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237990 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 17:28:07.832073 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237992 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 17:28:07.832073 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.237995 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 17:28:07.832073 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238005 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 17:28:07.832073 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238009 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 17:28:07.832073 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238012 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 17:28:07.832073 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238015 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 17:28:07.832073 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238017 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 17:28:07.832073 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238020 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 17:28:07.832073 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238023 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 17:28:07.832073 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238025 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 17:28:07.832073 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238028 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 17:28:07.832610 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238030 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 17:28:07.832610 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238032 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 17:28:07.832610 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238035 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 17:28:07.832610 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238038 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 17:28:07.832610 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238040 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 17:28:07.832610 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238043 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 17:28:07.832610 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238046 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 17:28:07.832610 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238048 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 17:28:07.832610 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238051 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 17:28:07.832610 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238053 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 17:28:07.832610 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238056 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 17:28:07.832610 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238058 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 17:28:07.832610 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.238065 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 17:28:07.832610 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238219 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImages Jul 09 17:28:07.832610 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238224 2565 feature_gate.go:328] unrecognized feature gate: MetricsCollectionProfiles Jul 09 17:28:07.833032 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238227 2565 feature_gate.go:328] unrecognized feature gate: ShortCertRotation Jul 09 17:28:07.833032 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238230 2565 feature_gate.go:328] unrecognized feature gate: AdditionalRoutingCapabilities Jul 09 17:28:07.833032 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238233 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryptionProvider Jul 09 17:28:07.833032 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238236 2565 feature_gate.go:328] unrecognized feature gate: AzureDualStackInstall Jul 09 17:28:07.833032 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238238 2565 feature_gate.go:328] unrecognized feature gate: HighlyAvailableArbiter Jul 09 17:28:07.833032 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238241 2565 feature_gate.go:328] unrecognized feature gate: NewOLMBoxCutterRuntime Jul 09 17:28:07.833032 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238243 2565 feature_gate.go:328] unrecognized feature gate: AzureClusterHostedDNSInstall Jul 09 17:28:07.833032 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238245 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstallIBMCloud Jul 09 17:28:07.833032 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238248 2565 feature_gate.go:328] unrecognized feature gate: OnPremDNSRecords Jul 09 17:28:07.833032 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238256 2565 feature_gate.go:328] unrecognized feature gate: AWSDedicatedHosts Jul 09 17:28:07.833032 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238259 2565 feature_gate.go:328] unrecognized feature gate: KMSEncryption Jul 09 17:28:07.833032 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238263 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNS Jul 09 17:28:07.833032 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238265 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIController Jul 09 17:28:07.833032 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238268 2565 feature_gate.go:328] unrecognized feature gate: NoRegistryClusterInstall Jul 09 17:28:07.833032 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238270 2565 feature_gate.go:328] unrecognized feature gate: InsightsOnDemandDataGather Jul 09 17:28:07.833032 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238273 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerification Jul 09 17:28:07.833032 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238275 2565 feature_gate.go:328] unrecognized feature gate: VSphereMixedNodeEnv Jul 09 17:28:07.833032 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238278 2565 feature_gate.go:328] unrecognized feature gate: BootImageSkewEnforcement Jul 09 17:28:07.833032 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238280 2565 feature_gate.go:328] unrecognized feature gate: NewOLMOwnSingleNamespace Jul 09 17:28:07.833032 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238283 2565 feature_gate.go:328] unrecognized feature gate: AzureWorkloadIdentity Jul 09 17:28:07.833595 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238285 2565 feature_gate.go:328] unrecognized feature gate: SignatureStores Jul 09 17:28:07.833595 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238287 2565 feature_gate.go:328] unrecognized feature gate: NewOLMPreflightPermissionChecks Jul 09 17:28:07.833595 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238290 2565 feature_gate.go:328] unrecognized feature gate: MultiArchInstallAzure Jul 09 17:28:07.833595 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238292 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNS Jul 09 17:28:07.833595 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238295 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAWS Jul 09 17:28:07.833595 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238297 2565 feature_gate.go:328] unrecognized feature gate: MultiDiskSetup Jul 09 17:28:07.833595 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238300 2565 feature_gate.go:328] unrecognized feature gate: PreconfiguredUDNAddresses Jul 09 17:28:07.833595 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238302 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIOperatorDisableMachineHealthCheckController Jul 09 17:28:07.833595 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238305 2565 feature_gate.go:328] unrecognized feature gate: VSphereHostVMGroupZonal Jul 09 17:28:07.833595 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238309 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesvSphere Jul 09 17:28:07.833595 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238311 2565 feature_gate.go:328] unrecognized feature gate: NetworkDiagnosticsConfig Jul 09 17:28:07.833595 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238313 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPIWithoutOLM Jul 09 17:28:07.833595 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238316 2565 feature_gate.go:328] unrecognized feature gate: UpgradeStatus Jul 09 17:28:07.833595 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238318 2565 feature_gate.go:328] unrecognized feature gate: OpenShiftPodSecurityAdmission Jul 09 17:28:07.833595 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238321 2565 feature_gate.go:328] unrecognized feature gate: NewOLM Jul 09 17:28:07.833595 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238323 2565 feature_gate.go:328] unrecognized feature gate: DNSNameResolver Jul 09 17:28:07.833595 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238326 2565 feature_gate.go:328] unrecognized feature gate: GCPDualStackInstall Jul 09 17:28:07.833595 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238328 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesAzure Jul 09 17:28:07.833595 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238331 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDC Jul 09 17:28:07.833595 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238333 2565 feature_gate.go:328] unrecognized feature gate: AzureMultiDisk Jul 09 17:28:07.834150 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238356 2565 feature_gate.go:328] unrecognized feature gate: AutomatedEtcdBackup Jul 09 17:28:07.834150 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238359 2565 feature_gate.go:328] unrecognized feature gate: EtcdBackendQuota Jul 09 17:28:07.834150 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238368 2565 feature_gate.go:328] unrecognized feature gate: ManagedBootImagesCPMS Jul 09 17:28:07.834150 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238372 2565 feature_gate.go:328] unrecognized feature gate: EventTTL Jul 09 17:28:07.834150 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238375 2565 feature_gate.go:328] unrecognized feature gate: ImageModeStatusReporting Jul 09 17:28:07.834150 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238377 2565 feature_gate.go:328] unrecognized feature gate: AWSDualStackInstall Jul 09 17:28:07.834150 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238380 2565 feature_gate.go:328] unrecognized feature gate: ExternalOIDCWithUIDAndExtraClaimMappings Jul 09 17:28:07.834150 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238384 2565 feature_gate.go:351] Setting GA feature gate ServiceAccountTokenNodeBinding=true. It will be removed in a future release. Jul 09 17:28:07.834150 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238388 2565 feature_gate.go:328] unrecognized feature gate: BootcNodeManagement Jul 09 17:28:07.834150 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238391 2565 feature_gate.go:328] unrecognized feature gate: HyperShiftOnlyDynamicResourceAllocation Jul 09 17:28:07.834150 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238393 2565 feature_gate.go:328] unrecognized feature gate: ProvisioningRequestAvailable Jul 09 17:28:07.834150 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238396 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIInstall Jul 09 17:28:07.834150 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238399 2565 feature_gate.go:328] unrecognized feature gate: AlibabaPlatform Jul 09 17:28:07.834150 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238402 2565 feature_gate.go:328] unrecognized feature gate: Example Jul 09 17:28:07.834150 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238404 2565 feature_gate.go:328] unrecognized feature gate: AWSServiceLBNetworkSecurityGroup Jul 09 17:28:07.834150 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238407 2565 feature_gate.go:328] unrecognized feature gate: CRDCompatibilityRequirementOperator Jul 09 17:28:07.834150 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238410 2565 feature_gate.go:328] unrecognized feature gate: AzureDedicatedHosts Jul 09 17:28:07.834150 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238412 2565 feature_gate.go:328] unrecognized feature gate: NewOLMCatalogdAPIV1Metas Jul 09 17:28:07.834150 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238415 2565 feature_gate.go:328] unrecognized feature gate: NetworkLiveMigration Jul 09 17:28:07.834710 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238418 2565 feature_gate.go:328] unrecognized feature gate: Example2 Jul 09 17:28:07.834710 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238420 2565 feature_gate.go:328] unrecognized feature gate: IrreconcilableMachineConfig Jul 09 17:28:07.834710 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238425 2565 feature_gate.go:328] unrecognized feature gate: OVNObservability Jul 09 17:28:07.834710 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238427 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiDisk Jul 09 17:28:07.834710 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238430 2565 feature_gate.go:328] unrecognized feature gate: VSphereMultiNetworks Jul 09 17:28:07.834710 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238434 2565 feature_gate.go:351] Setting GA feature gate VolumeAttributesClass=true. It will be removed in a future release. Jul 09 17:28:07.834710 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238437 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagementVSphere Jul 09 17:28:07.834710 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238440 2565 feature_gate.go:328] unrecognized feature gate: ExternalSnapshotMetadata Jul 09 17:28:07.834710 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238443 2565 feature_gate.go:328] unrecognized feature gate: DyanmicServiceEndpointIBMCloud Jul 09 17:28:07.834710 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238446 2565 feature_gate.go:328] unrecognized feature gate: CPMSMachineNamePrefix Jul 09 17:28:07.834710 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238448 2565 feature_gate.go:328] unrecognized feature gate: NutanixMultiSubnets Jul 09 17:28:07.834710 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238451 2565 feature_gate.go:328] unrecognized feature gate: MixedCPUsAllocation Jul 09 17:28:07.834710 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238454 2565 feature_gate.go:328] unrecognized feature gate: MachineConfigNodes Jul 09 17:28:07.834710 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238457 2565 feature_gate.go:328] unrecognized feature gate: MachineAPIMigration Jul 09 17:28:07.834710 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238459 2565 feature_gate.go:328] unrecognized feature gate: SigstoreImageVerificationPKI Jul 09 17:28:07.834710 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238461 2565 feature_gate.go:328] unrecognized feature gate: PinnedImages Jul 09 17:28:07.834710 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238471 2565 feature_gate.go:328] unrecognized feature gate: VolumeGroupSnapshot Jul 09 17:28:07.834710 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238474 2565 feature_gate.go:328] unrecognized feature gate: ClusterVersionOperatorConfiguration Jul 09 17:28:07.834710 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238477 2565 feature_gate.go:328] unrecognized feature gate: ClusterAPIMachineManagement Jul 09 17:28:07.835269 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238479 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpoints Jul 09 17:28:07.835269 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238481 2565 feature_gate.go:328] unrecognized feature gate: NewOLMWebhookProviderOpenshiftServiceCA Jul 09 17:28:07.835269 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238484 2565 feature_gate.go:328] unrecognized feature gate: RouteAdvertisements Jul 09 17:28:07.835269 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238486 2565 feature_gate.go:328] unrecognized feature gate: AWSClusterHostedDNSInstall Jul 09 17:28:07.835269 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238489 2565 feature_gate.go:328] unrecognized feature gate: GCPCustomAPIEndpointsInstall Jul 09 17:28:07.835269 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238491 2565 feature_gate.go:328] unrecognized feature gate: IngressControllerDynamicConfigurationManager Jul 09 17:28:07.835269 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238494 2565 feature_gate.go:328] unrecognized feature gate: DualReplica Jul 09 17:28:07.835269 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238496 2565 feature_gate.go:328] unrecognized feature gate: VSphereConfigurableMaxAllowedBlockVolumesPerNode Jul 09 17:28:07.835269 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238499 2565 feature_gate.go:328] unrecognized feature gate: ConsolePluginContentSecurityPolicy Jul 09 17:28:07.835269 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238501 2565 feature_gate.go:328] unrecognized feature gate: ImageStreamImportMode Jul 09 17:28:07.835269 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238504 2565 feature_gate.go:328] unrecognized feature gate: NetworkSegmentation Jul 09 17:28:07.835269 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238506 2565 feature_gate.go:328] unrecognized feature gate: GatewayAPI Jul 09 17:28:07.835269 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238509 2565 feature_gate.go:349] Setting deprecated feature gate KMSv1=true. It will be removed in a future release. Jul 09 17:28:07.835269 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238513 2565 feature_gate.go:328] unrecognized feature gate: OSStreams Jul 09 17:28:07.835269 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238515 2565 feature_gate.go:328] unrecognized feature gate: GCPClusterHostedDNSInstall Jul 09 17:28:07.835269 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238519 2565 feature_gate.go:328] unrecognized feature gate: BuildCSIVolumes Jul 09 17:28:07.835269 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238522 2565 feature_gate.go:328] unrecognized feature gate: ClusterMonitoringConfig Jul 09 17:28:07.835269 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238524 2565 feature_gate.go:328] unrecognized feature gate: AdminNetworkPolicy Jul 09 17:28:07.835269 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:06.238527 2565 feature_gate.go:328] unrecognized feature gate: InsightsConfig Jul 09 17:28:07.835820 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.238532 2565 feature_gate.go:384] feature gates: {map[CBORServingAndStorage:false ClientsAllowCBOR:false ClientsPreferCBOR:false EventedPLEG:false ImageVolume:true KMSv1:true MaxUnavailableStatefulSet:false MinimumKubeletVersion:false MutableCSINodeAllocatableCount:false MutatingAdmissionPolicy:false ProcMountType:true RouteExternalCertificate:true SELinuxMount:false ServiceAccountTokenNodeBinding:true StoragePerformantSecurityPolicy:true TranslateStreamCloseWebsocketRequests:false UserNamespacesPodSecurityStandards:true UserNamespacesSupport:true VolumeAttributesClass:true]} Jul 09 17:28:07.835820 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.238651 2565 server.go:962] "Client rotation is on, will bootstrap in background" Jul 09 17:28:07.835820 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.240591 2565 bootstrap.go:101] "Use the bootstrap credentials to request a cert, and set kubeconfig to point to the certificate dir" Jul 09 17:28:07.835820 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.242043 2565 server.go:1019] "Starting client certificate rotation" Jul 09 17:28:07.835820 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.242165 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 17:28:07.835820 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.243043 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kube-apiserver-client-kubelet" Jul 09 17:28:07.835820 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.246169 2565 dynamic_cafile_content.go:123] "Loaded a new CA Bundle and Verifier" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 17:28:07.835820 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.253277 2565 dynamic_cafile_content.go:161] "Starting controller" name="client-ca-bundle::/etc/kubernetes/kubelet-ca.crt" Jul 09 17:28:07.835820 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.267293 2565 log.go:25] "Validated CRI v1 runtime API" Jul 09 17:28:07.835820 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.269610 2565 log.go:25] "Validated CRI v1 image API" Jul 09 17:28:07.835820 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.270455 2565 server.go:1429] "Using cgroup driver setting received from the CRI runtime" cgroupDriver="systemd" Jul 09 17:28:07.835820 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.277411 2565 fs.go:135] Filesystem UUIDs: map[1129ce58-9957-4652-a604-f34efff6c485:/dev/nvme0n1p3 7B77-95E7:/dev/nvme0n1p2 e8c32ffc-c788-42a7-90a2-42bfc15ff3fa:/dev/nvme0n1p4] Jul 09 17:28:07.836161 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.277429 2565 fs.go:136] Filesystem partitions: map[/dev/nvme0n1p3:{mountpoint:/boot major:259 minor:3 fsType:ext4 blockSize:0} /dev/nvme0n1p4:{mountpoint:/var major:259 minor:4 fsType:xfs blockSize:0} /dev/shm:{mountpoint:/dev/shm major:0 minor:22 fsType:tmpfs blockSize:0} /run:{mountpoint:/run major:0 minor:24 fsType:tmpfs blockSize:0} /tmp:{mountpoint:/tmp major:0 minor:31 fsType:tmpfs blockSize:0} composefs_0-33:{mountpoint:/ major:0 minor:33 fsType:overlay blockSize:0}] Jul 09 17:28:07.836161 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.278320 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kube-apiserver-client-kubelet" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 17:28:07.836667 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.282308 2565 manager.go:216] Machine: {Timestamp:2026-07-09 17:28:06.281097141 +0000 UTC m=+0.378982621 CPUVendorID:GenuineIntel NumCores:8 NumPhysicalCores:4 NumSockets:1 CpuFrequency:3099504 MemoryCapacity:33164500992 SwapCapacity:0 MemoryByType:map[] NVMInfo:{MemoryModeCapacity:0 AppDirectModeCapacity:0 AvgPowerBudget:0} HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] MachineID:ec2416e43a12cc8f08136626adb2c8d7 SystemUUID:ec2416e4-3a12-cc8f-0813-6626adb2c8d7 BootID:b1bfbe57-a704-4d26-a3ae-c50038686dca Filesystems:[{Device:/dev/shm DeviceMajor:0 DeviceMinor:22 Capacity:16582250496 Type:vfs Inodes:4048401 HasInodes:true} {Device:/run DeviceMajor:0 DeviceMinor:24 Capacity:6632902656 Type:vfs Inodes:819200 HasInodes:true} {Device:/dev/nvme0n1p4 DeviceMajor:259 DeviceMinor:4 Capacity:128243970048 Type:vfs Inodes:62651840 HasInodes:true} {Device:composefs_0-33 DeviceMajor:0 DeviceMinor:33 Capacity:6107136 Type:vfs Inodes:18446744073709551615 HasInodes:true} {Device:/tmp DeviceMajor:0 DeviceMinor:31 Capacity:16582250496 Type:vfs Inodes:1048576 HasInodes:true} {Device:/dev/nvme0n1p3 DeviceMajor:259 DeviceMinor:3 Capacity:366869504 Type:vfs Inodes:98304 HasInodes:true}] DiskMap:map[259:0:{Name:nvme0n1 Major:259 Minor:0 Size:128849018880 Scheduler:none}] NetworkDevices:[{Name:br-ex MacAddress:02:e3:83:03:d9:31 Speed:0 Mtu:9001} {Name:ens5 MacAddress:02:e3:83:03:d9:31 Speed:0 Mtu:9001} {Name:ovs-system MacAddress:82:15:db:65:6b:bb Speed:0 Mtu:1500}] Topology:[{Id:0 Memory:33164500992 HugePages:[{PageSize:1048576 NumPages:0} {PageSize:2048 NumPages:0}] Cores:[{Id:0 Threads:[0 4] Caches:[{Id:0 Size:32768 Type:Data Level:1} {Id:0 Size:32768 Type:Instruction Level:1} {Id:0 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:1 Threads:[1 5] Caches:[{Id:1 Size:32768 Type:Data Level:1} {Id:1 Size:32768 Type:Instruction Level:1} {Id:1 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:2 Threads:[2 6] Caches:[{Id:2 Size:32768 Type:Data Level:1} {Id:2 Size:32768 Type:Instruction Level:1} {Id:2 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:} {Id:3 Threads:[3 7] Caches:[{Id:3 Size:32768 Type:Data Level:1} {Id:3 Size:32768 Type:Instruction Level:1} {Id:3 Size:1048576 Type:Unified Level:2}] UncoreCaches:[] SocketID:0 BookID: DrawerID:}] Caches:[{Id:0 Size:37486592 Type:Unified Level:3}] Distances:[10]}] CloudProvider:Unknown InstanceType:Unknown InstanceID:None} Jul 09 17:28:07.836667 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.282418 2565 manager_no_libpfm.go:29] cAdvisor is build without cgo and/or libpfm support. Perf event counters are not available. Jul 09 17:28:07.836667 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.282496 2565 manager.go:232] Version: {KernelVersion:5.14.0-570.126.1.el9_6.x86_64 ContainerOsVersion:Red Hat Enterprise Linux CoreOS 9.6.20260702-0 (Plow) DockerVersion: DockerAPIVersion: CadvisorVersion: CadvisorRevision:} Jul 09 17:28:07.836667 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.285765 2565 container_manager_linux.go:273] "Container manager verified user specified cgroup-root exists" cgroupRoot=[] Jul 09 17:28:07.836667 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.285789 2565 container_manager_linux.go:278] "Creating Container Manager object based on Node Config" nodeConfig={"NodeName":"ip-10-0-138-5.ec2.internal","RuntimeCgroupsName":"/system.slice/crio.service","SystemCgroupsName":"/system.slice","KubeletCgroupsName":"","KubeletOOMScoreAdj":-999,"ContainerRuntime":"","CgroupsPerQOS":true,"CgroupRoot":"/","CgroupDriver":"systemd","KubeletRootDir":"/var/lib/kubelet","ProtectKernelDefaults":true,"KubeReservedCgroupName":"","SystemReservedCgroupName":"","ReservedSystemCPUs":{},"EnforceNodeAllocatable":{"pods":{}},"KubeReserved":null,"SystemReserved":{"cpu":"500m","ephemeral-storage":"1Gi","memory":"1Gi"},"HardEvictionThresholds":[{"Signal":"imagefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.15},"GracePeriod":0,"MinReclaim":null},{"Signal":"imagefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null},{"Signal":"memory.available","Operator":"LessThan","Value":{"Quantity":"100Mi","Percentage":0},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.available","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.1},"GracePeriod":0,"MinReclaim":null},{"Signal":"nodefs.inodesFree","Operator":"LessThan","Value":{"Quantity":null,"Percentage":0.05},"GracePeriod":0,"MinReclaim":null}],"QOSReserved":{},"CPUManagerPolicy":"none","CPUManagerPolicyOptions":null,"TopologyManagerScope":"container","CPUManagerReconcilePeriod":10000000000,"MemoryManagerPolicy":"None","MemoryManagerReservedMemory":null,"PodPidsLimit":4096,"EnforceCPULimits":true,"CPUCFSQuotaPeriod":100000000,"TopologyManagerPolicy":"none","TopologyManagerPolicyOptions":null,"CgroupVersion":2} Jul 09 17:28:07.836667 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.286618 2565 topology_manager.go:138] "Creating topology manager with none policy" Jul 09 17:28:07.836667 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.286629 2565 container_manager_linux.go:309] "Creating device plugin manager" Jul 09 17:28:07.836667 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.286637 2565 manager.go:141] "Creating Device Plugin manager" path="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 17:28:07.836667 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.286647 2565 server.go:74] "Creating device plugin registration server" version="v1beta1" socket="/var/lib/kubelet/device-plugins/kubelet.sock" Jul 09 17:28:07.836667 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.287922 2565 container_manager_linux.go:318] "Creating Dynamic Resource Allocation (DRA) manager" Jul 09 17:28:07.836667 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.292232 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 09 17:28:07.836667 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.292365 2565 server.go:1240] "Using root directory" path="/var/lib/kubelet" Jul 09 17:28:07.836667 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.292394 2565 kubelet.go:486] "Attempting to sync node with API server" Jul 09 17:28:07.836667 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.292404 2565 kubelet.go:387] "Adding static pod path" path="/etc/kubernetes/manifests" Jul 09 17:28:07.836667 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.292419 2565 file.go:69] "Watching path" path="/etc/kubernetes/manifests" Jul 09 17:28:07.836667 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.292430 2565 kubelet.go:398] "Adding apiserver pod source" Jul 09 17:28:07.836667 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.292438 2565 apiserver.go:42] "Waiting for node sync before watching apiserver pods" Jul 09 17:28:07.836667 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.292817 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.292832 2565 state_mem.go:40] "Initialized new in-memory state store for pod resource information tracking" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.295238 2565 kuberuntime_manager.go:301] "Container runtime initialized" containerRuntime="cri-o" version="1.34.10-2.rhaos4.21.git83ee25b.el9" apiVersion="v1" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.297812 2565 kubelet.go:960] "Not starting ClusterTrustBundle informer because we are in static kubelet mode or the ClusterTrustBundleProjection featuregate is disabled" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.297840 2565 kubelet.go:984] "Not starting PodCertificateRequest manager because we are in static kubelet mode or the PodCertificateProjection feature gate is disabled" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.297992 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/portworx-volume" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.298003 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/empty-dir" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.298009 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/git-repo" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.298015 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/host-path" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.298022 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/nfs" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.298028 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/secret" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.298778 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/iscsi" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.298786 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/downward-api" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.298795 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/fc" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.298801 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/configmap" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.298809 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/projected" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.298817 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/local-volume" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.299546 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/csi" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.299555 2565 plugins.go:610] "Loaded volume plugin" pluginName="kubernetes.io/image" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:06.300727 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Service: services is forbidden: User \"system:anonymous\" cannot list resource \"services\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Service" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:06.300728 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.Node: nodes \"ip-10-0-138-5.ec2.internal\" is forbidden: User \"system:anonymous\" cannot list resource \"nodes\" in API group \"\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.Node" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.303958 2565 server.go:1268] "Started kubelet" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.304410 2565 server.go:180] "Starting to listen" address="0.0.0.0" port=10250 Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.306453 2565 server.go:310] "Adding debug handlers to kubelet server" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.306621 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nr7jk" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.306662 2565 ratelimit.go:56] "Setting rate limiting for endpoint" service="podresources" qps=100 burstTokens=10 Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.306712 2565 server_v1.go:49] "podresources" method="list" useActivePods=true Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.306785 2565 csi_plugin.go:990] Failed to contact API server when waiting for CSINode publishing: csinodes.storage.k8s.io "ip-10-0-138-5.ec2.internal" is forbidden: User "system:anonymous" cannot get resource "csinodes" in API group "storage.k8s.io" at the cluster scope Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.308542 2565 server.go:249] "Starting to serve the podresources API" endpoint="unix:/var/lib/kubelet/pod-resources/kubelet.sock" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:06.310624 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kube-apiserver-client-kubelet" csr="csr-nr7jk" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.353083 2565 fs_resource_analyzer.go:67] "Starting FS ResourceAnalyzer" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.353103 2565 certificate_manager.go:422] "Certificate rotation is enabled" logger="kubernetes.io/kubelet-serving" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:07.353234 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.353659 2565 volume_manager.go:311] "The desired_state_of_world populator starts" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.353676 2565 volume_manager.go:313] "Starting Kubelet Volume Manager" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.353775 2565 desired_state_of_world_populator.go:146] "Desired state populator starts to run" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.353846 2565 reconstruct.go:97] "Volume reconstruction finished" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.353854 2565 reconciler.go:29] "Reconciler: start to sync state" Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.353966 2565 factory.go:55] Registering systemd factory Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.353981 2565 factory.go:223] Registration of the systemd container factory successfully Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.354703 2565 factory.go:153] Registering CRI-O factory Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.354718 2565 factory.go:223] Registration of the crio container factory successfully Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.354784 2565 factory.go:221] Registration of the containerd container factory failed: unable to create containerd client: containerd: cannot unix dial containerd api service: dial unix /run/containerd/containerd.sock: connect: no such file or directory Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.354806 2565 factory.go:103] Registering Raw factory Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.354821 2565 manager.go:1196] Started watching for new ooms in manager Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.355871 2565 manager.go:349] Starting recovery of all containers Jul 09 17:28:07.837248 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:07.356453 2565 reflector.go:205] "Failed to watch" err="failed to list *v1.CSIDriver: csidrivers.storage.k8s.io is forbidden: User \"system:anonymous\" cannot list resource \"csidrivers\" in API group \"storage.k8s.io\" at the cluster scope" logger="UnhandledError" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.CSIDriver" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:07.356476 2565 controller.go:145] "Failed to ensure lease exists, will retry" err="leases.coordination.k8s.io \"ip-10-0-138-5.ec2.internal\" is forbidden: User \"system:anonymous\" cannot get resource \"leases\" in API group \"coordination.k8s.io\" in the namespace \"kube-node-lease\"" interval="200ms" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:07.356982 2565 kubelet.go:1638] "Image garbage collection failed once. Stats initialization may not have completed yet" err="failed to get imageFs info: unable to find data in memory cache" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.365122 2565 manager.go:354] Recovery completed Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:07.364161 2565 event.go:359] "Server rejected event (will not retry!)" err="events is forbidden: User \"system:anonymous\" cannot create resource \"events\" in API group \"\" in the namespace \"default\"" event="&Event{ObjectMeta:{ip-10-0-138-5.ec2.internal.18c0af33111b716e default 0 0001-01-01 00:00:00 +0000 UTC map[] map[] [] [] []},InvolvedObject:ObjectReference{Kind:Node,Namespace:,Name:ip-10-0-138-5.ec2.internal,UID:ip-10-0-138-5.ec2.internal,APIVersion:,ResourceVersion:,FieldPath:,},Reason:Starting,Message:Starting kubelet.,Source:EventSource{Component:kubelet,Host:ip-10-0-138-5.ec2.internal,},FirstTimestamp:2026-07-09 17:28:06.303920494 +0000 UTC m=+0.401805973,LastTimestamp:2026-07-09 17:28:06.303920494 +0000 UTC m=+0.401805973,Count:1,Type:Normal,EventTime:0001-01-01 00:00:00 +0000 UTC,Series:nil,Action:,Related:nil,ReportingController:kubelet,ReportingInstance:ip-10-0-138-5.ec2.internal,}" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.369623 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.371636 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientMemory" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.371667 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.371677 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientPID" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.372221 2565 cpu_manager.go:222] "Starting CPU manager" policy="none" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.372231 2565 cpu_manager.go:223] "Reconciling" reconcilePeriod="10s" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.372231 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.372246 2565 state_mem.go:36] "Initialized new in-memory state store" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.373171 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientMemory" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.373195 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.373205 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientPID" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.374308 2565 policy_none.go:49] "None policy: Start" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.374327 2565 memory_manager.go:187] "Starting memorymanager" policy="None" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.374337 2565 state_mem.go:36] "Initializing new in-memory state store" logger="Memory Manager state checkpoint" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.378926 2565 policy_none.go:47] "Start" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.407370 2565 manager.go:337] "Starting Device Plugin manager" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:07.407402 2565 manager.go:513] "Failed to read data from checkpoint" err="checkpoint is not found" checkpoint="kubelet_internal_checkpoint" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.407413 2565 server.go:87] "Starting device plugin registration server" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.407670 2565 eviction_manager.go:189] "Eviction manager: starting control loop" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.407682 2565 container_log_manager.go:146] "Initializing container log rotate workers" workers=1 monitorPeriod="10s" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.407988 2565 plugin_watcher.go:51] "Plugin Watcher Start" path="/var/lib/kubelet/plugins_registry" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.408055 2565 plugin_manager.go:116] "The desired_state_of_world populator (plugin watcher) starts" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.408064 2565 plugin_manager.go:118] "Starting Kubelet Plugin Manager" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:07.409226 2565 eviction_manager.go:267] "eviction manager: failed to check if we have separate container filesystem. Ignoring." err="non-existent label \"crio-containers\"" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:07.409278 2565 eviction_manager.go:292] "Eviction manager: failed to get summary stats" err="failed to get node info: node \"ip-10-0-138-5.ec2.internal\" not found" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.500464 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv4" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.501683 2565 kubelet_network_linux.go:54] "Initialized iptables rules." protocol="IPv6" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.501719 2565 status_manager.go:244] "Starting to sync pod status with apiserver" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.501744 2565 kubelet.go:2448] "Starting kubelet main sync loop" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:07.501794 2565 kubelet.go:2472] "Skipping pod synchronization" err="PLEG is not healthy: pleg has yet to be successful" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.503883 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.508597 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.509579 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientMemory" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.509605 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.509616 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientPID" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.509639 2565 kubelet_node_status.go:78] "Attempting to register node" node="ip-10-0-138-5.ec2.internal" Jul 09 17:28:08.086428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.517476 2565 kubelet_node_status.go:81] "Successfully registered node" node="ip-10-0-138-5.ec2.internal" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:07.517495 2565 kubelet_node_status.go:536] "Error updating node status, will retry" err="error getting node \"ip-10-0-138-5.ec2.internal\": node \"ip-10-0-138-5.ec2.internal\" not found" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:07.537410 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.602884 2565 kubelet.go:2535] "SyncLoop ADD" source="file" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal","kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal"] Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.602969 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.604546 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientMemory" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.604573 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.604583 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientPID" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.606771 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.606846 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.606875 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.614253 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientMemory" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.614278 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.614288 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientPID" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.614255 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientMemory" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.614354 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.614364 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientPID" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.616420 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.616459 2565 kubelet_node_status.go:400] "Setting node annotation to enable volume controller attach/detach" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.617179 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientMemory" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.617204 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasNoDiskPressure" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.617218 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeHasSufficientPID" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:07.637653 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:07.649414 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-5.ec2.internal\" not found" node="ip-10-0-138-5.ec2.internal" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:07.653572 2565 kubelet.go:3244] "No need to create a mirror pod, since failed to get node info from the cluster" err="node \"ip-10-0-138-5.ec2.internal\" not found" node="ip-10-0-138-5.ec2.internal" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:07.738295 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.755656 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0492d2bb9219188cc82326a2f44b03e5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal\" (UID: \"0492d2bb9219188cc82326a2f44b03e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.755685 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0492d2bb9219188cc82326a2f44b03e5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal\" (UID: \"0492d2bb9219188cc82326a2f44b03e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.755703 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/27ecca423593db51774231555b49ec3d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-5.ec2.internal\" (UID: \"27ecca423593db51774231555b49ec3d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:07.839050 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found" Jul 09 17:28:08.088312 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.856576 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0492d2bb9219188cc82326a2f44b03e5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal\" (UID: \"0492d2bb9219188cc82326a2f44b03e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal" Jul 09 17:28:08.089137 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.856618 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/host-path/27ecca423593db51774231555b49ec3d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-5.ec2.internal\" (UID: \"27ecca423593db51774231555b49ec3d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal" Jul 09 17:28:08.089137 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.856643 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0492d2bb9219188cc82326a2f44b03e5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal\" (UID: \"0492d2bb9219188cc82326a2f44b03e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal" Jul 09 17:28:08.089137 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.856685 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kube\" (UniqueName: \"kubernetes.io/host-path/0492d2bb9219188cc82326a2f44b03e5-etc-kube\") pod \"kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal\" (UID: \"0492d2bb9219188cc82326a2f44b03e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal" Jul 09 17:28:08.089137 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.856683 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/0492d2bb9219188cc82326a2f44b03e5-var-lib-kubelet\") pod \"kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal\" (UID: \"0492d2bb9219188cc82326a2f44b03e5\") " pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal" Jul 09 17:28:08.089137 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.856683 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/host-path/27ecca423593db51774231555b49ec3d-config\") pod \"kube-apiserver-proxy-ip-10-0-138-5.ec2.internal\" (UID: \"27ecca423593db51774231555b49ec3d\") " pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal" Jul 09 17:28:08.089137 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:07.939735 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found" Jul 09 17:28:08.089137 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.951888 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal" Jul 09 17:28:08.089137 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:07.956769 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal" Jul 09 17:28:08.089137 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:08.040322 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found" Jul 09 17:28:08.317152 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:08.140881 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found" Jul 09 17:28:08.317152 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:08.241366 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found" Jul 09 17:28:08.317152 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:08.283093 2565 transport.go:147] "Certificate rotation detected, shutting down client connections to start using new credentials" Jul 09 17:28:08.317152 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:08.283230 2565 reflector.go:571] "Warning: watch ended with error" reflector="k8s.io/client-go/informers/factory.go:160" type="*v1.RuntimeClass" err="very short watch: k8s.io/client-go/informers/factory.go:160: Unexpected watch close - watch lasted less than a second and no items received" Jul 09 17:28:08.527122 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:08.341538 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found" Jul 09 17:28:08.527122 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:08.365940 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kube-apiserver-client-kubelet" expiration="2028-07-08 17:23:07 +0000 UTC" deadline="2028-02-28 23:22:29.695045893 +0000 UTC" Jul 09 17:28:08.527122 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:08.365964 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kube-apiserver-client-kubelet" sleep="14381h54m21.329084849s" Jul 09 17:28:08.527122 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:08.442239 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found" Jul 09 17:28:08.741367 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:08.542961 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found" Jul 09 17:28:08.741367 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:08.636929 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0492d2bb9219188cc82326a2f44b03e5.slice/crio-a4c8ce79e3d15bf940cc1be1927b7faba38a2659d45b2734bb9007502c409098 WatchSource:0}: Error finding container a4c8ce79e3d15bf940cc1be1927b7faba38a2659d45b2734bb9007502c409098: Status 404 returned error can't find the container with id a4c8ce79e3d15bf940cc1be1927b7faba38a2659d45b2734bb9007502c409098 Jul 09 17:28:08.741367 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:08.640545 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 17:28:08.741367 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:08.643241 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found" Jul 09 17:28:08.751262 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:08.744334 2565 kubelet_node_status.go:454] "Error getting the current node from lister" err="node \"ip-10-0-138-5.ec2.internal\" not found" Jul 09 17:28:08.751262 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:08.747659 2565 reflector.go:439] "Caches populated" type="*v1.Node" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 17:28:08.754103 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:08.753498 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal" Jul 09 17:28:08.969250 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:08.911647 2565 reflector.go:439] "Caches populated" type="*v1.CSIDriver" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 17:28:09.336454 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.334694 2565 apiserver.go:52] "Watching apiserver" Jul 09 17:28:09.817918 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.817887 2565 certificate_manager.go:566] "Rotating certificates" logger="kubernetes.io/kubelet-serving" Jul 09 17:28:09.819961 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.819881 2565 reflector.go:439] "Caches populated" type="*v1.RuntimeClass" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 17:28:09.821301 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.821251 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal" event={"ID":"27ecca423593db51774231555b49ec3d","Type":"ContainerStarted","Data":"62247c9a4417f219ff684545a4d3379d7c3e95aab772bfb196b4cc4e240df32a"} Jul 09 17:28:09.822665 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.822641 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal" event={"ID":"0492d2bb9219188cc82326a2f44b03e5","Type":"ContainerStarted","Data":"a4c8ce79e3d15bf940cc1be1927b7faba38a2659d45b2734bb9007502c409098"} Jul 09 17:28:09.825950 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.825931 2565 reflector.go:439] "Caches populated" logger="kubernetes.io/kubelet-serving" type="*v1.CertificateSigningRequest" reflector="k8s.io/client-go/tools/watch/informerwatcher.go:162" Jul 09 17:28:09.828326 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.828313 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 17:28:09.829170 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.829157 2565 kubelet.go:3248] "Creating a mirror pod for static pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal" Jul 09 17:28:09.831713 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.831695 2565 reflector.go:439] "Caches populated" type="*v1.Service" reflector="k8s.io/client-go/informers/factory.go:160" Jul 09 17:28:09.832587 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.832572 2565 reflector.go:439] "Caches populated" type="*v1.Pod" reflector="pkg/kubelet/config/apiserver.go:66" Jul 09 17:28:09.832891 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.832874 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/global-pull-secret-syncer-gnf2w","kube-system/konnectivity-agent-qdmzx","openshift-cluster-node-tuning-operator/tuned-hhdf7","openshift-dns/node-resolver-w4fk8","openshift-image-registry/node-ca-86lxn","openshift-ovn-kubernetes/ovnkube-node-8wn62","openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss","openshift-multus/multus-additional-cni-plugins-l9l84","openshift-multus/multus-lgw9p","openshift-multus/network-metrics-daemon-ggmkn","openshift-network-diagnostics/network-check-target-xnjp4","openshift-network-operator/iptables-alerter-khz5w"] Jul 09 17:28:09.836346 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.836326 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:09.836410 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:09.836396 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:09.838276 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.838260 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qdmzx" Jul 09 17:28:09.840229 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.840209 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:09.840990 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.840971 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"default-dockercfg-bx54m\"" Jul 09 17:28:09.840990 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.840984 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"konnectivity-agent\"" Jul 09 17:28:09.841120 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.841082 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kube-system\"/\"konnectivity-ca-bundle\"" Jul 09 17:28:09.842298 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.842285 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"kube-root-ca.crt\"" Jul 09 17:28:09.842405 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.842390 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"openshift-service-ca.crt\"" Jul 09 17:28:09.842532 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.842517 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w4fk8" Jul 09 17:28:09.842610 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.842527 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-node-tuning-operator\"/\"tuned-dockercfg-9q7fj\"" Jul 09 17:28:09.845071 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.844535 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"node-resolver-dockercfg-tfntx\"" Jul 09 17:28:09.845071 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.844574 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"kube-root-ca.crt\"" Jul 09 17:28:09.845071 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.844607 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"openshift-service-ca.crt\"" Jul 09 17:28:09.845071 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.844718 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-86lxn" Jul 09 17:28:09.846453 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.846435 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"openshift-service-ca.crt\"" Jul 09 17:28:09.846612 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.846591 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"image-registry-certificates\"" Jul 09 17:28:09.846776 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.846746 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-image-registry\"/\"kube-root-ca.crt\"" Jul 09 17:28:09.846854 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.846823 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-image-registry\"/\"node-ca-dockercfg-8wjsp\"" Jul 09 17:28:09.847009 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.846996 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:09.847468 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.847449 2565 csr.go:274] "Certificate signing request is approved, waiting to be issued" logger="kubernetes.io/kubelet-serving" csr="csr-bvnjm" Jul 09 17:28:09.848943 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.848925 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"openshift-service-ca.crt\"" Jul 09 17:28:09.849067 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.848933 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"env-overrides\"" Jul 09 17:28:09.849161 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.849147 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"kube-root-ca.crt\"" Jul 09 17:28:09.849238 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.849184 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-config\"" Jul 09 17:28:09.849238 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.849187 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:09.849401 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.849255 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-node-metrics-cert\"" Jul 09 17:28:09.849401 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.849270 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ovn-kubernetes\"/\"ovn-kubernetes-node-dockercfg-h8bbk\"" Jul 09 17:28:09.850171 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.850154 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ovn-kubernetes\"/\"ovnkube-script-lib\"" Jul 09 17:28:09.851415 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.851398 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:09.851700 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.851559 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"kube-root-ca.crt\"" Jul 09 17:28:09.851700 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.851568 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-cluster-csi-drivers\"/\"openshift-service-ca.crt\"" Jul 09 17:28:09.851700 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.851602 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-sa-dockercfg-4hkht\"" Jul 09 17:28:09.851945 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.851927 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-cluster-csi-drivers\"/\"aws-ebs-csi-driver-node-metrics-serving-cert\"" Jul 09 17:28:09.853249 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.853229 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"cni-copy-resources\"" Jul 09 17:28:09.853452 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.853419 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"openshift-service-ca.crt\"" Jul 09 17:28:09.853800 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.853447 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"default-cni-sysctl-allowlist\"" Jul 09 17:28:09.853800 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.853631 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"whereabouts-flatfile-config\"" Jul 09 17:28:09.853800 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.853671 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"kube-root-ca.crt\"" Jul 09 17:28:09.853800 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.853672 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"multus-ancillary-tools-dockercfg-qcpc4\"" Jul 09 17:28:09.854530 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.854489 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lgw9p" Jul 09 17:28:09.855207 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.855191 2565 csr.go:270] "Certificate signing request is issued" logger="kubernetes.io/kubelet-serving" csr="csr-bvnjm" Jul 09 17:28:09.858394 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.856287 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:09.858394 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.856312 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"default-dockercfg-z8fcr\"" Jul 09 17:28:09.858394 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:09.856389 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:09.858394 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.856422 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-multus\"/\"multus-daemon-config\"" Jul 09 17:28:09.858666 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.858646 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:09.858834 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:09.858715 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:09.861435 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.861415 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal"] Jul 09 17:28:09.861528 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.861479 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-khz5w" Jul 09 17:28:09.863313 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.863297 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-dockercfg-nft6m\"" Jul 09 17:28:09.863405 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.863354 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"openshift-service-ca.crt\"" Jul 09 17:28:09.863405 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.863354 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"iptables-alerter-script\"" Jul 09 17:28:09.863547 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.863532 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-operator\"/\"kube-root-ca.crt\"" Jul 09 17:28:09.918694 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.918671 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e1cded27-42c6-4394-b60f-57b5fef447b7-env-overrides\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:09.918822 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.918698 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85ab2a66-354c-455f-969e-7d7a217ca9c1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:09.918822 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.918718 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/85ab2a66-354c-455f-969e-7d7a217ca9c1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:09.918822 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.918734 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-9fkr4\" (UniqueName: \"kubernetes.io/projected/85ab2a66-354c-455f-969e-7d7a217ca9c1-kube-api-access-9fkr4\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:09.918822 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.918749 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/837c9eb0-e736-47fc-a02e-daa26056d0fe-tmp-dir\") pod \"node-resolver-w4fk8\" (UID: \"837c9eb0-e736-47fc-a02e-daa26056d0fe\") " pod="openshift-dns/node-resolver-w4fk8" Jul 09 17:28:09.918822 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.918787 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs\") pod \"network-metrics-daemon-ggmkn\" (UID: \"8c6c5488-442d-41ea-b935-31c21f226a7c\") " pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:09.918822 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.918803 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret\") pod \"global-pull-secret-syncer-gnf2w\" (UID: \"50daa15b-9979-4a9f-a901-28e3d607c74e\") " pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:09.918822 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.918817 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-multus-conf-dir\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:09.919033 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.918835 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kxd57\" (UniqueName: \"kubernetes.io/projected/53da2f80-8416-4455-b359-ebfaa5551fda-kube-api-access-kxd57\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:09.919033 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.918857 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-etc-sysctl-conf\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:09.919033 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.918880 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-var-lib-openvswitch\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:09.919033 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.918897 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-run-ovn\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:09.919033 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.918912 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-os-release\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:09.919033 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.918935 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53da2f80-8416-4455-b359-ebfaa5551fda-cni-binary-copy\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:09.919033 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.918957 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/61cd09b0-79ba-4423-b79b-15b8281effa0-konnectivity-ca\") pod \"konnectivity-agent-qdmzx\" (UID: \"61cd09b0-79ba-4423-b79b-15b8281effa0\") " pod="kube-system/konnectivity-agent-qdmzx" Jul 09 17:28:09.919033 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.918972 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-etc-sysctl-d\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:09.919033 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.918986 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-lib-modules\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:09.919033 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919006 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/040a8ea6-253e-48ad-830f-7c3b998ba519-tmp\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:09.919295 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919030 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85ab2a66-354c-455f-969e-7d7a217ca9c1-os-release\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:09.919295 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919062 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/28f5e1b6-a011-45ca-827e-67a6eda59895-serviceca\") pod \"node-ca-86lxn\" (UID: \"28f5e1b6-a011-45ca-827e-67a6eda59895\") " pod="openshift-image-registry/node-ca-86lxn" Jul 09 17:28:09.919295 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919076 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lrjkf\" (UniqueName: \"kubernetes.io/projected/28f5e1b6-a011-45ca-827e-67a6eda59895-kube-api-access-lrjkf\") pod \"node-ca-86lxn\" (UID: \"28f5e1b6-a011-45ca-827e-67a6eda59895\") " pod="openshift-image-registry/node-ca-86lxn" Jul 09 17:28:09.919295 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919090 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vvtrx\" (UniqueName: \"kubernetes.io/projected/8c6c5488-442d-41ea-b935-31c21f226a7c-kube-api-access-vvtrx\") pod \"network-metrics-daemon-ggmkn\" (UID: \"8c6c5488-442d-41ea-b935-31c21f226a7c\") " pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:09.919295 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919121 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-run\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:09.919295 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919148 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-sys\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:09.919295 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919169 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e1cded27-42c6-4394-b60f-57b5fef447b7-ovnkube-config\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:09.919295 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919185 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-etc-kubernetes\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:09.919295 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919199 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d6e0a428-09fd-445c-acb2-6ce08c814474-socket-dir\") pod \"aws-ebs-csi-driver-node-69pss\" (UID: \"d6e0a428-09fd-445c-acb2-6ce08c814474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:09.919295 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919213 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d6e0a428-09fd-445c-acb2-6ce08c814474-etc-selinux\") pod \"aws-ebs-csi-driver-node-69pss\" (UID: \"d6e0a428-09fd-445c-acb2-6ce08c814474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:09.919295 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919228 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-5525b\" (UniqueName: \"kubernetes.io/projected/d6e0a428-09fd-445c-acb2-6ce08c814474-kube-api-access-5525b\") pod \"aws-ebs-csi-driver-node-69pss\" (UID: \"d6e0a428-09fd-445c-acb2-6ce08c814474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:09.919295 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919243 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-run-systemd\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:09.919295 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919274 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/85ab2a66-354c-455f-969e-7d7a217ca9c1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:09.919295 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919297 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-etc-kubernetes\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:09.919693 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919311 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-var-lib-kubelet\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:09.919693 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919337 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-etc-openvswitch\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:09.919693 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919361 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e1cded27-42c6-4394-b60f-57b5fef447b7-ovnkube-script-lib\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:09.919693 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919380 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85ab2a66-354c-455f-969e-7d7a217ca9c1-system-cni-dir\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:09.919693 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919394 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-cnibin\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:09.919693 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919412 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/50daa15b-9979-4a9f-a901-28e3d607c74e-kubelet-config\") pod \"global-pull-secret-syncer-gnf2w\" (UID: \"50daa15b-9979-4a9f-a901-28e3d607c74e\") " pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:09.919693 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919433 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/50daa15b-9979-4a9f-a901-28e3d607c74e-dbus\") pod \"global-pull-secret-syncer-gnf2w\" (UID: \"50daa15b-9979-4a9f-a901-28e3d607c74e\") " pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:09.919693 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919446 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-node-log\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:09.919693 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919460 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-system-cni-dir\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:09.919693 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919474 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-host-slash\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:09.919693 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919513 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/61cd09b0-79ba-4423-b79b-15b8281effa0-agent-certs\") pod \"konnectivity-agent-qdmzx\" (UID: \"61cd09b0-79ba-4423-b79b-15b8281effa0\") " pod="kube-system/konnectivity-agent-qdmzx" Jul 09 17:28:09.919693 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919530 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-etc-modprobe-d\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:09.919693 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919558 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7h8fc\" (UniqueName: \"kubernetes.io/projected/837c9eb0-e736-47fc-a02e-daa26056d0fe-kube-api-access-7h8fc\") pod \"node-resolver-w4fk8\" (UID: \"837c9eb0-e736-47fc-a02e-daa26056d0fe\") " pod="openshift-dns/node-resolver-w4fk8" Jul 09 17:28:09.919693 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919588 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-run-openvswitch\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:09.919693 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919620 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-log-socket\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:09.919693 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919637 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/837c9eb0-e736-47fc-a02e-daa26056d0fe-hosts-file\") pod \"node-resolver-w4fk8\" (UID: \"837c9eb0-e736-47fc-a02e-daa26056d0fe\") " pod="openshift-dns/node-resolver-w4fk8" Jul 09 17:28:09.919693 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919660 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-multus-cni-dir\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:09.920153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919679 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-host-run-netns\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:09.920153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919693 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-hostroot\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:09.920153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919706 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-etc-systemd\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:09.920153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919722 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-2v6cg\" (UniqueName: \"kubernetes.io/projected/e1cded27-42c6-4394-b60f-57b5fef447b7-kube-api-access-2v6cg\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:09.920153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919747 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85ab2a66-354c-455f-969e-7d7a217ca9c1-cni-binary-copy\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:09.920153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919777 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d6e0a428-09fd-445c-acb2-6ce08c814474-kubelet-dir\") pod \"aws-ebs-csi-driver-node-69pss\" (UID: \"d6e0a428-09fd-445c-acb2-6ce08c814474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:09.920153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919795 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d6e0a428-09fd-445c-acb2-6ce08c814474-device-dir\") pod \"aws-ebs-csi-driver-node-69pss\" (UID: \"d6e0a428-09fd-445c-acb2-6ce08c814474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:09.920153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919822 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-host-kubelet\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:09.920153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919848 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-systemd-units\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:09.920153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919870 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-host-run-k8s-cni-cncf-io\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:09.920153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919897 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-host-cni-bin\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:09.920153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919912 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d6e0a428-09fd-445c-acb2-6ce08c814474-registration-dir\") pod \"aws-ebs-csi-driver-node-69pss\" (UID: \"d6e0a428-09fd-445c-acb2-6ce08c814474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:09.920153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919937 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-host-run-multus-certs\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:09.920153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919960 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/040a8ea6-253e-48ad-830f-7c3b998ba519-etc-tuned\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:09.920153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919979 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-host-cni-netd\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:09.920153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.919998 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85ab2a66-354c-455f-969e-7d7a217ca9c1-cnibin\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:09.920677 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.920022 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-lvjh4\" (UniqueName: \"kubernetes.io/projected/040a8ea6-253e-48ad-830f-7c3b998ba519-kube-api-access-lvjh4\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:09.920677 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.920042 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:09.920677 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.920058 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1cded27-42c6-4394-b60f-57b5fef447b7-ovn-node-metrics-cert\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:09.920677 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.920072 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-multus-socket-dir-parent\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:09.920677 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.920094 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-host-var-lib-cni-bin\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:09.920677 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.920126 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/53da2f80-8416-4455-b359-ebfaa5551fda-multus-daemon-config\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:09.920677 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.920139 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-host\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:09.920677 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.920152 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28f5e1b6-a011-45ca-827e-67a6eda59895-host\") pod \"node-ca-86lxn\" (UID: \"28f5e1b6-a011-45ca-827e-67a6eda59895\") " pod="openshift-image-registry/node-ca-86lxn" Jul 09 17:28:09.920677 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.920171 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-host-var-lib-cni-multus\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:09.920677 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.920217 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d6e0a428-09fd-445c-acb2-6ce08c814474-sys-fs\") pod \"aws-ebs-csi-driver-node-69pss\" (UID: \"d6e0a428-09fd-445c-acb2-6ce08c814474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:09.920677 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.920252 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-host-var-lib-kubelet\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:09.920677 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.920280 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-etc-sysconfig\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:09.920677 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.920310 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-host-run-netns\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:09.920677 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.920330 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-host-run-ovn-kubernetes\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:09.933374 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.933357 2565 warnings.go:110] "Warning: metadata.name: this is used in the Pod's hostname, which can result in surprising behavior; a DNS label is recommended: [must not contain dots]" Jul 09 17:28:09.933661 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.933645 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal"] Jul 09 17:28:09.954559 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:09.954535 2565 desired_state_of_world_populator.go:154] "Finished populating initial desired state of world" Jul 09 17:28:10.020974 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.020936 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lvjh4\" (UniqueName: \"kubernetes.io/projected/040a8ea6-253e-48ad-830f-7c3b998ba519-kube-api-access-lvjh4\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.020974 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.020980 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.021212 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021009 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1cded27-42c6-4394-b60f-57b5fef447b7-ovn-node-metrics-cert\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.021212 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021031 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-multus-socket-dir-parent\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.021212 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021050 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-host-var-lib-cni-bin\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.021212 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021066 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/53da2f80-8416-4455-b359-ebfaa5551fda-multus-daemon-config\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.021212 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021068 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-networks-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-host-var-lib-cni-networks-ovn-kubernetes\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.021212 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021085 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-host\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.021212 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021126 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28f5e1b6-a011-45ca-827e-67a6eda59895-host\") pod \"node-ca-86lxn\" (UID: \"28f5e1b6-a011-45ca-827e-67a6eda59895\") " pod="openshift-image-registry/node-ca-86lxn" Jul 09 17:28:10.021212 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021134 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-host\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.021212 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021155 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-host-var-lib-cni-multus\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.021212 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021180 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d6e0a428-09fd-445c-acb2-6ce08c814474-sys-fs\") pod \"aws-ebs-csi-driver-node-69pss\" (UID: \"d6e0a428-09fd-445c-acb2-6ce08c814474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:10.021212 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021206 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-host-var-lib-kubelet\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.021212 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021213 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-socket-dir-parent\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-multus-socket-dir-parent\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.021750 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021230 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-etc-sysconfig\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.021750 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021253 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-host-run-netns\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.021750 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021256 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-multus\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-host-var-lib-cni-multus\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.021750 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021276 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-host-run-ovn-kubernetes\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.021750 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021293 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host\" (UniqueName: \"kubernetes.io/host-path/28f5e1b6-a011-45ca-827e-67a6eda59895-host\") pod \"node-ca-86lxn\" (UID: \"28f5e1b6-a011-45ca-827e-67a6eda59895\") " pod="openshift-image-registry/node-ca-86lxn" Jul 09 17:28:10.021750 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021300 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e1cded27-42c6-4394-b60f-57b5fef447b7-env-overrides\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.021750 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021327 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85ab2a66-354c-455f-969e-7d7a217ca9c1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:10.021750 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021354 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys-fs\" (UniqueName: \"kubernetes.io/host-path/d6e0a428-09fd-445c-acb2-6ce08c814474-sys-fs\") pod \"aws-ebs-csi-driver-node-69pss\" (UID: \"d6e0a428-09fd-445c-acb2-6ce08c814474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:10.021750 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021352 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/85ab2a66-354c-455f-969e-7d7a217ca9c1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:10.021750 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021393 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-9fkr4\" (UniqueName: \"kubernetes.io/projected/85ab2a66-354c-455f-969e-7d7a217ca9c1-kube-api-access-9fkr4\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:10.021750 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021422 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mstwd\" (UniqueName: \"kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd\") pod \"network-check-target-xnjp4\" (UID: \"3f81edf7-c666-416f-9cdf-99917a6759cd\") " pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:10.021750 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021449 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/837c9eb0-e736-47fc-a02e-daa26056d0fe-tmp-dir\") pod \"node-resolver-w4fk8\" (UID: \"837c9eb0-e736-47fc-a02e-daa26056d0fe\") " pod="openshift-dns/node-resolver-w4fk8" Jul 09 17:28:10.021750 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021473 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs\") pod \"network-metrics-daemon-ggmkn\" (UID: \"8c6c5488-442d-41ea-b935-31c21f226a7c\") " pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:10.021750 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021498 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret\") pod \"global-pull-secret-syncer-gnf2w\" (UID: \"50daa15b-9979-4a9f-a901-28e3d607c74e\") " pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:10.021750 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021522 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-multus-conf-dir\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.021750 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021510 2565 swap_util.go:74] "error creating dir to test if tmpfs noswap is enabled. Assuming not supported" mount path="" error="stat /var/lib/kubelet/plugins/kubernetes.io/empty-dir: no such file or directory" Jul 09 17:28:10.021750 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021552 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kxd57\" (UniqueName: \"kubernetes.io/projected/53da2f80-8416-4455-b359-ebfaa5551fda-kube-api-access-kxd57\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.022533 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021576 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-etc-sysctl-conf\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.022533 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021600 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-var-lib-openvswitch\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.022533 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021623 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-run-ovn\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.022533 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021646 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-os-release\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.022533 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021670 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53da2f80-8416-4455-b359-ebfaa5551fda-cni-binary-copy\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.022533 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:10.021700 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:28:10.022533 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:10.021833 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs podName:8c6c5488-442d-41ea-b935-31c21f226a7c nodeName:}" failed. No retries permitted until 2026-07-09 17:28:10.521809584 +0000 UTC m=+3.578278092 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs") pod "network-metrics-daemon-ggmkn" (UID: "8c6c5488-442d-41ea-b935-31c21f226a7c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:28:10.022533 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021836 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-cni-bin\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-host-var-lib-cni-bin\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.022533 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021850 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-daemon-config\" (UniqueName: \"kubernetes.io/configmap/53da2f80-8416-4455-b359-ebfaa5551fda-multus-daemon-config\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.022533 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021909 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"whereabouts-flatfile-configmap\" (UniqueName: \"kubernetes.io/configmap/85ab2a66-354c-455f-969e-7d7a217ca9c1-whereabouts-flatfile-configmap\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:10.022533 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:10.021960 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 17:28:10.022533 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021997 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-conf\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-etc-sysctl-conf\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.022533 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022007 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-ovn-kubernetes\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-host-run-ovn-kubernetes\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.022533 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022043 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-host-var-lib-kubelet\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.022533 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:10.022055 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret podName:50daa15b-9979-4a9f-a901-28e3d607c74e nodeName:}" failed. No retries permitted until 2026-07-09 17:28:10.522038781 +0000 UTC m=+3.578507272 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret") pod "global-pull-secret-syncer-gnf2w" (UID: "50daa15b-9979-4a9f-a901-28e3d607c74e") : object "kube-system"/"original-pull-secret" not registered Jul 09 17:28:10.022533 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021702 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/61cd09b0-79ba-4423-b79b-15b8281effa0-konnectivity-ca\") pod \"konnectivity-agent-qdmzx\" (UID: \"61cd09b0-79ba-4423-b79b-15b8281effa0\") " pod="kube-system/konnectivity-agent-qdmzx" Jul 09 17:28:10.022533 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022067 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysconfig\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-etc-sysconfig\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.023245 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022075 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tuning-conf-dir\" (UniqueName: \"kubernetes.io/host-path/85ab2a66-354c-455f-969e-7d7a217ca9c1-tuning-conf-dir\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:10.023245 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022091 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-conf-dir\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-multus-conf-dir\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.023245 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022094 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-etc-sysctl-d\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.023245 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022132 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-lib-modules\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.023245 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022157 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/040a8ea6-253e-48ad-830f-7c3b998ba519-tmp\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.023245 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022179 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85ab2a66-354c-455f-969e-7d7a217ca9c1-os-release\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:10.023245 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022186 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-sysctl-d\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-etc-sysctl-d\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.023245 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022203 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/28f5e1b6-a011-45ca-827e-67a6eda59895-serviceca\") pod \"node-ca-86lxn\" (UID: \"28f5e1b6-a011-45ca-827e-67a6eda59895\") " pod="openshift-image-registry/node-ca-86lxn" Jul 09 17:28:10.023245 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022208 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"konnectivity-ca\" (UniqueName: \"kubernetes.io/configmap/61cd09b0-79ba-4423-b79b-15b8281effa0-konnectivity-ca\") pod \"konnectivity-agent-qdmzx\" (UID: \"61cd09b0-79ba-4423-b79b-15b8281effa0\") " pod="kube-system/konnectivity-agent-qdmzx" Jul 09 17:28:10.023245 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022226 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-lrjkf\" (UniqueName: \"kubernetes.io/projected/28f5e1b6-a011-45ca-827e-67a6eda59895-kube-api-access-lrjkf\") pod \"node-ca-86lxn\" (UID: \"28f5e1b6-a011-45ca-827e-67a6eda59895\") " pod="openshift-image-registry/node-ca-86lxn" Jul 09 17:28:10.023245 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022251 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vvtrx\" (UniqueName: \"kubernetes.io/projected/8c6c5488-442d-41ea-b935-31c21f226a7c-kube-api-access-vvtrx\") pod \"network-metrics-daemon-ggmkn\" (UID: \"8c6c5488-442d-41ea-b935-31c21f226a7c\") " pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:10.023245 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022259 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/837c9eb0-e736-47fc-a02e-daa26056d0fe-tmp-dir\") pod \"node-resolver-w4fk8\" (UID: \"837c9eb0-e736-47fc-a02e-daa26056d0fe\") " pod="openshift-dns/node-resolver-w4fk8" Jul 09 17:28:10.023245 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022274 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-run\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.023245 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022290 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-ovn\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-run-ovn\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.023245 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022303 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-lib-modules\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.023245 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022309 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-sys\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.023245 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022315 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-run\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.023245 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.021963 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-host-run-netns\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.023978 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022335 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e1cded27-42c6-4394-b60f-57b5fef447b7-ovnkube-config\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.023978 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022350 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-os-release\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.023978 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022361 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-etc-kubernetes\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.023978 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022259 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-var-lib-openvswitch\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.023978 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022396 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d6e0a428-09fd-445c-acb2-6ce08c814474-socket-dir\") pod \"aws-ebs-csi-driver-node-69pss\" (UID: \"d6e0a428-09fd-445c-acb2-6ce08c814474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:10.023978 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022424 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d6e0a428-09fd-445c-acb2-6ce08c814474-etc-selinux\") pod \"aws-ebs-csi-driver-node-69pss\" (UID: \"d6e0a428-09fd-445c-acb2-6ce08c814474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:10.023978 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022411 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-etc-kubernetes\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.023978 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022451 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-5525b\" (UniqueName: \"kubernetes.io/projected/d6e0a428-09fd-445c-acb2-6ce08c814474-kube-api-access-5525b\") pod \"aws-ebs-csi-driver-node-69pss\" (UID: \"d6e0a428-09fd-445c-acb2-6ce08c814474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:10.023978 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022474 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-run-systemd\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.023978 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022479 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-sys\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.023978 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022497 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/85ab2a66-354c-455f-969e-7d7a217ca9c1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:10.023978 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022501 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"env-overrides\" (UniqueName: \"kubernetes.io/configmap/e1cded27-42c6-4394-b60f-57b5fef447b7-env-overrides\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.023978 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022584 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"os-release\" (UniqueName: \"kubernetes.io/host-path/85ab2a66-354c-455f-969e-7d7a217ca9c1-os-release\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:10.023978 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022628 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"socket-dir\" (UniqueName: \"kubernetes.io/host-path/d6e0a428-09fd-445c-acb2-6ce08c814474-socket-dir\") pod \"aws-ebs-csi-driver-node-69pss\" (UID: \"d6e0a428-09fd-445c-acb2-6ce08c814474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:10.023978 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022671 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-systemd\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-run-systemd\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.023978 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022750 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/53da2f80-8416-4455-b359-ebfaa5551fda-cni-binary-copy\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.023978 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022775 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-selinux\" (UniqueName: \"kubernetes.io/host-path/d6e0a428-09fd-445c-acb2-6ce08c814474-etc-selinux\") pod \"aws-ebs-csi-driver-node-69pss\" (UID: \"d6e0a428-09fd-445c-acb2-6ce08c814474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:10.024824 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022841 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-etc-kubernetes\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.024824 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022900 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-var-lib-kubelet\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.024824 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022908 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serviceca\" (UniqueName: \"kubernetes.io/configmap/28f5e1b6-a011-45ca-827e-67a6eda59895-serviceca\") pod \"node-ca-86lxn\" (UID: \"28f5e1b6-a011-45ca-827e-67a6eda59895\") " pod="openshift-image-registry/node-ca-86lxn" Jul 09 17:28:10.024824 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022947 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-kubernetes\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-etc-kubernetes\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.024824 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022953 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"var-lib-kubelet\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-var-lib-kubelet\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.024824 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022968 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-etc-openvswitch\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.024824 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.022994 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e1cded27-42c6-4394-b60f-57b5fef447b7-ovnkube-script-lib\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.024824 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023016 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-etc-openvswitch\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.024824 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023019 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85ab2a66-354c-455f-969e-7d7a217ca9c1-system-cni-dir\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:10.024824 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023047 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/85ab2a66-354c-455f-969e-7d7a217ca9c1-system-cni-dir\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:10.024824 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023090 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40b1ab68-2d19-4f8e-a360-1dbdc519cb30-host-slash\") pod \"iptables-alerter-khz5w\" (UID: \"40b1ab68-2d19-4f8e-a360-1dbdc519cb30\") " pod="openshift-network-operator/iptables-alerter-khz5w" Jul 09 17:28:10.024824 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023132 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-r6jcg\" (UniqueName: \"kubernetes.io/projected/40b1ab68-2d19-4f8e-a360-1dbdc519cb30-kube-api-access-r6jcg\") pod \"iptables-alerter-khz5w\" (UID: \"40b1ab68-2d19-4f8e-a360-1dbdc519cb30\") " pod="openshift-network-operator/iptables-alerter-khz5w" Jul 09 17:28:10.024824 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023160 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-cnibin\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.024824 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023185 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/50daa15b-9979-4a9f-a901-28e3d607c74e-kubelet-config\") pod \"global-pull-secret-syncer-gnf2w\" (UID: \"50daa15b-9979-4a9f-a901-28e3d607c74e\") " pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:10.024824 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023238 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-cnibin\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.024824 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023245 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-config\" (UniqueName: \"kubernetes.io/configmap/e1cded27-42c6-4394-b60f-57b5fef447b7-ovnkube-config\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.024824 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023262 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/50daa15b-9979-4a9f-a901-28e3d607c74e-dbus\") pod \"global-pull-secret-syncer-gnf2w\" (UID: \"50daa15b-9979-4a9f-a901-28e3d607c74e\") " pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:10.025563 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023293 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-config\" (UniqueName: \"kubernetes.io/host-path/50daa15b-9979-4a9f-a901-28e3d607c74e-kubelet-config\") pod \"global-pull-secret-syncer-gnf2w\" (UID: \"50daa15b-9979-4a9f-a901-28e3d607c74e\") " pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:10.025563 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023304 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-node-log\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.025563 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023340 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-system-cni-dir\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.025563 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023361 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-host-slash\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.025563 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023368 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dbus\" (UniqueName: \"kubernetes.io/host-path/50daa15b-9979-4a9f-a901-28e3d607c74e-dbus\") pod \"global-pull-secret-syncer-gnf2w\" (UID: \"50daa15b-9979-4a9f-a901-28e3d607c74e\") " pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:10.025563 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023394 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-host-slash\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.025563 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023408 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-log\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-node-log\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.025563 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023419 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/40b1ab68-2d19-4f8e-a360-1dbdc519cb30-iptables-alerter-script\") pod \"iptables-alerter-khz5w\" (UID: \"40b1ab68-2d19-4f8e-a360-1dbdc519cb30\") " pod="openshift-network-operator/iptables-alerter-khz5w" Jul 09 17:28:10.025563 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023438 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovnkube-script-lib\" (UniqueName: \"kubernetes.io/configmap/e1cded27-42c6-4394-b60f-57b5fef447b7-ovnkube-script-lib\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.025563 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023446 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/61cd09b0-79ba-4423-b79b-15b8281effa0-agent-certs\") pod \"konnectivity-agent-qdmzx\" (UID: \"61cd09b0-79ba-4423-b79b-15b8281effa0\") " pod="kube-system/konnectivity-agent-qdmzx" Jul 09 17:28:10.025563 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023481 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-etc-modprobe-d\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.025563 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023451 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"system-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-system-cni-dir\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.025563 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023603 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7h8fc\" (UniqueName: \"kubernetes.io/projected/837c9eb0-e736-47fc-a02e-daa26056d0fe-kube-api-access-7h8fc\") pod \"node-resolver-w4fk8\" (UID: \"837c9eb0-e736-47fc-a02e-daa26056d0fe\") " pod="openshift-dns/node-resolver-w4fk8" Jul 09 17:28:10.025563 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023630 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-run-openvswitch\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.025563 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023659 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-log-socket\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.025563 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023661 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-modprobe-d\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-etc-modprobe-d\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.025563 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023691 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/837c9eb0-e736-47fc-a02e-daa26056d0fe-hosts-file\") pod \"node-resolver-w4fk8\" (UID: \"837c9eb0-e736-47fc-a02e-daa26056d0fe\") " pod="openshift-dns/node-resolver-w4fk8" Jul 09 17:28:10.025563 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023710 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"log-socket\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-log-socket\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.026362 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023717 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-multus-cni-dir\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.026362 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023748 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"run-openvswitch\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-run-openvswitch\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.026362 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023744 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-host-run-netns\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.026362 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023800 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-hostroot\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.026362 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023809 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-sysctl-allowlist\" (UniqueName: \"kubernetes.io/configmap/85ab2a66-354c-455f-969e-7d7a217ca9c1-cni-sysctl-allowlist\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:10.026362 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023826 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-etc-systemd\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.026362 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023803 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hosts-file\" (UniqueName: \"kubernetes.io/host-path/837c9eb0-e736-47fc-a02e-daa26056d0fe-hosts-file\") pod \"node-resolver-w4fk8\" (UID: \"837c9eb0-e736-47fc-a02e-daa26056d0fe\") " pod="openshift-dns/node-resolver-w4fk8" Jul 09 17:28:10.026362 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023839 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"multus-cni-dir\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-multus-cni-dir\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.026362 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023851 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-2v6cg\" (UniqueName: \"kubernetes.io/projected/e1cded27-42c6-4394-b60f-57b5fef447b7-kube-api-access-2v6cg\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.026362 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023859 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"hostroot\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-hostroot\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.026362 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023871 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-systemd\" (UniqueName: \"kubernetes.io/host-path/040a8ea6-253e-48ad-830f-7c3b998ba519-etc-systemd\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.026362 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023877 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85ab2a66-354c-455f-969e-7d7a217ca9c1-cni-binary-copy\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:10.026362 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023896 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-netns\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-host-run-netns\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.026362 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023907 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d6e0a428-09fd-445c-acb2-6ce08c814474-kubelet-dir\") pod \"aws-ebs-csi-driver-node-69pss\" (UID: \"d6e0a428-09fd-445c-acb2-6ce08c814474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:10.026362 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023930 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d6e0a428-09fd-445c-acb2-6ce08c814474-device-dir\") pod \"aws-ebs-csi-driver-node-69pss\" (UID: \"d6e0a428-09fd-445c-acb2-6ce08c814474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:10.026362 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023981 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"device-dir\" (UniqueName: \"kubernetes.io/host-path/d6e0a428-09fd-445c-acb2-6ce08c814474-device-dir\") pod \"aws-ebs-csi-driver-node-69pss\" (UID: \"d6e0a428-09fd-445c-acb2-6ce08c814474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:10.026362 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.023989 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kubelet-dir\" (UniqueName: \"kubernetes.io/host-path/d6e0a428-09fd-445c-acb2-6ce08c814474-kubelet-dir\") pod \"aws-ebs-csi-driver-node-69pss\" (UID: \"d6e0a428-09fd-445c-acb2-6ce08c814474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:10.026362 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.024019 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-host-kubelet\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.027153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.024043 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-systemd-units\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.027153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.024053 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-kubelet\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-host-kubelet\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.027153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.024072 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-host-run-k8s-cni-cncf-io\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.027153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.024092 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"systemd-units\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-systemd-units\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.027153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.024095 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-host-cni-bin\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.027153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.024121 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d6e0a428-09fd-445c-acb2-6ce08c814474-registration-dir\") pod \"aws-ebs-csi-driver-node-69pss\" (UID: \"d6e0a428-09fd-445c-acb2-6ce08c814474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:10.027153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.024129 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-k8s-cni-cncf-io\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-host-run-k8s-cni-cncf-io\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.027153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.024148 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-host-run-multus-certs\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.027153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.024173 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/040a8ea6-253e-48ad-830f-7c3b998ba519-etc-tuned\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.027153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.024182 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"registration-dir\" (UniqueName: \"kubernetes.io/host-path/d6e0a428-09fd-445c-acb2-6ce08c814474-registration-dir\") pod \"aws-ebs-csi-driver-node-69pss\" (UID: \"d6e0a428-09fd-445c-acb2-6ce08c814474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:10.027153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.024148 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-bin\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-host-cni-bin\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.027153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.024197 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-host-cni-netd\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.027153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.024235 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-run-multus-certs\" (UniqueName: \"kubernetes.io/host-path/53da2f80-8416-4455-b359-ebfaa5551fda-host-run-multus-certs\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.027153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.024250 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-cni-netd\" (UniqueName: \"kubernetes.io/host-path/e1cded27-42c6-4394-b60f-57b5fef447b7-host-cni-netd\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.027153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.024263 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85ab2a66-354c-455f-969e-7d7a217ca9c1-cnibin\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:10.027153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.024309 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cni-binary-copy\" (UniqueName: \"kubernetes.io/configmap/85ab2a66-354c-455f-969e-7d7a217ca9c1-cni-binary-copy\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:10.027153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.024327 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cnibin\" (UniqueName: \"kubernetes.io/host-path/85ab2a66-354c-455f-969e-7d7a217ca9c1-cnibin\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:10.027933 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.026249 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/040a8ea6-253e-48ad-830f-7c3b998ba519-tmp\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.027933 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.026352 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"ovn-node-metrics-cert\" (UniqueName: \"kubernetes.io/secret/e1cded27-42c6-4394-b60f-57b5fef447b7-ovn-node-metrics-cert\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.027933 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.026506 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"agent-certs\" (UniqueName: \"kubernetes.io/secret/61cd09b0-79ba-4423-b79b-15b8281effa0-agent-certs\") pod \"konnectivity-agent-qdmzx\" (UID: \"61cd09b0-79ba-4423-b79b-15b8281effa0\") " pod="kube-system/konnectivity-agent-qdmzx" Jul 09 17:28:10.028215 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.028196 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"etc-tuned\" (UniqueName: \"kubernetes.io/empty-dir/040a8ea6-253e-48ad-830f-7c3b998ba519-etc-tuned\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.034750 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.034732 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kxd57\" (UniqueName: \"kubernetes.io/projected/53da2f80-8416-4455-b359-ebfaa5551fda-kube-api-access-kxd57\") pod \"multus-lgw9p\" (UID: \"53da2f80-8416-4455-b359-ebfaa5551fda\") " pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.039614 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.039591 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-5525b\" (UniqueName: \"kubernetes.io/projected/d6e0a428-09fd-445c-acb2-6ce08c814474-kube-api-access-5525b\") pod \"aws-ebs-csi-driver-node-69pss\" (UID: \"d6e0a428-09fd-445c-acb2-6ce08c814474\") " pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:10.040537 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.040513 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-9fkr4\" (UniqueName: \"kubernetes.io/projected/85ab2a66-354c-455f-969e-7d7a217ca9c1-kube-api-access-9fkr4\") pod \"multus-additional-cni-plugins-l9l84\" (UID: \"85ab2a66-354c-455f-969e-7d7a217ca9c1\") " pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:10.040655 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.040577 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lrjkf\" (UniqueName: \"kubernetes.io/projected/28f5e1b6-a011-45ca-827e-67a6eda59895-kube-api-access-lrjkf\") pod \"node-ca-86lxn\" (UID: \"28f5e1b6-a011-45ca-827e-67a6eda59895\") " pod="openshift-image-registry/node-ca-86lxn" Jul 09 17:28:10.040951 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.040928 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vvtrx\" (UniqueName: \"kubernetes.io/projected/8c6c5488-442d-41ea-b935-31c21f226a7c-kube-api-access-vvtrx\") pod \"network-metrics-daemon-ggmkn\" (UID: \"8c6c5488-442d-41ea-b935-31c21f226a7c\") " pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:10.041031 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.040964 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7h8fc\" (UniqueName: \"kubernetes.io/projected/837c9eb0-e736-47fc-a02e-daa26056d0fe-kube-api-access-7h8fc\") pod \"node-resolver-w4fk8\" (UID: \"837c9eb0-e736-47fc-a02e-daa26056d0fe\") " pod="openshift-dns/node-resolver-w4fk8" Jul 09 17:28:10.041694 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.041669 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-lvjh4\" (UniqueName: \"kubernetes.io/projected/040a8ea6-253e-48ad-830f-7c3b998ba519-kube-api-access-lvjh4\") pod \"tuned-hhdf7\" (UID: \"040a8ea6-253e-48ad-830f-7c3b998ba519\") " pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.042442 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.042421 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-2v6cg\" (UniqueName: \"kubernetes.io/projected/e1cded27-42c6-4394-b60f-57b5fef447b7-kube-api-access-2v6cg\") pod \"ovnkube-node-8wn62\" (UID: \"e1cded27-42c6-4394-b60f-57b5fef447b7\") " pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.125604 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.125527 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mstwd\" (UniqueName: \"kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd\") pod \"network-check-target-xnjp4\" (UID: \"3f81edf7-c666-416f-9cdf-99917a6759cd\") " pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:10.125604 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.125590 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40b1ab68-2d19-4f8e-a360-1dbdc519cb30-host-slash\") pod \"iptables-alerter-khz5w\" (UID: \"40b1ab68-2d19-4f8e-a360-1dbdc519cb30\") " pod="openshift-network-operator/iptables-alerter-khz5w" Jul 09 17:28:10.125604 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.125607 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-r6jcg\" (UniqueName: \"kubernetes.io/projected/40b1ab68-2d19-4f8e-a360-1dbdc519cb30-kube-api-access-r6jcg\") pod \"iptables-alerter-khz5w\" (UID: \"40b1ab68-2d19-4f8e-a360-1dbdc519cb30\") " pod="openshift-network-operator/iptables-alerter-khz5w" Jul 09 17:28:10.125873 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.125624 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/40b1ab68-2d19-4f8e-a360-1dbdc519cb30-iptables-alerter-script\") pod \"iptables-alerter-khz5w\" (UID: \"40b1ab68-2d19-4f8e-a360-1dbdc519cb30\") " pod="openshift-network-operator/iptables-alerter-khz5w" Jul 09 17:28:10.125873 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.125724 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"host-slash\" (UniqueName: \"kubernetes.io/host-path/40b1ab68-2d19-4f8e-a360-1dbdc519cb30-host-slash\") pod \"iptables-alerter-khz5w\" (UID: \"40b1ab68-2d19-4f8e-a360-1dbdc519cb30\") " pod="openshift-network-operator/iptables-alerter-khz5w" Jul 09 17:28:10.126094 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.126079 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"iptables-alerter-script\" (UniqueName: \"kubernetes.io/configmap/40b1ab68-2d19-4f8e-a360-1dbdc519cb30-iptables-alerter-script\") pod \"iptables-alerter-khz5w\" (UID: \"40b1ab68-2d19-4f8e-a360-1dbdc519cb30\") " pod="openshift-network-operator/iptables-alerter-khz5w" Jul 09 17:28:10.131709 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:10.131687 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 17:28:10.131709 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:10.131710 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 17:28:10.131892 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:10.131720 2565 projected.go:196] Error preparing data for projected volume kube-api-access-mstwd for pod openshift-network-diagnostics/network-check-target-xnjp4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:28:10.131892 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:10.131789 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd podName:3f81edf7-c666-416f-9cdf-99917a6759cd nodeName:}" failed. No retries permitted until 2026-07-09 17:28:10.631775373 +0000 UTC m=+3.688243866 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-mstwd" (UniqueName: "kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd") pod "network-check-target-xnjp4" (UID: "3f81edf7-c666-416f-9cdf-99917a6759cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:28:10.132989 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.132969 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-r6jcg\" (UniqueName: \"kubernetes.io/projected/40b1ab68-2d19-4f8e-a360-1dbdc519cb30-kube-api-access-r6jcg\") pod \"iptables-alerter-khz5w\" (UID: \"40b1ab68-2d19-4f8e-a360-1dbdc519cb30\") " pod="openshift-network-operator/iptables-alerter-khz5w" Jul 09 17:28:10.148533 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.148511 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/konnectivity-agent-qdmzx" Jul 09 17:28:10.153898 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.153880 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" Jul 09 17:28:10.160702 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:10.160602 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod61cd09b0_79ba_4423_b79b_15b8281effa0.slice/crio-a1ebd14cff820632e23a7df61efa46301b181380fab0e4be12305b7477e3952e WatchSource:0}: Error finding container a1ebd14cff820632e23a7df61efa46301b181380fab0e4be12305b7477e3952e: Status 404 returned error can't find the container with id a1ebd14cff820632e23a7df61efa46301b181380fab0e4be12305b7477e3952e Jul 09 17:28:10.162099 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.162080 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/node-resolver-w4fk8" Jul 09 17:28:10.163239 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:10.163215 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod040a8ea6_253e_48ad_830f_7c3b998ba519.slice/crio-510ae1e2a311bfbe31b95aed5d5e3a5a0dadc6e27fb83178829ef7cfb891d6e4 WatchSource:0}: Error finding container 510ae1e2a311bfbe31b95aed5d5e3a5a0dadc6e27fb83178829ef7cfb891d6e4: Status 404 returned error can't find the container with id 510ae1e2a311bfbe31b95aed5d5e3a5a0dadc6e27fb83178829ef7cfb891d6e4 Jul 09 17:28:10.166979 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.166924 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-image-registry/node-ca-86lxn" Jul 09 17:28:10.173157 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.173130 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:10.174502 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:10.174476 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod837c9eb0_e736_47fc_a02e_daa26056d0fe.slice/crio-46b6da225615e42282be178fe4f9298ed15dfbb7acd940de72111f40e4a00aa3 WatchSource:0}: Error finding container 46b6da225615e42282be178fe4f9298ed15dfbb7acd940de72111f40e4a00aa3: Status 404 returned error can't find the container with id 46b6da225615e42282be178fe4f9298ed15dfbb7acd940de72111f40e4a00aa3 Jul 09 17:28:10.178318 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.178296 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" Jul 09 17:28:10.179607 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:10.179578 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod28f5e1b6_a011_45ca_827e_67a6eda59895.slice/crio-79f3df50fa05f2f8c328856f4bf93daa86317f94fc0bc15733c2545f57956f4b WatchSource:0}: Error finding container 79f3df50fa05f2f8c328856f4bf93daa86317f94fc0bc15733c2545f57956f4b: Status 404 returned error can't find the container with id 79f3df50fa05f2f8c328856f4bf93daa86317f94fc0bc15733c2545f57956f4b Jul 09 17:28:10.184867 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.184743 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-additional-cni-plugins-l9l84" Jul 09 17:28:10.186296 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:10.186272 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode1cded27_42c6_4394_b60f_57b5fef447b7.slice/crio-683ff9cb55dd7f5c06bb9cc8f7765073392b8643d6628ce21a2962af440d54a2 WatchSource:0}: Error finding container 683ff9cb55dd7f5c06bb9cc8f7765073392b8643d6628ce21a2962af440d54a2: Status 404 returned error can't find the container with id 683ff9cb55dd7f5c06bb9cc8f7765073392b8643d6628ce21a2962af440d54a2 Jul 09 17:28:10.188730 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:10.188706 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6e0a428_09fd_445c_acb2_6ce08c814474.slice/crio-5796f35d9f53adde6f9a4252e460ff27f9bdb67447e5d504c5d62e2ad01b5067 WatchSource:0}: Error finding container 5796f35d9f53adde6f9a4252e460ff27f9bdb67447e5d504c5d62e2ad01b5067: Status 404 returned error can't find the container with id 5796f35d9f53adde6f9a4252e460ff27f9bdb67447e5d504c5d62e2ad01b5067 Jul 09 17:28:10.190362 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.190342 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/multus-lgw9p" Jul 09 17:28:10.194724 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.194695 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-operator/iptables-alerter-khz5w" Jul 09 17:28:10.195024 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:10.195006 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod85ab2a66_354c_455f_969e_7d7a217ca9c1.slice/crio-d81ea964369d2311956aa44975228416fb5a0a25c35f246b146fa2c4e4c9c6db WatchSource:0}: Error finding container d81ea964369d2311956aa44975228416fb5a0a25c35f246b146fa2c4e4c9c6db: Status 404 returned error can't find the container with id d81ea964369d2311956aa44975228416fb5a0a25c35f246b146fa2c4e4c9c6db Jul 09 17:28:10.203541 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:10.203511 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod53da2f80_8416_4455_b359_ebfaa5551fda.slice/crio-08486aaef773ca18f463c31b8de6a86e4df6973e10f8d58fad9cca6e25c4e9ce WatchSource:0}: Error finding container 08486aaef773ca18f463c31b8de6a86e4df6973e10f8d58fad9cca6e25c4e9ce: Status 404 returned error can't find the container with id 08486aaef773ca18f463c31b8de6a86e4df6973e10f8d58fad9cca6e25c4e9ce Jul 09 17:28:10.207032 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:28:10.207011 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod40b1ab68_2d19_4f8e_a360_1dbdc519cb30.slice/crio-8ec1bbcc1c8e6682f367bdb50b93e3010d689b0340bbff5e69698139fc964c73 WatchSource:0}: Error finding container 8ec1bbcc1c8e6682f367bdb50b93e3010d689b0340bbff5e69698139fc964c73: Status 404 returned error can't find the container with id 8ec1bbcc1c8e6682f367bdb50b93e3010d689b0340bbff5e69698139fc964c73 Jul 09 17:28:10.528930 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.528839 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs\") pod \"network-metrics-daemon-ggmkn\" (UID: \"8c6c5488-442d-41ea-b935-31c21f226a7c\") " pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:10.528930 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.528891 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret\") pod \"global-pull-secret-syncer-gnf2w\" (UID: \"50daa15b-9979-4a9f-a901-28e3d607c74e\") " pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:10.529635 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:10.529022 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 17:28:10.529635 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:10.529084 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret podName:50daa15b-9979-4a9f-a901-28e3d607c74e nodeName:}" failed. No retries permitted until 2026-07-09 17:28:11.529065912 +0000 UTC m=+4.585534402 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret") pod "global-pull-secret-syncer-gnf2w" (UID: "50daa15b-9979-4a9f-a901-28e3d607c74e") : object "kube-system"/"original-pull-secret" not registered Jul 09 17:28:10.529635 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:10.529144 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:28:10.529635 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:10.529174 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs podName:8c6c5488-442d-41ea-b935-31c21f226a7c nodeName:}" failed. No retries permitted until 2026-07-09 17:28:11.529163352 +0000 UTC m=+4.585631834 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs") pod "network-metrics-daemon-ggmkn" (UID: "8c6c5488-442d-41ea-b935-31c21f226a7c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:28:10.731272 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.731016 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mstwd\" (UniqueName: \"kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd\") pod \"network-check-target-xnjp4\" (UID: \"3f81edf7-c666-416f-9cdf-99917a6759cd\") " pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:10.731272 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:10.731228 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 17:28:10.731272 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:10.731249 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 17:28:10.731272 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:10.731262 2565 projected.go:196] Error preparing data for projected volume kube-api-access-mstwd for pod openshift-network-diagnostics/network-check-target-xnjp4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:28:10.731549 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:10.731330 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd podName:3f81edf7-c666-416f-9cdf-99917a6759cd nodeName:}" failed. No retries permitted until 2026-07-09 17:28:11.731310638 +0000 UTC m=+4.787779122 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-api-access-mstwd" (UniqueName: "kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd") pod "network-check-target-xnjp4" (UID: "3f81edf7-c666-416f-9cdf-99917a6759cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:28:10.826387 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.826304 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-khz5w" event={"ID":"40b1ab68-2d19-4f8e-a360-1dbdc519cb30","Type":"ContainerStarted","Data":"8ec1bbcc1c8e6682f367bdb50b93e3010d689b0340bbff5e69698139fc964c73"} Jul 09 17:28:10.827820 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.827789 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" event={"ID":"d6e0a428-09fd-445c-acb2-6ce08c814474","Type":"ContainerStarted","Data":"5796f35d9f53adde6f9a4252e460ff27f9bdb67447e5d504c5d62e2ad01b5067"} Jul 09 17:28:10.829036 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.829007 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w4fk8" event={"ID":"837c9eb0-e736-47fc-a02e-daa26056d0fe","Type":"ContainerStarted","Data":"46b6da225615e42282be178fe4f9298ed15dfbb7acd940de72111f40e4a00aa3"} Jul 09 17:28:10.830234 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.830186 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qdmzx" event={"ID":"61cd09b0-79ba-4423-b79b-15b8281effa0","Type":"ContainerStarted","Data":"a1ebd14cff820632e23a7df61efa46301b181380fab0e4be12305b7477e3952e"} Jul 09 17:28:10.831397 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.831372 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lgw9p" event={"ID":"53da2f80-8416-4455-b359-ebfaa5551fda","Type":"ContainerStarted","Data":"08486aaef773ca18f463c31b8de6a86e4df6973e10f8d58fad9cca6e25c4e9ce"} Jul 09 17:28:10.832847 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.832824 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9l84" event={"ID":"85ab2a66-354c-455f-969e-7d7a217ca9c1","Type":"ContainerStarted","Data":"d81ea964369d2311956aa44975228416fb5a0a25c35f246b146fa2c4e4c9c6db"} Jul 09 17:28:10.834103 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.834056 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" event={"ID":"e1cded27-42c6-4394-b60f-57b5fef447b7","Type":"ContainerStarted","Data":"683ff9cb55dd7f5c06bb9cc8f7765073392b8643d6628ce21a2962af440d54a2"} Jul 09 17:28:10.835353 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.835329 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-86lxn" event={"ID":"28f5e1b6-a011-45ca-827e-67a6eda59895","Type":"ContainerStarted","Data":"79f3df50fa05f2f8c328856f4bf93daa86317f94fc0bc15733c2545f57956f4b"} Jul 09 17:28:10.836675 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.836653 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" event={"ID":"040a8ea6-253e-48ad-830f-7c3b998ba519","Type":"ContainerStarted","Data":"510ae1e2a311bfbe31b95aed5d5e3a5a0dadc6e27fb83178829ef7cfb891d6e4"} Jul 09 17:28:10.858964 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.858899 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 17:23:09 +0000 UTC" deadline="2028-03-06 06:36:27.801738728 +0000 UTC" Jul 09 17:28:10.858964 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:10.858954 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="14533h8m16.942788885s" Jul 09 17:28:11.502524 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:11.502488 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:11.502717 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:11.502643 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:11.502794 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:11.502746 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:11.502902 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:11.502853 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:11.503035 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:11.502918 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:11.503035 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:11.502982 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:11.537953 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:11.537919 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs\") pod \"network-metrics-daemon-ggmkn\" (UID: \"8c6c5488-442d-41ea-b935-31c21f226a7c\") " pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:11.538424 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:11.537968 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret\") pod \"global-pull-secret-syncer-gnf2w\" (UID: \"50daa15b-9979-4a9f-a901-28e3d607c74e\") " pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:11.538424 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:11.538125 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 17:28:11.538424 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:11.538189 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret podName:50daa15b-9979-4a9f-a901-28e3d607c74e nodeName:}" failed. No retries permitted until 2026-07-09 17:28:13.53816991 +0000 UTC m=+6.594638389 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret") pod "global-pull-secret-syncer-gnf2w" (UID: "50daa15b-9979-4a9f-a901-28e3d607c74e") : object "kube-system"/"original-pull-secret" not registered Jul 09 17:28:11.538424 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:11.538257 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:28:11.538424 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:11.538290 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs podName:8c6c5488-442d-41ea-b935-31c21f226a7c nodeName:}" failed. No retries permitted until 2026-07-09 17:28:13.538277626 +0000 UTC m=+6.594746122 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs") pod "network-metrics-daemon-ggmkn" (UID: "8c6c5488-442d-41ea-b935-31c21f226a7c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:28:11.739954 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:11.739865 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mstwd\" (UniqueName: \"kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd\") pod \"network-check-target-xnjp4\" (UID: \"3f81edf7-c666-416f-9cdf-99917a6759cd\") " pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:11.740206 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:11.740071 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 17:28:11.740206 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:11.740093 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 17:28:11.740206 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:11.740105 2565 projected.go:196] Error preparing data for projected volume kube-api-access-mstwd for pod openshift-network-diagnostics/network-check-target-xnjp4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:28:11.740206 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:11.740176 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd podName:3f81edf7-c666-416f-9cdf-99917a6759cd nodeName:}" failed. No retries permitted until 2026-07-09 17:28:13.740146789 +0000 UTC m=+6.796615269 (durationBeforeRetry 2s). Error: MountVolume.SetUp failed for volume "kube-api-access-mstwd" (UniqueName: "kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd") pod "network-check-target-xnjp4" (UID: "3f81edf7-c666-416f-9cdf-99917a6759cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:28:11.860063 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:11.860001 2565 certificate_manager.go:715] "Certificate rotation deadline determined" logger="kubernetes.io/kubelet-serving" expiration="2028-07-08 17:23:09 +0000 UTC" deadline="2028-03-26 05:34:31.661421186 +0000 UTC" Jul 09 17:28:11.860063 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:11.860042 2565 certificate_manager.go:431] "Waiting for next certificate rotation" logger="kubernetes.io/kubelet-serving" sleep="15012h6m19.801383641s" Jul 09 17:28:13.505233 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:13.502263 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:13.505233 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:13.502387 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:13.505233 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:13.502776 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:13.505233 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:13.502871 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:13.505233 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:13.502921 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:13.505233 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:13.503001 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:13.553708 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:13.553027 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs\") pod \"network-metrics-daemon-ggmkn\" (UID: \"8c6c5488-442d-41ea-b935-31c21f226a7c\") " pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:13.553708 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:13.553074 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret\") pod \"global-pull-secret-syncer-gnf2w\" (UID: \"50daa15b-9979-4a9f-a901-28e3d607c74e\") " pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:13.553708 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:13.553205 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 17:28:13.553708 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:13.553264 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret podName:50daa15b-9979-4a9f-a901-28e3d607c74e nodeName:}" failed. No retries permitted until 2026-07-09 17:28:17.5532472 +0000 UTC m=+10.609715692 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret") pod "global-pull-secret-syncer-gnf2w" (UID: "50daa15b-9979-4a9f-a901-28e3d607c74e") : object "kube-system"/"original-pull-secret" not registered Jul 09 17:28:13.553708 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:13.553635 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:28:13.553708 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:13.553677 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs podName:8c6c5488-442d-41ea-b935-31c21f226a7c nodeName:}" failed. No retries permitted until 2026-07-09 17:28:17.553663612 +0000 UTC m=+10.610132109 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs") pod "network-metrics-daemon-ggmkn" (UID: "8c6c5488-442d-41ea-b935-31c21f226a7c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:28:13.755513 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:13.755428 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mstwd\" (UniqueName: \"kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd\") pod \"network-check-target-xnjp4\" (UID: \"3f81edf7-c666-416f-9cdf-99917a6759cd\") " pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:13.755683 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:13.755629 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 17:28:13.755683 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:13.755652 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 17:28:13.755683 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:13.755663 2565 projected.go:196] Error preparing data for projected volume kube-api-access-mstwd for pod openshift-network-diagnostics/network-check-target-xnjp4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:28:13.755856 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:13.755707 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd podName:3f81edf7-c666-416f-9cdf-99917a6759cd nodeName:}" failed. No retries permitted until 2026-07-09 17:28:17.755693774 +0000 UTC m=+10.812162252 (durationBeforeRetry 4s). Error: MountVolume.SetUp failed for volume "kube-api-access-mstwd" (UniqueName: "kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd") pod "network-check-target-xnjp4" (UID: "3f81edf7-c666-416f-9cdf-99917a6759cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:28:15.505555 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:15.505521 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:15.505555 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:15.505558 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:15.506055 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:15.505647 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:15.506055 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:15.505702 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:15.506055 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:15.505796 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:15.506055 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:15.505874 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:17.502822 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:17.502726 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:17.503235 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:17.502866 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:17.503235 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:17.503230 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:17.503355 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:17.503327 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:17.503418 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:17.503379 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:17.503466 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:17.503447 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:17.584816 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:17.584276 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs\") pod \"network-metrics-daemon-ggmkn\" (UID: \"8c6c5488-442d-41ea-b935-31c21f226a7c\") " pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:17.584816 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:17.584319 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret\") pod \"global-pull-secret-syncer-gnf2w\" (UID: \"50daa15b-9979-4a9f-a901-28e3d607c74e\") " pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:17.584816 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:17.584459 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 17:28:17.584816 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:17.584513 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret podName:50daa15b-9979-4a9f-a901-28e3d607c74e nodeName:}" failed. No retries permitted until 2026-07-09 17:28:25.584496595 +0000 UTC m=+18.640965072 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret") pod "global-pull-secret-syncer-gnf2w" (UID: "50daa15b-9979-4a9f-a901-28e3d607c74e") : object "kube-system"/"original-pull-secret" not registered Jul 09 17:28:17.584816 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:17.584629 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:28:17.584816 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:17.584689 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs podName:8c6c5488-442d-41ea-b935-31c21f226a7c nodeName:}" failed. No retries permitted until 2026-07-09 17:28:25.584676123 +0000 UTC m=+18.641144605 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs") pod "network-metrics-daemon-ggmkn" (UID: "8c6c5488-442d-41ea-b935-31c21f226a7c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:28:17.785395 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:17.785321 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mstwd\" (UniqueName: \"kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd\") pod \"network-check-target-xnjp4\" (UID: \"3f81edf7-c666-416f-9cdf-99917a6759cd\") " pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:17.785535 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:17.785499 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 17:28:17.785535 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:17.785517 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 17:28:17.785535 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:17.785526 2565 projected.go:196] Error preparing data for projected volume kube-api-access-mstwd for pod openshift-network-diagnostics/network-check-target-xnjp4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:28:17.785630 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:17.785575 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd podName:3f81edf7-c666-416f-9cdf-99917a6759cd nodeName:}" failed. No retries permitted until 2026-07-09 17:28:25.785558471 +0000 UTC m=+18.842026971 (durationBeforeRetry 8s). Error: MountVolume.SetUp failed for volume "kube-api-access-mstwd" (UniqueName: "kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd") pod "network-check-target-xnjp4" (UID: "3f81edf7-c666-416f-9cdf-99917a6759cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:28:19.502954 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:19.502876 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:19.502954 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:19.502884 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:19.503635 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:19.503128 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:19.503635 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:19.503123 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:19.503635 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:19.503235 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:19.503635 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:19.503291 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:21.503035 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:21.502999 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:21.503035 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:21.503024 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:21.503522 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:21.502999 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:21.503522 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:21.503149 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:21.503522 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:21.503208 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:21.503522 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:21.503245 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:23.502219 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:23.502183 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:23.502672 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:23.502193 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:23.502672 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:23.502319 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:23.502672 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:23.502316 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:23.502672 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:23.502429 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:23.502672 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:23.502579 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:25.502034 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:25.501994 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:25.502474 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:25.501994 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:25.502474 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:25.502136 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:25.502474 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:25.502168 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:25.502474 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:25.502280 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:25.502474 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:25.502371 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:25.644788 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:25.644741 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs\") pod \"network-metrics-daemon-ggmkn\" (UID: \"8c6c5488-442d-41ea-b935-31c21f226a7c\") " pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:25.644788 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:25.644789 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret\") pod \"global-pull-secret-syncer-gnf2w\" (UID: \"50daa15b-9979-4a9f-a901-28e3d607c74e\") " pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:25.645027 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:25.644904 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 17:28:25.645027 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:25.644924 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:28:25.645027 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:25.644959 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret podName:50daa15b-9979-4a9f-a901-28e3d607c74e nodeName:}" failed. No retries permitted until 2026-07-09 17:28:41.644942375 +0000 UTC m=+34.701410862 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret") pod "global-pull-secret-syncer-gnf2w" (UID: "50daa15b-9979-4a9f-a901-28e3d607c74e") : object "kube-system"/"original-pull-secret" not registered Jul 09 17:28:25.645027 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:25.644989 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs podName:8c6c5488-442d-41ea-b935-31c21f226a7c nodeName:}" failed. No retries permitted until 2026-07-09 17:28:41.644969156 +0000 UTC m=+34.701437637 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs") pod "network-metrics-daemon-ggmkn" (UID: "8c6c5488-442d-41ea-b935-31c21f226a7c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:28:25.846844 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:25.846746 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mstwd\" (UniqueName: \"kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd\") pod \"network-check-target-xnjp4\" (UID: \"3f81edf7-c666-416f-9cdf-99917a6759cd\") " pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:25.846989 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:25.846942 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 17:28:25.846989 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:25.846968 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 17:28:25.846989 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:25.846981 2565 projected.go:196] Error preparing data for projected volume kube-api-access-mstwd for pod openshift-network-diagnostics/network-check-target-xnjp4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:28:25.847099 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:25.847044 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd podName:3f81edf7-c666-416f-9cdf-99917a6759cd nodeName:}" failed. No retries permitted until 2026-07-09 17:28:41.847025302 +0000 UTC m=+34.903493797 (durationBeforeRetry 16s). Error: MountVolume.SetUp failed for volume "kube-api-access-mstwd" (UniqueName: "kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd") pod "network-check-target-xnjp4" (UID: "3f81edf7-c666-416f-9cdf-99917a6759cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:28:27.502837 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:27.502798 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:27.503300 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:27.502840 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:27.503300 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:27.502915 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:27.503300 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:27.502994 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:27.503300 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:27.503044 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:27.503300 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:27.503149 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:29.503004 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.502306 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:29.503004 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.502537 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:29.503004 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:29.502661 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:29.503004 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:29.502732 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:29.503004 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.502812 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:29.503004 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:29.502890 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:29.882518 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.882417 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 17:28:29.882867 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.882846 2565 generic.go:356] "Generic (PLEG): container finished" podID="e1cded27-42c6-4394-b60f-57b5fef447b7" containerID="fb27eb9b883aa6d1ab555cd7ebf871a627af7f4b498a9ae30daa43eb2121a37b" exitCode=1 Jul 09 17:28:29.882940 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.882917 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" event={"ID":"e1cded27-42c6-4394-b60f-57b5fef447b7","Type":"ContainerStarted","Data":"0014decab7309e5554ffacf87a5c7597c2a3698053e18f608144a3c6b8d584eb"} Jul 09 17:28:29.883021 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.883010 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" event={"ID":"e1cded27-42c6-4394-b60f-57b5fef447b7","Type":"ContainerStarted","Data":"410059ac278dc6ae55239734547a3c1d39f6c793132aa7db7440022e53188809"} Jul 09 17:28:29.883058 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.883043 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" event={"ID":"e1cded27-42c6-4394-b60f-57b5fef447b7","Type":"ContainerDied","Data":"fb27eb9b883aa6d1ab555cd7ebf871a627af7f4b498a9ae30daa43eb2121a37b"} Jul 09 17:28:29.883095 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.883073 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" event={"ID":"e1cded27-42c6-4394-b60f-57b5fef447b7","Type":"ContainerStarted","Data":"15fe86b452b68af2aea2a553eb51b0dd184489c26e1efbd4ca964f34ea191397"} Jul 09 17:28:29.884120 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.884099 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-image-registry/node-ca-86lxn" event={"ID":"28f5e1b6-a011-45ca-827e-67a6eda59895","Type":"ContainerStarted","Data":"15b28aa148305a06f3c3c46c5d0ce7f25aba848cbac7ed9f382c25f925bdd3a7"} Jul 09 17:28:29.885297 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.885274 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" event={"ID":"040a8ea6-253e-48ad-830f-7c3b998ba519","Type":"ContainerStarted","Data":"fe1ec1013cce0a4e9bc468a0476ddbf48dea869e40d34edf8f20c45eb63035b4"} Jul 09 17:28:29.886478 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.886461 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal" event={"ID":"27ecca423593db51774231555b49ec3d","Type":"ContainerStarted","Data":"bc38298c4be03fb387d7517c95ceb26e45f8c73b67aa2af8524cce61bb146d80"} Jul 09 17:28:29.887708 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.887690 2565 generic.go:356] "Generic (PLEG): container finished" podID="0492d2bb9219188cc82326a2f44b03e5" containerID="130700af7d6ed96aacb2b07c2d97c21e5eeec5f42c0a244222d57f499ce1db31" exitCode=0 Jul 09 17:28:29.887797 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.887752 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal" event={"ID":"0492d2bb9219188cc82326a2f44b03e5","Type":"ContainerDied","Data":"130700af7d6ed96aacb2b07c2d97c21e5eeec5f42c0a244222d57f499ce1db31"} Jul 09 17:28:29.889025 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.888975 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" event={"ID":"d6e0a428-09fd-445c-acb2-6ce08c814474","Type":"ContainerStarted","Data":"7fb8fa08775ec1b2b04b7f4ae327fb6f0b9b0be84be61f470be12623a2ea61a0"} Jul 09 17:28:29.890625 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.890606 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/node-resolver-w4fk8" event={"ID":"837c9eb0-e736-47fc-a02e-daa26056d0fe","Type":"ContainerStarted","Data":"3891caead8789c1a78ff2c40631275016f03a6b2df6caa85f7ea4dca4240b1a8"} Jul 09 17:28:29.891946 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.891928 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/konnectivity-agent-qdmzx" event={"ID":"61cd09b0-79ba-4423-b79b-15b8281effa0","Type":"ContainerStarted","Data":"c1658deafcb172c1dcb581bd4adafdb98c25a49c9fec2c35de5faabc769ceff4"} Jul 09 17:28:29.893321 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.893294 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-lgw9p" event={"ID":"53da2f80-8416-4455-b359-ebfaa5551fda","Type":"ContainerStarted","Data":"9b3edd6be7f698a72e39c4ff5e8273ec3e7110319db4ef3361b0d5daea03d220"} Jul 09 17:28:29.894671 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.894651 2565 generic.go:356] "Generic (PLEG): container finished" podID="85ab2a66-354c-455f-969e-7d7a217ca9c1" containerID="492c58d38f77a366ffd7a10852683082e71c7d1fa70ed5bfd7b0f85c922a61e7" exitCode=0 Jul 09 17:28:29.894783 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.894678 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9l84" event={"ID":"85ab2a66-354c-455f-969e-7d7a217ca9c1","Type":"ContainerDied","Data":"492c58d38f77a366ffd7a10852683082e71c7d1fa70ed5bfd7b0f85c922a61e7"} Jul 09 17:28:29.900919 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.900886 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-image-registry/node-ca-86lxn" podStartSLOduration=8.139882675 podStartE2EDuration="22.900875786s" totalImagesPullingTime="14.760993111s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:29.900633293 +0000 UTC m=+22.957101803" watchObservedRunningTime="2026-07-09 17:28:29.900875786 +0000 UTC m=+22.957344285" Jul 09 17:28:29.940310 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.940084 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-lgw9p" podStartSLOduration=3.745175979 podStartE2EDuration="22.940066806s" totalImagesPullingTime="19.194890827s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:29.939959068 +0000 UTC m=+22.996427602" watchObservedRunningTime="2026-07-09 17:28:29.940066806 +0000 UTC m=+22.996535310" Jul 09 17:28:29.966864 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.966824 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/konnectivity-agent-qdmzx" podStartSLOduration=11.896163619 podStartE2EDuration="22.966809139s" totalImagesPullingTime="11.07064552s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:29.966301551 +0000 UTC m=+23.022770072" watchObservedRunningTime="2026-07-09 17:28:29.966809139 +0000 UTC m=+23.023277639" Jul 09 17:28:29.985165 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:29.985108 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/kube-apiserver-proxy-ip-10-0-138-5.ec2.internal" podStartSLOduration=20.985089458 podStartE2EDuration="20.985089458s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:28:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:29.984904933 +0000 UTC m=+23.041373458" watchObservedRunningTime="2026-07-09 17:28:29.985089458 +0000 UTC m=+23.041557961" Jul 09 17:28:30.009330 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:30.009283 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-node-tuning-operator/tuned-hhdf7" podStartSLOduration=3.826342099 podStartE2EDuration="23.009268556s" totalImagesPullingTime="19.182926457s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:30.008700352 +0000 UTC m=+23.065168876" watchObservedRunningTime="2026-07-09 17:28:30.009268556 +0000 UTC m=+23.065737056" Jul 09 17:28:30.022811 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:30.022750 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/node-resolver-w4fk8" podStartSLOduration=3.857719459 podStartE2EDuration="23.022735044s" totalImagesPullingTime="19.165015585s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:30.022597746 +0000 UTC m=+23.079066246" watchObservedRunningTime="2026-07-09 17:28:30.022735044 +0000 UTC m=+23.079203545" Jul 09 17:28:30.898143 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:30.898109 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal" event={"ID":"0492d2bb9219188cc82326a2f44b03e5","Type":"ContainerStarted","Data":"c5cec5fb69dc45681a3de5b364eb2eb9eff7dd691cdec1e775633929b9b623b2"} Jul 09 17:28:30.899495 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:30.899469 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-operator/iptables-alerter-khz5w" event={"ID":"40b1ab68-2d19-4f8e-a360-1dbdc519cb30","Type":"ContainerStarted","Data":"360157ddb4d0ce458b39eab81086d480946a3a92fa76e25a8407841bbcc5aabb"} Jul 09 17:28:30.901838 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:30.901820 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 17:28:30.902222 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:30.902168 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" event={"ID":"e1cded27-42c6-4394-b60f-57b5fef447b7","Type":"ContainerStarted","Data":"1922131598f4d3b3e5bfe11c652fa6f89bc9442b28268e96228e1d2b36586082"} Jul 09 17:28:30.902309 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:30.902249 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" event={"ID":"e1cded27-42c6-4394-b60f-57b5fef447b7","Type":"ContainerStarted","Data":"c9e453b42b49a258e44cd939e4d5b27357cadc38dc10100a657e42b5c9b53664"} Jul 09 17:28:30.916939 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:30.916893 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-machine-config-operator/kube-rbac-proxy-crio-ip-10-0-138-5.ec2.internal" podStartSLOduration=21.916876661 podStartE2EDuration="21.916876661s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:28:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:30.916854587 +0000 UTC m=+23.973323100" watchObservedRunningTime="2026-07-09 17:28:30.916876661 +0000 UTC m=+23.973345159" Jul 09 17:28:30.930025 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:30.929982 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-operator/iptables-alerter-khz5w" podStartSLOduration=4.859676217 podStartE2EDuration="23.929969587s" totalImagesPullingTime="19.07029337s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:30.929468899 +0000 UTC m=+23.985937409" watchObservedRunningTime="2026-07-09 17:28:30.929969587 +0000 UTC m=+23.986438140" Jul 09 17:28:31.148397 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:31.148368 2565 plugin_watcher.go:194] "Adding socket path or updating timestamp to desired state cache" path="/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock" Jul 09 17:28:31.297960 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:31.297885 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w4fk8_837c9eb0-e736-47fc-a02e-daa26056d0fe/dns-node-resolver/0.log" Jul 09 17:28:31.503023 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:31.502988 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:31.503023 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:31.503003 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:31.503267 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:31.503109 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:31.503267 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:31.503123 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:31.503267 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:31.503206 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:31.503408 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:31.503309 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:31.634607 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:31.634520 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="kube-system/konnectivity-agent-qdmzx" Jul 09 17:28:31.635284 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:31.635262 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="kube-system/konnectivity-agent-qdmzx" Jul 09 17:28:31.826178 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:31.826041 2565 reconciler.go:161] "OperationExecutor.RegisterPlugin started" plugin={"SocketPath":"/var/lib/kubelet/plugins_registry/ebs.csi.aws.com-reg.sock","Timestamp":"2026-07-09T17:28:31.148392422Z","UUID":"e72691f5-919a-4272-9bb8-fb451f11909f","Handler":null,"Name":"","Endpoint":""} Jul 09 17:28:31.827777 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:31.827741 2565 csi_plugin.go:106] kubernetes.io/csi: Trying to validate a new CSI Driver with name: ebs.csi.aws.com endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock versions: 1.0.0 Jul 09 17:28:31.827916 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:31.827792 2565 csi_plugin.go:119] kubernetes.io/csi: Register new plugin with name: ebs.csi.aws.com at endpoint: /var/lib/kubelet/plugins/ebs.csi.aws.com/csi.sock Jul 09 17:28:31.905710 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:31.905634 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" event={"ID":"d6e0a428-09fd-445c-acb2-6ce08c814474","Type":"ContainerStarted","Data":"01ccb3a1c8428474c15acf21e2670a7b6d056b7d5012d4c7271aa57e4ae42264"} Jul 09 17:28:31.906190 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:31.906107 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kube-system/konnectivity-agent-qdmzx" Jul 09 17:28:31.906318 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:31.906305 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kube-system/konnectivity-agent-qdmzx" Jul 09 17:28:32.073314 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:32.073284 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-86lxn_28f5e1b6-a011-45ca-827e-67a6eda59895/node-ca/0.log" Jul 09 17:28:32.917159 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:32.917062 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" event={"ID":"d6e0a428-09fd-445c-acb2-6ce08c814474","Type":"ContainerStarted","Data":"95e1e4ec7725cc3a6855e6686465ac6923202735f95a7591c3115357cf7f8faa"} Jul 09 17:28:32.920742 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:32.920719 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 17:28:32.921188 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:32.921164 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" event={"ID":"e1cded27-42c6-4394-b60f-57b5fef447b7","Type":"ContainerStarted","Data":"6afb841fbffa74d956baf7b167cf4dd538e2a8e7fa60613322e448a50802b54a"} Jul 09 17:28:32.933587 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:32.933545 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-cluster-csi-drivers/aws-ebs-csi-driver-node-69pss" podStartSLOduration=4.134185346 podStartE2EDuration="25.933532616s" totalImagesPullingTime="21.79934727s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:28:07 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:32.932233776 +0000 UTC m=+25.988702280" watchObservedRunningTime="2026-07-09 17:28:32.933532616 +0000 UTC m=+25.990001126" Jul 09 17:28:33.502923 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:33.502891 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:33.503092 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:33.502891 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:33.503092 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:33.503019 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:33.503092 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:33.503070 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:33.503092 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:33.502891 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:33.503306 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:33.503193 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:35.502240 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:35.502045 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:35.502816 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:35.502138 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:35.502816 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:35.502340 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:35.502816 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:35.502182 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:35.502816 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:35.502457 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:35.502816 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:35.502567 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:35.930500 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:35.930467 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9l84" event={"ID":"85ab2a66-354c-455f-969e-7d7a217ca9c1","Type":"ContainerStarted","Data":"bf2a2b87b31ba6f44cb05b8e898e78f45f522cc22f669f19338c21678f8109f1"} Jul 09 17:28:35.933868 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:35.933850 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 17:28:35.934174 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:35.934155 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" event={"ID":"e1cded27-42c6-4394-b60f-57b5fef447b7","Type":"ContainerStarted","Data":"a76b174d45f7c18661294223de8284392eae615c4f5b1047e5be67cac165815a"} Jul 09 17:28:35.934584 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:35.934570 2565 scope.go:117] "RemoveContainer" containerID="fb27eb9b883aa6d1ab555cd7ebf871a627af7f4b498a9ae30daa43eb2121a37b" Jul 09 17:28:35.934936 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:35.934922 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:35.934987 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:35.934979 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:35.935068 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:35.935059 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:35.950293 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:35.950270 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:35.950393 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:35.950372 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:28:36.938520 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:36.938323 2565 generic.go:356] "Generic (PLEG): container finished" podID="85ab2a66-354c-455f-969e-7d7a217ca9c1" containerID="bf2a2b87b31ba6f44cb05b8e898e78f45f522cc22f669f19338c21678f8109f1" exitCode=0 Jul 09 17:28:36.939399 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:36.938410 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9l84" event={"ID":"85ab2a66-354c-455f-969e-7d7a217ca9c1","Type":"ContainerDied","Data":"bf2a2b87b31ba6f44cb05b8e898e78f45f522cc22f669f19338c21678f8109f1"} Jul 09 17:28:36.943002 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:36.942984 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 17:28:36.943361 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:36.943341 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" event={"ID":"e1cded27-42c6-4394-b60f-57b5fef447b7","Type":"ContainerStarted","Data":"60890cb09f4a2a1cd14302c96f1df02d144bf66ef08736ec1a22ec2fc852ec30"} Jul 09 17:28:36.983234 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:36.983186 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" podStartSLOduration=10.753080602 podStartE2EDuration="29.983171667s" totalImagesPullingTime="19.230091065s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:36.982634303 +0000 UTC m=+30.039102824" watchObservedRunningTime="2026-07-09 17:28:36.983171667 +0000 UTC m=+30.039640166" Jul 09 17:28:37.503423 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:37.503384 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:37.503598 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:37.503492 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:37.503598 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:37.503501 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:37.503598 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:37.503529 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:37.503720 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:37.503599 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:37.503720 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:37.503655 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:38.951560 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:38.951527 2565 generic.go:356] "Generic (PLEG): container finished" podID="85ab2a66-354c-455f-969e-7d7a217ca9c1" containerID="8c8c941a52e372656a2a182209796d0885096dda2152610473dc9e2270b8bfb7" exitCode=0 Jul 09 17:28:38.951942 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:38.951593 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9l84" event={"ID":"85ab2a66-354c-455f-969e-7d7a217ca9c1","Type":"ContainerDied","Data":"8c8c941a52e372656a2a182209796d0885096dda2152610473dc9e2270b8bfb7"} Jul 09 17:28:39.502987 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:39.502946 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:39.503166 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:39.502956 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:39.503166 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:39.503061 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:39.503166 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:39.503080 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:39.503284 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:39.503175 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:39.503284 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:39.503241 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:40.957387 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:40.957348 2565 generic.go:356] "Generic (PLEG): container finished" podID="85ab2a66-354c-455f-969e-7d7a217ca9c1" containerID="66b6444781392e0418ed7a3c4d1a3277d5f03920fe04b2de4da4af62b3c0b7ed" exitCode=0 Jul 09 17:28:40.957767 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:40.957388 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9l84" event={"ID":"85ab2a66-354c-455f-969e-7d7a217ca9c1","Type":"ContainerDied","Data":"66b6444781392e0418ed7a3c4d1a3277d5f03920fe04b2de4da4af62b3c0b7ed"} Jul 09 17:28:41.501982 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:41.501947 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:41.502122 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:41.501947 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:41.502122 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:41.502067 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:41.502223 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:41.501946 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:41.502223 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:41.502129 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:41.502223 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:41.502204 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:41.656710 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:41.656678 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs\") pod \"network-metrics-daemon-ggmkn\" (UID: \"8c6c5488-442d-41ea-b935-31c21f226a7c\") " pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:41.656710 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:41.656710 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret\") pod \"global-pull-secret-syncer-gnf2w\" (UID: \"50daa15b-9979-4a9f-a901-28e3d607c74e\") " pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:41.656949 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:41.656840 2565 secret.go:189] Couldn't get secret kube-system/original-pull-secret: object "kube-system"/"original-pull-secret" not registered Jul 09 17:28:41.656949 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:41.656846 2565 secret.go:189] Couldn't get secret openshift-multus/metrics-daemon-secret: object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:28:41.656949 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:41.656890 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret podName:50daa15b-9979-4a9f-a901-28e3d607c74e nodeName:}" failed. No retries permitted until 2026-07-09 17:29:13.656877462 +0000 UTC m=+66.713345943 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "original-pull-secret" (UniqueName: "kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret") pod "global-pull-secret-syncer-gnf2w" (UID: "50daa15b-9979-4a9f-a901-28e3d607c74e") : object "kube-system"/"original-pull-secret" not registered Jul 09 17:28:41.656949 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:41.656904 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs podName:8c6c5488-442d-41ea-b935-31c21f226a7c nodeName:}" failed. No retries permitted until 2026-07-09 17:29:13.656898023 +0000 UTC m=+66.713366501 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "metrics-certs" (UniqueName: "kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs") pod "network-metrics-daemon-ggmkn" (UID: "8c6c5488-442d-41ea-b935-31c21f226a7c") : object "openshift-multus"/"metrics-daemon-secret" not registered Jul 09 17:28:41.858541 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:41.858494 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mstwd\" (UniqueName: \"kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd\") pod \"network-check-target-xnjp4\" (UID: \"3f81edf7-c666-416f-9cdf-99917a6759cd\") " pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:41.858726 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:41.858640 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/kube-root-ca.crt: object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered Jul 09 17:28:41.858726 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:41.858662 2565 projected.go:291] Couldn't get configMap openshift-network-diagnostics/openshift-service-ca.crt: object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered Jul 09 17:28:41.858726 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:41.858675 2565 projected.go:196] Error preparing data for projected volume kube-api-access-mstwd for pod openshift-network-diagnostics/network-check-target-xnjp4: [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:28:41.858930 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:41.858734 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd podName:3f81edf7-c666-416f-9cdf-99917a6759cd nodeName:}" failed. No retries permitted until 2026-07-09 17:29:13.858719843 +0000 UTC m=+66.915188343 (durationBeforeRetry 32s). Error: MountVolume.SetUp failed for volume "kube-api-access-mstwd" (UniqueName: "kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd") pod "network-check-target-xnjp4" (UID: "3f81edf7-c666-416f-9cdf-99917a6759cd") : [object "openshift-network-diagnostics"/"kube-root-ca.crt" not registered, object "openshift-network-diagnostics"/"openshift-service-ca.crt" not registered] Jul 09 17:28:43.503094 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:43.503039 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:43.503553 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:43.503042 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:43.503553 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:43.503176 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:43.503553 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:43.503198 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:43.503553 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:43.503334 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:43.503553 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:43.503430 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:45.502700 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:45.502678 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:45.503012 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:45.502710 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:45.503012 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:45.502681 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:45.503012 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:45.502797 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:45.503012 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:45.502894 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:45.503012 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:45.502965 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:45.971467 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:45.971439 2565 generic.go:356] "Generic (PLEG): container finished" podID="85ab2a66-354c-455f-969e-7d7a217ca9c1" containerID="a497dd5e0e87a92707aa77e43b2305e42592ba77955e75ddf099f52ccb83ce26" exitCode=0 Jul 09 17:28:45.971632 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:45.971500 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9l84" event={"ID":"85ab2a66-354c-455f-969e-7d7a217ca9c1","Type":"ContainerDied","Data":"a497dd5e0e87a92707aa77e43b2305e42592ba77955e75ddf099f52ccb83ce26"} Jul 09 17:28:46.976411 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:46.976374 2565 generic.go:356] "Generic (PLEG): container finished" podID="85ab2a66-354c-455f-969e-7d7a217ca9c1" containerID="5452d5214d43fe9ef4a150166b4b24c84814359bb7ed6da2036478776dc9a979" exitCode=0 Jul 09 17:28:46.976825 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:46.976447 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9l84" event={"ID":"85ab2a66-354c-455f-969e-7d7a217ca9c1","Type":"ContainerDied","Data":"5452d5214d43fe9ef4a150166b4b24c84814359bb7ed6da2036478776dc9a979"} Jul 09 17:28:47.503533 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:47.503488 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:47.503727 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:47.503606 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:47.503727 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:47.503616 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:47.503727 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:47.503687 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:47.503916 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:47.503745 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:47.503916 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:47.503852 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:47.981363 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:47.981325 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/multus-additional-cni-plugins-l9l84" event={"ID":"85ab2a66-354c-455f-969e-7d7a217ca9c1","Type":"ContainerStarted","Data":"cdf9882896850ba00b9678e6082cba0f1264252b8ecf6d3240a4c0b4722718c4"} Jul 09 17:28:48.001272 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:48.001230 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/multus-additional-cni-plugins-l9l84" podStartSLOduration=8.894859502 podStartE2EDuration="41.001216417s" totalImagesPullingTime="32.106356915s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:28:07 +0000 UTC" imagePullSessionsCount=5 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:28:48.000794963 +0000 UTC m=+41.057263462" watchObservedRunningTime="2026-07-09 17:28:48.001216417 +0000 UTC m=+41.057684917" Jul 09 17:28:49.502587 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:49.502545 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:49.503075 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:49.502545 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:49.503075 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:49.502653 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:49.503075 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:49.502689 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:49.503075 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:49.502777 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:49.503075 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:49.502843 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:51.502692 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:51.502665 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:51.503079 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:51.502670 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:51.503079 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:51.502784 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:51.503079 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:51.502847 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:51.503079 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:51.502880 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:51.503079 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:51.502926 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:53.502723 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:53.502684 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:53.502723 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:53.502685 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:53.503270 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:53.502702 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:53.503270 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:53.502818 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:53.503270 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:53.502914 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:53.503270 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:53.503009 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:55.502079 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:55.501914 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:55.502529 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:55.501964 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:55.502529 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:55.502161 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:55.502529 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:55.502238 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:55.502529 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:55.501980 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:55.502529 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:55.502309 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:55.880268 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:55.880239 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xnjp4"] Jul 09 17:28:55.883168 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:55.883133 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gnf2w"] Jul 09 17:28:55.883842 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:55.883775 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ggmkn"] Jul 09 17:28:55.997944 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:55.997911 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:55.998129 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:55.997911 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:55.998129 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:55.998041 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:55.998129 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:55.997911 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:55.998129 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:55.998084 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:55.998348 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:55.998141 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:57.503311 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:57.503271 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:57.503961 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:57.503366 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:57.503961 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:57.503399 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:28:57.503961 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:57.503424 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:57.503961 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:57.503520 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:57.503961 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:57.503586 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:59.502939 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:59.502901 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:28:59.503421 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:59.502905 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:28:59.503421 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:59.503039 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-multus/network-metrics-daemon-ggmkn" podUID="8c6c5488-442d-41ea-b935-31c21f226a7c" Jul 09 17:28:59.503421 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:59.503077 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="openshift-network-diagnostics/network-check-target-xnjp4" podUID="3f81edf7-c666-416f-9cdf-99917a6759cd" Jul 09 17:28:59.503421 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:28:59.502908 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:28:59.503421 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:28:59.503139 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="network is not ready: container runtime network not ready: NetworkReady=false reason:NetworkPluginNotReady message:Network plugin returns error: no CNI configuration file in /etc/kubernetes/cni/net.d/. Has your network provider started?" pod="kube-system/global-pull-secret-syncer-gnf2w" podUID="50daa15b-9979-4a9f-a901-28e3d607c74e" Jul 09 17:29:00.217438 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.217365 2565 kubelet_node_status.go:695] "Recording event message for node" node="ip-10-0-138-5.ec2.internal" event="NodeReady" Jul 09 17:29:00.217636 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.217470 2565 kubelet_node_status.go:489] "Fast updating node status as it just became ready" Jul 09 17:29:00.258288 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.258259 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-dns/dns-default-xklhh"] Jul 09 17:29:00.276562 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.276533 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress-canary/ingress-canary-xddcm"] Jul 09 17:29:00.276699 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.276650 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xklhh" Jul 09 17:29:00.279070 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.279045 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-dns\"/\"dns-default\"" Jul 09 17:29:00.279204 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.279183 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-default-metrics-tls\"" Jul 09 17:29:00.279360 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.279345 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-dns\"/\"dns-dockercfg-gmgfn\"" Jul 09 17:29:00.290707 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.290690 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xklhh"] Jul 09 17:29:00.290812 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.290720 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xddcm"] Jul 09 17:29:00.290812 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.290735 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-insights/insights-runtime-extractor-7xbrm"] Jul 09 17:29:00.290882 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.290819 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xddcm" Jul 09 17:29:00.293880 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.293381 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"canary-serving-cert\"" Jul 09 17:29:00.293880 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.293707 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress-canary\"/\"default-dockercfg-z9xhd\"" Jul 09 17:29:00.294034 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.293973 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"kube-root-ca.crt\"" Jul 09 17:29:00.294230 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.294209 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress-canary\"/\"openshift-service-ca.crt\"" Jul 09 17:29:00.308875 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.308846 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7xbrm"] Jul 09 17:29:00.308971 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.308957 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7xbrm" Jul 09 17:29:00.311534 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.311507 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-rbac-proxy\"" Jul 09 17:29:00.311708 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.311638 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"kube-root-ca.crt\"" Jul 09 17:29:00.311708 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.311664 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-insights\"/\"openshift-service-ca.crt\"" Jul 09 17:29:00.311860 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.311838 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-sa-dockercfg-gxngq\"" Jul 09 17:29:00.311908 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.311895 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-insights\"/\"insights-runtime-extractor-tls\"" Jul 09 17:29:00.403976 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.403943 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4b094006-edae-410b-8222-3443c350811c-config-volume\") pod \"dns-default-xklhh\" (UID: \"4b094006-edae-410b-8222-3443c350811c\") " pod="openshift-dns/dns-default-xklhh" Jul 09 17:29:00.404162 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.404009 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6nbzx\" (UniqueName: \"kubernetes.io/projected/4b094006-edae-410b-8222-3443c350811c-kube-api-access-6nbzx\") pod \"dns-default-xklhh\" (UID: \"4b094006-edae-410b-8222-3443c350811c\") " pod="openshift-dns/dns-default-xklhh" Jul 09 17:29:00.404162 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.404065 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-tcfjt\" (UniqueName: \"kubernetes.io/projected/bec849b6-8fec-4321-814d-d6a49d54f927-kube-api-access-tcfjt\") pod \"ingress-canary-xddcm\" (UID: \"bec849b6-8fec-4321-814d-d6a49d54f927\") " pod="openshift-ingress-canary/ingress-canary-xddcm" Jul 09 17:29:00.404162 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.404153 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11b882e4-5a66-45f9-b3d5-a9d2b5831480-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7xbrm\" (UID: \"11b882e4-5a66-45f9-b3d5-a9d2b5831480\") " pod="openshift-insights/insights-runtime-extractor-7xbrm" Jul 09 17:29:00.404298 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.404191 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11b882e4-5a66-45f9-b3d5-a9d2b5831480-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7xbrm\" (UID: \"11b882e4-5a66-45f9-b3d5-a9d2b5831480\") " pod="openshift-insights/insights-runtime-extractor-7xbrm" Jul 09 17:29:00.404298 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.404215 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b094006-edae-410b-8222-3443c350811c-metrics-tls\") pod \"dns-default-xklhh\" (UID: \"4b094006-edae-410b-8222-3443c350811c\") " pod="openshift-dns/dns-default-xklhh" Jul 09 17:29:00.404298 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.404237 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b094006-edae-410b-8222-3443c350811c-tmp-dir\") pod \"dns-default-xklhh\" (UID: \"4b094006-edae-410b-8222-3443c350811c\") " pod="openshift-dns/dns-default-xklhh" Jul 09 17:29:00.404298 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.404252 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11b882e4-5a66-45f9-b3d5-a9d2b5831480-data-volume\") pod \"insights-runtime-extractor-7xbrm\" (UID: \"11b882e4-5a66-45f9-b3d5-a9d2b5831480\") " pod="openshift-insights/insights-runtime-extractor-7xbrm" Jul 09 17:29:00.404298 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.404275 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11b882e4-5a66-45f9-b3d5-a9d2b5831480-crio-socket\") pod \"insights-runtime-extractor-7xbrm\" (UID: \"11b882e4-5a66-45f9-b3d5-a9d2b5831480\") " pod="openshift-insights/insights-runtime-extractor-7xbrm" Jul 09 17:29:00.404298 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.404294 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-wtsl4\" (UniqueName: \"kubernetes.io/projected/11b882e4-5a66-45f9-b3d5-a9d2b5831480-kube-api-access-wtsl4\") pod \"insights-runtime-extractor-7xbrm\" (UID: \"11b882e4-5a66-45f9-b3d5-a9d2b5831480\") " pod="openshift-insights/insights-runtime-extractor-7xbrm" Jul 09 17:29:00.404492 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.404312 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bec849b6-8fec-4321-814d-d6a49d54f927-cert\") pod \"ingress-canary-xddcm\" (UID: \"bec849b6-8fec-4321-814d-d6a49d54f927\") " pod="openshift-ingress-canary/ingress-canary-xddcm" Jul 09 17:29:00.505531 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.505453 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6nbzx\" (UniqueName: \"kubernetes.io/projected/4b094006-edae-410b-8222-3443c350811c-kube-api-access-6nbzx\") pod \"dns-default-xklhh\" (UID: \"4b094006-edae-410b-8222-3443c350811c\") " pod="openshift-dns/dns-default-xklhh" Jul 09 17:29:00.505531 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.505488 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-tcfjt\" (UniqueName: \"kubernetes.io/projected/bec849b6-8fec-4321-814d-d6a49d54f927-kube-api-access-tcfjt\") pod \"ingress-canary-xddcm\" (UID: \"bec849b6-8fec-4321-814d-d6a49d54f927\") " pod="openshift-ingress-canary/ingress-canary-xddcm" Jul 09 17:29:00.505531 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.505510 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11b882e4-5a66-45f9-b3d5-a9d2b5831480-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7xbrm\" (UID: \"11b882e4-5a66-45f9-b3d5-a9d2b5831480\") " pod="openshift-insights/insights-runtime-extractor-7xbrm" Jul 09 17:29:00.506168 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.505539 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11b882e4-5a66-45f9-b3d5-a9d2b5831480-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7xbrm\" (UID: \"11b882e4-5a66-45f9-b3d5-a9d2b5831480\") " pod="openshift-insights/insights-runtime-extractor-7xbrm" Jul 09 17:29:00.506168 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.505570 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b094006-edae-410b-8222-3443c350811c-metrics-tls\") pod \"dns-default-xklhh\" (UID: \"4b094006-edae-410b-8222-3443c350811c\") " pod="openshift-dns/dns-default-xklhh" Jul 09 17:29:00.506168 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.505602 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b094006-edae-410b-8222-3443c350811c-tmp-dir\") pod \"dns-default-xklhh\" (UID: \"4b094006-edae-410b-8222-3443c350811c\") " pod="openshift-dns/dns-default-xklhh" Jul 09 17:29:00.506168 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.505622 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11b882e4-5a66-45f9-b3d5-a9d2b5831480-data-volume\") pod \"insights-runtime-extractor-7xbrm\" (UID: \"11b882e4-5a66-45f9-b3d5-a9d2b5831480\") " pod="openshift-insights/insights-runtime-extractor-7xbrm" Jul 09 17:29:00.506168 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.505654 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11b882e4-5a66-45f9-b3d5-a9d2b5831480-crio-socket\") pod \"insights-runtime-extractor-7xbrm\" (UID: \"11b882e4-5a66-45f9-b3d5-a9d2b5831480\") " pod="openshift-insights/insights-runtime-extractor-7xbrm" Jul 09 17:29:00.506168 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.505676 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-wtsl4\" (UniqueName: \"kubernetes.io/projected/11b882e4-5a66-45f9-b3d5-a9d2b5831480-kube-api-access-wtsl4\") pod \"insights-runtime-extractor-7xbrm\" (UID: \"11b882e4-5a66-45f9-b3d5-a9d2b5831480\") " pod="openshift-insights/insights-runtime-extractor-7xbrm" Jul 09 17:29:00.506168 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.505697 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bec849b6-8fec-4321-814d-d6a49d54f927-cert\") pod \"ingress-canary-xddcm\" (UID: \"bec849b6-8fec-4321-814d-d6a49d54f927\") " pod="openshift-ingress-canary/ingress-canary-xddcm" Jul 09 17:29:00.506168 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.505717 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4b094006-edae-410b-8222-3443c350811c-config-volume\") pod \"dns-default-xklhh\" (UID: \"4b094006-edae-410b-8222-3443c350811c\") " pod="openshift-dns/dns-default-xklhh" Jul 09 17:29:00.506168 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.505878 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"crio-socket\" (UniqueName: \"kubernetes.io/host-path/11b882e4-5a66-45f9-b3d5-a9d2b5831480-crio-socket\") pod \"insights-runtime-extractor-7xbrm\" (UID: \"11b882e4-5a66-45f9-b3d5-a9d2b5831480\") " pod="openshift-insights/insights-runtime-extractor-7xbrm" Jul 09 17:29:00.506168 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.506115 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/4b094006-edae-410b-8222-3443c350811c-tmp-dir\") pod \"dns-default-xklhh\" (UID: \"4b094006-edae-410b-8222-3443c350811c\") " pod="openshift-dns/dns-default-xklhh" Jul 09 17:29:00.506575 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.506241 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"data-volume\" (UniqueName: \"kubernetes.io/empty-dir/11b882e4-5a66-45f9-b3d5-a9d2b5831480-data-volume\") pod \"insights-runtime-extractor-7xbrm\" (UID: \"11b882e4-5a66-45f9-b3d5-a9d2b5831480\") " pod="openshift-insights/insights-runtime-extractor-7xbrm" Jul 09 17:29:00.506575 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.506300 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-rbac-proxy-cm\" (UniqueName: \"kubernetes.io/configmap/11b882e4-5a66-45f9-b3d5-a9d2b5831480-kube-rbac-proxy-cm\") pod \"insights-runtime-extractor-7xbrm\" (UID: \"11b882e4-5a66-45f9-b3d5-a9d2b5831480\") " pod="openshift-insights/insights-runtime-extractor-7xbrm" Jul 09 17:29:00.506575 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.506407 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/configmap/4b094006-edae-410b-8222-3443c350811c-config-volume\") pod \"dns-default-xklhh\" (UID: \"4b094006-edae-410b-8222-3443c350811c\") " pod="openshift-dns/dns-default-xklhh" Jul 09 17:29:00.509451 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.509419 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"insights-runtime-extractor-tls\" (UniqueName: \"kubernetes.io/secret/11b882e4-5a66-45f9-b3d5-a9d2b5831480-insights-runtime-extractor-tls\") pod \"insights-runtime-extractor-7xbrm\" (UID: \"11b882e4-5a66-45f9-b3d5-a9d2b5831480\") " pod="openshift-insights/insights-runtime-extractor-7xbrm" Jul 09 17:29:00.509553 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.509538 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-tls\" (UniqueName: \"kubernetes.io/secret/4b094006-edae-410b-8222-3443c350811c-metrics-tls\") pod \"dns-default-xklhh\" (UID: \"4b094006-edae-410b-8222-3443c350811c\") " pod="openshift-dns/dns-default-xklhh" Jul 09 17:29:00.509592 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.509572 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/bec849b6-8fec-4321-814d-d6a49d54f927-cert\") pod \"ingress-canary-xddcm\" (UID: \"bec849b6-8fec-4321-814d-d6a49d54f927\") " pod="openshift-ingress-canary/ingress-canary-xddcm" Jul 09 17:29:00.512736 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.512712 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-tcfjt\" (UniqueName: \"kubernetes.io/projected/bec849b6-8fec-4321-814d-d6a49d54f927-kube-api-access-tcfjt\") pod \"ingress-canary-xddcm\" (UID: \"bec849b6-8fec-4321-814d-d6a49d54f927\") " pod="openshift-ingress-canary/ingress-canary-xddcm" Jul 09 17:29:00.513465 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.513446 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-wtsl4\" (UniqueName: \"kubernetes.io/projected/11b882e4-5a66-45f9-b3d5-a9d2b5831480-kube-api-access-wtsl4\") pod \"insights-runtime-extractor-7xbrm\" (UID: \"11b882e4-5a66-45f9-b3d5-a9d2b5831480\") " pod="openshift-insights/insights-runtime-extractor-7xbrm" Jul 09 17:29:00.513602 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.513582 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6nbzx\" (UniqueName: \"kubernetes.io/projected/4b094006-edae-410b-8222-3443c350811c-kube-api-access-6nbzx\") pod \"dns-default-xklhh\" (UID: \"4b094006-edae-410b-8222-3443c350811c\") " pod="openshift-dns/dns-default-xklhh" Jul 09 17:29:00.586645 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.586609 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-dns/dns-default-xklhh" Jul 09 17:29:00.600784 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.600733 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress-canary/ingress-canary-xddcm" Jul 09 17:29:00.618134 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.618108 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-insights/insights-runtime-extractor-7xbrm" Jul 09 17:29:00.761014 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.760737 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress-canary/ingress-canary-xddcm"] Jul 09 17:29:00.763890 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.763868 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-dns/dns-default-xklhh"] Jul 09 17:29:00.767285 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:00.767265 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-insights/insights-runtime-extractor-7xbrm"] Jul 09 17:29:00.767383 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:29:00.767340 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4b094006_edae_410b_8222_3443c350811c.slice/crio-ee25fa7fba0b41d54a887be2b2013ed3609690dab9cc7b6d90eb87142050aefd WatchSource:0}: Error finding container ee25fa7fba0b41d54a887be2b2013ed3609690dab9cc7b6d90eb87142050aefd: Status 404 returned error can't find the container with id ee25fa7fba0b41d54a887be2b2013ed3609690dab9cc7b6d90eb87142050aefd Jul 09 17:29:00.770290 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:29:00.770267 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod11b882e4_5a66_45f9_b3d5_a9d2b5831480.slice/crio-568256a98c08c9df21f5e0f9fbeeae21141ca35842888c2f083be979733b4852 WatchSource:0}: Error finding container 568256a98c08c9df21f5e0f9fbeeae21141ca35842888c2f083be979733b4852: Status 404 returned error can't find the container with id 568256a98c08c9df21f5e0f9fbeeae21141ca35842888c2f083be979733b4852 Jul 09 17:29:01.008830 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.008788 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7xbrm" event={"ID":"11b882e4-5a66-45f9-b3d5-a9d2b5831480","Type":"ContainerStarted","Data":"568256a98c08c9df21f5e0f9fbeeae21141ca35842888c2f083be979733b4852"} Jul 09 17:29:01.009864 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.009836 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xddcm" event={"ID":"bec849b6-8fec-4321-814d-d6a49d54f927","Type":"ContainerStarted","Data":"db921ef86da2ea5061f0cc0ddcfed169c8cccb2fe871ebca24b2e9dd12b5207f"} Jul 09 17:29:01.010857 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.010834 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xklhh" event={"ID":"4b094006-edae-410b-8222-3443c350811c","Type":"ContainerStarted","Data":"ee25fa7fba0b41d54a887be2b2013ed3609690dab9cc7b6d90eb87142050aefd"} Jul 09 17:29:01.108670 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.108646 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-kgb24"] Jul 09 17:29:01.128902 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.128883 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-kgb24"] Jul 09 17:29:01.129013 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.128968 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-kgb24" Jul 09 17:29:01.131256 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.131235 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-tls\"" Jul 09 17:29:01.131366 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.131288 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-dockercfg-5w42n\"" Jul 09 17:29:01.131366 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.131290 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"openshift-service-ca.crt\"" Jul 09 17:29:01.131600 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.131587 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-root-ca.crt\"" Jul 09 17:29:01.132201 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.132181 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-operator-kube-rbac-proxy-config\"" Jul 09 17:29:01.132278 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.132183 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"metrics-client-ca\"" Jul 09 17:29:01.211043 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.211010 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bed4cd5-5ede-40bb-8640-fb41f2702e0a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-kgb24\" (UID: \"4bed4cd5-5ede-40bb-8640-fb41f2702e0a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kgb24" Jul 09 17:29:01.211205 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.211057 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bed4cd5-5ede-40bb-8640-fb41f2702e0a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-kgb24\" (UID: \"4bed4cd5-5ede-40bb-8640-fb41f2702e0a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kgb24" Jul 09 17:29:01.211205 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.211082 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bed4cd5-5ede-40bb-8640-fb41f2702e0a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-kgb24\" (UID: \"4bed4cd5-5ede-40bb-8640-fb41f2702e0a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kgb24" Jul 09 17:29:01.211205 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.211131 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rmhrw\" (UniqueName: \"kubernetes.io/projected/4bed4cd5-5ede-40bb-8640-fb41f2702e0a-kube-api-access-rmhrw\") pod \"prometheus-operator-64785b6675-kgb24\" (UID: \"4bed4cd5-5ede-40bb-8640-fb41f2702e0a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kgb24" Jul 09 17:29:01.312091 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.312053 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bed4cd5-5ede-40bb-8640-fb41f2702e0a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-kgb24\" (UID: \"4bed4cd5-5ede-40bb-8640-fb41f2702e0a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kgb24" Jul 09 17:29:01.312242 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.312113 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bed4cd5-5ede-40bb-8640-fb41f2702e0a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-kgb24\" (UID: \"4bed4cd5-5ede-40bb-8640-fb41f2702e0a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kgb24" Jul 09 17:29:01.312242 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.312137 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bed4cd5-5ede-40bb-8640-fb41f2702e0a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-kgb24\" (UID: \"4bed4cd5-5ede-40bb-8640-fb41f2702e0a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kgb24" Jul 09 17:29:01.312242 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.312164 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rmhrw\" (UniqueName: \"kubernetes.io/projected/4bed4cd5-5ede-40bb-8640-fb41f2702e0a-kube-api-access-rmhrw\") pod \"prometheus-operator-64785b6675-kgb24\" (UID: \"4bed4cd5-5ede-40bb-8640-fb41f2702e0a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kgb24" Jul 09 17:29:01.313510 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.313480 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/4bed4cd5-5ede-40bb-8640-fb41f2702e0a-metrics-client-ca\") pod \"prometheus-operator-64785b6675-kgb24\" (UID: \"4bed4cd5-5ede-40bb-8640-fb41f2702e0a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kgb24" Jul 09 17:29:01.318889 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.318848 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-tls\" (UniqueName: \"kubernetes.io/secret/4bed4cd5-5ede-40bb-8640-fb41f2702e0a-prometheus-operator-tls\") pod \"prometheus-operator-64785b6675-kgb24\" (UID: \"4bed4cd5-5ede-40bb-8640-fb41f2702e0a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kgb24" Jul 09 17:29:01.319004 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.318964 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-operator-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/4bed4cd5-5ede-40bb-8640-fb41f2702e0a-prometheus-operator-kube-rbac-proxy-config\") pod \"prometheus-operator-64785b6675-kgb24\" (UID: \"4bed4cd5-5ede-40bb-8640-fb41f2702e0a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kgb24" Jul 09 17:29:01.321782 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.321721 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rmhrw\" (UniqueName: \"kubernetes.io/projected/4bed4cd5-5ede-40bb-8640-fb41f2702e0a-kube-api-access-rmhrw\") pod \"prometheus-operator-64785b6675-kgb24\" (UID: \"4bed4cd5-5ede-40bb-8640-fb41f2702e0a\") " pod="openshift-monitoring/prometheus-operator-64785b6675-kgb24" Jul 09 17:29:01.439709 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.439485 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-operator-64785b6675-kgb24" Jul 09 17:29:01.504786 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.504075 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:29:01.504786 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.504096 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:29:01.504786 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.504321 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:29:01.508782 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.506789 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 17:29:01.508782 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.507040 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8889q\"" Jul 09 17:29:01.508782 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.508209 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 17:29:01.508782 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.508485 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ls9tf\"" Jul 09 17:29:01.508782 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.508677 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 17:29:01.509605 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.509577 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 17:29:01.652055 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:01.651936 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-operator-64785b6675-kgb24"] Jul 09 17:29:01.656833 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:29:01.656807 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod4bed4cd5_5ede_40bb_8640_fb41f2702e0a.slice/crio-2dc91eb9420ec18a7d858e20a0fd572d7410287572377264d5c2d5faf42774de WatchSource:0}: Error finding container 2dc91eb9420ec18a7d858e20a0fd572d7410287572377264d5c2d5faf42774de: Status 404 returned error can't find the container with id 2dc91eb9420ec18a7d858e20a0fd572d7410287572377264d5c2d5faf42774de Jul 09 17:29:02.017129 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:02.017086 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-kgb24" event={"ID":"4bed4cd5-5ede-40bb-8640-fb41f2702e0a","Type":"ContainerStarted","Data":"2dc91eb9420ec18a7d858e20a0fd572d7410287572377264d5c2d5faf42774de"} Jul 09 17:29:05.858744 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:05.858673 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-console/console-76c86fb65c-6drhc"] Jul 09 17:29:05.866051 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:05.866028 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:05.868566 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:05.868546 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-dockercfg-dhccb\"" Jul 09 17:29:05.868701 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:05.868552 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-oauth-config\"" Jul 09 17:29:05.869476 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:05.869355 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"console-config\"" Jul 09 17:29:05.869476 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:05.869374 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"kube-root-ca.crt\"" Jul 09 17:29:05.869476 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:05.869383 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"openshift-service-ca.crt\"" Jul 09 17:29:05.869476 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:05.869406 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-console\"/\"console-serving-cert\"" Jul 09 17:29:05.869476 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:05.869429 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"oauth-serving-cert\"" Jul 09 17:29:05.869476 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:05.869455 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"service-ca\"" Jul 09 17:29:05.872510 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:05.872488 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76c86fb65c-6drhc"] Jul 09 17:29:05.873932 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:05.873870 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-console\"/\"trusted-ca-bundle\"" Jul 09 17:29:05.955629 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:05.955598 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-trusted-ca-bundle\") pod \"console-76c86fb65c-6drhc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:05.955830 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:05.955643 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6m6kl\" (UniqueName: \"kubernetes.io/projected/1648feda-fed8-4e7d-a64e-6925eee3acdc-kube-api-access-6m6kl\") pod \"console-76c86fb65c-6drhc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:05.955830 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:05.955729 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-console-config\") pod \"console-76c86fb65c-6drhc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:05.955830 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:05.955776 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-service-ca\") pod \"console-76c86fb65c-6drhc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:05.955830 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:05.955810 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1648feda-fed8-4e7d-a64e-6925eee3acdc-console-serving-cert\") pod \"console-76c86fb65c-6drhc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:05.956019 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:05.955840 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-oauth-serving-cert\") pod \"console-76c86fb65c-6drhc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:05.956019 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:05.955946 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1648feda-fed8-4e7d-a64e-6925eee3acdc-console-oauth-config\") pod \"console-76c86fb65c-6drhc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:06.056672 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:06.056639 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1648feda-fed8-4e7d-a64e-6925eee3acdc-console-oauth-config\") pod \"console-76c86fb65c-6drhc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:06.056848 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:06.056686 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-trusted-ca-bundle\") pod \"console-76c86fb65c-6drhc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:06.056848 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:06.056715 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6m6kl\" (UniqueName: \"kubernetes.io/projected/1648feda-fed8-4e7d-a64e-6925eee3acdc-kube-api-access-6m6kl\") pod \"console-76c86fb65c-6drhc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:06.056848 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:06.056752 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-console-config\") pod \"console-76c86fb65c-6drhc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:06.056848 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:06.056789 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-service-ca\") pod \"console-76c86fb65c-6drhc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:06.056848 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:06.056815 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1648feda-fed8-4e7d-a64e-6925eee3acdc-console-serving-cert\") pod \"console-76c86fb65c-6drhc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:06.056848 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:06.056838 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-oauth-serving-cert\") pod \"console-76c86fb65c-6drhc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:06.058550 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:06.058429 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-console-config\") pod \"console-76c86fb65c-6drhc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:06.058550 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:06.058433 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-service-ca\") pod \"console-76c86fb65c-6drhc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:06.058749 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:06.058640 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-trusted-ca-bundle\") pod \"console-76c86fb65c-6drhc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:06.058979 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:06.058953 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-oauth-serving-cert\") pod \"console-76c86fb65c-6drhc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:06.062781 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:06.062735 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1648feda-fed8-4e7d-a64e-6925eee3acdc-console-oauth-config\") pod \"console-76c86fb65c-6drhc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:06.063551 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:06.063529 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1648feda-fed8-4e7d-a64e-6925eee3acdc-console-serving-cert\") pod \"console-76c86fb65c-6drhc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:06.064854 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:06.064835 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6m6kl\" (UniqueName: \"kubernetes.io/projected/1648feda-fed8-4e7d-a64e-6925eee3acdc-kube-api-access-6m6kl\") pod \"console-76c86fb65c-6drhc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:06.178491 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:06.178404 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:06.588862 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:06.588332 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-console/console-76c86fb65c-6drhc"] Jul 09 17:29:06.598970 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:29:06.598611 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod1648feda_fed8_4e7d_a64e_6925eee3acdc.slice/crio-b2468971df55996452a08a964f5356e62ce5b824a7f8b9bc6ba359f87c89139f WatchSource:0}: Error finding container b2468971df55996452a08a964f5356e62ce5b824a7f8b9bc6ba359f87c89139f: Status 404 returned error can't find the container with id b2468971df55996452a08a964f5356e62ce5b824a7f8b9bc6ba359f87c89139f Jul 09 17:29:07.032681 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:07.032638 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-kgb24" event={"ID":"4bed4cd5-5ede-40bb-8640-fb41f2702e0a","Type":"ContainerStarted","Data":"8ad372a489eb16afbc6b340746dde27042698e18df1a5ec4d087cb67784931a0"} Jul 09 17:29:07.033264 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:07.032706 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-operator-64785b6675-kgb24" event={"ID":"4bed4cd5-5ede-40bb-8640-fb41f2702e0a","Type":"ContainerStarted","Data":"eb64123a2a1680b3d3c6190c4e781e0a3194e0cd16e8cc261b755497fecee476"} Jul 09 17:29:07.034087 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:07.034064 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7xbrm" event={"ID":"11b882e4-5a66-45f9-b3d5-a9d2b5831480","Type":"ContainerStarted","Data":"5df1329143e5cf901fd9fbcd57e324085624f254090b9b6416e32b2884c2d098"} Jul 09 17:29:07.035355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:07.035326 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress-canary/ingress-canary-xddcm" event={"ID":"bec849b6-8fec-4321-814d-d6a49d54f927","Type":"ContainerStarted","Data":"2e6193fd598b06aaf113fabc08d33488cf7e8821238d945da675be45b686a3aa"} Jul 09 17:29:07.036910 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:07.036891 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xklhh" event={"ID":"4b094006-edae-410b-8222-3443c350811c","Type":"ContainerStarted","Data":"80ef99008c388dcd20dc59fe37752925cf8190b4d81dd9293cc5da35ad8940df"} Jul 09 17:29:07.037002 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:07.036934 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-dns/dns-default-xklhh" event={"ID":"4b094006-edae-410b-8222-3443c350811c","Type":"ContainerStarted","Data":"d96804a6a4c75bd8cc4a8cabd1bbc3b2ed840d8cb38a5c01cbece597d8f5a493"} Jul 09 17:29:07.037002 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:07.036963 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-dns/dns-default-xklhh" Jul 09 17:29:07.037937 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:07.037920 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76c86fb65c-6drhc" event={"ID":"1648feda-fed8-4e7d-a64e-6925eee3acdc","Type":"ContainerStarted","Data":"b2468971df55996452a08a964f5356e62ce5b824a7f8b9bc6ba359f87c89139f"} Jul 09 17:29:07.049484 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:07.049437 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-operator-64785b6675-kgb24" podStartSLOduration=1.301280427 podStartE2EDuration="6.049417631s" totalImagesPullingTime="4.748137204s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:29:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:07.048290968 +0000 UTC m=+60.104759504" watchObservedRunningTime="2026-07-09 17:29:07.049417631 +0000 UTC m=+60.105886131" Jul 09 17:29:07.066517 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:07.066454 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-dns/dns-default-xklhh" podStartSLOduration=1.4306906129999999 podStartE2EDuration="7.066435538s" totalImagesPullingTime="5.635744925s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:07.066217793 +0000 UTC m=+60.122686313" watchObservedRunningTime="2026-07-09 17:29:07.066435538 +0000 UTC m=+60.122904039" Jul 09 17:29:07.085411 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:07.085350 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress-canary/ingress-canary-xddcm" podStartSLOduration=1.445552512 podStartE2EDuration="7.085328537s" totalImagesPullingTime="5.639776025s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:29:00 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:07.083875111 +0000 UTC m=+60.140343613" watchObservedRunningTime="2026-07-09 17:29:07.085328537 +0000 UTC m=+60.141797129" Jul 09 17:29:07.959641 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:07.959528 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ovn-kubernetes/ovnkube-node-8wn62" Jul 09 17:29:08.044942 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.044855 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7xbrm" event={"ID":"11b882e4-5a66-45f9-b3d5-a9d2b5831480","Type":"ContainerStarted","Data":"53e80ff6b7fa4598f42d9904425f41086280b6cc1e2052d58557185b29f15008"} Jul 09 17:29:08.448690 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.448652 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-7p956"] Jul 09 17:29:08.462421 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.461836 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-7p956"] Jul 09 17:29:08.462421 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.461974 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7p956" Jul 09 17:29:08.464457 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.464401 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-tls\"" Jul 09 17:29:08.464645 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.464580 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-dockercfg-22nq4\"" Jul 09 17:29:08.464961 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.464675 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"openshift-state-metrics-kube-rbac-proxy-config\"" Jul 09 17:29:08.471722 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.471466 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-kjwqv"] Jul 09 17:29:08.484441 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.484416 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/node-exporter-jgbld"] Jul 09 17:29:08.484606 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.484537 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" Jul 09 17:29:08.487799 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.487315 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-kube-rbac-proxy-config\"" Jul 09 17:29:08.487799 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.487523 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-tls\"" Jul 09 17:29:08.495001 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.494975 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-dockercfg-5g97s\"" Jul 09 17:29:08.495239 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.495214 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kube-state-metrics-custom-resource-state-configmap\"" Jul 09 17:29:08.501521 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.501501 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-kjwqv"] Jul 09 17:29:08.501629 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.501604 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.504169 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.504137 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-kube-rbac-proxy-config\"" Jul 09 17:29:08.504254 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.504212 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"node-exporter-accelerators-collector-config\"" Jul 09 17:29:08.504254 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.504225 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-tls\"" Jul 09 17:29:08.504490 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.504476 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"node-exporter-dockercfg-mtzcm\"" Jul 09 17:29:08.579224 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.579185 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aae4cc98-4596-4b38-9472-0015fdc477ca-node-exporter-wtmp\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.579467 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.579267 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aae4cc98-4596-4b38-9472-0015fdc477ca-sys\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.579467 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.579316 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aae4cc98-4596-4b38-9472-0015fdc477ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.579467 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.579346 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-vmh8l\" (UniqueName: \"kubernetes.io/projected/7d06e450-a17b-43db-88d5-3e4097a0637c-kube-api-access-vmh8l\") pod \"kube-state-metrics-785778ff74-kjwqv\" (UID: \"7d06e450-a17b-43db-88d5-3e4097a0637c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" Jul 09 17:29:08.579467 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.579366 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aae4cc98-4596-4b38-9472-0015fdc477ca-node-exporter-tls\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.579467 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.579394 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d06e450-a17b-43db-88d5-3e4097a0637c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-kjwqv\" (UID: \"7d06e450-a17b-43db-88d5-3e4097a0637c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" Jul 09 17:29:08.579467 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.579428 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aae4cc98-4596-4b38-9472-0015fdc477ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.579805 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.579470 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-fdfsl\" (UniqueName: \"kubernetes.io/projected/aae4cc98-4596-4b38-9472-0015fdc477ca-kube-api-access-fdfsl\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.579805 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.579551 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7d06e450-a17b-43db-88d5-3e4097a0637c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-kjwqv\" (UID: \"7d06e450-a17b-43db-88d5-3e4097a0637c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" Jul 09 17:29:08.579805 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.579597 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aae4cc98-4596-4b38-9472-0015fdc477ca-metrics-client-ca\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.579805 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.579633 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kppdc\" (UniqueName: \"kubernetes.io/projected/14f5c160-fa6f-4d39-930f-205e117ca850-kube-api-access-kppdc\") pod \"openshift-state-metrics-84bd68b896-7p956\" (UID: \"14f5c160-fa6f-4d39-930f-205e117ca850\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7p956" Jul 09 17:29:08.579805 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.579655 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7d06e450-a17b-43db-88d5-3e4097a0637c-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-kjwqv\" (UID: \"7d06e450-a17b-43db-88d5-3e4097a0637c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" Jul 09 17:29:08.579805 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.579670 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d06e450-a17b-43db-88d5-3e4097a0637c-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-kjwqv\" (UID: \"7d06e450-a17b-43db-88d5-3e4097a0637c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" Jul 09 17:29:08.579805 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.579732 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14f5c160-fa6f-4d39-930f-205e117ca850-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-7p956\" (UID: \"14f5c160-fa6f-4d39-930f-205e117ca850\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7p956" Jul 09 17:29:08.579805 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.579808 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d06e450-a17b-43db-88d5-3e4097a0637c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-kjwqv\" (UID: \"7d06e450-a17b-43db-88d5-3e4097a0637c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" Jul 09 17:29:08.580187 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.579828 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14f5c160-fa6f-4d39-930f-205e117ca850-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-7p956\" (UID: \"14f5c160-fa6f-4d39-930f-205e117ca850\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7p956" Jul 09 17:29:08.580187 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.579854 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aae4cc98-4596-4b38-9472-0015fdc477ca-node-exporter-textfile\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.580187 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.579886 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f5c160-fa6f-4d39-930f-205e117ca850-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7p956\" (UID: \"14f5c160-fa6f-4d39-930f-205e117ca850\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7p956" Jul 09 17:29:08.580187 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.579901 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aae4cc98-4596-4b38-9472-0015fdc477ca-root\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.681278 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.680726 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d06e450-a17b-43db-88d5-3e4097a0637c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-kjwqv\" (UID: \"7d06e450-a17b-43db-88d5-3e4097a0637c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" Jul 09 17:29:08.681278 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.680793 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14f5c160-fa6f-4d39-930f-205e117ca850-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-7p956\" (UID: \"14f5c160-fa6f-4d39-930f-205e117ca850\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7p956" Jul 09 17:29:08.681278 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.680828 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aae4cc98-4596-4b38-9472-0015fdc477ca-node-exporter-textfile\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.681278 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.680856 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f5c160-fa6f-4d39-930f-205e117ca850-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7p956\" (UID: \"14f5c160-fa6f-4d39-930f-205e117ca850\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7p956" Jul 09 17:29:08.681278 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.680880 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aae4cc98-4596-4b38-9472-0015fdc477ca-root\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.681278 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.680915 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aae4cc98-4596-4b38-9472-0015fdc477ca-node-exporter-wtmp\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.681278 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.680972 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aae4cc98-4596-4b38-9472-0015fdc477ca-sys\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.681278 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.681018 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aae4cc98-4596-4b38-9472-0015fdc477ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.681278 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.681052 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-vmh8l\" (UniqueName: \"kubernetes.io/projected/7d06e450-a17b-43db-88d5-3e4097a0637c-kube-api-access-vmh8l\") pod \"kube-state-metrics-785778ff74-kjwqv\" (UID: \"7d06e450-a17b-43db-88d5-3e4097a0637c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" Jul 09 17:29:08.681278 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.681074 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aae4cc98-4596-4b38-9472-0015fdc477ca-node-exporter-tls\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.681278 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.681100 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d06e450-a17b-43db-88d5-3e4097a0637c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-kjwqv\" (UID: \"7d06e450-a17b-43db-88d5-3e4097a0637c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" Jul 09 17:29:08.681278 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.681127 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aae4cc98-4596-4b38-9472-0015fdc477ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.681278 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.681150 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-fdfsl\" (UniqueName: \"kubernetes.io/projected/aae4cc98-4596-4b38-9472-0015fdc477ca-kube-api-access-fdfsl\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.681278 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.681175 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7d06e450-a17b-43db-88d5-3e4097a0637c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-kjwqv\" (UID: \"7d06e450-a17b-43db-88d5-3e4097a0637c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" Jul 09 17:29:08.681278 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.681197 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aae4cc98-4596-4b38-9472-0015fdc477ca-metrics-client-ca\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.681278 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.681237 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kppdc\" (UniqueName: \"kubernetes.io/projected/14f5c160-fa6f-4d39-930f-205e117ca850-kube-api-access-kppdc\") pod \"openshift-state-metrics-84bd68b896-7p956\" (UID: \"14f5c160-fa6f-4d39-930f-205e117ca850\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7p956" Jul 09 17:29:08.682009 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.681276 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-wtmp\" (UniqueName: \"kubernetes.io/host-path/aae4cc98-4596-4b38-9472-0015fdc477ca-node-exporter-wtmp\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.682009 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:29:08.681292 2565 secret.go:189] Couldn't get secret openshift-monitoring/node-exporter-tls: secret "node-exporter-tls" not found Jul 09 17:29:08.682009 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.681343 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/aae4cc98-4596-4b38-9472-0015fdc477ca-sys\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.682009 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:29:08.681367 2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 09 17:29:08.682009 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:29:08.681374 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/aae4cc98-4596-4b38-9472-0015fdc477ca-node-exporter-tls podName:aae4cc98-4596-4b38-9472-0015fdc477ca nodeName:}" failed. No retries permitted until 2026-07-09 17:29:09.181348455 +0000 UTC m=+62.237816937 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "node-exporter-tls" (UniqueName: "kubernetes.io/secret/aae4cc98-4596-4b38-9472-0015fdc477ca-node-exporter-tls") pod "node-exporter-jgbld" (UID: "aae4cc98-4596-4b38-9472-0015fdc477ca") : secret "node-exporter-tls" not found Jul 09 17:29:08.682009 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:29:08.681419 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d06e450-a17b-43db-88d5-3e4097a0637c-kube-state-metrics-tls podName:7d06e450-a17b-43db-88d5-3e4097a0637c nodeName:}" failed. No retries permitted until 2026-07-09 17:29:09.181402456 +0000 UTC m=+62.237870949 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7d06e450-a17b-43db-88d5-3e4097a0637c-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-kjwqv" (UID: "7d06e450-a17b-43db-88d5-3e4097a0637c") : secret "kube-state-metrics-tls" not found Jul 09 17:29:08.682211 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.682128 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-accelerators-collector-config\" (UniqueName: \"kubernetes.io/configmap/aae4cc98-4596-4b38-9472-0015fdc477ca-node-exporter-accelerators-collector-config\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.682211 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.682147 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/14f5c160-fa6f-4d39-930f-205e117ca850-metrics-client-ca\") pod \"openshift-state-metrics-84bd68b896-7p956\" (UID: \"14f5c160-fa6f-4d39-930f-205e117ca850\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7p956" Jul 09 17:29:08.682369 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.682342 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-custom-resource-state-configmap\" (UniqueName: \"kubernetes.io/configmap/7d06e450-a17b-43db-88d5-3e4097a0637c-kube-state-metrics-custom-resource-state-configmap\") pod \"kube-state-metrics-785778ff74-kjwqv\" (UID: \"7d06e450-a17b-43db-88d5-3e4097a0637c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" Jul 09 17:29:08.682459 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.681277 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7d06e450-a17b-43db-88d5-3e4097a0637c-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-kjwqv\" (UID: \"7d06e450-a17b-43db-88d5-3e4097a0637c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" Jul 09 17:29:08.682459 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.682427 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d06e450-a17b-43db-88d5-3e4097a0637c-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-kjwqv\" (UID: \"7d06e450-a17b-43db-88d5-3e4097a0637c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" Jul 09 17:29:08.682585 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.682474 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14f5c160-fa6f-4d39-930f-205e117ca850-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-7p956\" (UID: \"14f5c160-fa6f-4d39-930f-205e117ca850\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7p956" Jul 09 17:29:08.682624 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.682613 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/aae4cc98-4596-4b38-9472-0015fdc477ca-metrics-client-ca\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.682693 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:29:08.682676 2565 secret.go:189] Couldn't get secret openshift-monitoring/openshift-state-metrics-tls: secret "openshift-state-metrics-tls" not found Jul 09 17:29:08.682748 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:29:08.682729 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/14f5c160-fa6f-4d39-930f-205e117ca850-openshift-state-metrics-tls podName:14f5c160-fa6f-4d39-930f-205e117ca850 nodeName:}" failed. No retries permitted until 2026-07-09 17:29:09.18271395 +0000 UTC m=+62.239182436 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "openshift-state-metrics-tls" (UniqueName: "kubernetes.io/secret/14f5c160-fa6f-4d39-930f-205e117ca850-openshift-state-metrics-tls") pod "openshift-state-metrics-84bd68b896-7p956" (UID: "14f5c160-fa6f-4d39-930f-205e117ca850") : secret "openshift-state-metrics-tls" not found Jul 09 17:29:08.683088 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.682897 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"volume-directive-shadow\" (UniqueName: \"kubernetes.io/empty-dir/7d06e450-a17b-43db-88d5-3e4097a0637c-volume-directive-shadow\") pod \"kube-state-metrics-785778ff74-kjwqv\" (UID: \"7d06e450-a17b-43db-88d5-3e4097a0637c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" Jul 09 17:29:08.683088 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.682994 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-textfile\" (UniqueName: \"kubernetes.io/empty-dir/aae4cc98-4596-4b38-9472-0015fdc477ca-node-exporter-textfile\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.683088 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.683063 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"root\" (UniqueName: \"kubernetes.io/host-path/aae4cc98-4596-4b38-9472-0015fdc477ca-root\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.684782 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.684720 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/7d06e450-a17b-43db-88d5-3e4097a0637c-metrics-client-ca\") pod \"kube-state-metrics-785778ff74-kjwqv\" (UID: \"7d06e450-a17b-43db-88d5-3e4097a0637c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" Jul 09 17:29:08.684947 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.684928 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/7d06e450-a17b-43db-88d5-3e4097a0637c-kube-state-metrics-kube-rbac-proxy-config\") pod \"kube-state-metrics-785778ff74-kjwqv\" (UID: \"7d06e450-a17b-43db-88d5-3e4097a0637c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" Jul 09 17:29:08.685283 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.685257 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/14f5c160-fa6f-4d39-930f-205e117ca850-openshift-state-metrics-kube-rbac-proxy-config\") pod \"openshift-state-metrics-84bd68b896-7p956\" (UID: \"14f5c160-fa6f-4d39-930f-205e117ca850\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7p956" Jul 09 17:29:08.685503 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.685475 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/aae4cc98-4596-4b38-9472-0015fdc477ca-node-exporter-kube-rbac-proxy-config\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:08.689401 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.689378 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-vmh8l\" (UniqueName: \"kubernetes.io/projected/7d06e450-a17b-43db-88d5-3e4097a0637c-kube-api-access-vmh8l\") pod \"kube-state-metrics-785778ff74-kjwqv\" (UID: \"7d06e450-a17b-43db-88d5-3e4097a0637c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" Jul 09 17:29:08.689599 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.689576 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kppdc\" (UniqueName: \"kubernetes.io/projected/14f5c160-fa6f-4d39-930f-205e117ca850-kube-api-access-kppdc\") pod \"openshift-state-metrics-84bd68b896-7p956\" (UID: \"14f5c160-fa6f-4d39-930f-205e117ca850\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7p956" Jul 09 17:29:08.690014 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:08.689950 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-fdfsl\" (UniqueName: \"kubernetes.io/projected/aae4cc98-4596-4b38-9472-0015fdc477ca-kube-api-access-fdfsl\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:09.186784 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.186739 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f5c160-fa6f-4d39-930f-205e117ca850-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7p956\" (UID: \"14f5c160-fa6f-4d39-930f-205e117ca850\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7p956" Jul 09 17:29:09.187260 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.186851 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aae4cc98-4596-4b38-9472-0015fdc477ca-node-exporter-tls\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:09.187260 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.186875 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d06e450-a17b-43db-88d5-3e4097a0637c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-kjwqv\" (UID: \"7d06e450-a17b-43db-88d5-3e4097a0637c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" Jul 09 17:29:09.187260 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:29:09.186982 2565 secret.go:189] Couldn't get secret openshift-monitoring/kube-state-metrics-tls: secret "kube-state-metrics-tls" not found Jul 09 17:29:09.187260 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:29:09.187052 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/7d06e450-a17b-43db-88d5-3e4097a0637c-kube-state-metrics-tls podName:7d06e450-a17b-43db-88d5-3e4097a0637c nodeName:}" failed. No retries permitted until 2026-07-09 17:29:10.187030432 +0000 UTC m=+63.243498977 (durationBeforeRetry 1s). Error: MountVolume.SetUp failed for volume "kube-state-metrics-tls" (UniqueName: "kubernetes.io/secret/7d06e450-a17b-43db-88d5-3e4097a0637c-kube-state-metrics-tls") pod "kube-state-metrics-785778ff74-kjwqv" (UID: "7d06e450-a17b-43db-88d5-3e4097a0637c") : secret "kube-state-metrics-tls" not found Jul 09 17:29:09.189328 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.189304 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"node-exporter-tls\" (UniqueName: \"kubernetes.io/secret/aae4cc98-4596-4b38-9472-0015fdc477ca-node-exporter-tls\") pod \"node-exporter-jgbld\" (UID: \"aae4cc98-4596-4b38-9472-0015fdc477ca\") " pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:09.189536 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.189513 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"openshift-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/14f5c160-fa6f-4d39-930f-205e117ca850-openshift-state-metrics-tls\") pod \"openshift-state-metrics-84bd68b896-7p956\" (UID: \"14f5c160-fa6f-4d39-930f-205e117ca850\") " pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7p956" Jul 09 17:29:09.374565 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.374535 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7p956" Jul 09 17:29:09.410496 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.410455 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/node-exporter-jgbld" Jul 09 17:29:09.532572 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.532537 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 17:29:09.566616 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.566582 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 17:29:09.566811 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.566789 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.569459 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.569162 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 17:29:09.569459 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.569189 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 17:29:09.569459 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.569283 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 17:29:09.569459 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.569287 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 17:29:09.569741 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.569613 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 17:29:09.569741 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.569622 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 17:29:09.569741 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.569690 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 17:29:09.569914 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.569790 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 17:29:09.569914 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.569795 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6r4mn\"" Jul 09 17:29:09.570040 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.570026 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 17:29:09.691729 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.691694 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.691936 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.691743 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-web-config\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.691936 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.691873 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02418a86-7d92-42ff-9323-6919708f2db8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.691936 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.691901 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.692078 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.691938 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-config-volume\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.692078 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.692009 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02418a86-7d92-42ff-9323-6919708f2db8-config-out\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.692078 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.692075 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02418a86-7d92-42ff-9323-6919708f2db8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.692213 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.692101 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s92t4\" (UniqueName: \"kubernetes.io/projected/02418a86-7d92-42ff-9323-6919708f2db8-kube-api-access-s92t4\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.692213 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.692133 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.692213 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.692173 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02418a86-7d92-42ff-9323-6919708f2db8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.692213 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.692201 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.692373 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.692222 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.692373 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.692280 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02418a86-7d92-42ff-9323-6919708f2db8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.793318 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.793286 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.793463 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.793331 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02418a86-7d92-42ff-9323-6919708f2db8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.793463 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.793395 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.793463 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.793446 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-web-config\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.793570 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.793509 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02418a86-7d92-42ff-9323-6919708f2db8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.793660 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.793643 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.793715 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.793701 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02418a86-7d92-42ff-9323-6919708f2db8-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.793799 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.793704 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-config-volume\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.793799 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.793790 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02418a86-7d92-42ff-9323-6919708f2db8-config-out\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.794134 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.794038 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02418a86-7d92-42ff-9323-6919708f2db8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.794134 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.794078 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s92t4\" (UniqueName: \"kubernetes.io/projected/02418a86-7d92-42ff-9323-6919708f2db8-kube-api-access-s92t4\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.794134 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.794111 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.794350 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.794154 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02418a86-7d92-42ff-9323-6919708f2db8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.794350 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.794181 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.794957 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.794575 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02418a86-7d92-42ff-9323-6919708f2db8-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.796513 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.796489 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02418a86-7d92-42ff-9323-6919708f2db8-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.796667 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.796523 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.796667 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.796526 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02418a86-7d92-42ff-9323-6919708f2db8-config-out\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.796667 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.796557 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-config-volume\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.796875 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.796728 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.796875 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.796781 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-web-config\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.797163 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.797137 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.797390 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.797368 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.798465 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.798446 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.798561 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.798535 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02418a86-7d92-42ff-9323-6919708f2db8-tls-assets\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.801748 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.801726 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s92t4\" (UniqueName: \"kubernetes.io/projected/02418a86-7d92-42ff-9323-6919708f2db8-kube-api-access-s92t4\") pod \"alertmanager-main-0\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:09.879307 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:09.879273 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:29:10.197391 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:10.197305 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d06e450-a17b-43db-88d5-3e4097a0637c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-kjwqv\" (UID: \"7d06e450-a17b-43db-88d5-3e4097a0637c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" Jul 09 17:29:10.199867 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:10.199835 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-state-metrics-tls\" (UniqueName: \"kubernetes.io/secret/7d06e450-a17b-43db-88d5-3e4097a0637c-kube-state-metrics-tls\") pod \"kube-state-metrics-785778ff74-kjwqv\" (UID: \"7d06e450-a17b-43db-88d5-3e4097a0637c\") " pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" Jul 09 17:29:10.302626 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:10.302592 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" Jul 09 17:29:10.975749 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:29:10.973580 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podaae4cc98_4596_4b38_9472_0015fdc477ca.slice/crio-7e3729a07c42299e9f407703812a69aaf2c38601510ed2a10cbf97e8fcf10243 WatchSource:0}: Error finding container 7e3729a07c42299e9f407703812a69aaf2c38601510ed2a10cbf97e8fcf10243: Status 404 returned error can't find the container with id 7e3729a07c42299e9f407703812a69aaf2c38601510ed2a10cbf97e8fcf10243 Jul 09 17:29:11.059380 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:11.059265 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jgbld" event={"ID":"aae4cc98-4596-4b38-9472-0015fdc477ca","Type":"ContainerStarted","Data":"7e3729a07c42299e9f407703812a69aaf2c38601510ed2a10cbf97e8fcf10243"} Jul 09 17:29:11.122214 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:11.122164 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/openshift-state-metrics-84bd68b896-7p956"] Jul 09 17:29:11.127052 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:29:11.127008 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod14f5c160_fa6f_4d39_930f_205e117ca850.slice/crio-8e1c4fcb4b46816e8c98f2e4e9d45738f2e0c14ae64508cbbb7f5e7b6a66b48c WatchSource:0}: Error finding container 8e1c4fcb4b46816e8c98f2e4e9d45738f2e0c14ae64508cbbb7f5e7b6a66b48c: Status 404 returned error can't find the container with id 8e1c4fcb4b46816e8c98f2e4e9d45738f2e0c14ae64508cbbb7f5e7b6a66b48c Jul 09 17:29:11.349869 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:11.349780 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/kube-state-metrics-785778ff74-kjwqv"] Jul 09 17:29:11.353534 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:11.353507 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 17:29:11.354672 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:29:11.354646 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod7d06e450_a17b_43db_88d5_3e4097a0637c.slice/crio-394302a710d294abb6cdba3949ec781359e1e5c458a8216694595571308cf0b1 WatchSource:0}: Error finding container 394302a710d294abb6cdba3949ec781359e1e5c458a8216694595571308cf0b1: Status 404 returned error can't find the container with id 394302a710d294abb6cdba3949ec781359e1e5c458a8216694595571308cf0b1 Jul 09 17:29:11.358274 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:29:11.358160 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod02418a86_7d92_42ff_9323_6919708f2db8.slice/crio-3daf2db8ece0c5e1e89446d3a8ea2fd06511eee6cd9271425cb5c9852b099068 WatchSource:0}: Error finding container 3daf2db8ece0c5e1e89446d3a8ea2fd06511eee6cd9271425cb5c9852b099068: Status 404 returned error can't find the container with id 3daf2db8ece0c5e1e89446d3a8ea2fd06511eee6cd9271425cb5c9852b099068 Jul 09 17:29:12.064542 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:12.064501 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" event={"ID":"7d06e450-a17b-43db-88d5-3e4097a0637c","Type":"ContainerStarted","Data":"394302a710d294abb6cdba3949ec781359e1e5c458a8216694595571308cf0b1"} Jul 09 17:29:12.067092 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:12.067063 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-insights/insights-runtime-extractor-7xbrm" event={"ID":"11b882e4-5a66-45f9-b3d5-a9d2b5831480","Type":"ContainerStarted","Data":"984026df0c1c9a1e1f9ea92e5fe2ea3c365c65d89858a3d4b2089e5647176b3e"} Jul 09 17:29:12.069314 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:12.069289 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7p956" event={"ID":"14f5c160-fa6f-4d39-930f-205e117ca850","Type":"ContainerStarted","Data":"a19dd6e6510387cbad2e5814f9db50b71aee803609c60819cbe6c1f3268687cb"} Jul 09 17:29:12.069445 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:12.069343 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7p956" event={"ID":"14f5c160-fa6f-4d39-930f-205e117ca850","Type":"ContainerStarted","Data":"82713df7a953edfee2999fb7354a8237f8861a4190bde2837bb3120ff03dd7ce"} Jul 09 17:29:12.069445 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:12.069371 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7p956" event={"ID":"14f5c160-fa6f-4d39-930f-205e117ca850","Type":"ContainerStarted","Data":"8e1c4fcb4b46816e8c98f2e4e9d45738f2e0c14ae64508cbbb7f5e7b6a66b48c"} Jul 09 17:29:12.071095 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:12.071061 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02418a86-7d92-42ff-9323-6919708f2db8","Type":"ContainerStarted","Data":"3daf2db8ece0c5e1e89446d3a8ea2fd06511eee6cd9271425cb5c9852b099068"} Jul 09 17:29:12.073533 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:12.073474 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76c86fb65c-6drhc" event={"ID":"1648feda-fed8-4e7d-a64e-6925eee3acdc","Type":"ContainerStarted","Data":"e512f5e8e3aadb6b27f939c2397a9e4a891edd91fd34ae54e99227d122b1d7c3"} Jul 09 17:29:12.075846 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:12.075823 2565 generic.go:356] "Generic (PLEG): container finished" podID="aae4cc98-4596-4b38-9472-0015fdc477ca" containerID="5484bad3bf44dce4cbf7a34656ee8ad8f6a021e8cd4bb74f25b9b69e3525a224" exitCode=0 Jul 09 17:29:12.075961 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:12.075872 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jgbld" event={"ID":"aae4cc98-4596-4b38-9472-0015fdc477ca","Type":"ContainerDied","Data":"5484bad3bf44dce4cbf7a34656ee8ad8f6a021e8cd4bb74f25b9b69e3525a224"} Jul 09 17:29:12.099851 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:12.099736 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-insights/insights-runtime-extractor-7xbrm" podStartSLOduration=2.054052552 podStartE2EDuration="12.099714654s" totalImagesPullingTime="10.045662102s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:29:00 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:12.084382296 +0000 UTC m=+65.140850796" watchObservedRunningTime="2026-07-09 17:29:12.099714654 +0000 UTC m=+65.156183155" Jul 09 17:29:12.099990 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:12.099949 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-console/console-76c86fb65c-6drhc" podStartSLOduration=2.729175563 podStartE2EDuration="7.0999395s" totalImagesPullingTime="4.370763937s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:29:05 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:12.098630904 +0000 UTC m=+65.155099565" watchObservedRunningTime="2026-07-09 17:29:12.0999395 +0000 UTC m=+65.156408002" Jul 09 17:29:13.082768 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.082719 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jgbld" event={"ID":"aae4cc98-4596-4b38-9472-0015fdc477ca","Type":"ContainerStarted","Data":"219a8abbe12329af4b1deb68c785590a8482dd2edbccbf46f157c9e2d4f329ae"} Jul 09 17:29:13.083148 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.082793 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/node-exporter-jgbld" event={"ID":"aae4cc98-4596-4b38-9472-0015fdc477ca","Type":"ContainerStarted","Data":"015e722e4272576df0d759ddbba4886a8c97b5fcbe669440de4d460a880a2d76"} Jul 09 17:29:13.103078 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.103019 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/node-exporter-jgbld" podStartSLOduration=4.252033539 podStartE2EDuration="5.103004188s" totalImagesPullingTime="785.431046ms" totalInitContainerRuntime="65.539603ms" isStatefulPod=true podCreationTimestamp="2026-07-09 17:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:13.101549817 +0000 UTC m=+66.158018318" watchObservedRunningTime="2026-07-09 17:29:13.103004188 +0000 UTC m=+66.159472753" Jul 09 17:29:13.273592 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.273562 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-c9v69"] Jul 09 17:29:13.275576 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.275555 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9v69" Jul 09 17:29:13.278747 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.278321 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-cert\"" Jul 09 17:29:13.278747 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.278604 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"monitoring-plugin-dockercfg-f4z7q\"" Jul 09 17:29:13.299261 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.299187 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-c9v69"] Jul 09 17:29:13.431264 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.431223 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhppr\" (UniqueName: \"kubernetes.io/projected/3c629acc-33b4-419a-a35a-9c257ff60bce-kube-api-access-bhppr\") pod \"monitoring-plugin-5f68df7f58-c9v69\" (UID: \"3c629acc-33b4-419a-a35a-9c257ff60bce\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9v69" Jul 09 17:29:13.431434 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.431381 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3c629acc-33b4-419a-a35a-9c257ff60bce-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-c9v69\" (UID: \"3c629acc-33b4-419a-a35a-9c257ff60bce\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9v69" Jul 09 17:29:13.532274 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.532242 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3c629acc-33b4-419a-a35a-9c257ff60bce-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-c9v69\" (UID: \"3c629acc-33b4-419a-a35a-9c257ff60bce\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9v69" Jul 09 17:29:13.532569 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.532294 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhppr\" (UniqueName: \"kubernetes.io/projected/3c629acc-33b4-419a-a35a-9c257ff60bce-kube-api-access-bhppr\") pod \"monitoring-plugin-5f68df7f58-c9v69\" (UID: \"3c629acc-33b4-419a-a35a-9c257ff60bce\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9v69" Jul 09 17:29:13.534678 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.534654 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"monitoring-plugin-cert\" (UniqueName: \"kubernetes.io/secret/3c629acc-33b4-419a-a35a-9c257ff60bce-monitoring-plugin-cert\") pod \"monitoring-plugin-5f68df7f58-c9v69\" (UID: \"3c629acc-33b4-419a-a35a-9c257ff60bce\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9v69" Jul 09 17:29:13.539897 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.539865 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhppr\" (UniqueName: \"kubernetes.io/projected/3c629acc-33b4-419a-a35a-9c257ff60bce-kube-api-access-bhppr\") pod \"monitoring-plugin-5f68df7f58-c9v69\" (UID: \"3c629acc-33b4-419a-a35a-9c257ff60bce\") " pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9v69" Jul 09 17:29:13.592513 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.592151 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9v69" Jul 09 17:29:13.663284 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.663251 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr"] Jul 09 17:29:13.666359 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.666339 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.668751 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.668728 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-kube-rbac-proxy-config\"" Jul 09 17:29:13.668751 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.668728 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client\"" Jul 09 17:29:13.668751 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.668797 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-client-serving-certs-ca-bundle\"" Jul 09 17:29:13.669000 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.668729 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-dockercfg-qslsg\"" Jul 09 17:29:13.669000 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.668925 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"federate-client-certs\"" Jul 09 17:29:13.669182 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.669167 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"telemeter-client-tls\"" Jul 09 17:29:13.673403 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.673385 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"telemeter-trusted-ca-bundle-8i12ta5c71j38\"" Jul 09 17:29:13.681530 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.681505 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr"] Jul 09 17:29:13.721575 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.721546 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/monitoring-plugin-5f68df7f58-c9v69"] Jul 09 17:29:13.724325 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:29:13.724294 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3c629acc_33b4_419a_a35a_9c257ff60bce.slice/crio-4a04fdc02b8822f70a735424bd5a58ad1bb36e5835af72a8abcd7fe4a9c3dd17 WatchSource:0}: Error finding container 4a04fdc02b8822f70a735424bd5a58ad1bb36e5835af72a8abcd7fe4a9c3dd17: Status 404 returned error can't find the container with id 4a04fdc02b8822f70a735424bd5a58ad1bb36e5835af72a8abcd7fe4a9c3dd17 Jul 09 17:29:13.734992 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.734969 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs\") pod \"network-metrics-daemon-ggmkn\" (UID: \"8c6c5488-442d-41ea-b935-31c21f226a7c\") " pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:29:13.735087 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.734999 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret\") pod \"global-pull-secret-syncer-gnf2w\" (UID: \"50daa15b-9979-4a9f-a901-28e3d607c74e\") " pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:29:13.737276 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.737260 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-secret\"" Jul 09 17:29:13.737322 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.737282 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kube-system\"/\"original-pull-secret\"" Jul 09 17:29:13.747420 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.747397 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-certs\" (UniqueName: \"kubernetes.io/secret/8c6c5488-442d-41ea-b935-31c21f226a7c-metrics-certs\") pod \"network-metrics-daemon-ggmkn\" (UID: \"8c6c5488-442d-41ea-b935-31c21f226a7c\") " pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:29:13.747503 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.747440 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"original-pull-secret\" (UniqueName: \"kubernetes.io/secret/50daa15b-9979-4a9f-a901-28e3d607c74e-original-pull-secret\") pod \"global-pull-secret-syncer-gnf2w\" (UID: \"50daa15b-9979-4a9f-a901-28e3d607c74e\") " pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:29:13.836106 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.836070 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/59510e8c-3519-4fcf-9747-d4ea71255bcb-federate-client-tls\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.836211 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.836116 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n42z6\" (UniqueName: \"kubernetes.io/projected/59510e8c-3519-4fcf-9747-d4ea71255bcb-kube-api-access-n42z6\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.836211 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.836145 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59510e8c-3519-4fcf-9747-d4ea71255bcb-metrics-client-ca\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.836211 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.836162 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59510e8c-3519-4fcf-9747-d4ea71255bcb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.836211 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.836181 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59510e8c-3519-4fcf-9747-d4ea71255bcb-serving-certs-ca-bundle\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.836211 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.836208 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/59510e8c-3519-4fcf-9747-d4ea71255bcb-telemeter-client-tls\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.836390 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.836233 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59510e8c-3519-4fcf-9747-d4ea71255bcb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.836390 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.836265 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/59510e8c-3519-4fcf-9747-d4ea71255bcb-secret-telemeter-client\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.866491 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.866429 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-multus\"/\"metrics-daemon-sa-dockercfg-ls9tf\"" Jul 09 17:29:13.873309 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.873290 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kube-system/global-pull-secret-syncer-gnf2w" Jul 09 17:29:13.874338 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.874323 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-multus/network-metrics-daemon-ggmkn" Jul 09 17:29:13.936828 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.936721 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mstwd\" (UniqueName: \"kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd\") pod \"network-check-target-xnjp4\" (UID: \"3f81edf7-c666-416f-9cdf-99917a6759cd\") " pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:29:13.936828 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.936796 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/59510e8c-3519-4fcf-9747-d4ea71255bcb-federate-client-tls\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.936828 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.936829 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n42z6\" (UniqueName: \"kubernetes.io/projected/59510e8c-3519-4fcf-9747-d4ea71255bcb-kube-api-access-n42z6\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.937073 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.936883 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59510e8c-3519-4fcf-9747-d4ea71255bcb-metrics-client-ca\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.937073 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.936907 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59510e8c-3519-4fcf-9747-d4ea71255bcb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.937073 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.936937 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59510e8c-3519-4fcf-9747-d4ea71255bcb-serving-certs-ca-bundle\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.937073 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.936959 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/59510e8c-3519-4fcf-9747-d4ea71255bcb-telemeter-client-tls\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.937073 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.936989 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59510e8c-3519-4fcf-9747-d4ea71255bcb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.937073 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.937044 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/59510e8c-3519-4fcf-9747-d4ea71255bcb-secret-telemeter-client\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.938304 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.938274 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59510e8c-3519-4fcf-9747-d4ea71255bcb-serving-certs-ca-bundle\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.938579 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.938535 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/59510e8c-3519-4fcf-9747-d4ea71255bcb-telemeter-trusted-ca-bundle\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.938579 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.938571 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/59510e8c-3519-4fcf-9747-d4ea71255bcb-metrics-client-ca\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.939940 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.939917 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"kube-root-ca.crt\"" Jul 09 17:29:13.940684 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.940641 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client\" (UniqueName: \"kubernetes.io/secret/59510e8c-3519-4fcf-9747-d4ea71255bcb-secret-telemeter-client\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.941264 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.941243 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"telemeter-client-tls\" (UniqueName: \"kubernetes.io/secret/59510e8c-3519-4fcf-9747-d4ea71255bcb-telemeter-client-tls\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.941350 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.941330 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"federate-client-tls\" (UniqueName: \"kubernetes.io/secret/59510e8c-3519-4fcf-9747-d4ea71255bcb-federate-client-tls\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.941777 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.941742 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-telemeter-client-kube-rbac-proxy-config\" (UniqueName: \"kubernetes.io/secret/59510e8c-3519-4fcf-9747-d4ea71255bcb-secret-telemeter-client-kube-rbac-proxy-config\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.945022 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.945002 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n42z6\" (UniqueName: \"kubernetes.io/projected/59510e8c-3519-4fcf-9747-d4ea71255bcb-kube-api-access-n42z6\") pod \"telemeter-client-587c7d8fb7-kdzrr\" (UID: \"59510e8c-3519-4fcf-9747-d4ea71255bcb\") " pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:13.949867 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.949850 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-network-diagnostics\"/\"openshift-service-ca.crt\"" Jul 09 17:29:13.961501 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.961321 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mstwd\" (UniqueName: \"kubernetes.io/projected/3f81edf7-c666-416f-9cdf-99917a6759cd-kube-api-access-mstwd\") pod \"network-check-target-xnjp4\" (UID: \"3f81edf7-c666-416f-9cdf-99917a6759cd\") " pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:29:13.975172 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:13.975143 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" Jul 09 17:29:14.009586 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.009560 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-multus/network-metrics-daemon-ggmkn"] Jul 09 17:29:14.013065 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:29:14.013039 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8c6c5488_442d_41ea_b935_31c21f226a7c.slice/crio-424e4b262bf3aa7459d675ea01ff8eb04415b4b934292fb118e38b2f66a4232a WatchSource:0}: Error finding container 424e4b262bf3aa7459d675ea01ff8eb04415b4b934292fb118e38b2f66a4232a: Status 404 returned error can't find the container with id 424e4b262bf3aa7459d675ea01ff8eb04415b4b934292fb118e38b2f66a4232a Jul 09 17:29:14.024651 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.024519 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kube-system/global-pull-secret-syncer-gnf2w"] Jul 09 17:29:14.028652 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:29:14.028622 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod50daa15b_9979_4a9f_a901_28e3d607c74e.slice/crio-5154a7207adc33999b7d3f7169cdcfd6629756265854d1396701985558ef9b81 WatchSource:0}: Error finding container 5154a7207adc33999b7d3f7169cdcfd6629756265854d1396701985558ef9b81: Status 404 returned error can't find the container with id 5154a7207adc33999b7d3f7169cdcfd6629756265854d1396701985558ef9b81 Jul 09 17:29:14.096142 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.096099 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7p956" event={"ID":"14f5c160-fa6f-4d39-930f-205e117ca850","Type":"ContainerStarted","Data":"8116c5dde04ff85311536fe39a719afab9954e1152c9e8d3f20821c426efac31"} Jul 09 17:29:14.097582 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.097559 2565 generic.go:356] "Generic (PLEG): container finished" podID="02418a86-7d92-42ff-9323-6919708f2db8" containerID="4c90ba0cf30dc158c9adfbd815bfe36f45e8224503077ba9f336bf6000f2ae49" exitCode=0 Jul 09 17:29:14.097688 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.097631 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02418a86-7d92-42ff-9323-6919708f2db8","Type":"ContainerDied","Data":"4c90ba0cf30dc158c9adfbd815bfe36f45e8224503077ba9f336bf6000f2ae49"} Jul 09 17:29:14.098867 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.098841 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ggmkn" event={"ID":"8c6c5488-442d-41ea-b935-31c21f226a7c","Type":"ContainerStarted","Data":"424e4b262bf3aa7459d675ea01ff8eb04415b4b934292fb118e38b2f66a4232a"} Jul 09 17:29:14.100033 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.100011 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gnf2w" event={"ID":"50daa15b-9979-4a9f-a901-28e3d607c74e","Type":"ContainerStarted","Data":"5154a7207adc33999b7d3f7169cdcfd6629756265854d1396701985558ef9b81"} Jul 09 17:29:14.101236 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.101216 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9v69" event={"ID":"3c629acc-33b4-419a-a35a-9c257ff60bce","Type":"ContainerStarted","Data":"4a04fdc02b8822f70a735424bd5a58ad1bb36e5835af72a8abcd7fe4a9c3dd17"} Jul 09 17:29:14.103082 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.103056 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" event={"ID":"7d06e450-a17b-43db-88d5-3e4097a0637c","Type":"ContainerStarted","Data":"5146ae3eecd74cf3df37b88eb9249a0a39c3b2151b2a30dcadc74f0a2e7eabe6"} Jul 09 17:29:14.103147 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.103094 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" event={"ID":"7d06e450-a17b-43db-88d5-3e4097a0637c","Type":"ContainerStarted","Data":"78311de41f19ac167d4c6993a9f1709e3712f6d7f413c23ca9cfc7b732ecd639"} Jul 09 17:29:14.103147 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.103114 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" event={"ID":"7d06e450-a17b-43db-88d5-3e4097a0637c","Type":"ContainerStarted","Data":"0c368a7c31acaf3d4d0eba0584f846ac5158338b083fea7917c24b6e7c3751ad"} Jul 09 17:29:14.110867 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.110844 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr"] Jul 09 17:29:14.112053 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.112017 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/openshift-state-metrics-84bd68b896-7p956" podStartSLOduration=4.233104066 podStartE2EDuration="6.112005048s" totalImagesPullingTime="1.878900982s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:14.111189331 +0000 UTC m=+67.167657851" watchObservedRunningTime="2026-07-09 17:29:14.112005048 +0000 UTC m=+67.168473573" Jul 09 17:29:14.113995 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:29:14.113974 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod59510e8c_3519_4fcf_9747_d4ea71255bcb.slice/crio-baa1e9cf8e9be58acb86bbe824678d1d74bb87d77d9271f8f8377750b7f76d36 WatchSource:0}: Error finding container baa1e9cf8e9be58acb86bbe824678d1d74bb87d77d9271f8f8377750b7f76d36: Status 404 returned error can't find the container with id baa1e9cf8e9be58acb86bbe824678d1d74bb87d77d9271f8f8377750b7f76d36 Jul 09 17:29:14.151305 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.151260 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/kube-state-metrics-785778ff74-kjwqv" podStartSLOduration=4.389698091 podStartE2EDuration="6.151245094s" totalImagesPullingTime="1.761547003s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:29:08 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:14.150601111 +0000 UTC m=+67.207069635" watchObservedRunningTime="2026-07-09 17:29:14.151245094 +0000 UTC m=+67.207713594" Jul 09 17:29:14.154077 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.154058 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-network-diagnostics\"/\"default-dockercfg-8889q\"" Jul 09 17:29:14.162922 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.162903 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:29:14.286313 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.286279 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-network-diagnostics/network-check-target-xnjp4"] Jul 09 17:29:14.289233 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:29:14.289206 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f81edf7_c666_416f_9cdf_99917a6759cd.slice/crio-0e6ef4dd0c08e0c31376c1d439c7e098c96f10b76bbe779b3805045d896c7234 WatchSource:0}: Error finding container 0e6ef4dd0c08e0c31376c1d439c7e098c96f10b76bbe779b3805045d896c7234: Status 404 returned error can't find the container with id 0e6ef4dd0c08e0c31376c1d439c7e098c96f10b76bbe779b3805045d896c7234 Jul 09 17:29:14.642037 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.639964 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 17:29:14.650143 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.646935 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.650310 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.650293 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 17:29:14.650624 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.650600 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mkvz8\"" Jul 09 17:29:14.650860 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.650825 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 17:29:14.651171 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.651153 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 17:29:14.651329 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.651308 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 17:29:14.651487 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.650903 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 17:29:14.651572 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.650600 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 17:29:14.651852 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.651833 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 17:29:14.652038 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.651991 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 17:29:14.652409 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.652390 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 17:29:14.652603 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.652587 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 17:29:14.652708 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.652693 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 17:29:14.653034 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.653018 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 17:29:14.653359 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.653345 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 17:29:14.653596 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.652617 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 17:29:14.667986 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.652661 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c81j6njkqbs5j\"" Jul 09 17:29:14.667986 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.661657 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 17:29:14.669607 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.669582 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 17:29:14.750582 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.750545 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.750744 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.750596 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.750744 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.750623 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.750744 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.750658 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.750744 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.750682 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.750744 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.750704 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-config-out\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.750744 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.750732 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.751085 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.750822 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.751085 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.750855 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-config\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.751085 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.750881 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.751085 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.750912 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.751085 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.750965 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.751085 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.751005 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.751085 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.751048 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.751085 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.751079 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.751518 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.751105 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-pw42b\" (UniqueName: \"kubernetes.io/projected/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-kube-api-access-pw42b\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.751518 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.751133 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.751518 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.751163 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-web-config\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.751518 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.751194 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.751518 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.751238 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.853063 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.852210 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.853063 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.852268 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.853063 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.852297 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-pw42b\" (UniqueName: \"kubernetes.io/projected/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-kube-api-access-pw42b\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.853063 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.852327 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.853063 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.852361 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-web-config\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.853063 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.852430 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.853063 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.852475 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.853063 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.852517 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.853063 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.852545 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.853063 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.852568 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.853063 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.852598 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.853063 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.852622 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.853063 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.852671 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-config-out\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.853063 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.852694 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.853063 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.852739 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.853063 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.852785 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-config\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.853063 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.852808 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.855576 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.852835 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.855576 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.852868 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.855576 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.852893 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.855576 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.855327 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.855576 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.855435 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.855576 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.855533 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.855878 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.855618 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.863051 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.861709 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.863051 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.861933 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-config-out\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.863051 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.862553 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.866338 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.865466 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.866338 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.865943 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.866918 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.866896 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.868443 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.868040 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.872268 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.872241 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.872473 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.872448 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-pw42b\" (UniqueName: \"kubernetes.io/projected/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-kube-api-access-pw42b\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.873034 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.873016 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-web-config\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.874423 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.874399 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.874642 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.874435 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-config\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.874811 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.874785 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.875032 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.875010 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.875160 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.875118 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.877444 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.877404 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:14.973027 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:14.972710 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:15.116515 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:15.116367 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xnjp4" event={"ID":"3f81edf7-c666-416f-9cdf-99917a6759cd","Type":"ContainerStarted","Data":"0e6ef4dd0c08e0c31376c1d439c7e098c96f10b76bbe779b3805045d896c7234"} Jul 09 17:29:15.141456 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:15.140442 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" event={"ID":"59510e8c-3519-4fcf-9747-d4ea71255bcb","Type":"ContainerStarted","Data":"baa1e9cf8e9be58acb86bbe824678d1d74bb87d77d9271f8f8377750b7f76d36"} Jul 09 17:29:15.184086 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:15.183977 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 17:29:16.179295 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:16.179257 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:16.179883 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:16.179327 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:16.185223 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:16.185200 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:16.314141 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:29:16.314102 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3f1c8954_5f15_4ee1_9cff_6a8277f99c50.slice/crio-9ba9dece2eabbcf2328949a823645301e1757a93ed1363f1c111098086864888 WatchSource:0}: Error finding container 9ba9dece2eabbcf2328949a823645301e1757a93ed1363f1c111098086864888: Status 404 returned error can't find the container with id 9ba9dece2eabbcf2328949a823645301e1757a93ed1363f1c111098086864888 Jul 09 17:29:17.048175 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:17.048144 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-dns/dns-default-xklhh" Jul 09 17:29:17.150422 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:17.150383 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1c8954-5f15-4ee1-9cff-6a8277f99c50","Type":"ContainerStarted","Data":"9ba9dece2eabbcf2328949a823645301e1757a93ed1363f1c111098086864888"} Jul 09 17:29:17.155263 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:17.155223 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:21.178500 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.178465 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-network-diagnostics/network-check-target-xnjp4" event={"ID":"3f81edf7-c666-416f-9cdf-99917a6759cd","Type":"ContainerStarted","Data":"47dabb27959220a3ab16b108e23997b826966873db4a7664691351f4aaf86db1"} Jul 09 17:29:21.178932 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.178581 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:29:21.180508 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.180477 2565 generic.go:356] "Generic (PLEG): container finished" podID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerID="eea1c0dfac87b9b2399b7d5b42ae97abf060d5874c3fe4dfe0c4193aadf0b9b4" exitCode=0 Jul 09 17:29:21.180647 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.180568 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1c8954-5f15-4ee1-9cff-6a8277f99c50","Type":"ContainerDied","Data":"eea1c0dfac87b9b2399b7d5b42ae97abf060d5874c3fe4dfe0c4193aadf0b9b4"} Jul 09 17:29:21.192634 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.192602 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02418a86-7d92-42ff-9323-6919708f2db8","Type":"ContainerStarted","Data":"735f15a57e905ee9bd6bcc7075bec9a8bd920968e039badb66811546e97bdb68"} Jul 09 17:29:21.192745 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.192713 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02418a86-7d92-42ff-9323-6919708f2db8","Type":"ContainerStarted","Data":"71ece860a3e39af11b23d0a91669a824900eafa8d1592457e8b0ab569fcfea41"} Jul 09 17:29:21.192829 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.192747 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02418a86-7d92-42ff-9323-6919708f2db8","Type":"ContainerStarted","Data":"4e4c296cefd7a24d14d29a6614f8b03ab68e5a36a83ffa2011f8b8011ff16c79"} Jul 09 17:29:21.192829 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.192799 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02418a86-7d92-42ff-9323-6919708f2db8","Type":"ContainerStarted","Data":"7194a16d8ff8bb0a9d5c28f9eb132571ec121f509087f7708ac8caafa62a5e64"} Jul 09 17:29:21.192929 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.192835 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02418a86-7d92-42ff-9323-6919708f2db8","Type":"ContainerStarted","Data":"3d3aede7866bfd307f1e55979302200f73da476a708d3df4763228b3c7dc3275"} Jul 09 17:29:21.194494 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.194444 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-network-diagnostics/network-check-target-xnjp4" podStartSLOduration=68.366903152 podStartE2EDuration="1m14.194427891s" totalImagesPullingTime="5.827524739s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:21.19320273 +0000 UTC m=+74.249671231" watchObservedRunningTime="2026-07-09 17:29:21.194427891 +0000 UTC m=+74.250896373" Jul 09 17:29:21.195664 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.195634 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ggmkn" event={"ID":"8c6c5488-442d-41ea-b935-31c21f226a7c","Type":"ContainerStarted","Data":"ff9d71d205212f6f1df274384e2d25b0d745182747dcd8bfefece39e36db2166"} Jul 09 17:29:21.195751 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.195681 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-multus/network-metrics-daemon-ggmkn" event={"ID":"8c6c5488-442d-41ea-b935-31c21f226a7c","Type":"ContainerStarted","Data":"5f83de454262c94e301ac96111f9967ab0c1d58cb5178a6f4b3b13c51dfaa817"} Jul 09 17:29:21.197307 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.197285 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kube-system/global-pull-secret-syncer-gnf2w" event={"ID":"50daa15b-9979-4a9f-a901-28e3d607c74e","Type":"ContainerStarted","Data":"343ca5e475d8ee0ec456d076bebe7c0b79ce93c9d5655dad31da388cb8f405ef"} Jul 09 17:29:21.199069 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.199039 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9v69" event={"ID":"3c629acc-33b4-419a-a35a-9c257ff60bce","Type":"ContainerStarted","Data":"ed00573ad7f5a514f3cea804cf3885ecae47fd6233475feff2ce89e1521bc7d3"} Jul 09 17:29:21.199214 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.199197 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9v69" Jul 09 17:29:21.202115 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.202091 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" event={"ID":"59510e8c-3519-4fcf-9747-d4ea71255bcb","Type":"ContainerStarted","Data":"80c1a9186de8e138a85a2d61ed12148a4ad2bd80d561c3d7a2d1bee9f7472542"} Jul 09 17:29:21.202211 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.202152 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" event={"ID":"59510e8c-3519-4fcf-9747-d4ea71255bcb","Type":"ContainerStarted","Data":"e7afcc1969cc6ee9dd05e12c36019365d0f8aaffb9ab6d3b857b1ebf4927f6a2"} Jul 09 17:29:21.202211 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.202173 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" event={"ID":"59510e8c-3519-4fcf-9747-d4ea71255bcb","Type":"ContainerStarted","Data":"d14264e381c4bdcbed14acbf264c8cd706362ae579dc585f1ea9411bc96c7936"} Jul 09 17:29:21.205611 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.205591 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9v69" Jul 09 17:29:21.241845 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.241797 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/telemeter-client-587c7d8fb7-kdzrr" podStartSLOduration=2.25501393 podStartE2EDuration="8.241782591s" totalImagesPullingTime="5.986768661s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:29:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:21.240100389 +0000 UTC m=+74.296568916" watchObservedRunningTime="2026-07-09 17:29:21.241782591 +0000 UTC m=+74.298251091" Jul 09 17:29:21.253871 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.253827 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kube-system/global-pull-secret-syncer-gnf2w" podStartSLOduration=68.160914036 podStartE2EDuration="1m14.253811287s" totalImagesPullingTime="6.092897251s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 17:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:21.253429938 +0000 UTC m=+74.309898458" watchObservedRunningTime="2026-07-09 17:29:21.253811287 +0000 UTC m=+74.310279786" Jul 09 17:29:21.270871 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.270827 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/monitoring-plugin-5f68df7f58-c9v69" podStartSLOduration=1.899020112 podStartE2EDuration="8.270815059s" totalImagesPullingTime="6.371794947s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:29:13 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:21.269641866 +0000 UTC m=+74.326110388" watchObservedRunningTime="2026-07-09 17:29:21.270815059 +0000 UTC m=+74.327283558" Jul 09 17:29:21.285529 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:21.285490 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-multus/network-metrics-daemon-ggmkn" podStartSLOduration=68.23458685 podStartE2EDuration="1m14.285476648s" totalImagesPullingTime="6.050889798s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:28:07 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:21.284032743 +0000 UTC m=+74.340501244" watchObservedRunningTime="2026-07-09 17:29:21.285476648 +0000 UTC m=+74.341945148" Jul 09 17:29:22.211429 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:22.211388 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02418a86-7d92-42ff-9323-6919708f2db8","Type":"ContainerStarted","Data":"fca780866d159607186f81cc5f66ebe4720c844d008074e00780d4ae5210f1bb"} Jul 09 17:29:22.244073 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:22.244021 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=4.533324605 podStartE2EDuration="13.24400445s" totalImagesPullingTime="8.685817123s" totalInitContainerRuntime="24.862722ms" isStatefulPod=false podCreationTimestamp="2026-07-09 17:29:09 +0000 UTC" imagePullSessionsCount=3 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:22.24273935 +0000 UTC m=+75.299207852" watchObservedRunningTime="2026-07-09 17:29:22.24400445 +0000 UTC m=+75.300472949" Jul 09 17:29:25.226092 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:25.226059 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1c8954-5f15-4ee1-9cff-6a8277f99c50","Type":"ContainerStarted","Data":"a9c40dcd521f44eb22595575ebd0b3e77d8cc3ad218a6e5e297cf6bc0ca0264c"} Jul 09 17:29:25.226457 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:25.226124 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1c8954-5f15-4ee1-9cff-6a8277f99c50","Type":"ContainerStarted","Data":"3266afd49125f61119c74644b45ba5b00faee6f8b52891005275df5b0dceecf8"} Jul 09 17:29:27.237519 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:27.237480 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1c8954-5f15-4ee1-9cff-6a8277f99c50","Type":"ContainerStarted","Data":"59d7ed8b9fd0f3e7f4eeebd0ee8b7b7c63d79912e36c0812ca677ed8fad0431c"} Jul 09 17:29:27.237966 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:27.237575 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1c8954-5f15-4ee1-9cff-6a8277f99c50","Type":"ContainerStarted","Data":"65f050e9933b6261b4749da9da1ba58306ad46c8b4780c9f9a3d1f28ed734ea8"} Jul 09 17:29:27.237966 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:27.237613 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1c8954-5f15-4ee1-9cff-6a8277f99c50","Type":"ContainerStarted","Data":"da45c49603c101f74559133a26117c2b84839ea2fd2ef134c8486967f7919a92"} Jul 09 17:29:27.237966 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:27.237649 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1c8954-5f15-4ee1-9cff-6a8277f99c50","Type":"ContainerStarted","Data":"6e1c20a24c641e6eb552b7b68872ff8529699f7a585b9780126af5458cd5b93e"} Jul 09 17:29:27.265186 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:27.265134 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=7.757933458 podStartE2EDuration="13.265112972s" totalImagesPullingTime="5.473848015s" totalInitContainerRuntime="33.331499ms" isStatefulPod=false podCreationTimestamp="2026-07-09 17:29:14 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:29:27.262557357 +0000 UTC m=+80.319025875" watchObservedRunningTime="2026-07-09 17:29:27.265112972 +0000 UTC m=+80.321581473" Jul 09 17:29:29.974136 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:29.974028 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:29:33.165318 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:33.165288 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76c86fb65c-6drhc"] Jul 09 17:29:52.214069 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:52.214039 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-network-diagnostics/network-check-target-xnjp4" Jul 09 17:29:58.186486 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.186421 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-console/console-76c86fb65c-6drhc" podUID="1648feda-fed8-4e7d-a64e-6925eee3acdc" containerName="console" containerID="cri-o://e512f5e8e3aadb6b27f939c2397a9e4a891edd91fd34ae54e99227d122b1d7c3" gracePeriod=15 Jul 09 17:29:58.363107 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.362927 2565 generic.go:356] "Generic (PLEG): container finished" podID="1648feda-fed8-4e7d-a64e-6925eee3acdc" containerID="e512f5e8e3aadb6b27f939c2397a9e4a891edd91fd34ae54e99227d122b1d7c3" exitCode=0 Jul 09 17:29:58.363107 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.363042 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76c86fb65c-6drhc" event={"ID":"1648feda-fed8-4e7d-a64e-6925eee3acdc","Type":"ContainerDied","Data":"e512f5e8e3aadb6b27f939c2397a9e4a891edd91fd34ae54e99227d122b1d7c3"} Jul 09 17:29:58.426071 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.426049 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:58.535137 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.535110 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-oauth-serving-cert\") pod \"1648feda-fed8-4e7d-a64e-6925eee3acdc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " Jul 09 17:29:58.535300 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.535160 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-console-config\") pod \"1648feda-fed8-4e7d-a64e-6925eee3acdc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " Jul 09 17:29:58.535300 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.535196 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1648feda-fed8-4e7d-a64e-6925eee3acdc-console-oauth-config\") pod \"1648feda-fed8-4e7d-a64e-6925eee3acdc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " Jul 09 17:29:58.535300 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.535232 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1648feda-fed8-4e7d-a64e-6925eee3acdc-console-serving-cert\") pod \"1648feda-fed8-4e7d-a64e-6925eee3acdc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " Jul 09 17:29:58.535300 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.535255 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-service-ca\") pod \"1648feda-fed8-4e7d-a64e-6925eee3acdc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " Jul 09 17:29:58.535300 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.535272 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6m6kl\" (UniqueName: \"kubernetes.io/projected/1648feda-fed8-4e7d-a64e-6925eee3acdc-kube-api-access-6m6kl\") pod \"1648feda-fed8-4e7d-a64e-6925eee3acdc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " Jul 09 17:29:58.535545 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.535317 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-trusted-ca-bundle\") pod \"1648feda-fed8-4e7d-a64e-6925eee3acdc\" (UID: \"1648feda-fed8-4e7d-a64e-6925eee3acdc\") " Jul 09 17:29:58.535752 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.535587 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-oauth-serving-cert" (OuterVolumeSpecName: "oauth-serving-cert") pod "1648feda-fed8-4e7d-a64e-6925eee3acdc" (UID: "1648feda-fed8-4e7d-a64e-6925eee3acdc"). InnerVolumeSpecName "oauth-serving-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:29:58.535752 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.535699 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-console-config" (OuterVolumeSpecName: "console-config") pod "1648feda-fed8-4e7d-a64e-6925eee3acdc" (UID: "1648feda-fed8-4e7d-a64e-6925eee3acdc"). InnerVolumeSpecName "console-config". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:29:58.535927 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.535778 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-service-ca" (OuterVolumeSpecName: "service-ca") pod "1648feda-fed8-4e7d-a64e-6925eee3acdc" (UID: "1648feda-fed8-4e7d-a64e-6925eee3acdc"). InnerVolumeSpecName "service-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:29:58.535927 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.535860 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-trusted-ca-bundle" (OuterVolumeSpecName: "trusted-ca-bundle") pod "1648feda-fed8-4e7d-a64e-6925eee3acdc" (UID: "1648feda-fed8-4e7d-a64e-6925eee3acdc"). InnerVolumeSpecName "trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:29:58.537702 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.537668 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/1648feda-fed8-4e7d-a64e-6925eee3acdc-kube-api-access-6m6kl" (OuterVolumeSpecName: "kube-api-access-6m6kl") pod "1648feda-fed8-4e7d-a64e-6925eee3acdc" (UID: "1648feda-fed8-4e7d-a64e-6925eee3acdc"). InnerVolumeSpecName "kube-api-access-6m6kl". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:29:58.537904 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.537877 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1648feda-fed8-4e7d-a64e-6925eee3acdc-console-serving-cert" (OuterVolumeSpecName: "console-serving-cert") pod "1648feda-fed8-4e7d-a64e-6925eee3acdc" (UID: "1648feda-fed8-4e7d-a64e-6925eee3acdc"). InnerVolumeSpecName "console-serving-cert". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:29:58.538018 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.537996 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/1648feda-fed8-4e7d-a64e-6925eee3acdc-console-oauth-config" (OuterVolumeSpecName: "console-oauth-config") pod "1648feda-fed8-4e7d-a64e-6925eee3acdc" (UID: "1648feda-fed8-4e7d-a64e-6925eee3acdc"). InnerVolumeSpecName "console-oauth-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:29:58.636090 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.636053 2565 reconciler_common.go:299] "Volume detached for volume \"oauth-serving-cert\" (UniqueName: \"kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-oauth-serving-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:29:58.636090 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.636086 2565 reconciler_common.go:299] "Volume detached for volume \"console-config\" (UniqueName: \"kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-console-config\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:29:58.636090 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.636095 2565 reconciler_common.go:299] "Volume detached for volume \"console-oauth-config\" (UniqueName: \"kubernetes.io/secret/1648feda-fed8-4e7d-a64e-6925eee3acdc-console-oauth-config\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:29:58.636314 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.636103 2565 reconciler_common.go:299] "Volume detached for volume \"console-serving-cert\" (UniqueName: \"kubernetes.io/secret/1648feda-fed8-4e7d-a64e-6925eee3acdc-console-serving-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:29:58.636314 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.636111 2565 reconciler_common.go:299] "Volume detached for volume \"service-ca\" (UniqueName: \"kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-service-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:29:58.636314 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.636119 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6m6kl\" (UniqueName: \"kubernetes.io/projected/1648feda-fed8-4e7d-a64e-6925eee3acdc-kube-api-access-6m6kl\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:29:58.636314 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:58.636127 2565 reconciler_common.go:299] "Volume detached for volume \"trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/1648feda-fed8-4e7d-a64e-6925eee3acdc-trusted-ca-bundle\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:29:59.368041 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:59.368014 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-console/console-76c86fb65c-6drhc" Jul 09 17:29:59.368435 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:59.368017 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-console/console-76c86fb65c-6drhc" event={"ID":"1648feda-fed8-4e7d-a64e-6925eee3acdc","Type":"ContainerDied","Data":"b2468971df55996452a08a964f5356e62ce5b824a7f8b9bc6ba359f87c89139f"} Jul 09 17:29:59.368435 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:59.368140 2565 scope.go:117] "RemoveContainer" containerID="e512f5e8e3aadb6b27f939c2397a9e4a891edd91fd34ae54e99227d122b1d7c3" Jul 09 17:29:59.387428 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:59.387404 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-console/console-76c86fb65c-6drhc"] Jul 09 17:29:59.390548 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:59.390527 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-console/console-76c86fb65c-6drhc"] Jul 09 17:29:59.507505 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:29:59.507472 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="1648feda-fed8-4e7d-a64e-6925eee3acdc" path="/var/lib/kubelet/pods/1648feda-fed8-4e7d-a64e-6925eee3acdc/volumes" Jul 09 17:30:14.973797 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:14.973733 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:14.993035 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:14.993009 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:15.448263 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:15.448238 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:28.800900 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:28.800861 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 17:30:28.801479 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:28.801176 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="kube-rbac-proxy-metric" containerID="cri-o://735f15a57e905ee9bd6bcc7075bec9a8bd920968e039badb66811546e97bdb68" gracePeriod=120 Jul 09 17:30:28.801479 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:28.801232 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="alertmanager" containerID="cri-o://3d3aede7866bfd307f1e55979302200f73da476a708d3df4763228b3c7dc3275" gracePeriod=120 Jul 09 17:30:28.801479 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:28.801242 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="kube-rbac-proxy" containerID="cri-o://71ece860a3e39af11b23d0a91669a824900eafa8d1592457e8b0ab569fcfea41" gracePeriod=120 Jul 09 17:30:28.801479 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:28.801176 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="config-reloader" containerID="cri-o://7194a16d8ff8bb0a9d5c28f9eb132571ec121f509087f7708ac8caafa62a5e64" gracePeriod=120 Jul 09 17:30:28.801479 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:28.801271 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="prom-label-proxy" containerID="cri-o://fca780866d159607186f81cc5f66ebe4720c844d008074e00780d4ae5210f1bb" gracePeriod=120 Jul 09 17:30:28.801750 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:28.801479 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/alertmanager-main-0" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="kube-rbac-proxy-web" containerID="cri-o://4e4c296cefd7a24d14d29a6614f8b03ab68e5a36a83ffa2011f8b8011ff16c79" gracePeriod=120 Jul 09 17:30:29.484491 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:29.484459 2565 generic.go:356] "Generic (PLEG): container finished" podID="02418a86-7d92-42ff-9323-6919708f2db8" containerID="fca780866d159607186f81cc5f66ebe4720c844d008074e00780d4ae5210f1bb" exitCode=0 Jul 09 17:30:29.484491 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:29.484482 2565 generic.go:356] "Generic (PLEG): container finished" podID="02418a86-7d92-42ff-9323-6919708f2db8" containerID="735f15a57e905ee9bd6bcc7075bec9a8bd920968e039badb66811546e97bdb68" exitCode=0 Jul 09 17:30:29.484491 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:29.484490 2565 generic.go:356] "Generic (PLEG): container finished" podID="02418a86-7d92-42ff-9323-6919708f2db8" containerID="71ece860a3e39af11b23d0a91669a824900eafa8d1592457e8b0ab569fcfea41" exitCode=0 Jul 09 17:30:29.484491 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:29.484496 2565 generic.go:356] "Generic (PLEG): container finished" podID="02418a86-7d92-42ff-9323-6919708f2db8" containerID="7194a16d8ff8bb0a9d5c28f9eb132571ec121f509087f7708ac8caafa62a5e64" exitCode=0 Jul 09 17:30:29.484491 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:29.484501 2565 generic.go:356] "Generic (PLEG): container finished" podID="02418a86-7d92-42ff-9323-6919708f2db8" containerID="3d3aede7866bfd307f1e55979302200f73da476a708d3df4763228b3c7dc3275" exitCode=0 Jul 09 17:30:29.484809 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:29.484529 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02418a86-7d92-42ff-9323-6919708f2db8","Type":"ContainerDied","Data":"fca780866d159607186f81cc5f66ebe4720c844d008074e00780d4ae5210f1bb"} Jul 09 17:30:29.484809 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:29.484591 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02418a86-7d92-42ff-9323-6919708f2db8","Type":"ContainerDied","Data":"735f15a57e905ee9bd6bcc7075bec9a8bd920968e039badb66811546e97bdb68"} Jul 09 17:30:29.484809 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:29.484619 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02418a86-7d92-42ff-9323-6919708f2db8","Type":"ContainerDied","Data":"71ece860a3e39af11b23d0a91669a824900eafa8d1592457e8b0ab569fcfea41"} Jul 09 17:30:29.484809 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:29.484642 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02418a86-7d92-42ff-9323-6919708f2db8","Type":"ContainerDied","Data":"7194a16d8ff8bb0a9d5c28f9eb132571ec121f509087f7708ac8caafa62a5e64"} Jul 09 17:30:29.484809 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:29.484665 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02418a86-7d92-42ff-9323-6919708f2db8","Type":"ContainerDied","Data":"3d3aede7866bfd307f1e55979302200f73da476a708d3df4763228b3c7dc3275"} Jul 09 17:30:30.047410 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.047388 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.115474 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.115444 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-kube-rbac-proxy\") pod \"02418a86-7d92-42ff-9323-6919708f2db8\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " Jul 09 17:30:30.115639 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.115492 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-kube-rbac-proxy-metric\") pod \"02418a86-7d92-42ff-9323-6919708f2db8\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " Jul 09 17:30:30.115639 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.115513 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-config-volume\") pod \"02418a86-7d92-42ff-9323-6919708f2db8\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " Jul 09 17:30:30.115639 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.115531 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-kube-rbac-proxy-web\") pod \"02418a86-7d92-42ff-9323-6919708f2db8\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " Jul 09 17:30:30.115639 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.115559 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-cluster-tls-config\") pod \"02418a86-7d92-42ff-9323-6919708f2db8\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " Jul 09 17:30:30.115639 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.115606 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02418a86-7d92-42ff-9323-6919708f2db8-config-out\") pod \"02418a86-7d92-42ff-9323-6919708f2db8\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " Jul 09 17:30:30.115985 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.115951 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-s92t4\" (UniqueName: \"kubernetes.io/projected/02418a86-7d92-42ff-9323-6919708f2db8-kube-api-access-s92t4\") pod \"02418a86-7d92-42ff-9323-6919708f2db8\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " Jul 09 17:30:30.116064 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.115994 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02418a86-7d92-42ff-9323-6919708f2db8-metrics-client-ca\") pod \"02418a86-7d92-42ff-9323-6919708f2db8\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " Jul 09 17:30:30.116064 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.116050 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-web-config\") pod \"02418a86-7d92-42ff-9323-6919708f2db8\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " Jul 09 17:30:30.116175 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.116084 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02418a86-7d92-42ff-9323-6919708f2db8-tls-assets\") pod \"02418a86-7d92-42ff-9323-6919708f2db8\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " Jul 09 17:30:30.116175 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.116139 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02418a86-7d92-42ff-9323-6919708f2db8-alertmanager-trusted-ca-bundle\") pod \"02418a86-7d92-42ff-9323-6919708f2db8\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " Jul 09 17:30:30.116274 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.116178 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-main-tls\") pod \"02418a86-7d92-42ff-9323-6919708f2db8\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " Jul 09 17:30:30.116274 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.116203 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02418a86-7d92-42ff-9323-6919708f2db8-alertmanager-main-db\") pod \"02418a86-7d92-42ff-9323-6919708f2db8\" (UID: \"02418a86-7d92-42ff-9323-6919708f2db8\") " Jul 09 17:30:30.117113 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.116776 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02418a86-7d92-42ff-9323-6919708f2db8-alertmanager-main-db" (OuterVolumeSpecName: "alertmanager-main-db") pod "02418a86-7d92-42ff-9323-6919708f2db8" (UID: "02418a86-7d92-42ff-9323-6919708f2db8"). InnerVolumeSpecName "alertmanager-main-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:30:30.117547 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.117504 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02418a86-7d92-42ff-9323-6919708f2db8-alertmanager-trusted-ca-bundle" (OuterVolumeSpecName: "alertmanager-trusted-ca-bundle") pod "02418a86-7d92-42ff-9323-6919708f2db8" (UID: "02418a86-7d92-42ff-9323-6919708f2db8"). InnerVolumeSpecName "alertmanager-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:30:30.117547 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.117515 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/02418a86-7d92-42ff-9323-6919708f2db8-metrics-client-ca" (OuterVolumeSpecName: "metrics-client-ca") pod "02418a86-7d92-42ff-9323-6919708f2db8" (UID: "02418a86-7d92-42ff-9323-6919708f2db8"). InnerVolumeSpecName "metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:30:30.119970 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.119916 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/02418a86-7d92-42ff-9323-6919708f2db8-config-out" (OuterVolumeSpecName: "config-out") pod "02418a86-7d92-42ff-9323-6919708f2db8" (UID: "02418a86-7d92-42ff-9323-6919708f2db8"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:30:30.119970 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.119941 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-web") pod "02418a86-7d92-42ff-9323-6919708f2db8" (UID: "02418a86-7d92-42ff-9323-6919708f2db8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:30:30.120436 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.120392 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-kube-rbac-proxy" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy") pod "02418a86-7d92-42ff-9323-6919708f2db8" (UID: "02418a86-7d92-42ff-9323-6919708f2db8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:30:30.120436 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.120411 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02418a86-7d92-42ff-9323-6919708f2db8-kube-api-access-s92t4" (OuterVolumeSpecName: "kube-api-access-s92t4") pod "02418a86-7d92-42ff-9323-6919708f2db8" (UID: "02418a86-7d92-42ff-9323-6919708f2db8"). InnerVolumeSpecName "kube-api-access-s92t4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:30:30.120585 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.120473 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-main-tls" (OuterVolumeSpecName: "secret-alertmanager-main-tls") pod "02418a86-7d92-42ff-9323-6919708f2db8" (UID: "02418a86-7d92-42ff-9323-6919708f2db8"). InnerVolumeSpecName "secret-alertmanager-main-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:30:30.120585 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.120527 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-config-volume" (OuterVolumeSpecName: "config-volume") pod "02418a86-7d92-42ff-9323-6919708f2db8" (UID: "02418a86-7d92-42ff-9323-6919708f2db8"). InnerVolumeSpecName "config-volume". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:30:30.120707 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.120688 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/02418a86-7d92-42ff-9323-6919708f2db8-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "02418a86-7d92-42ff-9323-6919708f2db8" (UID: "02418a86-7d92-42ff-9323-6919708f2db8"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:30:30.121525 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.121502 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-kube-rbac-proxy-metric" (OuterVolumeSpecName: "secret-alertmanager-kube-rbac-proxy-metric") pod "02418a86-7d92-42ff-9323-6919708f2db8" (UID: "02418a86-7d92-42ff-9323-6919708f2db8"). InnerVolumeSpecName "secret-alertmanager-kube-rbac-proxy-metric". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:30:30.124289 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.124143 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-cluster-tls-config" (OuterVolumeSpecName: "cluster-tls-config") pod "02418a86-7d92-42ff-9323-6919708f2db8" (UID: "02418a86-7d92-42ff-9323-6919708f2db8"). InnerVolumeSpecName "cluster-tls-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:30:30.130863 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.130841 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-web-config" (OuterVolumeSpecName: "web-config") pod "02418a86-7d92-42ff-9323-6919708f2db8" (UID: "02418a86-7d92-42ff-9323-6919708f2db8"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:30:30.217453 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.217422 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/02418a86-7d92-42ff-9323-6919708f2db8-config-out\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:30.217453 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.217450 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-s92t4\" (UniqueName: \"kubernetes.io/projected/02418a86-7d92-42ff-9323-6919708f2db8-kube-api-access-s92t4\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:30.217453 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.217459 2565 reconciler_common.go:299] "Volume detached for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/02418a86-7d92-42ff-9323-6919708f2db8-metrics-client-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:30.217650 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.217468 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-web-config\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:30.217650 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.217477 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/02418a86-7d92-42ff-9323-6919708f2db8-tls-assets\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:30.217650 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.217485 2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/02418a86-7d92-42ff-9323-6919708f2db8-alertmanager-trusted-ca-bundle\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:30.217650 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.217495 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-main-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:30.217650 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.217503 2565 reconciler_common.go:299] "Volume detached for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/02418a86-7d92-42ff-9323-6919708f2db8-alertmanager-main-db\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:30.217650 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.217512 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-kube-rbac-proxy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:30.217650 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.217521 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-kube-rbac-proxy-metric\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:30.217650 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.217530 2565 reconciler_common.go:299] "Volume detached for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-config-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:30.217650 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.217538 2565 reconciler_common.go:299] "Volume detached for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-secret-alertmanager-kube-rbac-proxy-web\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:30.217650 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.217546 2565 reconciler_common.go:299] "Volume detached for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/02418a86-7d92-42ff-9323-6919708f2db8-cluster-tls-config\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:30.491260 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.491169 2565 generic.go:356] "Generic (PLEG): container finished" podID="02418a86-7d92-42ff-9323-6919708f2db8" containerID="4e4c296cefd7a24d14d29a6614f8b03ab68e5a36a83ffa2011f8b8011ff16c79" exitCode=0 Jul 09 17:30:30.491393 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.491252 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.491393 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.491246 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02418a86-7d92-42ff-9323-6919708f2db8","Type":"ContainerDied","Data":"4e4c296cefd7a24d14d29a6614f8b03ab68e5a36a83ffa2011f8b8011ff16c79"} Jul 09 17:30:30.491463 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.491408 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"02418a86-7d92-42ff-9323-6919708f2db8","Type":"ContainerDied","Data":"3daf2db8ece0c5e1e89446d3a8ea2fd06511eee6cd9271425cb5c9852b099068"} Jul 09 17:30:30.491463 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.491442 2565 scope.go:117] "RemoveContainer" containerID="fca780866d159607186f81cc5f66ebe4720c844d008074e00780d4ae5210f1bb" Jul 09 17:30:30.500421 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.500402 2565 scope.go:117] "RemoveContainer" containerID="735f15a57e905ee9bd6bcc7075bec9a8bd920968e039badb66811546e97bdb68" Jul 09 17:30:30.509704 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.509024 2565 scope.go:117] "RemoveContainer" containerID="71ece860a3e39af11b23d0a91669a824900eafa8d1592457e8b0ab569fcfea41" Jul 09 17:30:30.516627 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.516603 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 17:30:30.517229 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.517212 2565 scope.go:117] "RemoveContainer" containerID="4e4c296cefd7a24d14d29a6614f8b03ab68e5a36a83ffa2011f8b8011ff16c79" Jul 09 17:30:30.519701 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.519681 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 17:30:30.524407 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.524390 2565 scope.go:117] "RemoveContainer" containerID="7194a16d8ff8bb0a9d5c28f9eb132571ec121f509087f7708ac8caafa62a5e64" Jul 09 17:30:30.530964 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.530946 2565 scope.go:117] "RemoveContainer" containerID="3d3aede7866bfd307f1e55979302200f73da476a708d3df4763228b3c7dc3275" Jul 09 17:30:30.537846 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.537825 2565 scope.go:117] "RemoveContainer" containerID="4c90ba0cf30dc158c9adfbd815bfe36f45e8224503077ba9f336bf6000f2ae49" Jul 09 17:30:30.544231 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.544207 2565 scope.go:117] "RemoveContainer" containerID="fca780866d159607186f81cc5f66ebe4720c844d008074e00780d4ae5210f1bb" Jul 09 17:30:30.544481 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:30:30.544462 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fca780866d159607186f81cc5f66ebe4720c844d008074e00780d4ae5210f1bb\": container with ID starting with fca780866d159607186f81cc5f66ebe4720c844d008074e00780d4ae5210f1bb not found: ID does not exist" containerID="fca780866d159607186f81cc5f66ebe4720c844d008074e00780d4ae5210f1bb" Jul 09 17:30:30.544529 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.544489 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fca780866d159607186f81cc5f66ebe4720c844d008074e00780d4ae5210f1bb"} err="failed to get container status \"fca780866d159607186f81cc5f66ebe4720c844d008074e00780d4ae5210f1bb\": rpc error: code = NotFound desc = could not find container \"fca780866d159607186f81cc5f66ebe4720c844d008074e00780d4ae5210f1bb\": container with ID starting with fca780866d159607186f81cc5f66ebe4720c844d008074e00780d4ae5210f1bb not found: ID does not exist" Jul 09 17:30:30.544529 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.544520 2565 scope.go:117] "RemoveContainer" containerID="735f15a57e905ee9bd6bcc7075bec9a8bd920968e039badb66811546e97bdb68" Jul 09 17:30:30.544774 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:30:30.544735 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"735f15a57e905ee9bd6bcc7075bec9a8bd920968e039badb66811546e97bdb68\": container with ID starting with 735f15a57e905ee9bd6bcc7075bec9a8bd920968e039badb66811546e97bdb68 not found: ID does not exist" containerID="735f15a57e905ee9bd6bcc7075bec9a8bd920968e039badb66811546e97bdb68" Jul 09 17:30:30.544836 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.544778 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"735f15a57e905ee9bd6bcc7075bec9a8bd920968e039badb66811546e97bdb68"} err="failed to get container status \"735f15a57e905ee9bd6bcc7075bec9a8bd920968e039badb66811546e97bdb68\": rpc error: code = NotFound desc = could not find container \"735f15a57e905ee9bd6bcc7075bec9a8bd920968e039badb66811546e97bdb68\": container with ID starting with 735f15a57e905ee9bd6bcc7075bec9a8bd920968e039badb66811546e97bdb68 not found: ID does not exist" Jul 09 17:30:30.544836 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.544800 2565 scope.go:117] "RemoveContainer" containerID="71ece860a3e39af11b23d0a91669a824900eafa8d1592457e8b0ab569fcfea41" Jul 09 17:30:30.545011 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:30:30.544996 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"71ece860a3e39af11b23d0a91669a824900eafa8d1592457e8b0ab569fcfea41\": container with ID starting with 71ece860a3e39af11b23d0a91669a824900eafa8d1592457e8b0ab569fcfea41 not found: ID does not exist" containerID="71ece860a3e39af11b23d0a91669a824900eafa8d1592457e8b0ab569fcfea41" Jul 09 17:30:30.545049 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.545013 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"71ece860a3e39af11b23d0a91669a824900eafa8d1592457e8b0ab569fcfea41"} err="failed to get container status \"71ece860a3e39af11b23d0a91669a824900eafa8d1592457e8b0ab569fcfea41\": rpc error: code = NotFound desc = could not find container \"71ece860a3e39af11b23d0a91669a824900eafa8d1592457e8b0ab569fcfea41\": container with ID starting with 71ece860a3e39af11b23d0a91669a824900eafa8d1592457e8b0ab569fcfea41 not found: ID does not exist" Jul 09 17:30:30.545049 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.545024 2565 scope.go:117] "RemoveContainer" containerID="4e4c296cefd7a24d14d29a6614f8b03ab68e5a36a83ffa2011f8b8011ff16c79" Jul 09 17:30:30.545233 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:30:30.545215 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4e4c296cefd7a24d14d29a6614f8b03ab68e5a36a83ffa2011f8b8011ff16c79\": container with ID starting with 4e4c296cefd7a24d14d29a6614f8b03ab68e5a36a83ffa2011f8b8011ff16c79 not found: ID does not exist" containerID="4e4c296cefd7a24d14d29a6614f8b03ab68e5a36a83ffa2011f8b8011ff16c79" Jul 09 17:30:30.545275 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.545238 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4e4c296cefd7a24d14d29a6614f8b03ab68e5a36a83ffa2011f8b8011ff16c79"} err="failed to get container status \"4e4c296cefd7a24d14d29a6614f8b03ab68e5a36a83ffa2011f8b8011ff16c79\": rpc error: code = NotFound desc = could not find container \"4e4c296cefd7a24d14d29a6614f8b03ab68e5a36a83ffa2011f8b8011ff16c79\": container with ID starting with 4e4c296cefd7a24d14d29a6614f8b03ab68e5a36a83ffa2011f8b8011ff16c79 not found: ID does not exist" Jul 09 17:30:30.545275 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.545256 2565 scope.go:117] "RemoveContainer" containerID="7194a16d8ff8bb0a9d5c28f9eb132571ec121f509087f7708ac8caafa62a5e64" Jul 09 17:30:30.545479 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:30:30.545461 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"7194a16d8ff8bb0a9d5c28f9eb132571ec121f509087f7708ac8caafa62a5e64\": container with ID starting with 7194a16d8ff8bb0a9d5c28f9eb132571ec121f509087f7708ac8caafa62a5e64 not found: ID does not exist" containerID="7194a16d8ff8bb0a9d5c28f9eb132571ec121f509087f7708ac8caafa62a5e64" Jul 09 17:30:30.545556 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.545483 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"7194a16d8ff8bb0a9d5c28f9eb132571ec121f509087f7708ac8caafa62a5e64"} err="failed to get container status \"7194a16d8ff8bb0a9d5c28f9eb132571ec121f509087f7708ac8caafa62a5e64\": rpc error: code = NotFound desc = could not find container \"7194a16d8ff8bb0a9d5c28f9eb132571ec121f509087f7708ac8caafa62a5e64\": container with ID starting with 7194a16d8ff8bb0a9d5c28f9eb132571ec121f509087f7708ac8caafa62a5e64 not found: ID does not exist" Jul 09 17:30:30.545556 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.545499 2565 scope.go:117] "RemoveContainer" containerID="3d3aede7866bfd307f1e55979302200f73da476a708d3df4763228b3c7dc3275" Jul 09 17:30:30.545849 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:30:30.545750 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3d3aede7866bfd307f1e55979302200f73da476a708d3df4763228b3c7dc3275\": container with ID starting with 3d3aede7866bfd307f1e55979302200f73da476a708d3df4763228b3c7dc3275 not found: ID does not exist" containerID="3d3aede7866bfd307f1e55979302200f73da476a708d3df4763228b3c7dc3275" Jul 09 17:30:30.545952 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.545856 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3d3aede7866bfd307f1e55979302200f73da476a708d3df4763228b3c7dc3275"} err="failed to get container status \"3d3aede7866bfd307f1e55979302200f73da476a708d3df4763228b3c7dc3275\": rpc error: code = NotFound desc = could not find container \"3d3aede7866bfd307f1e55979302200f73da476a708d3df4763228b3c7dc3275\": container with ID starting with 3d3aede7866bfd307f1e55979302200f73da476a708d3df4763228b3c7dc3275 not found: ID does not exist" Jul 09 17:30:30.545952 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.545874 2565 scope.go:117] "RemoveContainer" containerID="4c90ba0cf30dc158c9adfbd815bfe36f45e8224503077ba9f336bf6000f2ae49" Jul 09 17:30:30.546340 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:30:30.546298 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"4c90ba0cf30dc158c9adfbd815bfe36f45e8224503077ba9f336bf6000f2ae49\": container with ID starting with 4c90ba0cf30dc158c9adfbd815bfe36f45e8224503077ba9f336bf6000f2ae49 not found: ID does not exist" containerID="4c90ba0cf30dc158c9adfbd815bfe36f45e8224503077ba9f336bf6000f2ae49" Jul 09 17:30:30.546340 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.546330 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"4c90ba0cf30dc158c9adfbd815bfe36f45e8224503077ba9f336bf6000f2ae49"} err="failed to get container status \"4c90ba0cf30dc158c9adfbd815bfe36f45e8224503077ba9f336bf6000f2ae49\": rpc error: code = NotFound desc = could not find container \"4c90ba0cf30dc158c9adfbd815bfe36f45e8224503077ba9f336bf6000f2ae49\": container with ID starting with 4c90ba0cf30dc158c9adfbd815bfe36f45e8224503077ba9f336bf6000f2ae49 not found: ID does not exist" Jul 09 17:30:30.548082 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548064 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 17:30:30.548384 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548370 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="kube-rbac-proxy-metric" Jul 09 17:30:30.548384 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548385 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="kube-rbac-proxy-metric" Jul 09 17:30:30.548471 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548398 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="1648feda-fed8-4e7d-a64e-6925eee3acdc" containerName="console" Jul 09 17:30:30.548471 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548404 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="1648feda-fed8-4e7d-a64e-6925eee3acdc" containerName="console" Jul 09 17:30:30.548471 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548414 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="kube-rbac-proxy" Jul 09 17:30:30.548471 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548419 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="kube-rbac-proxy" Jul 09 17:30:30.548471 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548425 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="prom-label-proxy" Jul 09 17:30:30.548471 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548430 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="prom-label-proxy" Jul 09 17:30:30.548471 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548440 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="config-reloader" Jul 09 17:30:30.548471 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548445 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="config-reloader" Jul 09 17:30:30.548471 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548452 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="init-config-reloader" Jul 09 17:30:30.548471 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548457 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="init-config-reloader" Jul 09 17:30:30.548471 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548463 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="kube-rbac-proxy-web" Jul 09 17:30:30.548471 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548468 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="kube-rbac-proxy-web" Jul 09 17:30:30.548471 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548475 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="alertmanager" Jul 09 17:30:30.548887 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548480 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="alertmanager" Jul 09 17:30:30.548887 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548532 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="alertmanager" Jul 09 17:30:30.548887 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548541 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="1648feda-fed8-4e7d-a64e-6925eee3acdc" containerName="console" Jul 09 17:30:30.548887 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548548 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="config-reloader" Jul 09 17:30:30.548887 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548554 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="kube-rbac-proxy-web" Jul 09 17:30:30.548887 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548561 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="kube-rbac-proxy" Jul 09 17:30:30.548887 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548566 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="kube-rbac-proxy-metric" Jul 09 17:30:30.548887 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.548571 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="02418a86-7d92-42ff-9323-6919708f2db8" containerName="prom-label-proxy" Jul 09 17:30:30.553479 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.553464 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.555923 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.555904 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-web-config\"" Jul 09 17:30:30.556025 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.555952 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy\"" Jul 09 17:30:30.556025 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.555955 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-cluster-tls-config\"" Jul 09 17:30:30.556025 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.555996 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-dockercfg-6r4mn\"" Jul 09 17:30:30.556285 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.556269 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-web\"" Jul 09 17:30:30.556285 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.556277 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-kube-rbac-proxy-metric\"" Jul 09 17:30:30.556408 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.556333 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-generated\"" Jul 09 17:30:30.556408 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.556350 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls-assets-0\"" Jul 09 17:30:30.556515 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.556424 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"alertmanager-main-tls\"" Jul 09 17:30:30.561591 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.561570 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"alertmanager-trusted-ca-bundle\"" Jul 09 17:30:30.566849 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.566826 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 17:30:30.620518 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.620489 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da348fce-887f-4e28-a04f-de03b4eab3bc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.620695 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.620522 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/da348fce-887f-4e28-a04f-de03b4eab3bc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.620695 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.620546 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da348fce-887f-4e28-a04f-de03b4eab3bc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.620695 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.620570 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da348fce-887f-4e28-a04f-de03b4eab3bc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.620695 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.620628 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da348fce-887f-4e28-a04f-de03b4eab3bc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.620695 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.620689 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da348fce-887f-4e28-a04f-de03b4eab3bc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.620954 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.620721 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/da348fce-887f-4e28-a04f-de03b4eab3bc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.620954 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.620775 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/da348fce-887f-4e28-a04f-de03b4eab3bc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.620954 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.620804 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/da348fce-887f-4e28-a04f-de03b4eab3bc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.620954 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.620842 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xx6h2\" (UniqueName: \"kubernetes.io/projected/da348fce-887f-4e28-a04f-de03b4eab3bc-kube-api-access-xx6h2\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.620954 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.620900 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da348fce-887f-4e28-a04f-de03b4eab3bc-web-config\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.620954 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.620938 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da348fce-887f-4e28-a04f-de03b4eab3bc-config-out\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.621154 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.620981 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/da348fce-887f-4e28-a04f-de03b4eab3bc-config-volume\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.721677 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.721630 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da348fce-887f-4e28-a04f-de03b4eab3bc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.721677 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.721670 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/da348fce-887f-4e28-a04f-de03b4eab3bc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.721941 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.721691 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/da348fce-887f-4e28-a04f-de03b4eab3bc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.721941 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.721708 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/da348fce-887f-4e28-a04f-de03b4eab3bc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.721941 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.721731 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xx6h2\" (UniqueName: \"kubernetes.io/projected/da348fce-887f-4e28-a04f-de03b4eab3bc-kube-api-access-xx6h2\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.721941 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.721803 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da348fce-887f-4e28-a04f-de03b4eab3bc-web-config\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.721941 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.721829 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da348fce-887f-4e28-a04f-de03b4eab3bc-config-out\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.721941 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.721856 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/da348fce-887f-4e28-a04f-de03b4eab3bc-config-volume\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.722235 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.721971 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da348fce-887f-4e28-a04f-de03b4eab3bc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.722235 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.721998 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/da348fce-887f-4e28-a04f-de03b4eab3bc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.722235 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.722032 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da348fce-887f-4e28-a04f-de03b4eab3bc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.722235 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.722062 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da348fce-887f-4e28-a04f-de03b4eab3bc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.722235 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.722090 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da348fce-887f-4e28-a04f-de03b4eab3bc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.722235 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.722157 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-main-db\" (UniqueName: \"kubernetes.io/empty-dir/da348fce-887f-4e28-a04f-de03b4eab3bc-alertmanager-main-db\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.722733 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.722589 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/da348fce-887f-4e28-a04f-de03b4eab3bc-metrics-client-ca\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.723448 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.723419 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"alertmanager-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/da348fce-887f-4e28-a04f-de03b4eab3bc-alertmanager-trusted-ca-bundle\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.724830 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.724808 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-main-tls\" (UniqueName: \"kubernetes.io/secret/da348fce-887f-4e28-a04f-de03b4eab3bc-secret-alertmanager-main-tls\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.725331 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.724909 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cluster-tls-config\" (UniqueName: \"kubernetes.io/secret/da348fce-887f-4e28-a04f-de03b4eab3bc-cluster-tls-config\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.725331 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.725286 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/da348fce-887f-4e28-a04f-de03b4eab3bc-tls-assets\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.725331 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.725321 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/da348fce-887f-4e28-a04f-de03b4eab3bc-secret-alertmanager-kube-rbac-proxy\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.725474 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.725401 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-metric\" (UniqueName: \"kubernetes.io/secret/da348fce-887f-4e28-a04f-de03b4eab3bc-secret-alertmanager-kube-rbac-proxy-metric\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.725474 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.725400 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/da348fce-887f-4e28-a04f-de03b4eab3bc-web-config\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.725542 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.725470 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-volume\" (UniqueName: \"kubernetes.io/secret/da348fce-887f-4e28-a04f-de03b4eab3bc-config-volume\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.725886 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.725865 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-alertmanager-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/da348fce-887f-4e28-a04f-de03b4eab3bc-secret-alertmanager-kube-rbac-proxy-web\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.726388 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.726370 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/da348fce-887f-4e28-a04f-de03b4eab3bc-config-out\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.729217 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.729201 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xx6h2\" (UniqueName: \"kubernetes.io/projected/da348fce-887f-4e28-a04f-de03b4eab3bc-kube-api-access-xx6h2\") pod \"alertmanager-main-0\" (UID: \"da348fce-887f-4e28-a04f-de03b4eab3bc\") " pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.864329 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.864298 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/alertmanager-main-0" Jul 09 17:30:30.995343 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:30.995319 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/alertmanager-main-0"] Jul 09 17:30:30.997200 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:30:30.997177 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podda348fce_887f_4e28_a04f_de03b4eab3bc.slice/crio-dbf77a978a37f69922276a282175d83c8ebbafd7d975af65162a273ae3025dcd WatchSource:0}: Error finding container dbf77a978a37f69922276a282175d83c8ebbafd7d975af65162a273ae3025dcd: Status 404 returned error can't find the container with id dbf77a978a37f69922276a282175d83c8ebbafd7d975af65162a273ae3025dcd Jul 09 17:30:31.496538 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:31.496503 2565 generic.go:356] "Generic (PLEG): container finished" podID="da348fce-887f-4e28-a04f-de03b4eab3bc" containerID="e42337ffde53989eade898ae50fdf30b539f556c8dad7c33659624b04fc4da1d" exitCode=0 Jul 09 17:30:31.496937 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:31.496549 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da348fce-887f-4e28-a04f-de03b4eab3bc","Type":"ContainerDied","Data":"e42337ffde53989eade898ae50fdf30b539f556c8dad7c33659624b04fc4da1d"} Jul 09 17:30:31.496937 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:31.496599 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da348fce-887f-4e28-a04f-de03b4eab3bc","Type":"ContainerStarted","Data":"dbf77a978a37f69922276a282175d83c8ebbafd7d975af65162a273ae3025dcd"} Jul 09 17:30:31.506733 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:31.506708 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="02418a86-7d92-42ff-9323-6919708f2db8" path="/var/lib/kubelet/pods/02418a86-7d92-42ff-9323-6919708f2db8/volumes" Jul 09 17:30:32.503487 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:32.503449 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da348fce-887f-4e28-a04f-de03b4eab3bc","Type":"ContainerStarted","Data":"7ded931505449856ea8a37929ad7a8dd29f555bd28311a2adda9c395bb0dc030"} Jul 09 17:30:32.503878 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:32.503530 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da348fce-887f-4e28-a04f-de03b4eab3bc","Type":"ContainerStarted","Data":"fb52a770f326a1b30dfeca9ed7e34a5536ef735b7cf665c6f8fb85e6933ef38e"} Jul 09 17:30:32.503878 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:32.503573 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da348fce-887f-4e28-a04f-de03b4eab3bc","Type":"ContainerStarted","Data":"d7fa4c1bfaadaa7e10c8142046b1a1e6fecd73c2d592359b4ce2a146a940a533"} Jul 09 17:30:32.503878 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:32.503610 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da348fce-887f-4e28-a04f-de03b4eab3bc","Type":"ContainerStarted","Data":"3ab204047bb6fcdfceb62917f5d33e2a69f8cd80fae7b0e0c96a4a021747833d"} Jul 09 17:30:32.503878 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:32.503644 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da348fce-887f-4e28-a04f-de03b4eab3bc","Type":"ContainerStarted","Data":"40f79e597c8ad75a64ad11c552092ec476b8f59f2320da3d2c18712881efca50"} Jul 09 17:30:32.503878 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:32.503686 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/alertmanager-main-0" event={"ID":"da348fce-887f-4e28-a04f-de03b4eab3bc","Type":"ContainerStarted","Data":"c241f6cc13b5f2927711ba3f3e46f64b4b9c303ae5896dc5785601e3d32d9cc7"} Jul 09 17:30:32.533049 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:32.532999 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/alertmanager-main-0" podStartSLOduration=2.514935102 podStartE2EDuration="2.532984608s" totalImagesPullingTime="0s" totalInitContainerRuntime="18.049506ms" isStatefulPod=false podCreationTimestamp="2026-07-09 17:30:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:30:32.53219761 +0000 UTC m=+145.588666149" watchObservedRunningTime="2026-07-09 17:30:32.532984608 +0000 UTC m=+145.589453152" Jul 09 17:30:33.038064 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:33.038023 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 17:30:33.038720 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:33.038687 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="kube-rbac-proxy-thanos" containerID="cri-o://59d7ed8b9fd0f3e7f4eeebd0ee8b7b7c63d79912e36c0812ca677ed8fad0431c" gracePeriod=600 Jul 09 17:30:33.039079 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:33.039050 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="kube-rbac-proxy-web" containerID="cri-o://da45c49603c101f74559133a26117c2b84839ea2fd2ef134c8486967f7919a92" gracePeriod=600 Jul 09 17:30:33.039223 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:33.039201 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="kube-rbac-proxy" containerID="cri-o://65f050e9933b6261b4749da9da1ba58306ad46c8b4780c9f9a3d1f28ed734ea8" gracePeriod=600 Jul 09 17:30:33.039334 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:33.039302 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="config-reloader" containerID="cri-o://a9c40dcd521f44eb22595575ebd0b3e77d8cc3ad218a6e5e297cf6bc0ca0264c" gracePeriod=600 Jul 09 17:30:33.040062 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:33.039821 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="prometheus" containerID="cri-o://3266afd49125f61119c74644b45ba5b00faee6f8b52891005275df5b0dceecf8" gracePeriod=600 Jul 09 17:30:33.040062 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:33.039060 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-monitoring/prometheus-k8s-0" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="thanos-sidecar" containerID="cri-o://6e1c20a24c641e6eb552b7b68872ff8529699f7a585b9780126af5458cd5b93e" gracePeriod=600 Jul 09 17:30:33.511516 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:33.511431 2565 generic.go:356] "Generic (PLEG): container finished" podID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerID="59d7ed8b9fd0f3e7f4eeebd0ee8b7b7c63d79912e36c0812ca677ed8fad0431c" exitCode=0 Jul 09 17:30:33.511516 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:33.511456 2565 generic.go:356] "Generic (PLEG): container finished" podID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerID="65f050e9933b6261b4749da9da1ba58306ad46c8b4780c9f9a3d1f28ed734ea8" exitCode=0 Jul 09 17:30:33.511516 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:33.511462 2565 generic.go:356] "Generic (PLEG): container finished" podID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerID="6e1c20a24c641e6eb552b7b68872ff8529699f7a585b9780126af5458cd5b93e" exitCode=0 Jul 09 17:30:33.511516 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:33.511468 2565 generic.go:356] "Generic (PLEG): container finished" podID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerID="a9c40dcd521f44eb22595575ebd0b3e77d8cc3ad218a6e5e297cf6bc0ca0264c" exitCode=0 Jul 09 17:30:33.511516 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:33.511473 2565 generic.go:356] "Generic (PLEG): container finished" podID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerID="3266afd49125f61119c74644b45ba5b00faee6f8b52891005275df5b0dceecf8" exitCode=0 Jul 09 17:30:33.511516 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:33.511498 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1c8954-5f15-4ee1-9cff-6a8277f99c50","Type":"ContainerDied","Data":"59d7ed8b9fd0f3e7f4eeebd0ee8b7b7c63d79912e36c0812ca677ed8fad0431c"} Jul 09 17:30:33.512066 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:33.511559 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1c8954-5f15-4ee1-9cff-6a8277f99c50","Type":"ContainerDied","Data":"65f050e9933b6261b4749da9da1ba58306ad46c8b4780c9f9a3d1f28ed734ea8"} Jul 09 17:30:33.512066 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:33.511587 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1c8954-5f15-4ee1-9cff-6a8277f99c50","Type":"ContainerDied","Data":"6e1c20a24c641e6eb552b7b68872ff8529699f7a585b9780126af5458cd5b93e"} Jul 09 17:30:33.512066 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:33.511614 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1c8954-5f15-4ee1-9cff-6a8277f99c50","Type":"ContainerDied","Data":"a9c40dcd521f44eb22595575ebd0b3e77d8cc3ad218a6e5e297cf6bc0ca0264c"} Jul 09 17:30:33.512066 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:33.511639 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1c8954-5f15-4ee1-9cff-6a8277f99c50","Type":"ContainerDied","Data":"3266afd49125f61119c74644b45ba5b00faee6f8b52891005275df5b0dceecf8"} Jul 09 17:30:34.291193 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.291171 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.457034 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.456941 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-rulefiles-2\") pod \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " Jul 09 17:30:34.457034 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.456980 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " Jul 09 17:30:34.457034 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.457002 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-tls-assets\") pod \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " Jul 09 17:30:34.457034 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.457022 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-configmap-kubelet-serving-ca-bundle\") pod \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " Jul 09 17:30:34.457352 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.457049 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-configmap-metrics-client-ca\") pod \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " Jul 09 17:30:34.457352 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.457079 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " Jul 09 17:30:34.457352 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.457103 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-metrics-client-certs\") pod \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " Jul 09 17:30:34.457352 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.457134 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-rulefiles-0\") pod \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " Jul 09 17:30:34.457352 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.457161 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-trusted-ca-bundle\") pod \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " Jul 09 17:30:34.457352 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.457184 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-configmap-serving-certs-ca-bundle\") pod \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " Jul 09 17:30:34.457635 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.457463 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-rulefiles-2" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-2") pod "3f1c8954-5f15-4ee1-9cff-6a8277f99c50" (UID: "3f1c8954-5f15-4ee1-9cff-6a8277f99c50"). InnerVolumeSpecName "prometheus-k8s-rulefiles-2". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:30:34.457693 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.457555 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-configmap-kubelet-serving-ca-bundle" (OuterVolumeSpecName: "configmap-kubelet-serving-ca-bundle") pod "3f1c8954-5f15-4ee1-9cff-6a8277f99c50" (UID: "3f1c8954-5f15-4ee1-9cff-6a8277f99c50"). InnerVolumeSpecName "configmap-kubelet-serving-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:30:34.457693 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.457566 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-configmap-metrics-client-ca" (OuterVolumeSpecName: "configmap-metrics-client-ca") pod "3f1c8954-5f15-4ee1-9cff-6a8277f99c50" (UID: "3f1c8954-5f15-4ee1-9cff-6a8277f99c50"). InnerVolumeSpecName "configmap-metrics-client-ca". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:30:34.457830 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.457705 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-grpc-tls\") pod \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " Jul 09 17:30:34.457830 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.457745 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-config\") pod \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " Jul 09 17:30:34.457830 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.457789 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-configmap-serving-certs-ca-bundle" (OuterVolumeSpecName: "configmap-serving-certs-ca-bundle") pod "3f1c8954-5f15-4ee1-9cff-6a8277f99c50" (UID: "3f1c8954-5f15-4ee1-9cff-6a8277f99c50"). InnerVolumeSpecName "configmap-serving-certs-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:30:34.457830 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.457804 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-config-out\") pod \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " Jul 09 17:30:34.458027 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.457866 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-rulefiles-1\") pod \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " Jul 09 17:30:34.458027 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.457891 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-prometheus-k8s-tls\") pod \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " Jul 09 17:30:34.458027 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.457920 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-pw42b\" (UniqueName: \"kubernetes.io/projected/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-kube-api-access-pw42b\") pod \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " Jul 09 17:30:34.458027 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.457959 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-kube-rbac-proxy\") pod \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " Jul 09 17:30:34.458027 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.458008 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-db\") pod \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " Jul 09 17:30:34.458251 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.458016 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-trusted-ca-bundle" (OuterVolumeSpecName: "prometheus-trusted-ca-bundle") pod "3f1c8954-5f15-4ee1-9cff-6a8277f99c50" (UID: "3f1c8954-5f15-4ee1-9cff-6a8277f99c50"). InnerVolumeSpecName "prometheus-trusted-ca-bundle". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:30:34.458251 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.458053 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-thanos-prometheus-http-client-file\") pod \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " Jul 09 17:30:34.458251 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.458088 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-web-config\") pod \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\" (UID: \"3f1c8954-5f15-4ee1-9cff-6a8277f99c50\") " Jul 09 17:30:34.458394 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.458336 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-rulefiles-2\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:34.458394 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.458354 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-configmap-kubelet-serving-ca-bundle\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:34.458394 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.458371 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-configmap-metrics-client-ca\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:34.458394 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.458386 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-trusted-ca-bundle\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:34.458576 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.458401 2565 reconciler_common.go:299] "Volume detached for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-configmap-serving-certs-ca-bundle\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:34.459025 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.458750 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-rulefiles-0" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-0") pod "3f1c8954-5f15-4ee1-9cff-6a8277f99c50" (UID: "3f1c8954-5f15-4ee1-9cff-6a8277f99c50"). InnerVolumeSpecName "prometheus-k8s-rulefiles-0". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:30:34.459976 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.459947 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-tls-assets" (OuterVolumeSpecName: "tls-assets") pod "3f1c8954-5f15-4ee1-9cff-6a8277f99c50" (UID: "3f1c8954-5f15-4ee1-9cff-6a8277f99c50"). InnerVolumeSpecName "tls-assets". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:30:34.460498 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.460178 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-metrics-client-certs" (OuterVolumeSpecName: "secret-metrics-client-certs") pod "3f1c8954-5f15-4ee1-9cff-6a8277f99c50" (UID: "3f1c8954-5f15-4ee1-9cff-6a8277f99c50"). InnerVolumeSpecName "secret-metrics-client-certs". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:30:34.460498 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.460266 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-rulefiles-1" (OuterVolumeSpecName: "prometheus-k8s-rulefiles-1") pod "3f1c8954-5f15-4ee1-9cff-6a8277f99c50" (UID: "3f1c8954-5f15-4ee1-9cff-6a8277f99c50"). InnerVolumeSpecName "prometheus-k8s-rulefiles-1". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:30:34.460714 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.460506 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-prometheus-k8s-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-tls") pod "3f1c8954-5f15-4ee1-9cff-6a8277f99c50" (UID: "3f1c8954-5f15-4ee1-9cff-6a8277f99c50"). InnerVolumeSpecName "secret-prometheus-k8s-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:30:34.460967 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.460876 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-prometheus-k8s-kube-rbac-proxy-web" (OuterVolumeSpecName: "secret-prometheus-k8s-kube-rbac-proxy-web") pod "3f1c8954-5f15-4ee1-9cff-6a8277f99c50" (UID: "3f1c8954-5f15-4ee1-9cff-6a8277f99c50"). InnerVolumeSpecName "secret-prometheus-k8s-kube-rbac-proxy-web". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:30:34.461053 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.460968 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-prometheus-k8s-thanos-sidecar-tls" (OuterVolumeSpecName: "secret-prometheus-k8s-thanos-sidecar-tls") pod "3f1c8954-5f15-4ee1-9cff-6a8277f99c50" (UID: "3f1c8954-5f15-4ee1-9cff-6a8277f99c50"). InnerVolumeSpecName "secret-prometheus-k8s-thanos-sidecar-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:30:34.461653 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.461593 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-config-out" (OuterVolumeSpecName: "config-out") pod "3f1c8954-5f15-4ee1-9cff-6a8277f99c50" (UID: "3f1c8954-5f15-4ee1-9cff-6a8277f99c50"). InnerVolumeSpecName "config-out". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:30:34.461991 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.461963 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-db" (OuterVolumeSpecName: "prometheus-k8s-db") pod "3f1c8954-5f15-4ee1-9cff-6a8277f99c50" (UID: "3f1c8954-5f15-4ee1-9cff-6a8277f99c50"). InnerVolumeSpecName "prometheus-k8s-db". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:30:34.462266 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.462236 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-grpc-tls" (OuterVolumeSpecName: "secret-grpc-tls") pod "3f1c8954-5f15-4ee1-9cff-6a8277f99c50" (UID: "3f1c8954-5f15-4ee1-9cff-6a8277f99c50"). InnerVolumeSpecName "secret-grpc-tls". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:30:34.462488 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.462459 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-kube-rbac-proxy" (OuterVolumeSpecName: "secret-kube-rbac-proxy") pod "3f1c8954-5f15-4ee1-9cff-6a8277f99c50" (UID: "3f1c8954-5f15-4ee1-9cff-6a8277f99c50"). InnerVolumeSpecName "secret-kube-rbac-proxy". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:30:34.462604 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.462577 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-config" (OuterVolumeSpecName: "config") pod "3f1c8954-5f15-4ee1-9cff-6a8277f99c50" (UID: "3f1c8954-5f15-4ee1-9cff-6a8277f99c50"). InnerVolumeSpecName "config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:30:34.463034 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.463016 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-thanos-prometheus-http-client-file" (OuterVolumeSpecName: "thanos-prometheus-http-client-file") pod "3f1c8954-5f15-4ee1-9cff-6a8277f99c50" (UID: "3f1c8954-5f15-4ee1-9cff-6a8277f99c50"). InnerVolumeSpecName "thanos-prometheus-http-client-file". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:30:34.463139 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.463116 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-kube-api-access-pw42b" (OuterVolumeSpecName: "kube-api-access-pw42b") pod "3f1c8954-5f15-4ee1-9cff-6a8277f99c50" (UID: "3f1c8954-5f15-4ee1-9cff-6a8277f99c50"). InnerVolumeSpecName "kube-api-access-pw42b". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:30:34.471336 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.471307 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-web-config" (OuterVolumeSpecName: "web-config") pod "3f1c8954-5f15-4ee1-9cff-6a8277f99c50" (UID: "3f1c8954-5f15-4ee1-9cff-6a8277f99c50"). InnerVolumeSpecName "web-config". PluginName "kubernetes.io/secret", VolumeGIDValue "" Jul 09 17:30:34.519209 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.519180 2565 generic.go:356] "Generic (PLEG): container finished" podID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerID="da45c49603c101f74559133a26117c2b84839ea2fd2ef134c8486967f7919a92" exitCode=0 Jul 09 17:30:34.519592 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.519232 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1c8954-5f15-4ee1-9cff-6a8277f99c50","Type":"ContainerDied","Data":"da45c49603c101f74559133a26117c2b84839ea2fd2ef134c8486967f7919a92"} Jul 09 17:30:34.519592 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.519250 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.519592 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.519288 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"3f1c8954-5f15-4ee1-9cff-6a8277f99c50","Type":"ContainerDied","Data":"9ba9dece2eabbcf2328949a823645301e1757a93ed1363f1c111098086864888"} Jul 09 17:30:34.519592 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.519320 2565 scope.go:117] "RemoveContainer" containerID="59d7ed8b9fd0f3e7f4eeebd0ee8b7b7c63d79912e36c0812ca677ed8fad0431c" Jul 09 17:30:34.527267 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.527249 2565 scope.go:117] "RemoveContainer" containerID="65f050e9933b6261b4749da9da1ba58306ad46c8b4780c9f9a3d1f28ed734ea8" Jul 09 17:30:34.534593 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.534566 2565 scope.go:117] "RemoveContainer" containerID="da45c49603c101f74559133a26117c2b84839ea2fd2ef134c8486967f7919a92" Jul 09 17:30:34.540956 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.540937 2565 scope.go:117] "RemoveContainer" containerID="6e1c20a24c641e6eb552b7b68872ff8529699f7a585b9780126af5458cd5b93e" Jul 09 17:30:34.549938 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.549915 2565 scope.go:117] "RemoveContainer" containerID="a9c40dcd521f44eb22595575ebd0b3e77d8cc3ad218a6e5e297cf6bc0ca0264c" Jul 09 17:30:34.556988 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.556972 2565 scope.go:117] "RemoveContainer" containerID="3266afd49125f61119c74644b45ba5b00faee6f8b52891005275df5b0dceecf8" Jul 09 17:30:34.559134 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.559116 2565 reconciler_common.go:299] "Volume detached for volume \"config\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-config\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:34.559223 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.559138 2565 reconciler_common.go:299] "Volume detached for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-config-out\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:34.559223 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.559156 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-rulefiles-1\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:34.559223 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.559170 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-prometheus-k8s-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:34.559223 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.559184 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-pw42b\" (UniqueName: \"kubernetes.io/projected/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-kube-api-access-pw42b\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:34.559223 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.559197 2565 reconciler_common.go:299] "Volume detached for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-kube-rbac-proxy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:34.559223 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.559210 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-db\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:34.559223 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.559223 2565 reconciler_common.go:299] "Volume detached for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-thanos-prometheus-http-client-file\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:34.559468 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.559236 2565 reconciler_common.go:299] "Volume detached for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-web-config\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:34.559468 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.559250 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-prometheus-k8s-thanos-sidecar-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:34.559468 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.559263 2565 reconciler_common.go:299] "Volume detached for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-tls-assets\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:34.559468 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.559276 2565 reconciler_common.go:299] "Volume detached for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-prometheus-k8s-kube-rbac-proxy-web\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:34.559468 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.559290 2565 reconciler_common.go:299] "Volume detached for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-metrics-client-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:34.559468 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.559304 2565 reconciler_common.go:299] "Volume detached for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-prometheus-k8s-rulefiles-0\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:34.559468 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.559319 2565 reconciler_common.go:299] "Volume detached for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/3f1c8954-5f15-4ee1-9cff-6a8277f99c50-secret-grpc-tls\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:30:34.564001 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.563976 2565 scope.go:117] "RemoveContainer" containerID="eea1c0dfac87b9b2399b7d5b42ae97abf060d5874c3fe4dfe0c4193aadf0b9b4" Jul 09 17:30:34.566198 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.566094 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 17:30:34.571434 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.571417 2565 scope.go:117] "RemoveContainer" containerID="59d7ed8b9fd0f3e7f4eeebd0ee8b7b7c63d79912e36c0812ca677ed8fad0431c" Jul 09 17:30:34.571708 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:30:34.571688 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"59d7ed8b9fd0f3e7f4eeebd0ee8b7b7c63d79912e36c0812ca677ed8fad0431c\": container with ID starting with 59d7ed8b9fd0f3e7f4eeebd0ee8b7b7c63d79912e36c0812ca677ed8fad0431c not found: ID does not exist" containerID="59d7ed8b9fd0f3e7f4eeebd0ee8b7b7c63d79912e36c0812ca677ed8fad0431c" Jul 09 17:30:34.571805 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.571716 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"59d7ed8b9fd0f3e7f4eeebd0ee8b7b7c63d79912e36c0812ca677ed8fad0431c"} err="failed to get container status \"59d7ed8b9fd0f3e7f4eeebd0ee8b7b7c63d79912e36c0812ca677ed8fad0431c\": rpc error: code = NotFound desc = could not find container \"59d7ed8b9fd0f3e7f4eeebd0ee8b7b7c63d79912e36c0812ca677ed8fad0431c\": container with ID starting with 59d7ed8b9fd0f3e7f4eeebd0ee8b7b7c63d79912e36c0812ca677ed8fad0431c not found: ID does not exist" Jul 09 17:30:34.571805 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.571734 2565 scope.go:117] "RemoveContainer" containerID="65f050e9933b6261b4749da9da1ba58306ad46c8b4780c9f9a3d1f28ed734ea8" Jul 09 17:30:34.572013 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:30:34.571996 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65f050e9933b6261b4749da9da1ba58306ad46c8b4780c9f9a3d1f28ed734ea8\": container with ID starting with 65f050e9933b6261b4749da9da1ba58306ad46c8b4780c9f9a3d1f28ed734ea8 not found: ID does not exist" containerID="65f050e9933b6261b4749da9da1ba58306ad46c8b4780c9f9a3d1f28ed734ea8" Jul 09 17:30:34.572059 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.572019 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65f050e9933b6261b4749da9da1ba58306ad46c8b4780c9f9a3d1f28ed734ea8"} err="failed to get container status \"65f050e9933b6261b4749da9da1ba58306ad46c8b4780c9f9a3d1f28ed734ea8\": rpc error: code = NotFound desc = could not find container \"65f050e9933b6261b4749da9da1ba58306ad46c8b4780c9f9a3d1f28ed734ea8\": container with ID starting with 65f050e9933b6261b4749da9da1ba58306ad46c8b4780c9f9a3d1f28ed734ea8 not found: ID does not exist" Jul 09 17:30:34.572059 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.572035 2565 scope.go:117] "RemoveContainer" containerID="da45c49603c101f74559133a26117c2b84839ea2fd2ef134c8486967f7919a92" Jul 09 17:30:34.572280 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:30:34.572235 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"da45c49603c101f74559133a26117c2b84839ea2fd2ef134c8486967f7919a92\": container with ID starting with da45c49603c101f74559133a26117c2b84839ea2fd2ef134c8486967f7919a92 not found: ID does not exist" containerID="da45c49603c101f74559133a26117c2b84839ea2fd2ef134c8486967f7919a92" Jul 09 17:30:34.572280 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.572251 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"da45c49603c101f74559133a26117c2b84839ea2fd2ef134c8486967f7919a92"} err="failed to get container status \"da45c49603c101f74559133a26117c2b84839ea2fd2ef134c8486967f7919a92\": rpc error: code = NotFound desc = could not find container \"da45c49603c101f74559133a26117c2b84839ea2fd2ef134c8486967f7919a92\": container with ID starting with da45c49603c101f74559133a26117c2b84839ea2fd2ef134c8486967f7919a92 not found: ID does not exist" Jul 09 17:30:34.572280 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.572263 2565 scope.go:117] "RemoveContainer" containerID="6e1c20a24c641e6eb552b7b68872ff8529699f7a585b9780126af5458cd5b93e" Jul 09 17:30:34.572553 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:30:34.572534 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6e1c20a24c641e6eb552b7b68872ff8529699f7a585b9780126af5458cd5b93e\": container with ID starting with 6e1c20a24c641e6eb552b7b68872ff8529699f7a585b9780126af5458cd5b93e not found: ID does not exist" containerID="6e1c20a24c641e6eb552b7b68872ff8529699f7a585b9780126af5458cd5b93e" Jul 09 17:30:34.572591 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.572557 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6e1c20a24c641e6eb552b7b68872ff8529699f7a585b9780126af5458cd5b93e"} err="failed to get container status \"6e1c20a24c641e6eb552b7b68872ff8529699f7a585b9780126af5458cd5b93e\": rpc error: code = NotFound desc = could not find container \"6e1c20a24c641e6eb552b7b68872ff8529699f7a585b9780126af5458cd5b93e\": container with ID starting with 6e1c20a24c641e6eb552b7b68872ff8529699f7a585b9780126af5458cd5b93e not found: ID does not exist" Jul 09 17:30:34.572591 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.572573 2565 scope.go:117] "RemoveContainer" containerID="a9c40dcd521f44eb22595575ebd0b3e77d8cc3ad218a6e5e297cf6bc0ca0264c" Jul 09 17:30:34.572822 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:30:34.572803 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a9c40dcd521f44eb22595575ebd0b3e77d8cc3ad218a6e5e297cf6bc0ca0264c\": container with ID starting with a9c40dcd521f44eb22595575ebd0b3e77d8cc3ad218a6e5e297cf6bc0ca0264c not found: ID does not exist" containerID="a9c40dcd521f44eb22595575ebd0b3e77d8cc3ad218a6e5e297cf6bc0ca0264c" Jul 09 17:30:34.572908 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.572823 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a9c40dcd521f44eb22595575ebd0b3e77d8cc3ad218a6e5e297cf6bc0ca0264c"} err="failed to get container status \"a9c40dcd521f44eb22595575ebd0b3e77d8cc3ad218a6e5e297cf6bc0ca0264c\": rpc error: code = NotFound desc = could not find container \"a9c40dcd521f44eb22595575ebd0b3e77d8cc3ad218a6e5e297cf6bc0ca0264c\": container with ID starting with a9c40dcd521f44eb22595575ebd0b3e77d8cc3ad218a6e5e297cf6bc0ca0264c not found: ID does not exist" Jul 09 17:30:34.572908 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.572835 2565 scope.go:117] "RemoveContainer" containerID="3266afd49125f61119c74644b45ba5b00faee6f8b52891005275df5b0dceecf8" Jul 09 17:30:34.573146 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:30:34.573028 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"3266afd49125f61119c74644b45ba5b00faee6f8b52891005275df5b0dceecf8\": container with ID starting with 3266afd49125f61119c74644b45ba5b00faee6f8b52891005275df5b0dceecf8 not found: ID does not exist" containerID="3266afd49125f61119c74644b45ba5b00faee6f8b52891005275df5b0dceecf8" Jul 09 17:30:34.573146 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.573041 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"3266afd49125f61119c74644b45ba5b00faee6f8b52891005275df5b0dceecf8"} err="failed to get container status \"3266afd49125f61119c74644b45ba5b00faee6f8b52891005275df5b0dceecf8\": rpc error: code = NotFound desc = could not find container \"3266afd49125f61119c74644b45ba5b00faee6f8b52891005275df5b0dceecf8\": container with ID starting with 3266afd49125f61119c74644b45ba5b00faee6f8b52891005275df5b0dceecf8 not found: ID does not exist" Jul 09 17:30:34.573146 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.573052 2565 scope.go:117] "RemoveContainer" containerID="eea1c0dfac87b9b2399b7d5b42ae97abf060d5874c3fe4dfe0c4193aadf0b9b4" Jul 09 17:30:34.573279 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:30:34.573259 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"eea1c0dfac87b9b2399b7d5b42ae97abf060d5874c3fe4dfe0c4193aadf0b9b4\": container with ID starting with eea1c0dfac87b9b2399b7d5b42ae97abf060d5874c3fe4dfe0c4193aadf0b9b4 not found: ID does not exist" containerID="eea1c0dfac87b9b2399b7d5b42ae97abf060d5874c3fe4dfe0c4193aadf0b9b4" Jul 09 17:30:34.573318 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.573297 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"eea1c0dfac87b9b2399b7d5b42ae97abf060d5874c3fe4dfe0c4193aadf0b9b4"} err="failed to get container status \"eea1c0dfac87b9b2399b7d5b42ae97abf060d5874c3fe4dfe0c4193aadf0b9b4\": rpc error: code = NotFound desc = could not find container \"eea1c0dfac87b9b2399b7d5b42ae97abf060d5874c3fe4dfe0c4193aadf0b9b4\": container with ID starting with eea1c0dfac87b9b2399b7d5b42ae97abf060d5874c3fe4dfe0c4193aadf0b9b4 not found: ID does not exist" Jul 09 17:30:34.574145 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.574129 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 17:30:34.593581 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.593561 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 17:30:34.593900 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.593885 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="config-reloader" Jul 09 17:30:34.593900 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.593902 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="config-reloader" Jul 09 17:30:34.594020 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.593914 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="kube-rbac-proxy" Jul 09 17:30:34.594020 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.593922 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="kube-rbac-proxy" Jul 09 17:30:34.594020 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.593937 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="kube-rbac-proxy-thanos" Jul 09 17:30:34.594020 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.593945 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="kube-rbac-proxy-thanos" Jul 09 17:30:34.594020 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.593975 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="kube-rbac-proxy-web" Jul 09 17:30:34.594020 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.593983 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="kube-rbac-proxy-web" Jul 09 17:30:34.594020 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.593997 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="init-config-reloader" Jul 09 17:30:34.594020 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.594007 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="init-config-reloader" Jul 09 17:30:34.594020 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.594019 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="prometheus" Jul 09 17:30:34.594499 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.594028 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="prometheus" Jul 09 17:30:34.594499 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.594037 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="thanos-sidecar" Jul 09 17:30:34.594499 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.594045 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="thanos-sidecar" Jul 09 17:30:34.594499 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.594107 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="prometheus" Jul 09 17:30:34.594499 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.594120 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="kube-rbac-proxy-thanos" Jul 09 17:30:34.594499 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.594130 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="thanos-sidecar" Jul 09 17:30:34.594499 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.594141 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="config-reloader" Jul 09 17:30:34.594499 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.594151 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="kube-rbac-proxy-web" Jul 09 17:30:34.594499 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.594159 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" containerName="kube-rbac-proxy" Jul 09 17:30:34.599700 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.599683 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.609848 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.609823 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-1\"" Jul 09 17:30:34.609967 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.609951 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-web-config\"" Jul 09 17:30:34.610032 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.609953 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"serving-certs-ca-bundle\"" Jul 09 17:30:34.610032 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.609953 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-prometheus-http-client-file\"" Jul 09 17:30:34.610032 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.610023 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"kube-rbac-proxy\"" Jul 09 17:30:34.610153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.610062 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-thanos-sidecar-tls\"" Jul 09 17:30:34.610153 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.610105 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-kube-rbac-proxy-web\"" Jul 09 17:30:34.610356 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.610341 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-2\"" Jul 09 17:30:34.610551 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.610537 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls-assets-0\"" Jul 09 17:30:34.610551 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.610535 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s\"" Jul 09 17:30:34.610679 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.610603 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-grpc-tls-c81j6njkqbs5j\"" Jul 09 17:30:34.610679 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.610614 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-tls\"" Jul 09 17:30:34.610898 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.610880 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"metrics-client-certs\"" Jul 09 17:30:34.611041 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.611027 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-dockercfg-mkvz8\"" Jul 09 17:30:34.611274 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.611260 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"kubelet-serving-ca-bundle\"" Jul 09 17:30:34.630416 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.630393 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-k8s-rulefiles-0\"" Jul 09 17:30:34.630613 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.630597 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-monitoring\"/\"prometheus-trusted-ca-bundle\"" Jul 09 17:30:34.632994 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.632974 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 17:30:34.760247 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.760154 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e539b84f-c1a7-452f-9e6d-a025b4708d2d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.760247 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.760195 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e539b84f-c1a7-452f-9e6d-a025b4708d2d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.760247 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.760226 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.760458 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.760262 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e539b84f-c1a7-452f-9e6d-a025b4708d2d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.760458 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.760277 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-web-config\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.760458 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.760296 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.760458 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.760344 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e539b84f-c1a7-452f-9e6d-a025b4708d2d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.760458 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.760412 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.760458 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.760441 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e539b84f-c1a7-452f-9e6d-a025b4708d2d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.760630 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.760458 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e539b84f-c1a7-452f-9e6d-a025b4708d2d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.760630 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.760508 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e539b84f-c1a7-452f-9e6d-a025b4708d2d-config-out\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.760630 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.760538 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-jcjf5\" (UniqueName: \"kubernetes.io/projected/e539b84f-c1a7-452f-9e6d-a025b4708d2d-kube-api-access-jcjf5\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.760630 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.760562 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.760630 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.760591 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.760630 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.760607 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e539b84f-c1a7-452f-9e6d-a025b4708d2d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.760630 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.760625 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.760860 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.760670 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-config\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.760860 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.760690 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.760860 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.760710 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e539b84f-c1a7-452f-9e6d-a025b4708d2d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.760860 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.760728 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e539b84f-c1a7-452f-9e6d-a025b4708d2d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.861747 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.861693 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e539b84f-c1a7-452f-9e6d-a025b4708d2d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.861747 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.861777 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.861987 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.861803 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e539b84f-c1a7-452f-9e6d-a025b4708d2d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.861987 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.861824 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e539b84f-c1a7-452f-9e6d-a025b4708d2d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.861987 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.861860 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e539b84f-c1a7-452f-9e6d-a025b4708d2d-config-out\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.861987 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.861888 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-jcjf5\" (UniqueName: \"kubernetes.io/projected/e539b84f-c1a7-452f-9e6d-a025b4708d2d-kube-api-access-jcjf5\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.861987 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.861911 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.861987 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.861936 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.861987 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.861963 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e539b84f-c1a7-452f-9e6d-a025b4708d2d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.861987 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.861991 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.863022 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.862663 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-metrics-client-ca\" (UniqueName: \"kubernetes.io/configmap/e539b84f-c1a7-452f-9e6d-a025b4708d2d-configmap-metrics-client-ca\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.863022 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.862952 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-db\" (UniqueName: \"kubernetes.io/empty-dir/e539b84f-c1a7-452f-9e6d-a025b4708d2d-prometheus-k8s-db\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.863022 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.863000 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-config\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.863264 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.863036 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.863264 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.863067 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e539b84f-c1a7-452f-9e6d-a025b4708d2d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.863264 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.863093 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e539b84f-c1a7-452f-9e6d-a025b4708d2d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.863264 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.863129 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e539b84f-c1a7-452f-9e6d-a025b4708d2d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.863264 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.863152 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e539b84f-c1a7-452f-9e6d-a025b4708d2d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.863264 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.863184 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.863264 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.863234 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e539b84f-c1a7-452f-9e6d-a025b4708d2d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.863264 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.863245 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-trusted-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e539b84f-c1a7-452f-9e6d-a025b4708d2d-prometheus-trusted-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.863264 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.863260 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-web-config\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.863688 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.863292 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.865165 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.864889 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-thanos-sidecar-tls\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-secret-prometheus-k8s-thanos-sidecar-tls\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.865165 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.864937 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-metrics-client-certs\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-secret-metrics-client-certs\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.865165 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.864941 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"thanos-prometheus-http-client-file\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-thanos-prometheus-http-client-file\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.865634 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.865605 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-tls\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-secret-prometheus-k8s-tls\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.865790 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.865747 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-out\" (UniqueName: \"kubernetes.io/empty-dir/e539b84f-c1a7-452f-9e6d-a025b4708d2d-config-out\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.865869 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.865744 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-assets\" (UniqueName: \"kubernetes.io/projected/e539b84f-c1a7-452f-9e6d-a025b4708d2d-tls-assets\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.865932 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.865893 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-0\" (UniqueName: \"kubernetes.io/configmap/e539b84f-c1a7-452f-9e6d-a025b4708d2d-prometheus-k8s-rulefiles-0\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.866579 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.866278 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-kubelet-serving-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e539b84f-c1a7-452f-9e6d-a025b4708d2d-configmap-kubelet-serving-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.866579 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.866462 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"configmap-serving-certs-ca-bundle\" (UniqueName: \"kubernetes.io/configmap/e539b84f-c1a7-452f-9e6d-a025b4708d2d-configmap-serving-certs-ca-bundle\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.866579 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.866520 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-2\" (UniqueName: \"kubernetes.io/configmap/e539b84f-c1a7-452f-9e6d-a025b4708d2d-prometheus-k8s-rulefiles-2\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.866812 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.866607 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-grpc-tls\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-secret-grpc-tls\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.866812 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.866796 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"prometheus-k8s-rulefiles-1\" (UniqueName: \"kubernetes.io/configmap/e539b84f-c1a7-452f-9e6d-a025b4708d2d-prometheus-k8s-rulefiles-1\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.867314 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.867285 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-kube-rbac-proxy\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-secret-kube-rbac-proxy\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.867390 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.867348 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-config\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.867551 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.867534 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"secret-prometheus-k8s-kube-rbac-proxy-web\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-secret-prometheus-k8s-kube-rbac-proxy-web\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.868060 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.868044 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"web-config\" (UniqueName: \"kubernetes.io/secret/e539b84f-c1a7-452f-9e6d-a025b4708d2d-web-config\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.881049 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.881030 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-jcjf5\" (UniqueName: \"kubernetes.io/projected/e539b84f-c1a7-452f-9e6d-a025b4708d2d-kube-api-access-jcjf5\") pod \"prometheus-k8s-0\" (UID: \"e539b84f-c1a7-452f-9e6d-a025b4708d2d\") " pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:34.908234 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:34.908203 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:30:35.058185 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:35.058159 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-monitoring/prometheus-k8s-0"] Jul 09 17:30:35.059774 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:30:35.059733 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pode539b84f_c1a7_452f_9e6d_a025b4708d2d.slice/crio-8b9b40ecb041b911c13f1d592a2fe42967ee862b13536d0283797c8eb2db815c WatchSource:0}: Error finding container 8b9b40ecb041b911c13f1d592a2fe42967ee862b13536d0283797c8eb2db815c: Status 404 returned error can't find the container with id 8b9b40ecb041b911c13f1d592a2fe42967ee862b13536d0283797c8eb2db815c Jul 09 17:30:35.508192 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:35.508117 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3f1c8954-5f15-4ee1-9cff-6a8277f99c50" path="/var/lib/kubelet/pods/3f1c8954-5f15-4ee1-9cff-6a8277f99c50/volumes" Jul 09 17:30:35.524672 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:35.524644 2565 generic.go:356] "Generic (PLEG): container finished" podID="e539b84f-c1a7-452f-9e6d-a025b4708d2d" containerID="c5957bce3a508649e57df7186a6c8c7d836468d2fecca51629f644fa7b273cde" exitCode=0 Jul 09 17:30:35.525108 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:35.524733 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e539b84f-c1a7-452f-9e6d-a025b4708d2d","Type":"ContainerDied","Data":"c5957bce3a508649e57df7186a6c8c7d836468d2fecca51629f644fa7b273cde"} Jul 09 17:30:35.525108 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:35.524828 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e539b84f-c1a7-452f-9e6d-a025b4708d2d","Type":"ContainerStarted","Data":"8b9b40ecb041b911c13f1d592a2fe42967ee862b13536d0283797c8eb2db815c"} Jul 09 17:30:36.532683 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:36.532647 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e539b84f-c1a7-452f-9e6d-a025b4708d2d","Type":"ContainerStarted","Data":"cb81f2b240a0313fb73559a33ddd346072253f4bb24eb237cc4fb20062c6a4a5"} Jul 09 17:30:36.533085 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:36.532730 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e539b84f-c1a7-452f-9e6d-a025b4708d2d","Type":"ContainerStarted","Data":"f060778180d1f4ac6dcf5ed1cd87598acb03722fdf991eff1ddfe27ba0ec80e9"} Jul 09 17:30:36.533085 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:36.532787 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e539b84f-c1a7-452f-9e6d-a025b4708d2d","Type":"ContainerStarted","Data":"13392b7fbf421dc1bb59d092df65c7a844be85effffbd08b6b1db295442a11e0"} Jul 09 17:30:36.533085 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:36.532829 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e539b84f-c1a7-452f-9e6d-a025b4708d2d","Type":"ContainerStarted","Data":"437529503d7a02682291eabfec0001b97195930b601137b758570d6045208319"} Jul 09 17:30:36.533085 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:36.532865 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e539b84f-c1a7-452f-9e6d-a025b4708d2d","Type":"ContainerStarted","Data":"c6fb0565cd0b8fd88c894f7f01f6c1bb8d100238dc1cf2a3e3d6322bc88fac77"} Jul 09 17:30:36.533085 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:36.532897 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-monitoring/prometheus-k8s-0" event={"ID":"e539b84f-c1a7-452f-9e6d-a025b4708d2d","Type":"ContainerStarted","Data":"6b2bed83566d8699d4ffcf0cbd2171a249a4b752da150a6358a66fdf4b787d12"} Jul 09 17:30:36.593389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:36.593324 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-monitoring/prometheus-k8s-0" podStartSLOduration=2.57349654 podStartE2EDuration="2.593306993s" totalImagesPullingTime="0s" totalInitContainerRuntime="19.810453ms" isStatefulPod=false podCreationTimestamp="2026-07-09 17:30:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:30:36.592151307 +0000 UTC m=+149.648619809" watchObservedRunningTime="2026-07-09 17:30:36.593306993 +0000 UTC m=+149.649775493" Jul 09 17:30:39.908361 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:30:39.908321 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:31:34.908946 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:31:34.908913 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:31:34.924738 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:31:34.924712 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:31:35.774143 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:31:35.774113 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-monitoring/prometheus-k8s-0" Jul 09 17:31:50.980820 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:31:50.980788 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-69xs7"] Jul 09 17:31:50.985420 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:31:50.985373 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-69xs7" Jul 09 17:31:50.987593 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:31:50.987568 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"openshift-service-ca.crt\"" Jul 09 17:31:50.988821 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:31:50.988505 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"cert-manager\"/\"cert-manager-webhook-dockercfg-wd4zg\"" Jul 09 17:31:50.988942 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:31:50.988531 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"cert-manager\"/\"kube-root-ca.crt\"" Jul 09 17:31:50.993355 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:31:50.993335 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-69xs7"] Jul 09 17:31:51.099637 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:31:51.099599 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce7f7c94-dde9-4557-a040-680628807a1f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-69xs7\" (UID: \"ce7f7c94-dde9-4557-a040-680628807a1f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-69xs7" Jul 09 17:31:51.099829 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:31:51.099649 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-s2w9r\" (UniqueName: \"kubernetes.io/projected/ce7f7c94-dde9-4557-a040-680628807a1f-kube-api-access-s2w9r\") pod \"cert-manager-webhook-6486ffd997-69xs7\" (UID: \"ce7f7c94-dde9-4557-a040-680628807a1f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-69xs7" Jul 09 17:31:51.200097 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:31:51.200068 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-s2w9r\" (UniqueName: \"kubernetes.io/projected/ce7f7c94-dde9-4557-a040-680628807a1f-kube-api-access-s2w9r\") pod \"cert-manager-webhook-6486ffd997-69xs7\" (UID: \"ce7f7c94-dde9-4557-a040-680628807a1f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-69xs7" Jul 09 17:31:51.200208 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:31:51.200151 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce7f7c94-dde9-4557-a040-680628807a1f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-69xs7\" (UID: \"ce7f7c94-dde9-4557-a040-680628807a1f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-69xs7" Jul 09 17:31:51.212652 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:31:51.212622 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"bound-sa-token\" (UniqueName: \"kubernetes.io/projected/ce7f7c94-dde9-4557-a040-680628807a1f-bound-sa-token\") pod \"cert-manager-webhook-6486ffd997-69xs7\" (UID: \"ce7f7c94-dde9-4557-a040-680628807a1f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-69xs7" Jul 09 17:31:51.212912 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:31:51.212890 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-s2w9r\" (UniqueName: \"kubernetes.io/projected/ce7f7c94-dde9-4557-a040-680628807a1f-kube-api-access-s2w9r\") pod \"cert-manager-webhook-6486ffd997-69xs7\" (UID: \"ce7f7c94-dde9-4557-a040-680628807a1f\") " pod="cert-manager/cert-manager-webhook-6486ffd997-69xs7" Jul 09 17:31:51.304475 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:31:51.304445 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="cert-manager/cert-manager-webhook-6486ffd997-69xs7" Jul 09 17:31:51.429657 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:31:51.429626 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["cert-manager/cert-manager-webhook-6486ffd997-69xs7"] Jul 09 17:31:51.432673 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:31:51.432648 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podce7f7c94_dde9_4557_a040_680628807a1f.slice/crio-3f7b7e85ad38e33a37567b0e2f68c7619459ebb095d0fc7d110cdea0277ff68a WatchSource:0}: Error finding container 3f7b7e85ad38e33a37567b0e2f68c7619459ebb095d0fc7d110cdea0277ff68a: Status 404 returned error can't find the container with id 3f7b7e85ad38e33a37567b0e2f68c7619459ebb095d0fc7d110cdea0277ff68a Jul 09 17:31:51.821354 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:31:51.821263 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-69xs7" event={"ID":"ce7f7c94-dde9-4557-a040-680628807a1f","Type":"ContainerStarted","Data":"3f7b7e85ad38e33a37567b0e2f68c7619459ebb095d0fc7d110cdea0277ff68a"} Jul 09 17:31:54.836437 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:31:54.836402 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="cert-manager/cert-manager-webhook-6486ffd997-69xs7" event={"ID":"ce7f7c94-dde9-4557-a040-680628807a1f","Type":"ContainerStarted","Data":"09ddc021f3187668c367666a72bcd30638985b940ac0e1ca51d171bc457fc42f"} Jul 09 17:31:54.836905 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:31:54.836453 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="cert-manager/cert-manager-webhook-6486ffd997-69xs7" Jul 09 17:31:54.850891 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:31:54.850843 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="cert-manager/cert-manager-webhook-6486ffd997-69xs7" podStartSLOduration=1.781875047 podStartE2EDuration="4.850826057s" totalImagesPullingTime="3.06895101s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:31:50 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:31:54.850109416 +0000 UTC m=+227.906577917" watchObservedRunningTime="2026-07-09 17:31:54.850826057 +0000 UTC m=+227.907294558" Jul 09 17:32:00.842878 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:00.842852 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="cert-manager/cert-manager-webhook-6486ffd997-69xs7" Jul 09 17:32:02.555137 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:02.555102 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wts2g"] Jul 09 17:32:02.558196 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:02.558181 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wts2g" Jul 09 17:32:02.560532 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:02.560511 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"openshift-service-ca.crt\"" Jul 09 17:32:02.560532 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:02.560528 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-lws-operator\"/\"openshift-lws-operator-dockercfg-749n7\"" Jul 09 17:32:02.561411 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:02.561384 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-lws-operator\"/\"kube-root-ca.crt\"" Jul 09 17:32:02.566471 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:02.566450 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wts2g"] Jul 09 17:32:02.595986 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:02.595954 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bhg62\" (UniqueName: \"kubernetes.io/projected/fcd7ba59-531b-4e4f-828e-2e514c5b7cd0-kube-api-access-bhg62\") pod \"openshift-lws-operator-fd8ccff4c-wts2g\" (UID: \"fcd7ba59-531b-4e4f-828e-2e514c5b7cd0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wts2g" Jul 09 17:32:02.596144 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:02.596033 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcd7ba59-531b-4e4f-828e-2e514c5b7cd0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wts2g\" (UID: \"fcd7ba59-531b-4e4f-828e-2e514c5b7cd0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wts2g" Jul 09 17:32:02.696814 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:02.696747 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bhg62\" (UniqueName: \"kubernetes.io/projected/fcd7ba59-531b-4e4f-828e-2e514c5b7cd0-kube-api-access-bhg62\") pod \"openshift-lws-operator-fd8ccff4c-wts2g\" (UID: \"fcd7ba59-531b-4e4f-828e-2e514c5b7cd0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wts2g" Jul 09 17:32:02.696997 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:02.696852 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcd7ba59-531b-4e4f-828e-2e514c5b7cd0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wts2g\" (UID: \"fcd7ba59-531b-4e4f-828e-2e514c5b7cd0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wts2g" Jul 09 17:32:02.697217 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:02.697196 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/fcd7ba59-531b-4e4f-828e-2e514c5b7cd0-tmp\") pod \"openshift-lws-operator-fd8ccff4c-wts2g\" (UID: \"fcd7ba59-531b-4e4f-828e-2e514c5b7cd0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wts2g" Jul 09 17:32:02.704595 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:02.704565 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bhg62\" (UniqueName: \"kubernetes.io/projected/fcd7ba59-531b-4e4f-828e-2e514c5b7cd0-kube-api-access-bhg62\") pod \"openshift-lws-operator-fd8ccff4c-wts2g\" (UID: \"fcd7ba59-531b-4e4f-828e-2e514c5b7cd0\") " pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wts2g" Jul 09 17:32:02.868672 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:02.868597 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wts2g" Jul 09 17:32:02.987783 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:02.987738 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wts2g"] Jul 09 17:32:02.990689 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:32:02.990661 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-besteffort.slice/kubepods-besteffort-podfcd7ba59_531b_4e4f_828e_2e514c5b7cd0.slice/crio-406d27de143e04ae10af8bd6846c2032363bf4f3330e4f8cb9c5b2ff77322a44 WatchSource:0}: Error finding container 406d27de143e04ae10af8bd6846c2032363bf4f3330e4f8cb9c5b2ff77322a44: Status 404 returned error can't find the container with id 406d27de143e04ae10af8bd6846c2032363bf4f3330e4f8cb9c5b2ff77322a44 Jul 09 17:32:03.873789 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:03.873731 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wts2g" event={"ID":"fcd7ba59-531b-4e4f-828e-2e514c5b7cd0","Type":"ContainerStarted","Data":"406d27de143e04ae10af8bd6846c2032363bf4f3330e4f8cb9c5b2ff77322a44"} Jul 09 17:32:05.885562 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:05.885457 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wts2g" event={"ID":"fcd7ba59-531b-4e4f-828e-2e514c5b7cd0","Type":"ContainerStarted","Data":"077e2d096892a58f02b9bc87d3e685d8197f30d196a842bbdbd4572af6c3712d"} Jul 09 17:32:05.902884 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:05.902834 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-lws-operator/openshift-lws-operator-fd8ccff4c-wts2g" podStartSLOduration=1.288079967 podStartE2EDuration="3.902818022s" totalImagesPullingTime="2.614738055s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:32:02 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:32:05.90177856 +0000 UTC m=+238.958247081" watchObservedRunningTime="2026-07-09 17:32:05.902818022 +0000 UTC m=+238.959286521" Jul 09 17:32:25.589484 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.589453 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv"] Jul 09 17:32:25.595733 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.595703 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" Jul 09 17:32:25.599135 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.599110 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-webhook-cert\"" Jul 09 17:32:25.599269 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.599145 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-dockercfg-94t5d\"" Jul 09 17:32:25.599269 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.599120 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"opendatahub-operator-controller-manager-service-cert\"" Jul 09 17:32:25.600194 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.600180 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"kube-root-ca.crt\"" Jul 09 17:32:25.600729 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.600708 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"opendatahub\"/\"openshift-service-ca.crt\"" Jul 09 17:32:25.616797 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.616772 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv"] Jul 09 17:32:25.691574 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.691544 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecfd8064-b01d-4f42-9614-75dac1f15c07-tmp\") pod \"opendatahub-operator-controller-manager-c8444b686-nlkxv\" (UID: \"ecfd8064-b01d-4f42-9614-75dac1f15c07\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" Jul 09 17:32:25.691782 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.691588 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ecfd8064-b01d-4f42-9614-75dac1f15c07-manifests\") pod \"opendatahub-operator-controller-manager-c8444b686-nlkxv\" (UID: \"ecfd8064-b01d-4f42-9614-75dac1f15c07\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" Jul 09 17:32:25.691782 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.691632 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ecfd8064-b01d-4f42-9614-75dac1f15c07-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c8444b686-nlkxv\" (UID: \"ecfd8064-b01d-4f42-9614-75dac1f15c07\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" Jul 09 17:32:25.691782 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.691665 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ecfd8064-b01d-4f42-9614-75dac1f15c07-webhook-cert\") pod \"opendatahub-operator-controller-manager-c8444b686-nlkxv\" (UID: \"ecfd8064-b01d-4f42-9614-75dac1f15c07\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" Jul 09 17:32:25.691782 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.691687 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-cklhd\" (UniqueName: \"kubernetes.io/projected/ecfd8064-b01d-4f42-9614-75dac1f15c07-kube-api-access-cklhd\") pod \"opendatahub-operator-controller-manager-c8444b686-nlkxv\" (UID: \"ecfd8064-b01d-4f42-9614-75dac1f15c07\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" Jul 09 17:32:25.792679 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.792646 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecfd8064-b01d-4f42-9614-75dac1f15c07-tmp\") pod \"opendatahub-operator-controller-manager-c8444b686-nlkxv\" (UID: \"ecfd8064-b01d-4f42-9614-75dac1f15c07\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" Jul 09 17:32:25.792870 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.792686 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ecfd8064-b01d-4f42-9614-75dac1f15c07-manifests\") pod \"opendatahub-operator-controller-manager-c8444b686-nlkxv\" (UID: \"ecfd8064-b01d-4f42-9614-75dac1f15c07\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" Jul 09 17:32:25.792870 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.792835 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ecfd8064-b01d-4f42-9614-75dac1f15c07-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c8444b686-nlkxv\" (UID: \"ecfd8064-b01d-4f42-9614-75dac1f15c07\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" Jul 09 17:32:25.792992 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.792892 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ecfd8064-b01d-4f42-9614-75dac1f15c07-webhook-cert\") pod \"opendatahub-operator-controller-manager-c8444b686-nlkxv\" (UID: \"ecfd8064-b01d-4f42-9614-75dac1f15c07\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" Jul 09 17:32:25.792992 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.792919 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-cklhd\" (UniqueName: \"kubernetes.io/projected/ecfd8064-b01d-4f42-9614-75dac1f15c07-kube-api-access-cklhd\") pod \"opendatahub-operator-controller-manager-c8444b686-nlkxv\" (UID: \"ecfd8064-b01d-4f42-9614-75dac1f15c07\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" Jul 09 17:32:25.793086 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.793051 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"manifests\" (UniqueName: \"kubernetes.io/empty-dir/ecfd8064-b01d-4f42-9614-75dac1f15c07-manifests\") pod \"opendatahub-operator-controller-manager-c8444b686-nlkxv\" (UID: \"ecfd8064-b01d-4f42-9614-75dac1f15c07\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" Jul 09 17:32:25.794893 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.794869 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/ecfd8064-b01d-4f42-9614-75dac1f15c07-tmp\") pod \"opendatahub-operator-controller-manager-c8444b686-nlkxv\" (UID: \"ecfd8064-b01d-4f42-9614-75dac1f15c07\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" Jul 09 17:32:25.795088 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.795070 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"apiservice-cert\" (UniqueName: \"kubernetes.io/secret/ecfd8064-b01d-4f42-9614-75dac1f15c07-apiservice-cert\") pod \"opendatahub-operator-controller-manager-c8444b686-nlkxv\" (UID: \"ecfd8064-b01d-4f42-9614-75dac1f15c07\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" Jul 09 17:32:25.795263 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.795244 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"webhook-cert\" (UniqueName: \"kubernetes.io/secret/ecfd8064-b01d-4f42-9614-75dac1f15c07-webhook-cert\") pod \"opendatahub-operator-controller-manager-c8444b686-nlkxv\" (UID: \"ecfd8064-b01d-4f42-9614-75dac1f15c07\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" Jul 09 17:32:25.800716 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.800694 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-cklhd\" (UniqueName: \"kubernetes.io/projected/ecfd8064-b01d-4f42-9614-75dac1f15c07-kube-api-access-cklhd\") pod \"opendatahub-operator-controller-manager-c8444b686-nlkxv\" (UID: \"ecfd8064-b01d-4f42-9614-75dac1f15c07\") " pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" Jul 09 17:32:25.905569 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:25.905476 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" Jul 09 17:32:26.038264 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:26.038230 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv"] Jul 09 17:32:26.041584 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:32:26.041562 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podecfd8064_b01d_4f42_9614_75dac1f15c07.slice/crio-521671837cecb079d2c7791670c0c1d44328d904ef8c9b8cbd852319e501f4fc WatchSource:0}: Error finding container 521671837cecb079d2c7791670c0c1d44328d904ef8c9b8cbd852319e501f4fc: Status 404 returned error can't find the container with id 521671837cecb079d2c7791670c0c1d44328d904ef8c9b8cbd852319e501f4fc Jul 09 17:32:26.970262 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:26.970223 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" event={"ID":"ecfd8064-b01d-4f42-9614-75dac1f15c07","Type":"ContainerStarted","Data":"521671837cecb079d2c7791670c0c1d44328d904ef8c9b8cbd852319e501f4fc"} Jul 09 17:32:29.984468 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:29.984429 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" event={"ID":"ecfd8064-b01d-4f42-9614-75dac1f15c07","Type":"ContainerStarted","Data":"544e1bfef36b13ca16fc00ae01eeeedfe2d646575f4266101b54571fe6c14ab8"} Jul 09 17:32:30.989426 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:30.989393 2565 generic.go:356] "Generic (PLEG): container finished" podID="ecfd8064-b01d-4f42-9614-75dac1f15c07" containerID="544e1bfef36b13ca16fc00ae01eeeedfe2d646575f4266101b54571fe6c14ab8" exitCode=0 Jul 09 17:32:30.989851 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:30.989468 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" event={"ID":"ecfd8064-b01d-4f42-9614-75dac1f15c07","Type":"ContainerDied","Data":"544e1bfef36b13ca16fc00ae01eeeedfe2d646575f4266101b54571fe6c14ab8"} Jul 09 17:32:31.995162 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:31.995123 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" event={"ID":"ecfd8064-b01d-4f42-9614-75dac1f15c07","Type":"ContainerStarted","Data":"51c4beffac3c0e1adb6716ec23ba8d81d244bbd8edad33ebed25a970ee07aae6"} Jul 09 17:32:31.995637 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:31.995245 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" Jul 09 17:32:32.016268 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:32.016219 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" podStartSLOduration=2.457732062 podStartE2EDuration="7.016201792s" totalImagesPullingTime="3.463613003s" totalInitContainerRuntime="1.094856727s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:32:25 +0000 UTC" imagePullSessionsCount=2 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:32:32.014447872 +0000 UTC m=+265.070916372" watchObservedRunningTime="2026-07-09 17:32:32.016201792 +0000 UTC m=+265.072670291" Jul 09 17:32:43.002539 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:43.002502 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/opendatahub-operator-controller-manager-c8444b686-nlkxv" Jul 09 17:32:45.242863 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:45.242833 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/kube-auth-proxy-85cbbdb477-bgt89"] Jul 09 17:32:45.251180 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:45.251157 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85cbbdb477-bgt89" Jul 09 17:32:45.253937 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:45.253908 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"kube-root-ca.crt\"" Jul 09 17:32:45.254803 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:45.254776 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-dockercfg-5g6mp\"" Jul 09 17:32:45.254803 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:45.254799 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-creds\"" Jul 09 17:32:45.254948 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:45.254826 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-service-ca.crt\"" Jul 09 17:32:45.255272 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:45.255257 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"kube-auth-proxy-tls\"" Jul 09 17:32:45.266602 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:45.266575 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a95fb50-4b17-4436-a6cc-4a34f9a9be2d-tls-certs\") pod \"kube-auth-proxy-85cbbdb477-bgt89\" (UID: \"0a95fb50-4b17-4436-a6cc-4a34f9a9be2d\") " pod="openshift-ingress/kube-auth-proxy-85cbbdb477-bgt89" Jul 09 17:32:45.266602 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:45.266591 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85cbbdb477-bgt89"] Jul 09 17:32:45.266818 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:45.266616 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-rpvww\" (UniqueName: \"kubernetes.io/projected/0a95fb50-4b17-4436-a6cc-4a34f9a9be2d-kube-api-access-rpvww\") pod \"kube-auth-proxy-85cbbdb477-bgt89\" (UID: \"0a95fb50-4b17-4436-a6cc-4a34f9a9be2d\") " pod="openshift-ingress/kube-auth-proxy-85cbbdb477-bgt89" Jul 09 17:32:45.266818 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:45.266679 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a95fb50-4b17-4436-a6cc-4a34f9a9be2d-tmp\") pod \"kube-auth-proxy-85cbbdb477-bgt89\" (UID: \"0a95fb50-4b17-4436-a6cc-4a34f9a9be2d\") " pod="openshift-ingress/kube-auth-proxy-85cbbdb477-bgt89" Jul 09 17:32:45.367571 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:45.367542 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a95fb50-4b17-4436-a6cc-4a34f9a9be2d-tls-certs\") pod \"kube-auth-proxy-85cbbdb477-bgt89\" (UID: \"0a95fb50-4b17-4436-a6cc-4a34f9a9be2d\") " pod="openshift-ingress/kube-auth-proxy-85cbbdb477-bgt89" Jul 09 17:32:45.367571 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:45.367576 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-rpvww\" (UniqueName: \"kubernetes.io/projected/0a95fb50-4b17-4436-a6cc-4a34f9a9be2d-kube-api-access-rpvww\") pod \"kube-auth-proxy-85cbbdb477-bgt89\" (UID: \"0a95fb50-4b17-4436-a6cc-4a34f9a9be2d\") " pod="openshift-ingress/kube-auth-proxy-85cbbdb477-bgt89" Jul 09 17:32:45.367799 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:45.367616 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a95fb50-4b17-4436-a6cc-4a34f9a9be2d-tmp\") pod \"kube-auth-proxy-85cbbdb477-bgt89\" (UID: \"0a95fb50-4b17-4436-a6cc-4a34f9a9be2d\") " pod="openshift-ingress/kube-auth-proxy-85cbbdb477-bgt89" Jul 09 17:32:45.369990 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:45.369959 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp\" (UniqueName: \"kubernetes.io/empty-dir/0a95fb50-4b17-4436-a6cc-4a34f9a9be2d-tmp\") pod \"kube-auth-proxy-85cbbdb477-bgt89\" (UID: \"0a95fb50-4b17-4436-a6cc-4a34f9a9be2d\") " pod="openshift-ingress/kube-auth-proxy-85cbbdb477-bgt89" Jul 09 17:32:45.370135 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:45.370119 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/0a95fb50-4b17-4436-a6cc-4a34f9a9be2d-tls-certs\") pod \"kube-auth-proxy-85cbbdb477-bgt89\" (UID: \"0a95fb50-4b17-4436-a6cc-4a34f9a9be2d\") " pod="openshift-ingress/kube-auth-proxy-85cbbdb477-bgt89" Jul 09 17:32:45.375929 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:45.375900 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-rpvww\" (UniqueName: \"kubernetes.io/projected/0a95fb50-4b17-4436-a6cc-4a34f9a9be2d-kube-api-access-rpvww\") pod \"kube-auth-proxy-85cbbdb477-bgt89\" (UID: \"0a95fb50-4b17-4436-a6cc-4a34f9a9be2d\") " pod="openshift-ingress/kube-auth-proxy-85cbbdb477-bgt89" Jul 09 17:32:45.561695 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:45.561664 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/kube-auth-proxy-85cbbdb477-bgt89" Jul 09 17:32:45.705047 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:45.705017 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/kube-auth-proxy-85cbbdb477-bgt89"] Jul 09 17:32:45.708429 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:32:45.708401 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod0a95fb50_4b17_4436_a6cc_4a34f9a9be2d.slice/crio-4bce401be7912da3c944edaccfffcdcca736f2f6945c4bad03803f23416a36be WatchSource:0}: Error finding container 4bce401be7912da3c944edaccfffcdcca736f2f6945c4bad03803f23416a36be: Status 404 returned error can't find the container with id 4bce401be7912da3c944edaccfffcdcca736f2f6945c4bad03803f23416a36be Jul 09 17:32:46.055945 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:46.055909 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85cbbdb477-bgt89" event={"ID":"0a95fb50-4b17-4436-a6cc-4a34f9a9be2d","Type":"ContainerStarted","Data":"4bce401be7912da3c944edaccfffcdcca736f2f6945c4bad03803f23416a36be"} Jul 09 17:32:50.074300 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:50.074263 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/kube-auth-proxy-85cbbdb477-bgt89" event={"ID":"0a95fb50-4b17-4436-a6cc-4a34f9a9be2d","Type":"ContainerStarted","Data":"06c432e5ab9dc7dd041225b65250fda9382a8c9f7d094cadf2536e95a1a2e723"} Jul 09 17:32:50.090859 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:50.090778 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/kube-auth-proxy-85cbbdb477-bgt89" podStartSLOduration=1.742839287 podStartE2EDuration="5.090742554s" totalImagesPullingTime="3.347903267s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:32:45 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:32:50.090216586 +0000 UTC m=+283.146685089" watchObservedRunningTime="2026-07-09 17:32:50.090742554 +0000 UTC m=+283.147211055" Jul 09 17:32:53.316578 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.316543 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m"] Jul 09 17:32:53.320611 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.320592 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.322833 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.322810 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-ingress\"/\"openshift-gw-ca-root-cert\"" Jul 09 17:32:53.322978 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.322958 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"data-science-gateway-data-science-gateway-class-dockercfg-vwltx\"" Jul 09 17:32:53.331983 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.331961 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m"] Jul 09 17:32:53.436676 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.436645 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6cb1372-4b09-4426-b24a-031792f726fc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.436676 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.436685 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6cb1372-4b09-4426-b24a-031792f726fc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.436930 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.436718 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6cb1372-4b09-4426-b24a-031792f726fc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.436930 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.436810 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6cb1372-4b09-4426-b24a-031792f726fc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.436930 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.436851 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6cb1372-4b09-4426-b24a-031792f726fc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.436930 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.436895 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-t6sc5\" (UniqueName: \"kubernetes.io/projected/d6cb1372-4b09-4426-b24a-031792f726fc-kube-api-access-t6sc5\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.436930 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.436914 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6cb1372-4b09-4426-b24a-031792f726fc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.437102 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.436951 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6cb1372-4b09-4426-b24a-031792f726fc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.437102 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.436970 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6cb1372-4b09-4426-b24a-031792f726fc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.487814 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.487780 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5"] Jul 09 17:32:53.491033 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.491012 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.495449 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.495429 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-tls\"" Jul 09 17:32:53.495743 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.495717 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"cacerts\"" Jul 09 17:32:53.495987 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.495973 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istio-kubeconfig\"" Jul 09 17:32:53.498831 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.498815 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"istiod-openshift-gateway-dockercfg-j9zt2\"" Jul 09 17:32:53.531966 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.531934 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5"] Jul 09 17:32:53.538411 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.538378 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6cb1372-4b09-4426-b24a-031792f726fc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.538538 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.538423 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-ssw9d\" (UniqueName: \"kubernetes.io/projected/949e4acd-1c87-4284-8116-2479ded66416-kube-api-access-ssw9d\") pod \"istiod-openshift-gateway-94bb8fbfd-mrrp5\" (UID: \"949e4acd-1c87-4284-8116-2479ded66416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.538538 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.538467 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6cb1372-4b09-4426-b24a-031792f726fc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.538538 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.538494 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/949e4acd-1c87-4284-8116-2479ded66416-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mrrp5\" (UID: \"949e4acd-1c87-4284-8116-2479ded66416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.538713 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.538574 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6cb1372-4b09-4426-b24a-031792f726fc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.538713 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.538605 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/949e4acd-1c87-4284-8116-2479ded66416-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mrrp5\" (UID: \"949e4acd-1c87-4284-8116-2479ded66416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.538713 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.538642 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/949e4acd-1c87-4284-8116-2479ded66416-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mrrp5\" (UID: \"949e4acd-1c87-4284-8116-2479ded66416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.538713 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.538674 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6cb1372-4b09-4426-b24a-031792f726fc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.538979 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.538733 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6cb1372-4b09-4426-b24a-031792f726fc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.538979 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.538782 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/949e4acd-1c87-4284-8116-2479ded66416-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mrrp5\" (UID: \"949e4acd-1c87-4284-8116-2479ded66416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.538979 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.538816 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/d6cb1372-4b09-4426-b24a-031792f726fc-workload-certs\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.538979 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.538825 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-t6sc5\" (UniqueName: \"kubernetes.io/projected/d6cb1372-4b09-4426-b24a-031792f726fc-kube-api-access-t6sc5\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.539229 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.538985 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/949e4acd-1c87-4284-8116-2479ded66416-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mrrp5\" (UID: \"949e4acd-1c87-4284-8116-2479ded66416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.539229 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.539054 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6cb1372-4b09-4426-b24a-031792f726fc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.539229 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.539140 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6cb1372-4b09-4426-b24a-031792f726fc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.539229 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.539171 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6cb1372-4b09-4426-b24a-031792f726fc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.539438 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.539326 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/d6cb1372-4b09-4426-b24a-031792f726fc-istio-data\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.539438 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.539429 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/949e4acd-1c87-4284-8116-2479ded66416-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mrrp5\" (UID: \"949e4acd-1c87-4284-8116-2479ded66416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.539684 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.539655 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6cb1372-4b09-4426-b24a-031792f726fc-credential-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.539839 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.539699 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/d6cb1372-4b09-4426-b24a-031792f726fc-workload-socket\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.539956 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.539936 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/d6cb1372-4b09-4426-b24a-031792f726fc-istiod-ca-cert\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.542169 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.541873 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/d6cb1372-4b09-4426-b24a-031792f726fc-istio-envoy\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.542320 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.542268 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/d6cb1372-4b09-4426-b24a-031792f726fc-istio-podinfo\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.546892 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.546865 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/d6cb1372-4b09-4426-b24a-031792f726fc-istio-token\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.547011 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.546994 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-t6sc5\" (UniqueName: \"kubernetes.io/projected/d6cb1372-4b09-4426-b24a-031792f726fc-kube-api-access-t6sc5\") pod \"data-science-gateway-data-science-gateway-class-6576859cf4nb52m\" (UID: \"d6cb1372-4b09-4426-b24a-031792f726fc\") " pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.630368 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.630287 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:53.640981 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.640944 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/949e4acd-1c87-4284-8116-2479ded66416-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mrrp5\" (UID: \"949e4acd-1c87-4284-8116-2479ded66416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.641113 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.640999 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/949e4acd-1c87-4284-8116-2479ded66416-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mrrp5\" (UID: \"949e4acd-1c87-4284-8116-2479ded66416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.641113 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.641050 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/949e4acd-1c87-4284-8116-2479ded66416-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mrrp5\" (UID: \"949e4acd-1c87-4284-8116-2479ded66416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.641113 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.641079 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/949e4acd-1c87-4284-8116-2479ded66416-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mrrp5\" (UID: \"949e4acd-1c87-4284-8116-2479ded66416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.641270 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.641125 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/949e4acd-1c87-4284-8116-2479ded66416-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mrrp5\" (UID: \"949e4acd-1c87-4284-8116-2479ded66416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.641270 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.641170 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-ssw9d\" (UniqueName: \"kubernetes.io/projected/949e4acd-1c87-4284-8116-2479ded66416-kube-api-access-ssw9d\") pod \"istiod-openshift-gateway-94bb8fbfd-mrrp5\" (UID: \"949e4acd-1c87-4284-8116-2479ded66416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.641270 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.641206 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/949e4acd-1c87-4284-8116-2479ded66416-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mrrp5\" (UID: \"949e4acd-1c87-4284-8116-2479ded66416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.641974 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.641948 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-ca-configmap\" (UniqueName: \"kubernetes.io/configmap/949e4acd-1c87-4284-8116-2479ded66416-istio-csr-ca-configmap\") pod \"istiod-openshift-gateway-94bb8fbfd-mrrp5\" (UID: \"949e4acd-1c87-4284-8116-2479ded66416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.644025 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.643994 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-csr-dns-cert\" (UniqueName: \"kubernetes.io/secret/949e4acd-1c87-4284-8116-2479ded66416-istio-csr-dns-cert\") pod \"istiod-openshift-gateway-94bb8fbfd-mrrp5\" (UID: \"949e4acd-1c87-4284-8116-2479ded66416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.644123 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.643994 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"local-certs\" (UniqueName: \"kubernetes.io/empty-dir/949e4acd-1c87-4284-8116-2479ded66416-local-certs\") pod \"istiod-openshift-gateway-94bb8fbfd-mrrp5\" (UID: \"949e4acd-1c87-4284-8116-2479ded66416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.644123 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.644042 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-kubeconfig\" (UniqueName: \"kubernetes.io/secret/949e4acd-1c87-4284-8116-2479ded66416-istio-kubeconfig\") pod \"istiod-openshift-gateway-94bb8fbfd-mrrp5\" (UID: \"949e4acd-1c87-4284-8116-2479ded66416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.644123 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.644044 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cacerts\" (UniqueName: \"kubernetes.io/secret/949e4acd-1c87-4284-8116-2479ded66416-cacerts\") pod \"istiod-openshift-gateway-94bb8fbfd-mrrp5\" (UID: \"949e4acd-1c87-4284-8116-2479ded66416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.650149 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.650126 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/949e4acd-1c87-4284-8116-2479ded66416-istio-token\") pod \"istiod-openshift-gateway-94bb8fbfd-mrrp5\" (UID: \"949e4acd-1c87-4284-8116-2479ded66416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.650332 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.650315 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-ssw9d\" (UniqueName: \"kubernetes.io/projected/949e4acd-1c87-4284-8116-2479ded66416-kube-api-access-ssw9d\") pod \"istiod-openshift-gateway-94bb8fbfd-mrrp5\" (UID: \"949e4acd-1c87-4284-8116-2479ded66416\") " pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.776641 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.776495 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m"] Jul 09 17:32:53.778786 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:32:53.778743 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd6cb1372_4b09_4426_b24a_031792f726fc.slice/crio-ef694ec51a1b97ed8301b0cc673fa9ee7239cc301349ee8c784a1a81a1bbce09 WatchSource:0}: Error finding container ef694ec51a1b97ed8301b0cc673fa9ee7239cc301349ee8c784a1a81a1bbce09: Status 404 returned error can't find the container with id ef694ec51a1b97ed8301b0cc673fa9ee7239cc301349ee8c784a1a81a1bbce09 Jul 09 17:32:53.800714 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.800688 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:53.943412 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:53.943374 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5"] Jul 09 17:32:53.945226 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:32:53.945186 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod949e4acd_1c87_4284_8116_2479ded66416.slice/crio-09af50e21c99b057bd943f1896b1b3f896e0b938316acdee9c3c3696003cfe8d WatchSource:0}: Error finding container 09af50e21c99b057bd943f1896b1b3f896e0b938316acdee9c3c3696003cfe8d: Status 404 returned error can't find the container with id 09af50e21c99b057bd943f1896b1b3f896e0b938316acdee9c3c3696003cfe8d Jul 09 17:32:54.093010 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:54.092975 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" event={"ID":"d6cb1372-4b09-4426-b24a-031792f726fc","Type":"ContainerStarted","Data":"ef694ec51a1b97ed8301b0cc673fa9ee7239cc301349ee8c784a1a81a1bbce09"} Jul 09 17:32:54.094005 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:54.093974 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" event={"ID":"949e4acd-1c87-4284-8116-2479ded66416","Type":"ContainerStarted","Data":"09af50e21c99b057bd943f1896b1b3f896e0b938316acdee9c3c3696003cfe8d"} Jul 09 17:32:56.193100 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:56.193068 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bz4ns"] Jul 09 17:32:56.196721 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:56.196699 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bz4ns" Jul 09 17:32:56.199273 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:56.199254 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-webhook-server-cert\"" Jul 09 17:32:56.199373 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:56.199317 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"opendatahub\"/\"kserve-controller-manager-dockercfg-rnfdx\"" Jul 09 17:32:56.207981 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:56.207957 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bz4ns"] Jul 09 17:32:56.271977 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:56.271939 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-8ntxh\" (UniqueName: \"kubernetes.io/projected/b5ec1f1e-cf6c-4654-8c5b-ea2c45234ae2-kube-api-access-8ntxh\") pod \"kserve-controller-manager-d6f4b65b8-bz4ns\" (UID: \"b5ec1f1e-cf6c-4654-8c5b-ea2c45234ae2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bz4ns" Jul 09 17:32:56.272141 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:56.271990 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5ec1f1e-cf6c-4654-8c5b-ea2c45234ae2-cert\") pod \"kserve-controller-manager-d6f4b65b8-bz4ns\" (UID: \"b5ec1f1e-cf6c-4654-8c5b-ea2c45234ae2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bz4ns" Jul 09 17:32:56.373562 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:56.373500 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-8ntxh\" (UniqueName: \"kubernetes.io/projected/b5ec1f1e-cf6c-4654-8c5b-ea2c45234ae2-kube-api-access-8ntxh\") pod \"kserve-controller-manager-d6f4b65b8-bz4ns\" (UID: \"b5ec1f1e-cf6c-4654-8c5b-ea2c45234ae2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bz4ns" Jul 09 17:32:56.373734 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:56.373600 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5ec1f1e-cf6c-4654-8c5b-ea2c45234ae2-cert\") pod \"kserve-controller-manager-d6f4b65b8-bz4ns\" (UID: \"b5ec1f1e-cf6c-4654-8c5b-ea2c45234ae2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bz4ns" Jul 09 17:32:56.373823 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:32:56.373736 2565 secret.go:189] Couldn't get secret opendatahub/kserve-webhook-server-cert: secret "kserve-webhook-server-cert" not found Jul 09 17:32:56.373823 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:32:56.373818 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/secret/b5ec1f1e-cf6c-4654-8c5b-ea2c45234ae2-cert podName:b5ec1f1e-cf6c-4654-8c5b-ea2c45234ae2 nodeName:}" failed. No retries permitted until 2026-07-09 17:32:56.873796311 +0000 UTC m=+289.930264791 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "cert" (UniqueName: "kubernetes.io/secret/b5ec1f1e-cf6c-4654-8c5b-ea2c45234ae2-cert") pod "kserve-controller-manager-d6f4b65b8-bz4ns" (UID: "b5ec1f1e-cf6c-4654-8c5b-ea2c45234ae2") : secret "kserve-webhook-server-cert" not found Jul 09 17:32:56.384898 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:56.384869 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-8ntxh\" (UniqueName: \"kubernetes.io/projected/b5ec1f1e-cf6c-4654-8c5b-ea2c45234ae2-kube-api-access-8ntxh\") pod \"kserve-controller-manager-d6f4b65b8-bz4ns\" (UID: \"b5ec1f1e-cf6c-4654-8c5b-ea2c45234ae2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bz4ns" Jul 09 17:32:56.876983 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:56.876951 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5ec1f1e-cf6c-4654-8c5b-ea2c45234ae2-cert\") pod \"kserve-controller-manager-d6f4b65b8-bz4ns\" (UID: \"b5ec1f1e-cf6c-4654-8c5b-ea2c45234ae2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bz4ns" Jul 09 17:32:56.879263 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:56.879242 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"cert\" (UniqueName: \"kubernetes.io/secret/b5ec1f1e-cf6c-4654-8c5b-ea2c45234ae2-cert\") pod \"kserve-controller-manager-d6f4b65b8-bz4ns\" (UID: \"b5ec1f1e-cf6c-4654-8c5b-ea2c45234ae2\") " pod="opendatahub/kserve-controller-manager-d6f4b65b8-bz4ns" Jul 09 17:32:57.111450 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:57.111417 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bz4ns" Jul 09 17:32:57.779832 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:57.779783 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:32:57.780202 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:57.779859 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:32:57.780202 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:57.779919 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:32:57.783750 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:57.783710 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:32:57.783909 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:57.783808 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:32:57.916221 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:57.916118 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["opendatahub/kserve-controller-manager-d6f4b65b8-bz4ns"] Jul 09 17:32:58.121341 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:58.120995 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" event={"ID":"949e4acd-1c87-4284-8116-2479ded66416","Type":"ContainerStarted","Data":"05a05e5b30ccd561c146654c788f31ff537ecd226ea0b45b22d691372902e393"} Jul 09 17:32:58.121341 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:58.121262 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:58.123710 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:58.123392 2565 patch_prober.go:28] interesting pod/istiod-openshift-gateway-94bb8fbfd-mrrp5 container/discovery namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 17:32:58.123710 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:58.123446 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" podUID="949e4acd-1c87-4284-8116-2479ded66416" containerName="discovery" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 17:32:58.124677 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:58.124649 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" event={"ID":"d6cb1372-4b09-4426-b24a-031792f726fc","Type":"ContainerStarted","Data":"ef487fc56ca56911f861b06a330a0097d0e0307fe3dab28cc6f6105236766f87"} Jul 09 17:32:58.127578 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:58.127548 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bz4ns" event={"ID":"b5ec1f1e-cf6c-4654-8c5b-ea2c45234ae2","Type":"ContainerStarted","Data":"e06d87e9430e308c8e6ea531b3a4a55c47263209b60e1688816b38495646c8be"} Jul 09 17:32:58.191214 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:58.190635 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" podStartSLOduration=1.191924002 podStartE2EDuration="5.190614902s" totalImagesPullingTime="3.9986909s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:32:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:32:58.189503201 +0000 UTC m=+291.245971726" watchObservedRunningTime="2026-07-09 17:32:58.190614902 +0000 UTC m=+291.247083403" Jul 09 17:32:58.191214 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:58.190803 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" podStartSLOduration=1.354714191 podStartE2EDuration="5.190793563s" totalImagesPullingTime="3.836079372s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:32:53 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:32:58.154946342 +0000 UTC m=+291.211414844" watchObservedRunningTime="2026-07-09 17:32:58.190793563 +0000 UTC m=+291.247262063" Jul 09 17:32:58.631259 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:58.631219 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:58.635896 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:58.635869 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:59.133472 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:59.133416 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:32:59.134110 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:59.134088 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/istiod-openshift-gateway-94bb8fbfd-mrrp5" Jul 09 17:32:59.134536 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:32:59.134518 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/data-science-gateway-data-science-gateway-class-6576859cf4nb52m" Jul 09 17:33:01.143922 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:01.143890 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bz4ns" event={"ID":"b5ec1f1e-cf6c-4654-8c5b-ea2c45234ae2","Type":"ContainerStarted","Data":"a1701f071bf5b7d7523042d1cb9ea7cd645266d2e9df71332b5efe3c6b40adf1"} Jul 09 17:33:01.160080 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:01.160034 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bz4ns" podStartSLOduration=2.588534012 podStartE2EDuration="5.16001851s" totalImagesPullingTime="2.571484498s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:32:56 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:33:01.158238345 +0000 UTC m=+294.214706866" watchObservedRunningTime="2026-07-09 17:33:01.16001851 +0000 UTC m=+294.216487040" Jul 09 17:33:02.149024 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:02.148995 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bz4ns" Jul 09 17:33:07.386944 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:07.386917 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 17:33:07.387368 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:07.387268 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 17:33:07.391085 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:07.391062 2565 kubelet.go:1648] "Image garbage collection succeeded" Jul 09 17:33:33.161437 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:33.161409 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="opendatahub/kserve-controller-manager-d6f4b65b8-bz4ns" Jul 09 17:33:46.634751 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:46.634722 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x4dvb"] Jul 09 17:33:46.636847 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:46.636828 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x4dvb" Jul 09 17:33:46.641177 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:46.641145 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 17:33:46.641592 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:46.641574 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 17:33:46.641817 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:46.641793 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-catalog-dockercfg-xbfmb\"" Jul 09 17:33:46.655775 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:46.655724 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x4dvb"] Jul 09 17:33:46.713131 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:46.713101 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bsjh6\" (UniqueName: \"kubernetes.io/projected/96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a-kube-api-access-bsjh6\") pod \"kuadrant-operator-catalog-x4dvb\" (UID: \"96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a\") " pod="kuadrant-system/kuadrant-operator-catalog-x4dvb" Jul 09 17:33:46.814049 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:46.814008 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bsjh6\" (UniqueName: \"kubernetes.io/projected/96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a-kube-api-access-bsjh6\") pod \"kuadrant-operator-catalog-x4dvb\" (UID: \"96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a\") " pod="kuadrant-system/kuadrant-operator-catalog-x4dvb" Jul 09 17:33:46.821532 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:46.821508 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bsjh6\" (UniqueName: \"kubernetes.io/projected/96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a-kube-api-access-bsjh6\") pod \"kuadrant-operator-catalog-x4dvb\" (UID: \"96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a\") " pod="kuadrant-system/kuadrant-operator-catalog-x4dvb" Jul 09 17:33:46.952537 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:46.952455 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x4dvb" Jul 09 17:33:46.954876 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:46.954518 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x4dvb"] Jul 09 17:33:47.077519 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:47.077497 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x4dvb"] Jul 09 17:33:47.080319 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:33:47.080293 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod96dc8d7d_88cf_4cdd_a08b_b5890f86fd0a.slice/crio-cc79ad90437aa2ab31e127c0ffd5556b821ea6441d4b024fa18d3b2ed35ae5c1 WatchSource:0}: Error finding container cc79ad90437aa2ab31e127c0ffd5556b821ea6441d4b024fa18d3b2ed35ae5c1: Status 404 returned error can't find the container with id cc79ad90437aa2ab31e127c0ffd5556b821ea6441d4b024fa18d3b2ed35ae5c1 Jul 09 17:33:47.082042 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:47.082026 2565 provider.go:93] Refreshing cache for provider: *credentialprovider.defaultDockerConfigProvider Jul 09 17:33:47.354620 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:47.354580 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x4dvb" event={"ID":"96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a","Type":"ContainerStarted","Data":"cc79ad90437aa2ab31e127c0ffd5556b821ea6441d4b024fa18d3b2ed35ae5c1"} Jul 09 17:33:49.366411 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:49.366377 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x4dvb" event={"ID":"96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a","Type":"ContainerStarted","Data":"6247848eecd344e22ab8cf007b99326d88d03b8dcb2f6772ee25795156d6a91b"} Jul 09 17:33:49.366863 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:49.366502 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-catalog-x4dvb" podUID="96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a" containerName="registry-server" containerID="cri-o://6247848eecd344e22ab8cf007b99326d88d03b8dcb2f6772ee25795156d6a91b" gracePeriod=2 Jul 09 17:33:49.382470 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:49.382405 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-catalog-x4dvb" podStartSLOduration=1.305130068 podStartE2EDuration="3.382389127s" totalImagesPullingTime="2.077259059s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:33:46 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:33:49.380386789 +0000 UTC m=+342.436855323" watchObservedRunningTime="2026-07-09 17:33:49.382389127 +0000 UTC m=+342.438857627" Jul 09 17:33:49.603259 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:49.603236 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x4dvb" Jul 09 17:33:49.739753 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:49.739672 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bsjh6\" (UniqueName: \"kubernetes.io/projected/96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a-kube-api-access-bsjh6\") pod \"96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a\" (UID: \"96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a\") " Jul 09 17:33:49.741939 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:49.741904 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a-kube-api-access-bsjh6" (OuterVolumeSpecName: "kube-api-access-bsjh6") pod "96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a" (UID: "96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a"). InnerVolumeSpecName "kube-api-access-bsjh6". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:33:49.840774 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:49.840717 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bsjh6\" (UniqueName: \"kubernetes.io/projected/96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a-kube-api-access-bsjh6\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:33:50.372214 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:50.372178 2565 generic.go:356] "Generic (PLEG): container finished" podID="96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a" containerID="6247848eecd344e22ab8cf007b99326d88d03b8dcb2f6772ee25795156d6a91b" exitCode=0 Jul 09 17:33:50.372631 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:50.372222 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-catalog-x4dvb" Jul 09 17:33:50.372631 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:50.372233 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x4dvb" event={"ID":"96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a","Type":"ContainerDied","Data":"6247848eecd344e22ab8cf007b99326d88d03b8dcb2f6772ee25795156d6a91b"} Jul 09 17:33:50.372631 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:50.372309 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-catalog-x4dvb" event={"ID":"96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a","Type":"ContainerDied","Data":"cc79ad90437aa2ab31e127c0ffd5556b821ea6441d4b024fa18d3b2ed35ae5c1"} Jul 09 17:33:50.372631 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:50.372330 2565 scope.go:117] "RemoveContainer" containerID="6247848eecd344e22ab8cf007b99326d88d03b8dcb2f6772ee25795156d6a91b" Jul 09 17:33:50.381300 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:50.381282 2565 scope.go:117] "RemoveContainer" containerID="6247848eecd344e22ab8cf007b99326d88d03b8dcb2f6772ee25795156d6a91b" Jul 09 17:33:50.381549 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:33:50.381528 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6247848eecd344e22ab8cf007b99326d88d03b8dcb2f6772ee25795156d6a91b\": container with ID starting with 6247848eecd344e22ab8cf007b99326d88d03b8dcb2f6772ee25795156d6a91b not found: ID does not exist" containerID="6247848eecd344e22ab8cf007b99326d88d03b8dcb2f6772ee25795156d6a91b" Jul 09 17:33:50.381611 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:50.381560 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6247848eecd344e22ab8cf007b99326d88d03b8dcb2f6772ee25795156d6a91b"} err="failed to get container status \"6247848eecd344e22ab8cf007b99326d88d03b8dcb2f6772ee25795156d6a91b\": rpc error: code = NotFound desc = could not find container \"6247848eecd344e22ab8cf007b99326d88d03b8dcb2f6772ee25795156d6a91b\": container with ID starting with 6247848eecd344e22ab8cf007b99326d88d03b8dcb2f6772ee25795156d6a91b not found: ID does not exist" Jul 09 17:33:50.391121 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:50.391098 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x4dvb"] Jul 09 17:33:50.394599 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:50.394578 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-catalog-x4dvb"] Jul 09 17:33:51.508167 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:33:51.508135 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a" path="/var/lib/kubelet/pods/96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a/volumes" Jul 09 17:34:19.459734 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:19.459700 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg"] Jul 09 17:34:19.460160 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:19.460092 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a" containerName="registry-server" Jul 09 17:34:19.460160 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:19.460108 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a" containerName="registry-server" Jul 09 17:34:19.460231 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:19.460182 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="96dc8d7d-88cf-4cdd-a08b-b5890f86fd0a" containerName="registry-server" Jul 09 17:34:19.467884 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:19.467865 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" Jul 09 17:34:19.470472 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:19.470443 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"openshift-service-ca.crt\"" Jul 09 17:34:19.470617 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:19.470489 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"kube-root-ca.crt\"" Jul 09 17:34:19.470617 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:19.470614 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-22x2w\"" Jul 09 17:34:19.477832 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:19.477796 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg"] Jul 09 17:34:19.502057 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:19.502024 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3233473-8614-49b1-8e58-f682f6dc1a5f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gn4zg\" (UID: \"d3233473-8614-49b1-8e58-f682f6dc1a5f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" Jul 09 17:34:19.502193 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:19.502072 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-l5tkf\" (UniqueName: \"kubernetes.io/projected/d3233473-8614-49b1-8e58-f682f6dc1a5f-kube-api-access-l5tkf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gn4zg\" (UID: \"d3233473-8614-49b1-8e58-f682f6dc1a5f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" Jul 09 17:34:19.603352 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:19.603319 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3233473-8614-49b1-8e58-f682f6dc1a5f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gn4zg\" (UID: \"d3233473-8614-49b1-8e58-f682f6dc1a5f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" Jul 09 17:34:19.603501 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:19.603358 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-l5tkf\" (UniqueName: \"kubernetes.io/projected/d3233473-8614-49b1-8e58-f682f6dc1a5f-kube-api-access-l5tkf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gn4zg\" (UID: \"d3233473-8614-49b1-8e58-f682f6dc1a5f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" Jul 09 17:34:19.603687 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:19.603669 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3233473-8614-49b1-8e58-f682f6dc1a5f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gn4zg\" (UID: \"d3233473-8614-49b1-8e58-f682f6dc1a5f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" Jul 09 17:34:19.614940 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:19.614915 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-l5tkf\" (UniqueName: \"kubernetes.io/projected/d3233473-8614-49b1-8e58-f682f6dc1a5f-kube-api-access-l5tkf\") pod \"kuadrant-operator-controller-manager-8684c9ff49-gn4zg\" (UID: \"d3233473-8614-49b1-8e58-f682f6dc1a5f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" Jul 09 17:34:19.778478 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:19.778398 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" Jul 09 17:34:19.921125 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:19.921101 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg"] Jul 09 17:34:19.924173 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:34:19.924140 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podd3233473_8614_49b1_8e58_f682f6dc1a5f.slice/crio-39cd96c0428321e8dbb66d16401c6121b81f9e15a675b5e5e440235244d6055d WatchSource:0}: Error finding container 39cd96c0428321e8dbb66d16401c6121b81f9e15a675b5e5e440235244d6055d: Status 404 returned error can't find the container with id 39cd96c0428321e8dbb66d16401c6121b81f9e15a675b5e5e440235244d6055d Jul 09 17:34:20.516704 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:20.516670 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" event={"ID":"d3233473-8614-49b1-8e58-f682f6dc1a5f","Type":"ContainerStarted","Data":"39cd96c0428321e8dbb66d16401c6121b81f9e15a675b5e5e440235244d6055d"} Jul 09 17:34:23.225198 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:23.225166 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-t2k67"] Jul 09 17:34:23.228871 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:23.228844 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t2k67" Jul 09 17:34:23.231526 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:23.231505 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"authorino-operator-dockercfg-6c4cb\"" Jul 09 17:34:23.248024 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:23.247998 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-t2k67"] Jul 09 17:34:23.340794 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:23.340740 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xpjh2\" (UniqueName: \"kubernetes.io/projected/f644127f-5bfe-4d97-aad8-0a992e693ca3-kube-api-access-xpjh2\") pod \"authorino-operator-75cc8d5cb7-t2k67\" (UID: \"f644127f-5bfe-4d97-aad8-0a992e693ca3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-t2k67" Jul 09 17:34:23.441607 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:23.441572 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xpjh2\" (UniqueName: \"kubernetes.io/projected/f644127f-5bfe-4d97-aad8-0a992e693ca3-kube-api-access-xpjh2\") pod \"authorino-operator-75cc8d5cb7-t2k67\" (UID: \"f644127f-5bfe-4d97-aad8-0a992e693ca3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-t2k67" Jul 09 17:34:23.450360 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:23.450330 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xpjh2\" (UniqueName: \"kubernetes.io/projected/f644127f-5bfe-4d97-aad8-0a992e693ca3-kube-api-access-xpjh2\") pod \"authorino-operator-75cc8d5cb7-t2k67\" (UID: \"f644127f-5bfe-4d97-aad8-0a992e693ca3\") " pod="kuadrant-system/authorino-operator-75cc8d5cb7-t2k67" Jul 09 17:34:23.541509 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:23.541482 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t2k67" Jul 09 17:34:23.680661 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:23.680639 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/authorino-operator-75cc8d5cb7-t2k67"] Jul 09 17:34:23.683003 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:34:23.682980 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podf644127f_5bfe_4d97_aad8_0a992e693ca3.slice/crio-0960ab878d820ad77381b7640ce58264e81b8bf92c58cb12356df9f0bcb7a9c3 WatchSource:0}: Error finding container 0960ab878d820ad77381b7640ce58264e81b8bf92c58cb12356df9f0bcb7a9c3: Status 404 returned error can't find the container with id 0960ab878d820ad77381b7640ce58264e81b8bf92c58cb12356df9f0bcb7a9c3 Jul 09 17:34:24.537162 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:24.537125 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t2k67" event={"ID":"f644127f-5bfe-4d97-aad8-0a992e693ca3","Type":"ContainerStarted","Data":"0960ab878d820ad77381b7640ce58264e81b8bf92c58cb12356df9f0bcb7a9c3"} Jul 09 17:34:27.552122 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:27.552084 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" event={"ID":"d3233473-8614-49b1-8e58-f682f6dc1a5f","Type":"ContainerStarted","Data":"b43650cd35e7df0c16e4f5803f81652c5793ff4b5549bbf99da1816dc3733b3b"} Jul 09 17:34:27.552551 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:27.552154 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" Jul 09 17:34:27.553463 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:27.553441 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t2k67" event={"ID":"f644127f-5bfe-4d97-aad8-0a992e693ca3","Type":"ContainerStarted","Data":"b17cf8980ca0cd61aae1f3f9074b511a294cf449f1163ad337f350438bce96b6"} Jul 09 17:34:27.553606 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:27.553543 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t2k67" Jul 09 17:34:27.574420 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:27.574373 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" podStartSLOduration=1.612260926 podStartE2EDuration="8.574357999s" totalImagesPullingTime="6.962097073s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:34:19 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:34:27.572514115 +0000 UTC m=+380.628982611" watchObservedRunningTime="2026-07-09 17:34:27.574357999 +0000 UTC m=+380.630826498" Jul 09 17:34:27.590174 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:27.590124 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t2k67" podStartSLOduration=1.348282197 podStartE2EDuration="4.590109959s" totalImagesPullingTime="3.241827762s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:34:23 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:34:27.588239551 +0000 UTC m=+380.644708117" watchObservedRunningTime="2026-07-09 17:34:27.590109959 +0000 UTC m=+380.646578459" Jul 09 17:34:38.560815 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:38.560787 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/authorino-operator-75cc8d5cb7-t2k67" Jul 09 17:34:38.561274 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:38.560855 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" Jul 09 17:34:40.229709 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.229676 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nx4dx"] Jul 09 17:34:40.233251 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.233226 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nx4dx" Jul 09 17:34:40.245124 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.245098 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nx4dx"] Jul 09 17:34:40.322640 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.322599 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e70be8f6-5e09-482e-a9e3-7d6aca92350f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nx4dx\" (UID: \"e70be8f6-5e09-482e-a9e3-7d6aca92350f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nx4dx" Jul 09 17:34:40.322862 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.322698 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-j2v2z\" (UniqueName: \"kubernetes.io/projected/e70be8f6-5e09-482e-a9e3-7d6aca92350f-kube-api-access-j2v2z\") pod \"kuadrant-operator-controller-manager-86878c769f-nx4dx\" (UID: \"e70be8f6-5e09-482e-a9e3-7d6aca92350f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nx4dx" Jul 09 17:34:40.337366 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.337330 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg"] Jul 09 17:34:40.337612 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.337571 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" podUID="d3233473-8614-49b1-8e58-f682f6dc1a5f" containerName="manager" containerID="cri-o://b43650cd35e7df0c16e4f5803f81652c5793ff4b5549bbf99da1816dc3733b3b" gracePeriod=2 Jul 09 17:34:40.348618 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.348589 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg"] Jul 09 17:34:40.349697 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:34:40.349656 2565 status_manager.go:1041] "Failed to update status for pod" err="failed to patch status \"{\\\"metadata\\\":{\\\"uid\\\":\\\"d3233473-8614-49b1-8e58-f682f6dc1a5f\\\"},\\\"status\\\":{\\\"$setElementOrder/conditions\\\":[{\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"type\\\":\\\"Initialized\\\"},{\\\"type\\\":\\\"Ready\\\"},{\\\"type\\\":\\\"ContainersReady\\\"},{\\\"type\\\":\\\"PodScheduled\\\"}],\\\"conditions\\\":[{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodReadyToStartContainers\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Initialized\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"Ready\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"ContainersReady\\\"},{\\\"observedGeneration\\\":2,\\\"type\\\":\\\"PodScheduled\\\"}],\\\"observedGeneration\\\":2}}\" for pod \"kuadrant-system\"/\"kuadrant-operator-controller-manager-8684c9ff49-gn4zg\": pods \"kuadrant-operator-controller-manager-8684c9ff49-gn4zg\" not found" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" Jul 09 17:34:40.357906 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.357883 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nx4dx"] Jul 09 17:34:40.358182 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:34:40.358164 2565 pod_workers.go:1324] "Error syncing pod, skipping" err="unmounted volumes=[extensions-socket-volume kube-api-access-j2v2z], unattached volumes=[], failed to process volumes=[]: context canceled" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nx4dx" podUID="e70be8f6-5e09-482e-a9e3-7d6aca92350f" Jul 09 17:34:40.360466 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.360443 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb"] Jul 09 17:34:40.360840 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.360826 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="d3233473-8614-49b1-8e58-f682f6dc1a5f" containerName="manager" Jul 09 17:34:40.360888 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.360842 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="d3233473-8614-49b1-8e58-f682f6dc1a5f" containerName="manager" Jul 09 17:34:40.360922 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.360897 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="d3233473-8614-49b1-8e58-f682f6dc1a5f" containerName="manager" Jul 09 17:34:40.363853 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.363838 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb" Jul 09 17:34:40.365882 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:34:40.365861 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gn4zg\" is forbidden: User \"system:node:ip-10-0-138-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-5.ec2.internal' and this object" podUID="d3233473-8614-49b1-8e58-f682f6dc1a5f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" Jul 09 17:34:40.370516 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.370492 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nx4dx"] Jul 09 17:34:40.378607 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.378584 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb"] Jul 09 17:34:40.382928 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.382897 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w"] Jul 09 17:34:40.386329 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.386312 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w" Jul 09 17:34:40.403675 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.403634 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w"] Jul 09 17:34:40.405609 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:34:40.405559 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gn4zg\" is forbidden: User \"system:node:ip-10-0-138-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-5.ec2.internal' and this object" podUID="d3233473-8614-49b1-8e58-f682f6dc1a5f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" Jul 09 17:34:40.423109 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.423089 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e70be8f6-5e09-482e-a9e3-7d6aca92350f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nx4dx\" (UID: \"e70be8f6-5e09-482e-a9e3-7d6aca92350f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nx4dx" Jul 09 17:34:40.423211 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.423153 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-j2v2z\" (UniqueName: \"kubernetes.io/projected/e70be8f6-5e09-482e-a9e3-7d6aca92350f-kube-api-access-j2v2z\") pod \"kuadrant-operator-controller-manager-86878c769f-nx4dx\" (UID: \"e70be8f6-5e09-482e-a9e3-7d6aca92350f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nx4dx" Jul 09 17:34:40.423395 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.423377 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e70be8f6-5e09-482e-a9e3-7d6aca92350f-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-nx4dx\" (UID: \"e70be8f6-5e09-482e-a9e3-7d6aca92350f\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nx4dx" Jul 09 17:34:40.427935 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:34:40.427919 2565 projected.go:196] Error preparing data for projected volume kube-api-access-j2v2z for pod kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nx4dx: failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-nx4dx" not found Jul 09 17:34:40.428013 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:34:40.427997 2565 nestedpendingoperations.go:348] Operation for "{volumeName:kubernetes.io/projected/e70be8f6-5e09-482e-a9e3-7d6aca92350f-kube-api-access-j2v2z podName:e70be8f6-5e09-482e-a9e3-7d6aca92350f nodeName:}" failed. No retries permitted until 2026-07-09 17:34:40.927982138 +0000 UTC m=+393.984450616 (durationBeforeRetry 500ms). Error: MountVolume.SetUp failed for volume "kube-api-access-j2v2z" (UniqueName: "kubernetes.io/projected/e70be8f6-5e09-482e-a9e3-7d6aca92350f-kube-api-access-j2v2z") pod "kuadrant-operator-controller-manager-86878c769f-nx4dx" (UID: "e70be8f6-5e09-482e-a9e3-7d6aca92350f") : failed to fetch token: pod "kuadrant-operator-controller-manager-86878c769f-nx4dx" not found Jul 09 17:34:40.524381 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.524349 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-gqvmj\" (UniqueName: \"kubernetes.io/projected/fabb067f-d89e-4e87-9633-92e9b39073ae-kube-api-access-gqvmj\") pod \"kuadrant-operator-controller-manager-86878c769f-jhg8w\" (UID: \"fabb067f-d89e-4e87-9633-92e9b39073ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w" Jul 09 17:34:40.524501 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.524394 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16ee5cb4-a3ab-4086-88e0-071e7d6ec342-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2nztb\" (UID: \"16ee5cb4-a3ab-4086-88e0-071e7d6ec342\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb" Jul 09 17:34:40.524501 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.524441 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fabb067f-d89e-4e87-9633-92e9b39073ae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jhg8w\" (UID: \"fabb067f-d89e-4e87-9633-92e9b39073ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w" Jul 09 17:34:40.524501 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.524480 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-7bjz4\" (UniqueName: \"kubernetes.io/projected/16ee5cb4-a3ab-4086-88e0-071e7d6ec342-kube-api-access-7bjz4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2nztb\" (UID: \"16ee5cb4-a3ab-4086-88e0-071e7d6ec342\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb" Jul 09 17:34:40.579074 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.579048 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" Jul 09 17:34:40.581290 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:34:40.581261 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gn4zg\" is forbidden: User \"system:node:ip-10-0-138-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-5.ec2.internal' and this object" podUID="d3233473-8614-49b1-8e58-f682f6dc1a5f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" Jul 09 17:34:40.612783 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.612738 2565 generic.go:356] "Generic (PLEG): container finished" podID="d3233473-8614-49b1-8e58-f682f6dc1a5f" containerID="b43650cd35e7df0c16e4f5803f81652c5793ff4b5549bbf99da1816dc3733b3b" exitCode=0 Jul 09 17:34:40.612903 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.612797 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" Jul 09 17:34:40.612943 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.612799 2565 scope.go:117] "RemoveContainer" containerID="b43650cd35e7df0c16e4f5803f81652c5793ff4b5549bbf99da1816dc3733b3b" Jul 09 17:34:40.612978 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.612965 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nx4dx" Jul 09 17:34:40.615005 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:34:40.614969 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gn4zg\" is forbidden: User \"system:node:ip-10-0-138-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-5.ec2.internal' and this object" podUID="d3233473-8614-49b1-8e58-f682f6dc1a5f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" Jul 09 17:34:40.616935 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:34:40.616911 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gn4zg\" is forbidden: User \"system:node:ip-10-0-138-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-5.ec2.internal' and this object" podUID="d3233473-8614-49b1-8e58-f682f6dc1a5f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" Jul 09 17:34:40.618750 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:34:40.618719 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-nx4dx\" is forbidden: User \"system:node:ip-10-0-138-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-5.ec2.internal' and this object" podUID="e70be8f6-5e09-482e-a9e3-7d6aca92350f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nx4dx" Jul 09 17:34:40.619803 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.619785 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nx4dx" Jul 09 17:34:40.621604 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.621585 2565 scope.go:117] "RemoveContainer" containerID="b43650cd35e7df0c16e4f5803f81652c5793ff4b5549bbf99da1816dc3733b3b" Jul 09 17:34:40.621684 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:34:40.621623 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gn4zg\" is forbidden: User \"system:node:ip-10-0-138-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-5.ec2.internal' and this object" podUID="d3233473-8614-49b1-8e58-f682f6dc1a5f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" Jul 09 17:34:40.621901 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:34:40.621874 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"b43650cd35e7df0c16e4f5803f81652c5793ff4b5549bbf99da1816dc3733b3b\": container with ID starting with b43650cd35e7df0c16e4f5803f81652c5793ff4b5549bbf99da1816dc3733b3b not found: ID does not exist" containerID="b43650cd35e7df0c16e4f5803f81652c5793ff4b5549bbf99da1816dc3733b3b" Jul 09 17:34:40.621964 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.621921 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"b43650cd35e7df0c16e4f5803f81652c5793ff4b5549bbf99da1816dc3733b3b"} err="failed to get container status \"b43650cd35e7df0c16e4f5803f81652c5793ff4b5549bbf99da1816dc3733b3b\": rpc error: code = NotFound desc = could not find container \"b43650cd35e7df0c16e4f5803f81652c5793ff4b5549bbf99da1816dc3733b3b\": container with ID starting with b43650cd35e7df0c16e4f5803f81652c5793ff4b5549bbf99da1816dc3733b3b not found: ID does not exist" Jul 09 17:34:40.623447 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:34:40.623421 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-nx4dx\" is forbidden: User \"system:node:ip-10-0-138-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-5.ec2.internal' and this object" podUID="e70be8f6-5e09-482e-a9e3-7d6aca92350f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nx4dx" Jul 09 17:34:40.625878 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.625858 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16ee5cb4-a3ab-4086-88e0-071e7d6ec342-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2nztb\" (UID: \"16ee5cb4-a3ab-4086-88e0-071e7d6ec342\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb" Jul 09 17:34:40.625960 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.625897 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fabb067f-d89e-4e87-9633-92e9b39073ae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jhg8w\" (UID: \"fabb067f-d89e-4e87-9633-92e9b39073ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w" Jul 09 17:34:40.626024 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.626012 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-7bjz4\" (UniqueName: \"kubernetes.io/projected/16ee5cb4-a3ab-4086-88e0-071e7d6ec342-kube-api-access-7bjz4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2nztb\" (UID: \"16ee5cb4-a3ab-4086-88e0-071e7d6ec342\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb" Jul 09 17:34:40.626163 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.626151 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-gqvmj\" (UniqueName: \"kubernetes.io/projected/fabb067f-d89e-4e87-9633-92e9b39073ae-kube-api-access-gqvmj\") pod \"kuadrant-operator-controller-manager-86878c769f-jhg8w\" (UID: \"fabb067f-d89e-4e87-9633-92e9b39073ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w" Jul 09 17:34:40.626230 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.626210 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16ee5cb4-a3ab-4086-88e0-071e7d6ec342-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2nztb\" (UID: \"16ee5cb4-a3ab-4086-88e0-071e7d6ec342\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb" Jul 09 17:34:40.626294 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.626276 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fabb067f-d89e-4e87-9633-92e9b39073ae-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-jhg8w\" (UID: \"fabb067f-d89e-4e87-9633-92e9b39073ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w" Jul 09 17:34:40.633963 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.633936 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-gqvmj\" (UniqueName: \"kubernetes.io/projected/fabb067f-d89e-4e87-9633-92e9b39073ae-kube-api-access-gqvmj\") pod \"kuadrant-operator-controller-manager-86878c769f-jhg8w\" (UID: \"fabb067f-d89e-4e87-9633-92e9b39073ae\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w" Jul 09 17:34:40.634687 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.634665 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-7bjz4\" (UniqueName: \"kubernetes.io/projected/16ee5cb4-a3ab-4086-88e0-071e7d6ec342-kube-api-access-7bjz4\") pod \"kuadrant-operator-controller-manager-8684c9ff49-2nztb\" (UID: \"16ee5cb4-a3ab-4086-88e0-071e7d6ec342\") " pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb" Jul 09 17:34:40.714861 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.714829 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb" Jul 09 17:34:40.722077 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.722062 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w" Jul 09 17:34:40.727036 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.727016 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e70be8f6-5e09-482e-a9e3-7d6aca92350f-extensions-socket-volume\") pod \"e70be8f6-5e09-482e-a9e3-7d6aca92350f\" (UID: \"e70be8f6-5e09-482e-a9e3-7d6aca92350f\") " Jul 09 17:34:40.727137 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.727053 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3233473-8614-49b1-8e58-f682f6dc1a5f-extensions-socket-volume\") pod \"d3233473-8614-49b1-8e58-f682f6dc1a5f\" (UID: \"d3233473-8614-49b1-8e58-f682f6dc1a5f\") " Jul 09 17:34:40.727137 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.727071 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-l5tkf\" (UniqueName: \"kubernetes.io/projected/d3233473-8614-49b1-8e58-f682f6dc1a5f-kube-api-access-l5tkf\") pod \"d3233473-8614-49b1-8e58-f682f6dc1a5f\" (UID: \"d3233473-8614-49b1-8e58-f682f6dc1a5f\") " Jul 09 17:34:40.727307 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.727289 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-j2v2z\" (UniqueName: \"kubernetes.io/projected/e70be8f6-5e09-482e-a9e3-7d6aca92350f-kube-api-access-j2v2z\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:34:40.727373 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.727310 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/e70be8f6-5e09-482e-a9e3-7d6aca92350f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "e70be8f6-5e09-482e-a9e3-7d6aca92350f" (UID: "e70be8f6-5e09-482e-a9e3-7d6aca92350f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:34:40.727627 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.727601 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/d3233473-8614-49b1-8e58-f682f6dc1a5f-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "d3233473-8614-49b1-8e58-f682f6dc1a5f" (UID: "d3233473-8614-49b1-8e58-f682f6dc1a5f"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:34:40.729144 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.729117 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/d3233473-8614-49b1-8e58-f682f6dc1a5f-kube-api-access-l5tkf" (OuterVolumeSpecName: "kube-api-access-l5tkf") pod "d3233473-8614-49b1-8e58-f682f6dc1a5f" (UID: "d3233473-8614-49b1-8e58-f682f6dc1a5f"). InnerVolumeSpecName "kube-api-access-l5tkf". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:34:40.828542 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.828511 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/e70be8f6-5e09-482e-a9e3-7d6aca92350f-extensions-socket-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:34:40.828654 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.828550 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/d3233473-8614-49b1-8e58-f682f6dc1a5f-extensions-socket-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:34:40.828654 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.828569 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-l5tkf\" (UniqueName: \"kubernetes.io/projected/d3233473-8614-49b1-8e58-f682f6dc1a5f-kube-api-access-l5tkf\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:34:40.856621 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.856594 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb"] Jul 09 17:34:40.860449 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:34:40.860422 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod16ee5cb4_a3ab_4086_88e0_071e7d6ec342.slice/crio-2a7fb3ed3195106902b2008578d63121021d8061a6362fb7256fe732e44b15ed WatchSource:0}: Error finding container 2a7fb3ed3195106902b2008578d63121021d8061a6362fb7256fe732e44b15ed: Status 404 returned error can't find the container with id 2a7fb3ed3195106902b2008578d63121021d8061a6362fb7256fe732e44b15ed Jul 09 17:34:40.882729 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:40.882708 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w"] Jul 09 17:34:40.891850 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:34:40.891829 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podfabb067f_d89e_4e87_9633_92e9b39073ae.slice/crio-d6b568f8850d5436074a7216854c7d7646cee4bcfa209ad3e116713232272b42 WatchSource:0}: Error finding container d6b568f8850d5436074a7216854c7d7646cee4bcfa209ad3e116713232272b42: Status 404 returned error can't find the container with id d6b568f8850d5436074a7216854c7d7646cee4bcfa209ad3e116713232272b42 Jul 09 17:34:40.924211 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:34:40.924178 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-8684c9ff49-gn4zg\" is forbidden: User \"system:node:ip-10-0-138-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-5.ec2.internal' and this object" podUID="d3233473-8614-49b1-8e58-f682f6dc1a5f" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-gn4zg" Jul 09 17:34:40.926055 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:34:40.926028 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-nx4dx\" is forbidden: User \"system:node:ip-10-0-138-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-5.ec2.internal' and this object" podUID="e70be8f6-5e09-482e-a9e3-7d6aca92350f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nx4dx" Jul 09 17:34:41.508870 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:41.508835 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="d3233473-8614-49b1-8e58-f682f6dc1a5f" path="/var/lib/kubelet/pods/d3233473-8614-49b1-8e58-f682f6dc1a5f/volumes" Jul 09 17:34:41.509238 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:41.509169 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="e70be8f6-5e09-482e-a9e3-7d6aca92350f" path="/var/lib/kubelet/pods/e70be8f6-5e09-482e-a9e3-7d6aca92350f/volumes" Jul 09 17:34:41.621815 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:41.621715 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb" event={"ID":"16ee5cb4-a3ab-4086-88e0-071e7d6ec342","Type":"ContainerStarted","Data":"48d786571853b4c0e1bc2fa9676f4168b3f6929bb5f9bde7b044b676126d37e5"} Jul 09 17:34:41.621986 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:41.621817 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb" event={"ID":"16ee5cb4-a3ab-4086-88e0-071e7d6ec342","Type":"ContainerStarted","Data":"2a7fb3ed3195106902b2008578d63121021d8061a6362fb7256fe732e44b15ed"} Jul 09 17:34:41.621986 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:41.621848 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb" Jul 09 17:34:41.623396 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:41.623373 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nx4dx" Jul 09 17:34:41.623396 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:41.623384 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w" event={"ID":"fabb067f-d89e-4e87-9633-92e9b39073ae","Type":"ContainerStarted","Data":"01af999ac30916bc170a19dc5d8a5bc706a36c6025bc78396fb4386a6c89e2e4"} Jul 09 17:34:41.623540 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:41.623425 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w" event={"ID":"fabb067f-d89e-4e87-9633-92e9b39073ae","Type":"ContainerStarted","Data":"d6b568f8850d5436074a7216854c7d7646cee4bcfa209ad3e116713232272b42"} Jul 09 17:34:41.623540 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:41.623461 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w" Jul 09 17:34:41.665416 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:41.665364 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb" podStartSLOduration=1.665346829 podStartE2EDuration="1.665346829s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:34:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:34:41.66252412 +0000 UTC m=+394.718992637" watchObservedRunningTime="2026-07-09 17:34:41.665346829 +0000 UTC m=+394.721815320" Jul 09 17:34:41.688502 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:41.688461 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w" podStartSLOduration=1.688447968 podStartE2EDuration="1.688447968s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:34:40 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:34:41.687826823 +0000 UTC m=+394.744295324" watchObservedRunningTime="2026-07-09 17:34:41.688447968 +0000 UTC m=+394.744916467" Jul 09 17:34:41.690161 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:34:41.690134 2565 status_manager.go:1018] "Failed to get status for pod" err="pods \"kuadrant-operator-controller-manager-86878c769f-nx4dx\" is forbidden: User \"system:node:ip-10-0-138-5.ec2.internal\" cannot get resource \"pods\" in API group \"\" in the namespace \"kuadrant-system\": no relationship found between node 'ip-10-0-138-5.ec2.internal' and this object" podUID="e70be8f6-5e09-482e-a9e3-7d6aca92350f" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-nx4dx" Jul 09 17:34:52.630656 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:52.630626 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w" Jul 09 17:34:52.631046 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:52.630693 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb" Jul 09 17:34:52.699515 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:52.699481 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb"] Jul 09 17:34:52.699692 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:52.699661 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb" podUID="16ee5cb4-a3ab-4086-88e0-071e7d6ec342" containerName="manager" containerID="cri-o://48d786571853b4c0e1bc2fa9676f4168b3f6929bb5f9bde7b044b676126d37e5" gracePeriod=10 Jul 09 17:34:52.941147 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:52.941126 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb" Jul 09 17:34:53.030182 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:53.030153 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16ee5cb4-a3ab-4086-88e0-071e7d6ec342-extensions-socket-volume\") pod \"16ee5cb4-a3ab-4086-88e0-071e7d6ec342\" (UID: \"16ee5cb4-a3ab-4086-88e0-071e7d6ec342\") " Jul 09 17:34:53.030362 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:53.030204 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-7bjz4\" (UniqueName: \"kubernetes.io/projected/16ee5cb4-a3ab-4086-88e0-071e7d6ec342-kube-api-access-7bjz4\") pod \"16ee5cb4-a3ab-4086-88e0-071e7d6ec342\" (UID: \"16ee5cb4-a3ab-4086-88e0-071e7d6ec342\") " Jul 09 17:34:53.030538 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:53.030513 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/16ee5cb4-a3ab-4086-88e0-071e7d6ec342-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "16ee5cb4-a3ab-4086-88e0-071e7d6ec342" (UID: "16ee5cb4-a3ab-4086-88e0-071e7d6ec342"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:34:53.032314 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:53.032289 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/16ee5cb4-a3ab-4086-88e0-071e7d6ec342-kube-api-access-7bjz4" (OuterVolumeSpecName: "kube-api-access-7bjz4") pod "16ee5cb4-a3ab-4086-88e0-071e7d6ec342" (UID: "16ee5cb4-a3ab-4086-88e0-071e7d6ec342"). InnerVolumeSpecName "kube-api-access-7bjz4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:34:53.130994 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:53.130961 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/16ee5cb4-a3ab-4086-88e0-071e7d6ec342-extensions-socket-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:34:53.130994 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:53.130989 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-7bjz4\" (UniqueName: \"kubernetes.io/projected/16ee5cb4-a3ab-4086-88e0-071e7d6ec342-kube-api-access-7bjz4\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:34:53.679541 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:53.679507 2565 generic.go:356] "Generic (PLEG): container finished" podID="16ee5cb4-a3ab-4086-88e0-071e7d6ec342" containerID="48d786571853b4c0e1bc2fa9676f4168b3f6929bb5f9bde7b044b676126d37e5" exitCode=0 Jul 09 17:34:53.680021 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:53.679566 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb" Jul 09 17:34:53.680021 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:53.679590 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb" event={"ID":"16ee5cb4-a3ab-4086-88e0-071e7d6ec342","Type":"ContainerDied","Data":"48d786571853b4c0e1bc2fa9676f4168b3f6929bb5f9bde7b044b676126d37e5"} Jul 09 17:34:53.680021 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:53.679653 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb" event={"ID":"16ee5cb4-a3ab-4086-88e0-071e7d6ec342","Type":"ContainerDied","Data":"2a7fb3ed3195106902b2008578d63121021d8061a6362fb7256fe732e44b15ed"} Jul 09 17:34:53.680021 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:53.679687 2565 scope.go:117] "RemoveContainer" containerID="48d786571853b4c0e1bc2fa9676f4168b3f6929bb5f9bde7b044b676126d37e5" Jul 09 17:34:53.688309 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:53.688290 2565 scope.go:117] "RemoveContainer" containerID="48d786571853b4c0e1bc2fa9676f4168b3f6929bb5f9bde7b044b676126d37e5" Jul 09 17:34:53.688560 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:34:53.688544 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"48d786571853b4c0e1bc2fa9676f4168b3f6929bb5f9bde7b044b676126d37e5\": container with ID starting with 48d786571853b4c0e1bc2fa9676f4168b3f6929bb5f9bde7b044b676126d37e5 not found: ID does not exist" containerID="48d786571853b4c0e1bc2fa9676f4168b3f6929bb5f9bde7b044b676126d37e5" Jul 09 17:34:53.688626 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:53.688568 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"48d786571853b4c0e1bc2fa9676f4168b3f6929bb5f9bde7b044b676126d37e5"} err="failed to get container status \"48d786571853b4c0e1bc2fa9676f4168b3f6929bb5f9bde7b044b676126d37e5\": rpc error: code = NotFound desc = could not find container \"48d786571853b4c0e1bc2fa9676f4168b3f6929bb5f9bde7b044b676126d37e5\": container with ID starting with 48d786571853b4c0e1bc2fa9676f4168b3f6929bb5f9bde7b044b676126d37e5 not found: ID does not exist" Jul 09 17:34:53.707381 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:53.707355 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb"] Jul 09 17:34:53.715012 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:53.714991 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-8684c9ff49-2nztb"] Jul 09 17:34:55.507725 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:34:55.507687 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="16ee5cb4-a3ab-4086-88e0-071e7d6ec342" path="/var/lib/kubelet/pods/16ee5cb4-a3ab-4086-88e0-071e7d6ec342/volumes" Jul 09 17:35:09.120942 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.120911 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv"] Jul 09 17:35:09.121644 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.121568 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="16ee5cb4-a3ab-4086-88e0-071e7d6ec342" containerName="manager" Jul 09 17:35:09.121644 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.121621 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="16ee5cb4-a3ab-4086-88e0-071e7d6ec342" containerName="manager" Jul 09 17:35:09.121903 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.121770 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="16ee5cb4-a3ab-4086-88e0-071e7d6ec342" containerName="manager" Jul 09 17:35:09.125052 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.125032 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.128721 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.128702 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"maas-default-gateway-openshift-default-dockercfg-c7hjw\"" Jul 09 17:35:09.139668 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.139643 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv"] Jul 09 17:35:09.167994 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.167964 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a60c117-56e9-4418-9344-e0b401b99772-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.168167 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.168010 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a60c117-56e9-4418-9344-e0b401b99772-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.168167 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.168031 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a60c117-56e9-4418-9344-e0b401b99772-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.168167 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.168143 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a60c117-56e9-4418-9344-e0b401b99772-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.168333 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.168180 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a60c117-56e9-4418-9344-e0b401b99772-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.168333 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.168218 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a60c117-56e9-4418-9344-e0b401b99772-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.168333 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.168271 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-n55cm\" (UniqueName: \"kubernetes.io/projected/8a60c117-56e9-4418-9344-e0b401b99772-kube-api-access-n55cm\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.168333 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.168311 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a60c117-56e9-4418-9344-e0b401b99772-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.168496 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.168338 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a60c117-56e9-4418-9344-e0b401b99772-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.269030 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.268995 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a60c117-56e9-4418-9344-e0b401b99772-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.269213 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.269042 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a60c117-56e9-4418-9344-e0b401b99772-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.269213 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.269063 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a60c117-56e9-4418-9344-e0b401b99772-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.269213 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.269105 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a60c117-56e9-4418-9344-e0b401b99772-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.269213 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.269120 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a60c117-56e9-4418-9344-e0b401b99772-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.269213 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.269141 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a60c117-56e9-4418-9344-e0b401b99772-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.269213 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.269184 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-n55cm\" (UniqueName: \"kubernetes.io/projected/8a60c117-56e9-4418-9344-e0b401b99772-kube-api-access-n55cm\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.269213 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.269214 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a60c117-56e9-4418-9344-e0b401b99772-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.269587 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.269239 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a60c117-56e9-4418-9344-e0b401b99772-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.269587 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.269473 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/8a60c117-56e9-4418-9344-e0b401b99772-workload-certs\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.269654 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.269598 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a60c117-56e9-4418-9344-e0b401b99772-credential-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.269696 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.269670 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/8a60c117-56e9-4418-9344-e0b401b99772-istio-data\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.269984 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.269960 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/8a60c117-56e9-4418-9344-e0b401b99772-istiod-ca-cert\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.270092 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.270076 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/8a60c117-56e9-4418-9344-e0b401b99772-workload-socket\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.271490 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.271470 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/8a60c117-56e9-4418-9344-e0b401b99772-istio-envoy\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.271605 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.271589 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/8a60c117-56e9-4418-9344-e0b401b99772-istio-podinfo\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.278540 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.278517 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/8a60c117-56e9-4418-9344-e0b401b99772-istio-token\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.279525 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.279497 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-n55cm\" (UniqueName: \"kubernetes.io/projected/8a60c117-56e9-4418-9344-e0b401b99772-kube-api-access-n55cm\") pod \"maas-default-gateway-openshift-default-56654dcf7-r96gv\" (UID: \"8a60c117-56e9-4418-9344-e0b401b99772\") " pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.440446 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.440360 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:09.574323 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.574299 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv"] Jul 09 17:35:09.576800 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:35:09.576767 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod8a60c117_56e9_4418_9344_e0b401b99772.slice/crio-dfb69e2df4916a01c6f15b83e6bdb939c3db7b746ae7b1ef76dfcc77ebd1895b WatchSource:0}: Error finding container dfb69e2df4916a01c6f15b83e6bdb939c3db7b746ae7b1ef76dfcc77ebd1895b: Status 404 returned error can't find the container with id dfb69e2df4916a01c6f15b83e6bdb939c3db7b746ae7b1ef76dfcc77ebd1895b Jul 09 17:35:09.578880 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.578847 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:35:09.578974 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.578910 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:35:09.578974 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.578937 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:35:09.758577 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.758486 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" event={"ID":"8a60c117-56e9-4418-9344-e0b401b99772","Type":"ContainerStarted","Data":"75e47d28daeb4874b1b2edf39de1bcfe348489e3c062e55121dd752756b44427"} Jul 09 17:35:09.758577 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.758556 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" event={"ID":"8a60c117-56e9-4418-9344-e0b401b99772","Type":"ContainerStarted","Data":"dfb69e2df4916a01c6f15b83e6bdb939c3db7b746ae7b1ef76dfcc77ebd1895b"} Jul 09 17:35:09.778029 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:09.777979 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" podStartSLOduration=0.777964454 podStartE2EDuration="777.964454ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:35:09 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:35:09.775730868 +0000 UTC m=+422.832199389" watchObservedRunningTime="2026-07-09 17:35:09.777964454 +0000 UTC m=+422.834432954" Jul 09 17:35:10.441487 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:10.441450 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:10.446053 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:10.446031 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:10.763289 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:10.763202 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:10.764259 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:10.764238 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:35:11.222653 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:11.222624 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:35:11.225416 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:11.225384 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-8s9dt" Jul 09 17:35:11.227681 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:11.227661 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"default-dockercfg-8qdz7\"" Jul 09 17:35:11.227778 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:11.227667 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"kuadrant-system\"/\"limitador-limits-config-limitador\"" Jul 09 17:35:11.233292 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:11.233268 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:35:11.261520 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:11.261487 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:35:11.291330 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:11.291303 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-qx5fq\" (UniqueName: \"kubernetes.io/projected/b9f2ae2b-8c08-418e-9797-20cd9c91ba02-kube-api-access-qx5fq\") pod \"limitador-limitador-54d6d988d5-8s9dt\" (UID: \"b9f2ae2b-8c08-418e-9797-20cd9c91ba02\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8s9dt" Jul 09 17:35:11.291460 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:11.291353 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9f2ae2b-8c08-418e-9797-20cd9c91ba02-config-file\") pod \"limitador-limitador-54d6d988d5-8s9dt\" (UID: \"b9f2ae2b-8c08-418e-9797-20cd9c91ba02\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8s9dt" Jul 09 17:35:11.391812 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:11.391778 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-qx5fq\" (UniqueName: \"kubernetes.io/projected/b9f2ae2b-8c08-418e-9797-20cd9c91ba02-kube-api-access-qx5fq\") pod \"limitador-limitador-54d6d988d5-8s9dt\" (UID: \"b9f2ae2b-8c08-418e-9797-20cd9c91ba02\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8s9dt" Jul 09 17:35:11.391980 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:11.391831 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9f2ae2b-8c08-418e-9797-20cd9c91ba02-config-file\") pod \"limitador-limitador-54d6d988d5-8s9dt\" (UID: \"b9f2ae2b-8c08-418e-9797-20cd9c91ba02\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8s9dt" Jul 09 17:35:11.392397 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:11.392377 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"config-file\" (UniqueName: \"kubernetes.io/configmap/b9f2ae2b-8c08-418e-9797-20cd9c91ba02-config-file\") pod \"limitador-limitador-54d6d988d5-8s9dt\" (UID: \"b9f2ae2b-8c08-418e-9797-20cd9c91ba02\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8s9dt" Jul 09 17:35:11.399556 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:11.399524 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-qx5fq\" (UniqueName: \"kubernetes.io/projected/b9f2ae2b-8c08-418e-9797-20cd9c91ba02-kube-api-access-qx5fq\") pod \"limitador-limitador-54d6d988d5-8s9dt\" (UID: \"b9f2ae2b-8c08-418e-9797-20cd9c91ba02\") " pod="kuadrant-system/limitador-limitador-54d6d988d5-8s9dt" Jul 09 17:35:11.537277 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:11.537244 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/limitador-limitador-54d6d988d5-8s9dt" Jul 09 17:35:11.671674 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:11.671640 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:35:11.676135 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:35:11.676094 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podb9f2ae2b_8c08_418e_9797_20cd9c91ba02.slice/crio-da07d3f23daefc73b5cbd121532ef1fb4192048c96be60188f5442e417752023 WatchSource:0}: Error finding container da07d3f23daefc73b5cbd121532ef1fb4192048c96be60188f5442e417752023: Status 404 returned error can't find the container with id da07d3f23daefc73b5cbd121532ef1fb4192048c96be60188f5442e417752023 Jul 09 17:35:11.768213 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:11.768181 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-8s9dt" event={"ID":"b9f2ae2b-8c08-418e-9797-20cd9c91ba02","Type":"ContainerStarted","Data":"da07d3f23daefc73b5cbd121532ef1fb4192048c96be60188f5442e417752023"} Jul 09 17:35:14.785820 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:14.785779 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/limitador-limitador-54d6d988d5-8s9dt" event={"ID":"b9f2ae2b-8c08-418e-9797-20cd9c91ba02","Type":"ContainerStarted","Data":"4e71d298591460939fd56994ed44c48b0718d4d82f285009702998fdd7d7d808"} Jul 09 17:35:14.786207 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:14.785973 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-8s9dt" Jul 09 17:35:14.800386 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:14.800328 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/limitador-limitador-54d6d988d5-8s9dt" podStartSLOduration=1.223195353 podStartE2EDuration="3.800314102s" totalImagesPullingTime="2.577118749s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:35:11 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:35:14.799787604 +0000 UTC m=+427.856256108" watchObservedRunningTime="2026-07-09 17:35:14.800314102 +0000 UTC m=+427.856782603" Jul 09 17:35:25.791991 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:35:25.791966 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/limitador-limitador-54d6d988d5-8s9dt" Jul 09 17:36:22.481010 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:36:22.480977 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:36:30.139035 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:36:30.138999 2565 generic.go:356] "Generic (PLEG): container finished" podID="8a60c117-56e9-4418-9344-e0b401b99772" containerID="75e47d28daeb4874b1b2edf39de1bcfe348489e3c062e55121dd752756b44427" exitCode=0 Jul 09 17:36:30.139455 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:36:30.139073 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" event={"ID":"8a60c117-56e9-4418-9344-e0b401b99772","Type":"ContainerDied","Data":"75e47d28daeb4874b1b2edf39de1bcfe348489e3c062e55121dd752756b44427"} Jul 09 17:36:30.139455 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:36:30.139442 2565 scope.go:117] "RemoveContainer" containerID="75e47d28daeb4874b1b2edf39de1bcfe348489e3c062e55121dd752756b44427" Jul 09 17:36:30.140535 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:36:30.140508 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:36:30.140595 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:36:30.140574 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:36:30.140630 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:36:30.140619 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:36:31.146708 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:36:31.146671 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" event={"ID":"8a60c117-56e9-4418-9344-e0b401b99772","Type":"ContainerStarted","Data":"66cb1cd8d7b1fc6657fcaa6b0e755bca70e90600b5765a8e9d04f9677c2e24b9"} Jul 09 17:36:31.440953 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:36:31.440863 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:36:31.441260 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:36:31.441238 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-r96gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 09 17:36:31.441404 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:36:31.441376 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" podUID="8a60c117-56e9-4418-9344-e0b401b99772" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 09 17:36:32.441038 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:36:32.440995 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-r96gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 09 17:36:32.441535 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:36:32.441063 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" podUID="8a60c117-56e9-4418-9344-e0b401b99772" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 09 17:36:33.441421 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:36:33.441373 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-r96gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 09 17:36:33.441944 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:36:33.441456 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" podUID="8a60c117-56e9-4418-9344-e0b401b99772" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 09 17:36:34.441841 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:36:34.441797 2565 patch_prober.go:28] interesting pod/maas-default-gateway-openshift-default-56654dcf7-r96gv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" start-of-body= Jul 09 17:36:34.442363 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:36:34.441870 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" podUID="8a60c117-56e9-4418-9344-e0b401b99772" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.32:15021/healthz/ready\": dial tcp 10.134.0.32:15021: connect: connection refused" Jul 09 17:36:35.444856 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:36:35.444826 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:36:35.445291 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:36:35.445118 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:36:35.445709 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:36:35.445696 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/maas-default-gateway-openshift-default-56654dcf7-r96gv" Jul 09 17:36:39.174774 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:36:39.174724 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:36:58.072790 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:36:58.072742 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:37:01.273353 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.273265 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt"] Jul 09 17:37:01.275654 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.275625 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:01.279067 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.279043 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"default-dockercfg-c6gkt\"" Jul 09 17:37:01.279067 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.279043 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"openshift-service-ca.crt\"" Jul 09 17:37:01.279253 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.279050 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"llm\"/\"e2e-trlp-test-simulated-kserve-self-signed-certs\"" Jul 09 17:37:01.279253 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.279117 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"llm\"/\"kube-root-ca.crt\"" Jul 09 17:37:01.286947 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.286923 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt"] Jul 09 17:37:01.379372 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.379344 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebf9f88b-9611-412f-a931-1985caf223fb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f6tlt\" (UID: \"ebf9f88b-9611-412f-a931-1985caf223fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:01.379526 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.379379 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-4jqxr\" (UniqueName: \"kubernetes.io/projected/ebf9f88b-9611-412f-a931-1985caf223fb-kube-api-access-4jqxr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f6tlt\" (UID: \"ebf9f88b-9611-412f-a931-1985caf223fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:01.379526 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.379453 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebf9f88b-9611-412f-a931-1985caf223fb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f6tlt\" (UID: \"ebf9f88b-9611-412f-a931-1985caf223fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:01.379624 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.379563 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebf9f88b-9611-412f-a931-1985caf223fb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f6tlt\" (UID: \"ebf9f88b-9611-412f-a931-1985caf223fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:01.379624 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.379616 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebf9f88b-9611-412f-a931-1985caf223fb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f6tlt\" (UID: \"ebf9f88b-9611-412f-a931-1985caf223fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:01.379714 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.379653 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebf9f88b-9611-412f-a931-1985caf223fb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f6tlt\" (UID: \"ebf9f88b-9611-412f-a931-1985caf223fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:01.480824 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.480790 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebf9f88b-9611-412f-a931-1985caf223fb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f6tlt\" (UID: \"ebf9f88b-9611-412f-a931-1985caf223fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:01.480824 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.480824 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-4jqxr\" (UniqueName: \"kubernetes.io/projected/ebf9f88b-9611-412f-a931-1985caf223fb-kube-api-access-4jqxr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f6tlt\" (UID: \"ebf9f88b-9611-412f-a931-1985caf223fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:01.481038 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.480856 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebf9f88b-9611-412f-a931-1985caf223fb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f6tlt\" (UID: \"ebf9f88b-9611-412f-a931-1985caf223fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:01.481038 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.480926 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebf9f88b-9611-412f-a931-1985caf223fb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f6tlt\" (UID: \"ebf9f88b-9611-412f-a931-1985caf223fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:01.481038 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.480967 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebf9f88b-9611-412f-a931-1985caf223fb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f6tlt\" (UID: \"ebf9f88b-9611-412f-a931-1985caf223fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:01.481038 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.480999 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebf9f88b-9611-412f-a931-1985caf223fb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f6tlt\" (UID: \"ebf9f88b-9611-412f-a931-1985caf223fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:01.481246 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.481181 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"home\" (UniqueName: \"kubernetes.io/empty-dir/ebf9f88b-9611-412f-a931-1985caf223fb-home\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f6tlt\" (UID: \"ebf9f88b-9611-412f-a931-1985caf223fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:01.481337 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.481318 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"model-cache\" (UniqueName: \"kubernetes.io/empty-dir/ebf9f88b-9611-412f-a931-1985caf223fb-model-cache\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f6tlt\" (UID: \"ebf9f88b-9611-412f-a931-1985caf223fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:01.481397 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.481343 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tmp-dir\" (UniqueName: \"kubernetes.io/empty-dir/ebf9f88b-9611-412f-a931-1985caf223fb-tmp-dir\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f6tlt\" (UID: \"ebf9f88b-9611-412f-a931-1985caf223fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:01.483226 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.483209 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"dshm\" (UniqueName: \"kubernetes.io/empty-dir/ebf9f88b-9611-412f-a931-1985caf223fb-dshm\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f6tlt\" (UID: \"ebf9f88b-9611-412f-a931-1985caf223fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:01.483500 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.483482 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"tls-certs\" (UniqueName: \"kubernetes.io/secret/ebf9f88b-9611-412f-a931-1985caf223fb-tls-certs\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f6tlt\" (UID: \"ebf9f88b-9611-412f-a931-1985caf223fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:01.498732 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.498706 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-4jqxr\" (UniqueName: \"kubernetes.io/projected/ebf9f88b-9611-412f-a931-1985caf223fb-kube-api-access-4jqxr\") pod \"e2e-trlp-test-simulated-kserve-598466548d-f6tlt\" (UID: \"ebf9f88b-9611-412f-a931-1985caf223fb\") " pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:01.587047 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.587011 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:01.715751 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:01.715724 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt"] Jul 09 17:37:01.718149 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:37:01.718121 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podebf9f88b_9611_412f_a931_1985caf223fb.slice/crio-88a444c9e3fc370daf67d0b2d80a02d3c8645410794c45da05e5f20d34ad9eb8 WatchSource:0}: Error finding container 88a444c9e3fc370daf67d0b2d80a02d3c8645410794c45da05e5f20d34ad9eb8: Status 404 returned error can't find the container with id 88a444c9e3fc370daf67d0b2d80a02d3c8645410794c45da05e5f20d34ad9eb8 Jul 09 17:37:02.301330 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:02.301287 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" event={"ID":"ebf9f88b-9611-412f-a931-1985caf223fb","Type":"ContainerStarted","Data":"88a444c9e3fc370daf67d0b2d80a02d3c8645410794c45da05e5f20d34ad9eb8"} Jul 09 17:37:02.764963 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:02.764942 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:37:03.307948 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:03.307911 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" event={"ID":"ebf9f88b-9611-412f-a931-1985caf223fb","Type":"ContainerStarted","Data":"cb32396d0609f3464b5d77520d05d20f38652b7e129444d8aee09699ae6a82b9"} Jul 09 17:37:03.329974 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:03.329910 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" podStartSLOduration=1.337754989 podStartE2EDuration="2.329895356s" totalImagesPullingTime="992.140367ms" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:37:01 +0000 UTC" imagePullSessionsCount=1 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:37:03.327926433 +0000 UTC m=+536.384394933" watchObservedRunningTime="2026-07-09 17:37:03.329895356 +0000 UTC m=+536.386363855" Jul 09 17:37:09.265772 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:09.265713 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:37:11.587627 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:11.587590 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:11.588079 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:11.587652 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:11.600223 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:11.600201 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:12.362230 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:12.362204 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="llm/e2e-trlp-test-simulated-kserve-598466548d-f6tlt" Jul 09 17:37:15.469383 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:15.469350 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:37:32.174010 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:37:32.173978 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:38:07.420043 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:38:07.420013 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 17:38:07.421660 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:38:07.421641 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 17:39:27.674372 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:39:27.674334 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:39:39.263259 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:39:39.263223 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:39:48.373336 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:39:48.373306 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:39:58.672141 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:39:58.672106 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:40:08.473465 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:40:08.473426 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:40:35.976509 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:40:35.976476 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:40:49.068191 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:40:49.068156 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:41:23.366915 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:41:23.366878 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:41:32.673544 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:41:32.673510 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:41:42.564657 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:41:42.564622 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:41:52.565537 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:41:52.565496 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:42:01.774480 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:42:01.774438 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:42:13.172246 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:42:13.172212 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:42:23.977031 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:42:23.976998 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:42:33.772921 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:42:33.772889 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:42:55.175572 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:42:55.175537 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:43:06.574190 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:43:06.574111 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:43:07.451511 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:43:07.451483 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 17:43:07.452652 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:43:07.452628 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 17:43:30.376499 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:43:30.376468 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:43:40.572875 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:43:40.572843 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:43:57.072220 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:43:57.072186 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:44:06.177955 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:44:06.177920 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:44:17.371065 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:44:17.371034 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:44:26.873071 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:44:26.873036 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:44:36.373232 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:44:36.373152 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:45:01.456319 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:45:01.456283 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w"] Jul 09 17:45:01.456846 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:45:01.456464 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w" podUID="fabb067f-d89e-4e87-9633-92e9b39073ae" containerName="manager" containerID="cri-o://01af999ac30916bc170a19dc5d8a5bc706a36c6025bc78396fb4386a6c89e2e4" gracePeriod=10 Jul 09 17:45:05.215645 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:45:05.215621 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w" Jul 09 17:45:05.261798 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:45:05.261741 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-gqvmj\" (UniqueName: \"kubernetes.io/projected/fabb067f-d89e-4e87-9633-92e9b39073ae-kube-api-access-gqvmj\") pod \"fabb067f-d89e-4e87-9633-92e9b39073ae\" (UID: \"fabb067f-d89e-4e87-9633-92e9b39073ae\") " Jul 09 17:45:05.261974 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:45:05.261957 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fabb067f-d89e-4e87-9633-92e9b39073ae-extensions-socket-volume\") pod \"fabb067f-d89e-4e87-9633-92e9b39073ae\" (UID: \"fabb067f-d89e-4e87-9633-92e9b39073ae\") " Jul 09 17:45:05.262405 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:45:05.262371 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/fabb067f-d89e-4e87-9633-92e9b39073ae-extensions-socket-volume" (OuterVolumeSpecName: "extensions-socket-volume") pod "fabb067f-d89e-4e87-9633-92e9b39073ae" (UID: "fabb067f-d89e-4e87-9633-92e9b39073ae"). InnerVolumeSpecName "extensions-socket-volume". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:45:05.263913 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:45:05.263886 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/fabb067f-d89e-4e87-9633-92e9b39073ae-kube-api-access-gqvmj" (OuterVolumeSpecName: "kube-api-access-gqvmj") pod "fabb067f-d89e-4e87-9633-92e9b39073ae" (UID: "fabb067f-d89e-4e87-9633-92e9b39073ae"). InnerVolumeSpecName "kube-api-access-gqvmj". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:45:05.363296 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:45:05.363261 2565 reconciler_common.go:299] "Volume detached for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/fabb067f-d89e-4e87-9633-92e9b39073ae-extensions-socket-volume\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:45:05.363296 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:45:05.363291 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-gqvmj\" (UniqueName: \"kubernetes.io/projected/fabb067f-d89e-4e87-9633-92e9b39073ae-kube-api-access-gqvmj\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:45:05.572247 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:45:05.572220 2565 generic.go:356] "Generic (PLEG): container finished" podID="fabb067f-d89e-4e87-9633-92e9b39073ae" containerID="01af999ac30916bc170a19dc5d8a5bc706a36c6025bc78396fb4386a6c89e2e4" exitCode=0 Jul 09 17:45:05.572389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:45:05.572253 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w" event={"ID":"fabb067f-d89e-4e87-9633-92e9b39073ae","Type":"ContainerDied","Data":"01af999ac30916bc170a19dc5d8a5bc706a36c6025bc78396fb4386a6c89e2e4"} Jul 09 17:45:05.572389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:45:05.572266 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w" Jul 09 17:45:05.572389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:45:05.572289 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w" event={"ID":"fabb067f-d89e-4e87-9633-92e9b39073ae","Type":"ContainerDied","Data":"d6b568f8850d5436074a7216854c7d7646cee4bcfa209ad3e116713232272b42"} Jul 09 17:45:05.572389 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:45:05.572311 2565 scope.go:117] "RemoveContainer" containerID="01af999ac30916bc170a19dc5d8a5bc706a36c6025bc78396fb4386a6c89e2e4" Jul 09 17:45:05.582120 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:45:05.582103 2565 scope.go:117] "RemoveContainer" containerID="01af999ac30916bc170a19dc5d8a5bc706a36c6025bc78396fb4386a6c89e2e4" Jul 09 17:45:05.582376 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:45:05.582352 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"01af999ac30916bc170a19dc5d8a5bc706a36c6025bc78396fb4386a6c89e2e4\": container with ID starting with 01af999ac30916bc170a19dc5d8a5bc706a36c6025bc78396fb4386a6c89e2e4 not found: ID does not exist" containerID="01af999ac30916bc170a19dc5d8a5bc706a36c6025bc78396fb4386a6c89e2e4" Jul 09 17:45:05.582467 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:45:05.582381 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"01af999ac30916bc170a19dc5d8a5bc706a36c6025bc78396fb4386a6c89e2e4"} err="failed to get container status \"01af999ac30916bc170a19dc5d8a5bc706a36c6025bc78396fb4386a6c89e2e4\": rpc error: code = NotFound desc = could not find container \"01af999ac30916bc170a19dc5d8a5bc706a36c6025bc78396fb4386a6c89e2e4\": container with ID starting with 01af999ac30916bc170a19dc5d8a5bc706a36c6025bc78396fb4386a6c89e2e4 not found: ID does not exist" Jul 09 17:45:05.588856 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:45:05.588834 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w"] Jul 09 17:45:05.594251 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:45:05.594229 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-jhg8w"] Jul 09 17:45:07.507792 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:45:07.507750 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="fabb067f-d89e-4e87-9633-92e9b39073ae" path="/var/lib/kubelet/pods/fabb067f-d89e-4e87-9633-92e9b39073ae/volumes" Jul 09 17:46:02.670974 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:02.670900 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hsq8d"] Jul 09 17:46:02.671407 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:02.671249 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="fabb067f-d89e-4e87-9633-92e9b39073ae" containerName="manager" Jul 09 17:46:02.671407 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:02.671260 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="fabb067f-d89e-4e87-9633-92e9b39073ae" containerName="manager" Jul 09 17:46:02.671407 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:02.671336 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="fabb067f-d89e-4e87-9633-92e9b39073ae" containerName="manager" Jul 09 17:46:02.674366 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:02.674347 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hsq8d" Jul 09 17:46:02.676832 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:02.676812 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"kuadrant-system\"/\"kuadrant-operator-controller-manager-dockercfg-22x2w\"" Jul 09 17:46:02.687294 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:02.687270 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hsq8d"] Jul 09 17:46:02.763785 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:02.763742 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/466a5166-8738-478f-b949-1bdb6a3185d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hsq8d\" (UID: \"466a5166-8738-478f-b949-1bdb6a3185d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hsq8d" Jul 09 17:46:02.763896 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:02.763866 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xbxvf\" (UniqueName: \"kubernetes.io/projected/466a5166-8738-478f-b949-1bdb6a3185d7-kube-api-access-xbxvf\") pod \"kuadrant-operator-controller-manager-86878c769f-hsq8d\" (UID: \"466a5166-8738-478f-b949-1bdb6a3185d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hsq8d" Jul 09 17:46:02.864288 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:02.864264 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/466a5166-8738-478f-b949-1bdb6a3185d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hsq8d\" (UID: \"466a5166-8738-478f-b949-1bdb6a3185d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hsq8d" Jul 09 17:46:02.864405 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:02.864368 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xbxvf\" (UniqueName: \"kubernetes.io/projected/466a5166-8738-478f-b949-1bdb6a3185d7-kube-api-access-xbxvf\") pod \"kuadrant-operator-controller-manager-86878c769f-hsq8d\" (UID: \"466a5166-8738-478f-b949-1bdb6a3185d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hsq8d" Jul 09 17:46:02.864696 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:02.864678 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"extensions-socket-volume\" (UniqueName: \"kubernetes.io/empty-dir/466a5166-8738-478f-b949-1bdb6a3185d7-extensions-socket-volume\") pod \"kuadrant-operator-controller-manager-86878c769f-hsq8d\" (UID: \"466a5166-8738-478f-b949-1bdb6a3185d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hsq8d" Jul 09 17:46:02.875297 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:02.875272 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xbxvf\" (UniqueName: \"kubernetes.io/projected/466a5166-8738-478f-b949-1bdb6a3185d7-kube-api-access-xbxvf\") pod \"kuadrant-operator-controller-manager-86878c769f-hsq8d\" (UID: \"466a5166-8738-478f-b949-1bdb6a3185d7\") " pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hsq8d" Jul 09 17:46:02.984465 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:02.984399 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hsq8d" Jul 09 17:46:03.115845 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:03.115822 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hsq8d"] Jul 09 17:46:03.117812 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:46:03.117784 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod466a5166_8738_478f_b949_1bdb6a3185d7.slice/crio-078b07c2e11a293b62954dc6179952b5346fb4002596f2f77913bb37a9ca2e4e WatchSource:0}: Error finding container 078b07c2e11a293b62954dc6179952b5346fb4002596f2f77913bb37a9ca2e4e: Status 404 returned error can't find the container with id 078b07c2e11a293b62954dc6179952b5346fb4002596f2f77913bb37a9ca2e4e Jul 09 17:46:03.840592 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:03.840558 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hsq8d" event={"ID":"466a5166-8738-478f-b949-1bdb6a3185d7","Type":"ContainerStarted","Data":"ddeb93b8dd4644e51088771f4fa84e842b8e217db866c9c53fabe99bc79e4aec"} Jul 09 17:46:03.841002 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:03.840614 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hsq8d" event={"ID":"466a5166-8738-478f-b949-1bdb6a3185d7","Type":"ContainerStarted","Data":"078b07c2e11a293b62954dc6179952b5346fb4002596f2f77913bb37a9ca2e4e"} Jul 09 17:46:03.841002 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:03.840639 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hsq8d" Jul 09 17:46:03.859142 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:03.859085 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hsq8d" podStartSLOduration=1.859066269 podStartE2EDuration="1.859066269s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:46:02 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:46:03.857119383 +0000 UTC m=+1076.913588007" watchObservedRunningTime="2026-07-09 17:46:03.859066269 +0000 UTC m=+1076.915534770" Jul 09 17:46:14.846686 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:14.846655 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="kuadrant-system/kuadrant-operator-controller-manager-86878c769f-hsq8d" Jul 09 17:46:23.516094 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:23.516065 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:46:34.973205 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:34.973171 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:46:43.073309 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:43.073278 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:46:53.476340 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:46:53.476307 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:47:04.075615 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:47:04.075573 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:47:14.274122 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:47:14.274087 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:47:24.484065 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:47:24.484035 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:47:34.575304 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:47:34.575228 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:47:45.067515 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:47:45.067482 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:47:55.173557 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:47:55.173523 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:48:06.673421 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:48:06.673389 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:48:07.480349 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:48:07.480320 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 17:48:07.482319 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:48:07.482298 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 17:48:31.977037 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:48:31.977000 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:48:39.272257 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:48:39.272224 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:48:49.581138 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:48:49.581105 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:49:15.262832 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:49:15.262742 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:49:25.376134 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:49:25.376099 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:49:39.871673 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:49:39.871634 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:49:49.865582 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:49:49.865546 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:49:59.469495 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:49:59.469458 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:50:10.078490 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:50:10.078454 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:50:18.973564 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:50:18.973529 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:50:28.172019 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:50:28.171983 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:50:41.074977 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:50:41.074901 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:50:50.067484 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:50:50.067448 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:51:00.779218 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:51:00.779187 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:51:12.871115 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:51:12.871075 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:51:23.372990 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:51:23.372960 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:51:32.375070 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:51:32.375037 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:51:43.374401 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:51:43.374366 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:51:53.972929 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:51:53.972890 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:52:02.580007 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:02.579924 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:52:08.773324 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:08.773287 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:52:22.471504 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:22.471461 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:52:31.471706 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:31.471674 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:52:41.273642 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.273608 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:52:41.565994 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.565961 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr"] Jul 09 17:52:41.570044 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.570024 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.572512 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.572486 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-49f4e1e1-openshift-default-dockercfg-82xzv\"" Jul 09 17:52:41.590161 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.590140 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr"] Jul 09 17:52:41.739555 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.739525 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-envoy\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.739715 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.739558 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-podinfo\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.739715 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.739578 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-workload-socket\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.739715 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.739672 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bda7926-e239-4f7e-bc41-7170cf0acca0-istiod-ca-cert\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.739715 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.739700 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-data\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.739943 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.739823 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-credential-socket\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.739943 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.739857 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-workload-certs\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.739943 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.739885 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-xmctq\" (UniqueName: \"kubernetes.io/projected/9bda7926-e239-4f7e-bc41-7170cf0acca0-kube-api-access-xmctq\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.739943 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.739903 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-token\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.840915 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.840837 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-credential-socket\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.840915 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.840876 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-workload-certs\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.840915 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.840911 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-xmctq\" (UniqueName: \"kubernetes.io/projected/9bda7926-e239-4f7e-bc41-7170cf0acca0-kube-api-access-xmctq\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.841170 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.840945 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-token\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.841170 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.840994 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-envoy\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.841170 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.841123 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-podinfo\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.841326 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.841171 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-workload-socket\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.841326 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.841218 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bda7926-e239-4f7e-bc41-7170cf0acca0-istiod-ca-cert\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.841326 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.841250 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-data\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.841326 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.841266 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-credential-socket\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.841326 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.841301 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-workload-certs\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.841530 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.841460 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-workload-socket\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.841627 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.841605 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-data\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.841919 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.841900 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bda7926-e239-4f7e-bc41-7170cf0acca0-istiod-ca-cert\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.843212 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.843193 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-envoy\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.843439 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.843421 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-podinfo\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.848420 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.848399 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-xmctq\" (UniqueName: \"kubernetes.io/projected/9bda7926-e239-4f7e-bc41-7170cf0acca0-kube-api-access-xmctq\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.848544 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.848427 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-token\") pod \"e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:41.880435 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:41.880414 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:42.012400 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:42.012362 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr"] Jul 09 17:52:42.015747 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:52:42.015720 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9bda7926_e239_4f7e_bc41_7170cf0acca0.slice/crio-fb12e9c94945f59f3c4db85c3b86bdb39a80fee7808c5289a06db5cffafb1f82 WatchSource:0}: Error finding container fb12e9c94945f59f3c4db85c3b86bdb39a80fee7808c5289a06db5cffafb1f82: Status 404 returned error can't find the container with id fb12e9c94945f59f3c4db85c3b86bdb39a80fee7808c5289a06db5cffafb1f82 Jul 09 17:52:42.018222 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:42.018150 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:52:42.018334 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:42.018260 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:52:42.018334 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:42.018298 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:52:42.723474 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:42.723440 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" event={"ID":"9bda7926-e239-4f7e-bc41-7170cf0acca0","Type":"ContainerStarted","Data":"6dd0e3b66f1ee21d53a2b93e6f64595fadbdbd9990f45ec23c2e15c4c1659f7e"} Jul 09 17:52:42.723887 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:42.723493 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" event={"ID":"9bda7926-e239-4f7e-bc41-7170cf0acca0","Type":"ContainerStarted","Data":"fb12e9c94945f59f3c4db85c3b86bdb39a80fee7808c5289a06db5cffafb1f82"} Jul 09 17:52:42.745593 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:42.745537 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" podStartSLOduration=1.745518781 podStartE2EDuration="1.745518781s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:52:41 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:52:42.744980252 +0000 UTC m=+1475.801448760" watchObservedRunningTime="2026-07-09 17:52:42.745518781 +0000 UTC m=+1475.801987259" Jul 09 17:52:42.880575 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:42.880541 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:43.886308 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:43.886281 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:44.738726 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:44.738695 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:44.739735 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:44.739712 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:51.034343 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:51.034299 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr"] Jul 09 17:52:51.034886 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:51.034513 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" podUID="9bda7926-e239-4f7e-bc41-7170cf0acca0" containerName="istio-proxy" containerID="cri-o://6dd0e3b66f1ee21d53a2b93e6f64595fadbdbd9990f45ec23c2e15c4c1659f7e" gracePeriod=30 Jul 09 17:52:54.580714 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.580693 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:54.673140 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.673067 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-workload-certs\") pod \"9bda7926-e239-4f7e-bc41-7170cf0acca0\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " Jul 09 17:52:54.673140 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.673116 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-workload-socket\") pod \"9bda7926-e239-4f7e-bc41-7170cf0acca0\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " Jul 09 17:52:54.673140 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.673141 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-credential-socket\") pod \"9bda7926-e239-4f7e-bc41-7170cf0acca0\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " Jul 09 17:52:54.673408 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.673181 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-data\") pod \"9bda7926-e239-4f7e-bc41-7170cf0acca0\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " Jul 09 17:52:54.673408 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.673212 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-podinfo\") pod \"9bda7926-e239-4f7e-bc41-7170cf0acca0\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " Jul 09 17:52:54.673408 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.673230 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-envoy\") pod \"9bda7926-e239-4f7e-bc41-7170cf0acca0\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " Jul 09 17:52:54.673408 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.673270 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bda7926-e239-4f7e-bc41-7170cf0acca0-istiod-ca-cert\") pod \"9bda7926-e239-4f7e-bc41-7170cf0acca0\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " Jul 09 17:52:54.673408 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.673302 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-token\") pod \"9bda7926-e239-4f7e-bc41-7170cf0acca0\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " Jul 09 17:52:54.673408 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.673331 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9bda7926-e239-4f7e-bc41-7170cf0acca0" (UID: "9bda7926-e239-4f7e-bc41-7170cf0acca0"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:52:54.673408 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.673352 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-xmctq\" (UniqueName: \"kubernetes.io/projected/9bda7926-e239-4f7e-bc41-7170cf0acca0-kube-api-access-xmctq\") pod \"9bda7926-e239-4f7e-bc41-7170cf0acca0\" (UID: \"9bda7926-e239-4f7e-bc41-7170cf0acca0\") " Jul 09 17:52:54.673408 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.673401 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9bda7926-e239-4f7e-bc41-7170cf0acca0" (UID: "9bda7926-e239-4f7e-bc41-7170cf0acca0"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:52:54.673842 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.673577 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9bda7926-e239-4f7e-bc41-7170cf0acca0" (UID: "9bda7926-e239-4f7e-bc41-7170cf0acca0"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:52:54.673842 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.673806 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-workload-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:52:54.673842 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.673829 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-workload-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:52:54.674004 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.673844 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-credential-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:52:54.674004 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.673889 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9bda7926-e239-4f7e-bc41-7170cf0acca0-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9bda7926-e239-4f7e-bc41-7170cf0acca0" (UID: "9bda7926-e239-4f7e-bc41-7170cf0acca0"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:52:54.674150 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.674080 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-data" (OuterVolumeSpecName: "istio-data") pod "9bda7926-e239-4f7e-bc41-7170cf0acca0" (UID: "9bda7926-e239-4f7e-bc41-7170cf0acca0"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:52:54.675675 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.675639 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9bda7926-e239-4f7e-bc41-7170cf0acca0" (UID: "9bda7926-e239-4f7e-bc41-7170cf0acca0"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 17:52:54.676009 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.675648 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9bda7926-e239-4f7e-bc41-7170cf0acca0" (UID: "9bda7926-e239-4f7e-bc41-7170cf0acca0"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:52:54.676009 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.675702 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bda7926-e239-4f7e-bc41-7170cf0acca0-kube-api-access-xmctq" (OuterVolumeSpecName: "kube-api-access-xmctq") pod "9bda7926-e239-4f7e-bc41-7170cf0acca0" (UID: "9bda7926-e239-4f7e-bc41-7170cf0acca0"). InnerVolumeSpecName "kube-api-access-xmctq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:52:54.676009 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.675723 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-token" (OuterVolumeSpecName: "istio-token") pod "9bda7926-e239-4f7e-bc41-7170cf0acca0" (UID: "9bda7926-e239-4f7e-bc41-7170cf0acca0"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:52:54.775142 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.775112 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-xmctq\" (UniqueName: \"kubernetes.io/projected/9bda7926-e239-4f7e-bc41-7170cf0acca0-kube-api-access-xmctq\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:52:54.775142 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.775140 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:52:54.775142 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.775150 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-podinfo\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:52:54.775345 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.775158 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-envoy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:52:54.775345 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.775166 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9bda7926-e239-4f7e-bc41-7170cf0acca0-istiod-ca-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:52:54.775345 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.775173 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9bda7926-e239-4f7e-bc41-7170cf0acca0-istio-token\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:52:54.789146 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.789116 2565 generic.go:356] "Generic (PLEG): container finished" podID="9bda7926-e239-4f7e-bc41-7170cf0acca0" containerID="6dd0e3b66f1ee21d53a2b93e6f64595fadbdbd9990f45ec23c2e15c4c1659f7e" exitCode=0 Jul 09 17:52:54.789263 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.789156 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" Jul 09 17:52:54.789263 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.789196 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" event={"ID":"9bda7926-e239-4f7e-bc41-7170cf0acca0","Type":"ContainerDied","Data":"6dd0e3b66f1ee21d53a2b93e6f64595fadbdbd9990f45ec23c2e15c4c1659f7e"} Jul 09 17:52:54.789263 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.789250 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr" event={"ID":"9bda7926-e239-4f7e-bc41-7170cf0acca0","Type":"ContainerDied","Data":"fb12e9c94945f59f3c4db85c3b86bdb39a80fee7808c5289a06db5cffafb1f82"} Jul 09 17:52:54.789374 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.789274 2565 scope.go:117] "RemoveContainer" containerID="6dd0e3b66f1ee21d53a2b93e6f64595fadbdbd9990f45ec23c2e15c4c1659f7e" Jul 09 17:52:54.798242 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.798229 2565 scope.go:117] "RemoveContainer" containerID="6dd0e3b66f1ee21d53a2b93e6f64595fadbdbd9990f45ec23c2e15c4c1659f7e" Jul 09 17:52:54.798472 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:52:54.798458 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"6dd0e3b66f1ee21d53a2b93e6f64595fadbdbd9990f45ec23c2e15c4c1659f7e\": container with ID starting with 6dd0e3b66f1ee21d53a2b93e6f64595fadbdbd9990f45ec23c2e15c4c1659f7e not found: ID does not exist" containerID="6dd0e3b66f1ee21d53a2b93e6f64595fadbdbd9990f45ec23c2e15c4c1659f7e" Jul 09 17:52:54.798510 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.798479 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"6dd0e3b66f1ee21d53a2b93e6f64595fadbdbd9990f45ec23c2e15c4c1659f7e"} err="failed to get container status \"6dd0e3b66f1ee21d53a2b93e6f64595fadbdbd9990f45ec23c2e15c4c1659f7e\": rpc error: code = NotFound desc = could not find container \"6dd0e3b66f1ee21d53a2b93e6f64595fadbdbd9990f45ec23c2e15c4c1659f7e\": container with ID starting with 6dd0e3b66f1ee21d53a2b93e6f64595fadbdbd9990f45ec23c2e15c4c1659f7e not found: ID does not exist" Jul 09 17:52:54.812415 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.812393 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr"] Jul 09 17:52:54.814125 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:54.814108 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-49f4e1e1-openshift-default-5787c85d6f-kn9pr"] Jul 09 17:52:55.508430 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:55.508400 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9bda7926-e239-4f7e-bc41-7170cf0acca0" path="/var/lib/kubelet/pods/9bda7926-e239-4f7e-bc41-7170cf0acca0/volumes" Jul 09 17:52:57.028288 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.028257 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk"] Jul 09 17:52:57.028955 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.028930 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9bda7926-e239-4f7e-bc41-7170cf0acca0" containerName="istio-proxy" Jul 09 17:52:57.028955 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.028956 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9bda7926-e239-4f7e-bc41-7170cf0acca0" containerName="istio-proxy" Jul 09 17:52:57.029167 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.029070 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9bda7926-e239-4f7e-bc41-7170cf0acca0" containerName="istio-proxy" Jul 09 17:52:57.031987 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.031969 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.034400 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.034378 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-ait-7e0dcb49-openshift-default-dockercfg-5w7lt\"" Jul 09 17:52:57.045246 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.045222 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk"] Jul 09 17:52:57.097968 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.097943 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-credential-socket\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.098103 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.097971 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/469b8f5a-4347-407a-b87f-6072007c5595-istiod-ca-cert\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.098103 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.097993 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/469b8f5a-4347-407a-b87f-6072007c5595-istio-podinfo\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.098103 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.098051 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/469b8f5a-4347-407a-b87f-6072007c5595-istio-token\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.098221 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.098148 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-workload-certs\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.098221 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.098188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-istio-data\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.098221 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.098217 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-kdvf2\" (UniqueName: \"kubernetes.io/projected/469b8f5a-4347-407a-b87f-6072007c5595-kube-api-access-kdvf2\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.098314 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.098240 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-istio-envoy\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.098314 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.098275 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-workload-socket\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.199155 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.199120 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-workload-socket\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.199322 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.199165 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-credential-socket\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.199322 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.199181 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/469b8f5a-4347-407a-b87f-6072007c5595-istiod-ca-cert\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.199322 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.199296 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/469b8f5a-4347-407a-b87f-6072007c5595-istio-podinfo\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.199475 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.199351 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/469b8f5a-4347-407a-b87f-6072007c5595-istio-token\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.199475 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.199429 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-workload-certs\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.199575 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.199480 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-istio-data\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.199575 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.199524 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-kdvf2\" (UniqueName: \"kubernetes.io/projected/469b8f5a-4347-407a-b87f-6072007c5595-kube-api-access-kdvf2\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.199575 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.199530 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-workload-socket\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.199575 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.199562 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-istio-envoy\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.199821 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.199799 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-workload-certs\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.199888 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.199815 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-istio-data\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.199930 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.199902 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/469b8f5a-4347-407a-b87f-6072007c5595-istiod-ca-cert\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.199974 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.199951 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-credential-socket\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.201659 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.201639 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-istio-envoy\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.201887 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.201869 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/469b8f5a-4347-407a-b87f-6072007c5595-istio-podinfo\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.207314 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.207293 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/469b8f5a-4347-407a-b87f-6072007c5595-istio-token\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.207497 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.207478 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-kdvf2\" (UniqueName: \"kubernetes.io/projected/469b8f5a-4347-407a-b87f-6072007c5595-kube-api-access-kdvf2\") pod \"e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.344546 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.344519 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:57.507981 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:52:57.507954 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod469b8f5a_4347_407a_b87f_6072007c5595.slice/crio-e249b9f402dcd0d94a95b7b7f14c0fe3b2b09dd51fb9677fca541731d2b7e621 WatchSource:0}: Error finding container e249b9f402dcd0d94a95b7b7f14c0fe3b2b09dd51fb9677fca541731d2b7e621: Status 404 returned error can't find the container with id e249b9f402dcd0d94a95b7b7f14c0fe3b2b09dd51fb9677fca541731d2b7e621 Jul 09 17:52:57.509968 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.509950 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk"] Jul 09 17:52:57.510391 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.510363 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:52:57.510448 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.510423 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:52:57.510488 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.510451 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:52:57.811400 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.811367 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" event={"ID":"469b8f5a-4347-407a-b87f-6072007c5595","Type":"ContainerStarted","Data":"611cca8da1927751c3efbce9a8a52e40d8fd17ad27856de80858b1d0775cf328"} Jul 09 17:52:57.811545 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.811425 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" event={"ID":"469b8f5a-4347-407a-b87f-6072007c5595","Type":"ContainerStarted","Data":"e249b9f402dcd0d94a95b7b7f14c0fe3b2b09dd51fb9677fca541731d2b7e621"} Jul 09 17:52:57.829777 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:57.829708 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" podStartSLOduration=0.829680103 podStartE2EDuration="829.680103ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:52:57 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:52:57.829584 +0000 UTC m=+1490.886052501" watchObservedRunningTime="2026-07-09 17:52:57.829680103 +0000 UTC m=+1490.886148606" Jul 09 17:52:58.344692 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:58.344661 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:58.349575 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:58.349551 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:58.816581 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:58.816555 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:52:58.817412 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:52:58.817389 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:53:00.979028 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:00.978997 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:53:07.293309 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:07.293272 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk"] Jul 09 17:53:07.293778 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:07.293491 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" podUID="469b8f5a-4347-407a-b87f-6072007c5595" containerName="istio-proxy" containerID="cri-o://611cca8da1927751c3efbce9a8a52e40d8fd17ad27856de80858b1d0775cf328" gracePeriod=30 Jul 09 17:53:07.513607 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:07.513578 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 17:53:07.516489 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:07.516468 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 17:53:08.878507 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:08.878471 2565 generic.go:356] "Generic (PLEG): container finished" podID="469b8f5a-4347-407a-b87f-6072007c5595" containerID="611cca8da1927751c3efbce9a8a52e40d8fd17ad27856de80858b1d0775cf328" exitCode=0 Jul 09 17:53:08.878997 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:08.878572 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" event={"ID":"469b8f5a-4347-407a-b87f-6072007c5595","Type":"ContainerDied","Data":"611cca8da1927751c3efbce9a8a52e40d8fd17ad27856de80858b1d0775cf328"} Jul 09 17:53:08.947270 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:08.947246 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:53:09.009892 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.009819 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/469b8f5a-4347-407a-b87f-6072007c5595-istiod-ca-cert\") pod \"469b8f5a-4347-407a-b87f-6072007c5595\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " Jul 09 17:53:09.009892 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.009866 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-istio-envoy\") pod \"469b8f5a-4347-407a-b87f-6072007c5595\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " Jul 09 17:53:09.010088 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.009901 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/469b8f5a-4347-407a-b87f-6072007c5595-istio-token\") pod \"469b8f5a-4347-407a-b87f-6072007c5595\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " Jul 09 17:53:09.010088 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.009927 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-workload-socket\") pod \"469b8f5a-4347-407a-b87f-6072007c5595\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " Jul 09 17:53:09.010088 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.009991 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-kdvf2\" (UniqueName: \"kubernetes.io/projected/469b8f5a-4347-407a-b87f-6072007c5595-kube-api-access-kdvf2\") pod \"469b8f5a-4347-407a-b87f-6072007c5595\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " Jul 09 17:53:09.010246 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.010107 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-istio-data\") pod \"469b8f5a-4347-407a-b87f-6072007c5595\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " Jul 09 17:53:09.010246 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.010138 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/469b8f5a-4347-407a-b87f-6072007c5595-istio-podinfo\") pod \"469b8f5a-4347-407a-b87f-6072007c5595\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " Jul 09 17:53:09.010246 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.010172 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-workload-certs\") pod \"469b8f5a-4347-407a-b87f-6072007c5595\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " Jul 09 17:53:09.010246 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.010218 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-credential-socket\") pod \"469b8f5a-4347-407a-b87f-6072007c5595\" (UID: \"469b8f5a-4347-407a-b87f-6072007c5595\") " Jul 09 17:53:09.010246 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.010227 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/469b8f5a-4347-407a-b87f-6072007c5595-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "469b8f5a-4347-407a-b87f-6072007c5595" (UID: "469b8f5a-4347-407a-b87f-6072007c5595"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:53:09.010514 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.010467 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "469b8f5a-4347-407a-b87f-6072007c5595" (UID: "469b8f5a-4347-407a-b87f-6072007c5595"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:53:09.010579 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.010555 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-workload-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:53:09.010639 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.010582 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/469b8f5a-4347-407a-b87f-6072007c5595-istiod-ca-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:53:09.010777 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.010700 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "469b8f5a-4347-407a-b87f-6072007c5595" (UID: "469b8f5a-4347-407a-b87f-6072007c5595"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:53:09.010912 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.010793 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "469b8f5a-4347-407a-b87f-6072007c5595" (UID: "469b8f5a-4347-407a-b87f-6072007c5595"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:53:09.011021 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.010983 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-istio-data" (OuterVolumeSpecName: "istio-data") pod "469b8f5a-4347-407a-b87f-6072007c5595" (UID: "469b8f5a-4347-407a-b87f-6072007c5595"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:53:09.012573 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.012543 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/469b8f5a-4347-407a-b87f-6072007c5595-istio-token" (OuterVolumeSpecName: "istio-token") pod "469b8f5a-4347-407a-b87f-6072007c5595" (UID: "469b8f5a-4347-407a-b87f-6072007c5595"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:53:09.012694 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.012597 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "469b8f5a-4347-407a-b87f-6072007c5595" (UID: "469b8f5a-4347-407a-b87f-6072007c5595"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:53:09.012926 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.012896 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/469b8f5a-4347-407a-b87f-6072007c5595-kube-api-access-kdvf2" (OuterVolumeSpecName: "kube-api-access-kdvf2") pod "469b8f5a-4347-407a-b87f-6072007c5595" (UID: "469b8f5a-4347-407a-b87f-6072007c5595"). InnerVolumeSpecName "kube-api-access-kdvf2". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:53:09.013014 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.012931 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/469b8f5a-4347-407a-b87f-6072007c5595-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "469b8f5a-4347-407a-b87f-6072007c5595" (UID: "469b8f5a-4347-407a-b87f-6072007c5595"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 17:53:09.111592 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.111558 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-kdvf2\" (UniqueName: \"kubernetes.io/projected/469b8f5a-4347-407a-b87f-6072007c5595-kube-api-access-kdvf2\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:53:09.111592 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.111585 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-istio-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:53:09.111592 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.111595 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/469b8f5a-4347-407a-b87f-6072007c5595-istio-podinfo\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:53:09.111815 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.111604 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-workload-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:53:09.111815 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.111616 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-credential-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:53:09.111815 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.111627 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/469b8f5a-4347-407a-b87f-6072007c5595-istio-envoy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:53:09.111815 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.111635 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/469b8f5a-4347-407a-b87f-6072007c5595-istio-token\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:53:09.884427 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.884399 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" Jul 09 17:53:09.884427 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.884420 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk" event={"ID":"469b8f5a-4347-407a-b87f-6072007c5595","Type":"ContainerDied","Data":"e249b9f402dcd0d94a95b7b7f14c0fe3b2b09dd51fb9677fca541731d2b7e621"} Jul 09 17:53:09.884907 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.884478 2565 scope.go:117] "RemoveContainer" containerID="611cca8da1927751c3efbce9a8a52e40d8fd17ad27856de80858b1d0775cf328" Jul 09 17:53:09.900184 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.900161 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk"] Jul 09 17:53:09.904160 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:09.904139 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-ait-7e0dcb49-openshift-default-675bb5b7f-xgpbk"] Jul 09 17:53:11.507843 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:11.507809 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="469b8f5a-4347-407a-b87f-6072007c5595" path="/var/lib/kubelet/pods/469b8f5a-4347-407a-b87f-6072007c5595/volumes" Jul 09 17:53:13.239600 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.239570 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8"] Jul 09 17:53:13.240415 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.240145 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="469b8f5a-4347-407a-b87f-6072007c5595" containerName="istio-proxy" Jul 09 17:53:13.240415 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.240165 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="469b8f5a-4347-407a-b87f-6072007c5595" containerName="istio-proxy" Jul 09 17:53:13.240415 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.240246 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="469b8f5a-4347-407a-b87f-6072007c5595" containerName="istio-proxy" Jul 09 17:53:13.244844 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.244819 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.247522 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.247502 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-derive-1608c3e9-openshift-default-dockercfg-sds6x\"" Jul 09 17:53:13.258228 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.258204 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8"] Jul 09 17:53:13.348776 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.348726 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-credential-socket\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.348959 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.348822 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-dm8xt\" (UniqueName: \"kubernetes.io/projected/dd263b2a-e939-41f6-9482-963b7c292181-kube-api-access-dm8xt\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.348959 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.348852 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-workload-certs\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.348959 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.348942 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-workload-socket\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.349135 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.349035 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd263b2a-e939-41f6-9482-963b7c292181-istio-token\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.349135 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.349071 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd263b2a-e939-41f6-9482-963b7c292181-istio-podinfo\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.349135 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.349101 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-istio-data\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.349276 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.349141 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-istio-envoy\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.349276 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.349192 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd263b2a-e939-41f6-9482-963b7c292181-istiod-ca-cert\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.449864 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.449831 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-credential-socket\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.450053 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.449884 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-dm8xt\" (UniqueName: \"kubernetes.io/projected/dd263b2a-e939-41f6-9482-963b7c292181-kube-api-access-dm8xt\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.450053 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.449910 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-workload-certs\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.450053 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.449944 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-workload-socket\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.450053 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.449992 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd263b2a-e939-41f6-9482-963b7c292181-istio-token\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.450053 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.450020 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd263b2a-e939-41f6-9482-963b7c292181-istio-podinfo\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.450053 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.450045 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-istio-data\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.450370 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.450081 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-istio-envoy\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.450370 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.450114 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd263b2a-e939-41f6-9482-963b7c292181-istiod-ca-cert\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.450370 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.450298 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-credential-socket\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.450535 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.450409 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-workload-certs\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.450773 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.450733 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-workload-socket\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.450953 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.450859 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-istio-data\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.451160 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.451136 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd263b2a-e939-41f6-9482-963b7c292181-istiod-ca-cert\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.452642 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.452620 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-istio-envoy\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.452859 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.452844 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd263b2a-e939-41f6-9482-963b7c292181-istio-podinfo\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.457544 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.457510 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd263b2a-e939-41f6-9482-963b7c292181-istio-token\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.457697 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.457677 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-dm8xt\" (UniqueName: \"kubernetes.io/projected/dd263b2a-e939-41f6-9482-963b7c292181-kube-api-access-dm8xt\") pod \"e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.555696 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.555664 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:13.689111 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.689087 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8"] Jul 09 17:53:13.690811 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:53:13.690784 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-poddd263b2a_e939_41f6_9482_963b7c292181.slice/crio-3bdbd3e6bd098ca61d638ae8325a44ecb4b3d50366399fb6e316e4d17c47d73b WatchSource:0}: Error finding container 3bdbd3e6bd098ca61d638ae8325a44ecb4b3d50366399fb6e316e4d17c47d73b: Status 404 returned error can't find the container with id 3bdbd3e6bd098ca61d638ae8325a44ecb4b3d50366399fb6e316e4d17c47d73b Jul 09 17:53:13.693364 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.693334 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:53:13.693424 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.693395 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:53:13.693471 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.693426 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:53:13.905859 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.905748 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" event={"ID":"dd263b2a-e939-41f6-9482-963b7c292181","Type":"ContainerStarted","Data":"5f7eaac955b16def0bc853d1ee270ab943f95ecc1404ac9c1a7d86b344bb2ace"} Jul 09 17:53:13.905859 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.905828 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" event={"ID":"dd263b2a-e939-41f6-9482-963b7c292181","Type":"ContainerStarted","Data":"3bdbd3e6bd098ca61d638ae8325a44ecb4b3d50366399fb6e316e4d17c47d73b"} Jul 09 17:53:13.926035 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:13.925977 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" podStartSLOduration=0.925956882 podStartE2EDuration="925.956882ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:53:13 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:53:13.923287213 +0000 UTC m=+1506.979755738" watchObservedRunningTime="2026-07-09 17:53:13.925956882 +0000 UTC m=+1506.982425383" Jul 09 17:53:14.556314 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:14.556284 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:14.561200 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:14.561176 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:14.911288 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:14.911197 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:14.912308 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:14.912291 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:16.384203 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:16.384170 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:53:22.000654 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:22.000619 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8"] Jul 09 17:53:22.001103 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:22.000810 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" podUID="dd263b2a-e939-41f6-9482-963b7c292181" containerName="istio-proxy" containerID="cri-o://5f7eaac955b16def0bc853d1ee270ab943f95ecc1404ac9c1a7d86b344bb2ace" gracePeriod=30 Jul 09 17:53:27.251395 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.251373 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:27.379182 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.379158 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd263b2a-e939-41f6-9482-963b7c292181-istiod-ca-cert\") pod \"dd263b2a-e939-41f6-9482-963b7c292181\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " Jul 09 17:53:27.379337 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.379189 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-workload-certs\") pod \"dd263b2a-e939-41f6-9482-963b7c292181\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " Jul 09 17:53:27.379337 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.379216 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd263b2a-e939-41f6-9482-963b7c292181-istio-podinfo\") pod \"dd263b2a-e939-41f6-9482-963b7c292181\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " Jul 09 17:53:27.379337 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.379238 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-istio-data\") pod \"dd263b2a-e939-41f6-9482-963b7c292181\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " Jul 09 17:53:27.379337 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.379259 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-workload-socket\") pod \"dd263b2a-e939-41f6-9482-963b7c292181\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " Jul 09 17:53:27.379337 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.379278 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd263b2a-e939-41f6-9482-963b7c292181-istio-token\") pod \"dd263b2a-e939-41f6-9482-963b7c292181\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " Jul 09 17:53:27.379337 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.379335 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-istio-envoy\") pod \"dd263b2a-e939-41f6-9482-963b7c292181\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " Jul 09 17:53:27.379639 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.379366 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-dm8xt\" (UniqueName: \"kubernetes.io/projected/dd263b2a-e939-41f6-9482-963b7c292181-kube-api-access-dm8xt\") pod \"dd263b2a-e939-41f6-9482-963b7c292181\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " Jul 09 17:53:27.379639 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.379393 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-credential-socket\") pod \"dd263b2a-e939-41f6-9482-963b7c292181\" (UID: \"dd263b2a-e939-41f6-9482-963b7c292181\") " Jul 09 17:53:27.379639 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.379496 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "dd263b2a-e939-41f6-9482-963b7c292181" (UID: "dd263b2a-e939-41f6-9482-963b7c292181"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:53:27.379639 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.379592 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-istio-data" (OuterVolumeSpecName: "istio-data") pod "dd263b2a-e939-41f6-9482-963b7c292181" (UID: "dd263b2a-e939-41f6-9482-963b7c292181"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:53:27.379639 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.379598 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "dd263b2a-e939-41f6-9482-963b7c292181" (UID: "dd263b2a-e939-41f6-9482-963b7c292181"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:53:27.379639 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.379630 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/dd263b2a-e939-41f6-9482-963b7c292181-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "dd263b2a-e939-41f6-9482-963b7c292181" (UID: "dd263b2a-e939-41f6-9482-963b7c292181"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:53:27.379986 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.379774 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "dd263b2a-e939-41f6-9482-963b7c292181" (UID: "dd263b2a-e939-41f6-9482-963b7c292181"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:53:27.379986 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.379820 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/dd263b2a-e939-41f6-9482-963b7c292181-istiod-ca-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:53:27.379986 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.379836 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-workload-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:53:27.379986 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.379844 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-istio-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:53:27.379986 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.379852 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-workload-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:53:27.381396 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.381374 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/dd263b2a-e939-41f6-9482-963b7c292181-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "dd263b2a-e939-41f6-9482-963b7c292181" (UID: "dd263b2a-e939-41f6-9482-963b7c292181"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 17:53:27.381576 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.381556 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd263b2a-e939-41f6-9482-963b7c292181-istio-token" (OuterVolumeSpecName: "istio-token") pod "dd263b2a-e939-41f6-9482-963b7c292181" (UID: "dd263b2a-e939-41f6-9482-963b7c292181"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:53:27.381680 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.381665 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/dd263b2a-e939-41f6-9482-963b7c292181-kube-api-access-dm8xt" (OuterVolumeSpecName: "kube-api-access-dm8xt") pod "dd263b2a-e939-41f6-9482-963b7c292181" (UID: "dd263b2a-e939-41f6-9482-963b7c292181"). InnerVolumeSpecName "kube-api-access-dm8xt". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:53:27.381852 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.381825 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "dd263b2a-e939-41f6-9482-963b7c292181" (UID: "dd263b2a-e939-41f6-9482-963b7c292181"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:53:27.480799 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.480776 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/dd263b2a-e939-41f6-9482-963b7c292181-istio-podinfo\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:53:27.480799 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.480796 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/dd263b2a-e939-41f6-9482-963b7c292181-istio-token\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:53:27.480938 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.480806 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-istio-envoy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:53:27.480938 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.480814 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-dm8xt\" (UniqueName: \"kubernetes.io/projected/dd263b2a-e939-41f6-9482-963b7c292181-kube-api-access-dm8xt\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:53:27.480938 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.480823 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/dd263b2a-e939-41f6-9482-963b7c292181-credential-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:53:27.973553 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.973518 2565 generic.go:356] "Generic (PLEG): container finished" podID="dd263b2a-e939-41f6-9482-963b7c292181" containerID="5f7eaac955b16def0bc853d1ee270ab943f95ecc1404ac9c1a7d86b344bb2ace" exitCode=0 Jul 09 17:53:27.973719 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.973571 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" Jul 09 17:53:27.973719 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.973599 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" event={"ID":"dd263b2a-e939-41f6-9482-963b7c292181","Type":"ContainerDied","Data":"5f7eaac955b16def0bc853d1ee270ab943f95ecc1404ac9c1a7d86b344bb2ace"} Jul 09 17:53:27.973719 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.973653 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8" event={"ID":"dd263b2a-e939-41f6-9482-963b7c292181","Type":"ContainerDied","Data":"3bdbd3e6bd098ca61d638ae8325a44ecb4b3d50366399fb6e316e4d17c47d73b"} Jul 09 17:53:27.973719 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.973675 2565 scope.go:117] "RemoveContainer" containerID="5f7eaac955b16def0bc853d1ee270ab943f95ecc1404ac9c1a7d86b344bb2ace" Jul 09 17:53:27.982126 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.982111 2565 scope.go:117] "RemoveContainer" containerID="5f7eaac955b16def0bc853d1ee270ab943f95ecc1404ac9c1a7d86b344bb2ace" Jul 09 17:53:27.982368 ip-10-0-138-5 kubenswrapper[2565]: E0709 17:53:27.982352 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"5f7eaac955b16def0bc853d1ee270ab943f95ecc1404ac9c1a7d86b344bb2ace\": container with ID starting with 5f7eaac955b16def0bc853d1ee270ab943f95ecc1404ac9c1a7d86b344bb2ace not found: ID does not exist" containerID="5f7eaac955b16def0bc853d1ee270ab943f95ecc1404ac9c1a7d86b344bb2ace" Jul 09 17:53:27.982417 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.982376 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"5f7eaac955b16def0bc853d1ee270ab943f95ecc1404ac9c1a7d86b344bb2ace"} err="failed to get container status \"5f7eaac955b16def0bc853d1ee270ab943f95ecc1404ac9c1a7d86b344bb2ace\": rpc error: code = NotFound desc = could not find container \"5f7eaac955b16def0bc853d1ee270ab943f95ecc1404ac9c1a7d86b344bb2ace\": container with ID starting with 5f7eaac955b16def0bc853d1ee270ab943f95ecc1404ac9c1a7d86b344bb2ace not found: ID does not exist" Jul 09 17:53:27.993021 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.993000 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8"] Jul 09 17:53:27.997488 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:27.997469 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-derive-1608c3e9-openshift-default-576b76f69f-jdfr8"] Jul 09 17:53:29.509821 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:29.509712 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="dd263b2a-e939-41f6-9482-963b7c292181" path="/var/lib/kubelet/pods/dd263b2a-e939-41f6-9482-963b7c292181/volumes" Jul 09 17:53:31.076634 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:31.076604 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:53:41.474569 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:53:41.474523 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:55:24.674544 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:55:24.674461 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:55:32.277744 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:55:32.277712 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:56:50.342158 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.342123 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq"] Jul 09 17:56:50.342711 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.342695 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="dd263b2a-e939-41f6-9482-963b7c292181" containerName="istio-proxy" Jul 09 17:56:50.342790 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.342715 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="dd263b2a-e939-41f6-9482-963b7c292181" containerName="istio-proxy" Jul 09 17:56:50.342857 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.342844 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="dd263b2a-e939-41f6-9482-963b7c292181" containerName="istio-proxy" Jul 09 17:56:50.345981 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.345958 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.350743 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.350725 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-9bc868f0-openshift-default-dockercfg-jxb9b\"" Jul 09 17:56:50.378693 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.378669 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq"] Jul 09 17:56:50.430172 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.430139 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-envoy\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.430322 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.430181 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-token\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.430322 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.430258 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-podinfo\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.430322 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.430302 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-workload-socket\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.430501 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.430328 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istiod-ca-cert\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.430501 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.430425 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-workload-certs\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.430501 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.430469 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-credential-socket\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.430665 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.430507 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-data\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.430665 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.430533 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-nh8qs\" (UniqueName: \"kubernetes.io/projected/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-kube-api-access-nh8qs\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.531316 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.531277 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-workload-certs\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.531501 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.531327 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-credential-socket\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.531501 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.531365 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-data\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.531501 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.531478 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-nh8qs\" (UniqueName: \"kubernetes.io/projected/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-kube-api-access-nh8qs\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.531672 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.531521 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-envoy\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.531672 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.531544 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-token\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.531672 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.531612 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-podinfo\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.531672 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.531666 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-workload-socket\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.531913 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.531692 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-workload-certs\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.531913 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.531701 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istiod-ca-cert\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.532017 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.531975 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-credential-socket\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.532074 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.532050 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-workload-socket\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.532074 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.532059 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-data\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.532380 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.532353 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istiod-ca-cert\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.534026 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.534004 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-envoy\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.534245 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.534228 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-podinfo\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.544515 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.544493 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-token\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.546219 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.546196 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-nh8qs\" (UniqueName: \"kubernetes.io/projected/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-kube-api-access-nh8qs\") pod \"e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.655897 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.655818 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:50.793666 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.793644 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq"] Jul 09 17:56:50.795803 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:56:50.795780 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3b08ba5b_440f_4ee9_b641_2892f9ac1f89.slice/crio-e4150f71e47a3d559681b4406791522a1482882d2e1def701bff7447396f73c4 WatchSource:0}: Error finding container e4150f71e47a3d559681b4406791522a1482882d2e1def701bff7447396f73c4: Status 404 returned error can't find the container with id e4150f71e47a3d559681b4406791522a1482882d2e1def701bff7447396f73c4 Jul 09 17:56:50.797920 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.797884 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:56:50.798068 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.797964 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:56:50.798068 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.798010 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:56:50.951887 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.951796 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" event={"ID":"3b08ba5b-440f-4ee9-b641-2892f9ac1f89","Type":"ContainerStarted","Data":"c789c0c73b4ab672419eadab27d5f794dbe22f1ec15dc259e54e3e42e4c1ae44"} Jul 09 17:56:50.951887 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.951845 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" event={"ID":"3b08ba5b-440f-4ee9-b641-2892f9ac1f89","Type":"ContainerStarted","Data":"e4150f71e47a3d559681b4406791522a1482882d2e1def701bff7447396f73c4"} Jul 09 17:56:50.979731 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:50.979680 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" podStartSLOduration=0.979666323 podStartE2EDuration="979.666323ms" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:56:50 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:56:50.978422746 +0000 UTC m=+1724.034891248" watchObservedRunningTime="2026-07-09 17:56:50.979666323 +0000 UTC m=+1724.036134827" Jul 09 17:56:51.656420 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:51.656382 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:51.661275 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:51.661254 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:51.957604 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:51.957526 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:51.958558 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:51.958539 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:56:53.467045 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:56:53.467011 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:57:05.924909 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:05.924873 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:57:07.946249 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:07.946215 2565 patch_prober.go:28] interesting pod/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": read tcp 10.134.0.2:56982->10.134.0.39:15021: read: connection reset by peer" start-of-body= Jul 09 17:57:07.946677 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:07.946297 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" podUID="3b08ba5b-440f-4ee9-b641-2892f9ac1f89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": read tcp 10.134.0.2:56982->10.134.0.39:15021: read: connection reset by peer" Jul 09 17:57:08.042300 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:08.042271 2565 generic.go:356] "Generic (PLEG): container finished" podID="3b08ba5b-440f-4ee9-b641-2892f9ac1f89" containerID="c789c0c73b4ab672419eadab27d5f794dbe22f1ec15dc259e54e3e42e4c1ae44" exitCode=0 Jul 09 17:57:08.042423 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:08.042340 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" event={"ID":"3b08ba5b-440f-4ee9-b641-2892f9ac1f89","Type":"ContainerDied","Data":"c789c0c73b4ab672419eadab27d5f794dbe22f1ec15dc259e54e3e42e4c1ae44"} Jul 09 17:57:08.042747 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:08.042734 2565 scope.go:117] "RemoveContainer" containerID="c789c0c73b4ab672419eadab27d5f794dbe22f1ec15dc259e54e3e42e4c1ae44" Jul 09 17:57:08.043709 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:08.043682 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:57:08.043830 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:08.043744 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:57:08.043830 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:08.043798 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:57:09.050530 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:09.050499 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" event={"ID":"3b08ba5b-440f-4ee9-b641-2892f9ac1f89","Type":"ContainerStarted","Data":"d6f20265a1bcdb8fd04d75cc0ac8105a9c2d3ca3fa2e96f4f975a509d2928b3a"} Jul 09 17:57:09.656187 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:09.656148 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:57:09.656405 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:09.656378 2565 patch_prober.go:28] interesting pod/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 09 17:57:09.656489 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:09.656434 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" podUID="3b08ba5b-440f-4ee9-b641-2892f9ac1f89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 09 17:57:10.656440 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:10.656402 2565 patch_prober.go:28] interesting pod/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 09 17:57:10.656834 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:10.656485 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" podUID="3b08ba5b-440f-4ee9-b641-2892f9ac1f89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 09 17:57:11.656779 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:11.656725 2565 patch_prober.go:28] interesting pod/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 09 17:57:11.657180 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:11.656813 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" podUID="3b08ba5b-440f-4ee9-b641-2892f9ac1f89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 09 17:57:12.656807 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:12.656746 2565 patch_prober.go:28] interesting pod/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" start-of-body= Jul 09 17:57:12.657197 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:12.656832 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" podUID="3b08ba5b-440f-4ee9-b641-2892f9ac1f89" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.39:15021/healthz/ready\": dial tcp 10.134.0.39:15021: connect: connection refused" Jul 09 17:57:12.723064 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:12.721836 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq"] Jul 09 17:57:12.723064 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:12.722060 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" podUID="3b08ba5b-440f-4ee9-b641-2892f9ac1f89" containerName="istio-proxy" containerID="cri-o://d6f20265a1bcdb8fd04d75cc0ac8105a9c2d3ca3fa2e96f4f975a509d2928b3a" gracePeriod=30 Jul 09 17:57:15.440645 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:15.440611 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:57:18.098582 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.098540 2565 generic.go:356] "Generic (PLEG): container finished" podID="3b08ba5b-440f-4ee9-b641-2892f9ac1f89" containerID="d6f20265a1bcdb8fd04d75cc0ac8105a9c2d3ca3fa2e96f4f975a509d2928b3a" exitCode=0 Jul 09 17:57:18.098984 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.098595 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" event={"ID":"3b08ba5b-440f-4ee9-b641-2892f9ac1f89","Type":"ContainerDied","Data":"d6f20265a1bcdb8fd04d75cc0ac8105a9c2d3ca3fa2e96f4f975a509d2928b3a"} Jul 09 17:57:18.098984 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.098663 2565 scope.go:117] "RemoveContainer" containerID="c789c0c73b4ab672419eadab27d5f794dbe22f1ec15dc259e54e3e42e4c1ae44" Jul 09 17:57:18.184569 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.184545 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:57:18.288377 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.288351 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-credential-socket\") pod \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " Jul 09 17:57:18.288516 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.288400 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-workload-certs\") pod \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " Jul 09 17:57:18.288516 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.288436 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-token\") pod \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " Jul 09 17:57:18.288516 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.288477 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-workload-socket\") pod \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " Jul 09 17:57:18.288642 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.288527 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-nh8qs\" (UniqueName: \"kubernetes.io/projected/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-kube-api-access-nh8qs\") pod \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " Jul 09 17:57:18.288642 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.288582 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-podinfo\") pod \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " Jul 09 17:57:18.288642 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.288604 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istiod-ca-cert\") pod \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " Jul 09 17:57:18.288831 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.288660 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3b08ba5b-440f-4ee9-b641-2892f9ac1f89" (UID: "3b08ba5b-440f-4ee9-b641-2892f9ac1f89"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:57:18.288831 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.288730 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-data\") pod \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " Jul 09 17:57:18.288831 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.288750 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3b08ba5b-440f-4ee9-b641-2892f9ac1f89" (UID: "3b08ba5b-440f-4ee9-b641-2892f9ac1f89"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:57:18.288831 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.288808 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-envoy\") pod \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\" (UID: \"3b08ba5b-440f-4ee9-b641-2892f9ac1f89\") " Jul 09 17:57:18.289049 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.288864 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3b08ba5b-440f-4ee9-b641-2892f9ac1f89" (UID: "3b08ba5b-440f-4ee9-b641-2892f9ac1f89"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:57:18.289211 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.289187 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-credential-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:57:18.289323 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.289215 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-workload-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:57:18.289323 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.289229 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-workload-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:57:18.289323 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.289304 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3b08ba5b-440f-4ee9-b641-2892f9ac1f89" (UID: "3b08ba5b-440f-4ee9-b641-2892f9ac1f89"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:57:18.289575 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.289547 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-data" (OuterVolumeSpecName: "istio-data") pod "3b08ba5b-440f-4ee9-b641-2892f9ac1f89" (UID: "3b08ba5b-440f-4ee9-b641-2892f9ac1f89"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:57:18.290854 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.290825 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3b08ba5b-440f-4ee9-b641-2892f9ac1f89" (UID: "3b08ba5b-440f-4ee9-b641-2892f9ac1f89"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 17:57:18.290961 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.290936 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-kube-api-access-nh8qs" (OuterVolumeSpecName: "kube-api-access-nh8qs") pod "3b08ba5b-440f-4ee9-b641-2892f9ac1f89" (UID: "3b08ba5b-440f-4ee9-b641-2892f9ac1f89"). InnerVolumeSpecName "kube-api-access-nh8qs". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:57:18.291130 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.291109 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-token" (OuterVolumeSpecName: "istio-token") pod "3b08ba5b-440f-4ee9-b641-2892f9ac1f89" (UID: "3b08ba5b-440f-4ee9-b641-2892f9ac1f89"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:57:18.291189 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.291126 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3b08ba5b-440f-4ee9-b641-2892f9ac1f89" (UID: "3b08ba5b-440f-4ee9-b641-2892f9ac1f89"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:57:18.390279 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.390249 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-podinfo\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:57:18.390279 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.390277 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istiod-ca-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:57:18.390279 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.390288 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:57:18.390501 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.390299 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-envoy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:57:18.390501 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.390310 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-istio-token\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:57:18.390501 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:18.390322 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-nh8qs\" (UniqueName: \"kubernetes.io/projected/3b08ba5b-440f-4ee9-b641-2892f9ac1f89-kube-api-access-nh8qs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:57:19.105093 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:19.105065 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" Jul 09 17:57:19.105479 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:19.105064 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq" event={"ID":"3b08ba5b-440f-4ee9-b641-2892f9ac1f89","Type":"ContainerDied","Data":"e4150f71e47a3d559681b4406791522a1482882d2e1def701bff7447396f73c4"} Jul 09 17:57:19.105479 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:19.105196 2565 scope.go:117] "RemoveContainer" containerID="d6f20265a1bcdb8fd04d75cc0ac8105a9c2d3ca3fa2e96f4f975a509d2928b3a" Jul 09 17:57:19.131940 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:19.131908 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq"] Jul 09 17:57:19.142845 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:19.142821 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-9bc868f0-openshift-default-785fcbc94c-mv5gq"] Jul 09 17:57:19.508667 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:19.508591 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3b08ba5b-440f-4ee9-b641-2892f9ac1f89" path="/var/lib/kubelet/pods/3b08ba5b-440f-4ee9-b641-2892f9ac1f89/volumes" Jul 09 17:57:34.191396 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.191360 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q"] Jul 09 17:57:34.191896 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.191745 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b08ba5b-440f-4ee9-b641-2892f9ac1f89" containerName="istio-proxy" Jul 09 17:57:34.191896 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.191768 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b08ba5b-440f-4ee9-b641-2892f9ac1f89" containerName="istio-proxy" Jul 09 17:57:34.191896 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.191785 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3b08ba5b-440f-4ee9-b641-2892f9ac1f89" containerName="istio-proxy" Jul 09 17:57:34.191896 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.191790 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3b08ba5b-440f-4ee9-b641-2892f9ac1f89" containerName="istio-proxy" Jul 09 17:57:34.191896 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.191847 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b08ba5b-440f-4ee9-b641-2892f9ac1f89" containerName="istio-proxy" Jul 09 17:57:34.196625 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.196602 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.204568 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.204544 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-mt-aaf858ec-openshift-default-dockercfg-gpsgs\"" Jul 09 17:57:34.307500 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.307471 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q"] Jul 09 17:57:34.330208 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.330182 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-c5dsg\" (UniqueName: \"kubernetes.io/projected/424e6a9c-dd1a-4281-9888-f2fbd6330e63-kube-api-access-c5dsg\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.330366 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.330217 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-data\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.330366 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.330251 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-workload-certs\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.330366 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.330313 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-envoy\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.330541 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.330414 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-token\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.330541 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.330480 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-credential-socket\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.330541 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.330506 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-workload-socket\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.330679 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.330538 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-podinfo\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.330679 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.330579 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istiod-ca-cert\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.431597 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.431561 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-podinfo\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.431826 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.431610 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istiod-ca-cert\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.431826 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.431663 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-c5dsg\" (UniqueName: \"kubernetes.io/projected/424e6a9c-dd1a-4281-9888-f2fbd6330e63-kube-api-access-c5dsg\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.431826 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.431693 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-data\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.431826 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.431728 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-workload-certs\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.431826 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.431771 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-envoy\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.432107 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.431881 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-token\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.432107 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.431947 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-credential-socket\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.432107 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.431970 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-workload-socket\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.432259 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.432232 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-data\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.432259 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.432246 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-workload-certs\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.432367 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.432296 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-workload-socket\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.432367 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.432352 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-credential-socket\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.432796 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.432751 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istiod-ca-cert\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.434168 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.434148 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-podinfo\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.434283 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.434185 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-envoy\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.450101 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.450049 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-token\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.454932 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.454911 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-c5dsg\" (UniqueName: \"kubernetes.io/projected/424e6a9c-dd1a-4281-9888-f2fbd6330e63-kube-api-access-c5dsg\") pod \"e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.506947 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.506923 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:34.659177 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.659143 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q"] Jul 09 17:57:34.664199 ip-10-0-138-5 kubenswrapper[2565]: W0709 17:57:34.664171 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod424e6a9c_dd1a_4281_9888_f2fbd6330e63.slice/crio-d2a561c0bda48fad288d74f315bae363c7af1c761c5240cb38c66d420b9ede8a WatchSource:0}: Error finding container d2a561c0bda48fad288d74f315bae363c7af1c761c5240cb38c66d420b9ede8a: Status 404 returned error can't find the container with id d2a561c0bda48fad288d74f315bae363c7af1c761c5240cb38c66d420b9ede8a Jul 09 17:57:34.666257 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.666223 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:57:34.666337 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.666285 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:57:34.666337 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:34.666316 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:57:35.192274 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:35.192240 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" event={"ID":"424e6a9c-dd1a-4281-9888-f2fbd6330e63","Type":"ContainerStarted","Data":"ac869628a984bcc0c57a302fda571151709d7c310661d0ae29ae32aaa49d5a98"} Jul 09 17:57:35.192746 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:35.192299 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" event={"ID":"424e6a9c-dd1a-4281-9888-f2fbd6330e63","Type":"ContainerStarted","Data":"d2a561c0bda48fad288d74f315bae363c7af1c761c5240cb38c66d420b9ede8a"} Jul 09 17:57:35.508097 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:35.508014 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:35.512333 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:35.512309 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:35.570552 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:35.570500 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" podStartSLOduration=1.5704836800000002 podStartE2EDuration="1.57048368s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 17:57:34 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 17:57:35.269362944 +0000 UTC m=+1768.325831445" watchObservedRunningTime="2026-07-09 17:57:35.57048368 +0000 UTC m=+1768.626952179" Jul 09 17:57:36.196915 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:36.196887 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:36.197718 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:36.197699 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:43.510469 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:43.510435 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:57:51.198518 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:51.198474 2565 patch_prober.go:28] interesting pod/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 09 17:57:51.198937 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:51.198543 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" podUID="424e6a9c-dd1a-4281-9888-f2fbd6330e63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 09 17:57:51.276062 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:51.276032 2565 generic.go:356] "Generic (PLEG): container finished" podID="424e6a9c-dd1a-4281-9888-f2fbd6330e63" containerID="ac869628a984bcc0c57a302fda571151709d7c310661d0ae29ae32aaa49d5a98" exitCode=0 Jul 09 17:57:51.276212 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:51.276106 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" event={"ID":"424e6a9c-dd1a-4281-9888-f2fbd6330e63","Type":"ContainerDied","Data":"ac869628a984bcc0c57a302fda571151709d7c310661d0ae29ae32aaa49d5a98"} Jul 09 17:57:51.276518 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:51.276503 2565 scope.go:117] "RemoveContainer" containerID="ac869628a984bcc0c57a302fda571151709d7c310661d0ae29ae32aaa49d5a98" Jul 09 17:57:51.277534 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:51.277508 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:57:51.277593 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:51.277580 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:57:51.277633 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:51.277613 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 17:57:52.281966 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:52.281930 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" event={"ID":"424e6a9c-dd1a-4281-9888-f2fbd6330e63","Type":"ContainerStarted","Data":"a962abb6936abf73f83e15dd73691f2fc87fceae871f0639d7cda032391de107"} Jul 09 17:57:52.507821 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:52.507789 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:52.507985 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:52.507915 2565 patch_prober.go:28] interesting pod/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 09 17:57:52.513695 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:52.508137 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" podUID="424e6a9c-dd1a-4281-9888-f2fbd6330e63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 09 17:57:53.507916 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:53.507884 2565 patch_prober.go:28] interesting pod/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 09 17:57:53.508322 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:53.507950 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" podUID="424e6a9c-dd1a-4281-9888-f2fbd6330e63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 09 17:57:54.508139 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:54.508099 2565 patch_prober.go:28] interesting pod/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 09 17:57:54.508521 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:54.508170 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" podUID="424e6a9c-dd1a-4281-9888-f2fbd6330e63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 09 17:57:55.507246 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:55.507212 2565 patch_prober.go:28] interesting pod/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" start-of-body= Jul 09 17:57:55.507457 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:55.507268 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" podUID="424e6a9c-dd1a-4281-9888-f2fbd6330e63" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.40:15021/healthz/ready\": dial tcp 10.134.0.40:15021: connect: connection refused" Jul 09 17:57:56.511984 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:56.511947 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:56.512529 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:56.512260 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:56.513031 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:56.513013 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:57:59.516967 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:57:59.516895 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:58:07.545056 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:58:07.545031 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 17:58:07.549852 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:58:07.549832 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 17:58:24.682725 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:58:24.682692 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:58:34.873808 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:58:34.873776 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:58:44.701147 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:58:44.701114 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:59:03.005984 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:03.005953 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:59:21.547703 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:21.547667 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q"] Jul 09 17:59:21.548723 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:21.547906 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" podUID="424e6a9c-dd1a-4281-9888-f2fbd6330e63" containerName="istio-proxy" containerID="cri-o://a962abb6936abf73f83e15dd73691f2fc87fceae871f0639d7cda032391de107" gracePeriod=30 Jul 09 17:59:26.514615 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.514573 2565 patch_prober.go:28] interesting pod/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 17:59:26.515001 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.514646 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" podUID="424e6a9c-dd1a-4281-9888-f2fbd6330e63" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 17:59:26.735382 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.735353 2565 generic.go:356] "Generic (PLEG): container finished" podID="424e6a9c-dd1a-4281-9888-f2fbd6330e63" containerID="a962abb6936abf73f83e15dd73691f2fc87fceae871f0639d7cda032391de107" exitCode=0 Jul 09 17:59:26.735587 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.735410 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" event={"ID":"424e6a9c-dd1a-4281-9888-f2fbd6330e63","Type":"ContainerDied","Data":"a962abb6936abf73f83e15dd73691f2fc87fceae871f0639d7cda032391de107"} Jul 09 17:59:26.735587 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.735476 2565 scope.go:117] "RemoveContainer" containerID="ac869628a984bcc0c57a302fda571151709d7c310661d0ae29ae32aaa49d5a98" Jul 09 17:59:26.805380 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.805360 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:59:26.875036 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.875005 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-workload-socket\") pod \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " Jul 09 17:59:26.875036 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.875040 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-envoy\") pod \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " Jul 09 17:59:26.875256 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.875065 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-token\") pod \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " Jul 09 17:59:26.875256 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.875128 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-c5dsg\" (UniqueName: \"kubernetes.io/projected/424e6a9c-dd1a-4281-9888-f2fbd6330e63-kube-api-access-c5dsg\") pod \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " Jul 09 17:59:26.875256 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.875177 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-credential-socket\") pod \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " Jul 09 17:59:26.875256 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.875237 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-workload-certs\") pod \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " Jul 09 17:59:26.875458 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.875262 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-podinfo\") pod \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " Jul 09 17:59:26.875458 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.875279 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "424e6a9c-dd1a-4281-9888-f2fbd6330e63" (UID: "424e6a9c-dd1a-4281-9888-f2fbd6330e63"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:59:26.875458 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.875312 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-data\") pod \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " Jul 09 17:59:26.875458 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.875346 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istiod-ca-cert\") pod \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\" (UID: \"424e6a9c-dd1a-4281-9888-f2fbd6330e63\") " Jul 09 17:59:26.875737 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.875677 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-workload-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:59:26.875737 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.875655 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "424e6a9c-dd1a-4281-9888-f2fbd6330e63" (UID: "424e6a9c-dd1a-4281-9888-f2fbd6330e63"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:59:26.875737 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.875708 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "424e6a9c-dd1a-4281-9888-f2fbd6330e63" (UID: "424e6a9c-dd1a-4281-9888-f2fbd6330e63"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:59:26.875934 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.875863 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "424e6a9c-dd1a-4281-9888-f2fbd6330e63" (UID: "424e6a9c-dd1a-4281-9888-f2fbd6330e63"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 17:59:26.876425 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.876390 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-data" (OuterVolumeSpecName: "istio-data") pod "424e6a9c-dd1a-4281-9888-f2fbd6330e63" (UID: "424e6a9c-dd1a-4281-9888-f2fbd6330e63"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:59:26.877320 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.877288 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "424e6a9c-dd1a-4281-9888-f2fbd6330e63" (UID: "424e6a9c-dd1a-4281-9888-f2fbd6330e63"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 17:59:26.877419 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.877347 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/424e6a9c-dd1a-4281-9888-f2fbd6330e63-kube-api-access-c5dsg" (OuterVolumeSpecName: "kube-api-access-c5dsg") pod "424e6a9c-dd1a-4281-9888-f2fbd6330e63" (UID: "424e6a9c-dd1a-4281-9888-f2fbd6330e63"). InnerVolumeSpecName "kube-api-access-c5dsg". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:59:26.877632 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.877614 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-token" (OuterVolumeSpecName: "istio-token") pod "424e6a9c-dd1a-4281-9888-f2fbd6330e63" (UID: "424e6a9c-dd1a-4281-9888-f2fbd6330e63"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 17:59:26.877686 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.877655 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "424e6a9c-dd1a-4281-9888-f2fbd6330e63" (UID: "424e6a9c-dd1a-4281-9888-f2fbd6330e63"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 17:59:26.976225 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.976201 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-c5dsg\" (UniqueName: \"kubernetes.io/projected/424e6a9c-dd1a-4281-9888-f2fbd6330e63-kube-api-access-c5dsg\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:59:26.976225 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.976224 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-credential-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:59:26.976407 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.976233 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-workload-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:59:26.976407 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.976241 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-podinfo\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:59:26.976407 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.976249 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:59:26.976407 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.976257 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istiod-ca-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:59:26.976407 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.976264 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-envoy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:59:26.976407 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:26.976271 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/424e6a9c-dd1a-4281-9888-f2fbd6330e63-istio-token\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 17:59:27.743507 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:27.743476 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" Jul 09 17:59:27.744002 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:27.743468 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q" event={"ID":"424e6a9c-dd1a-4281-9888-f2fbd6330e63","Type":"ContainerDied","Data":"d2a561c0bda48fad288d74f315bae363c7af1c761c5240cb38c66d420b9ede8a"} Jul 09 17:59:27.744002 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:27.743627 2565 scope.go:117] "RemoveContainer" containerID="a962abb6936abf73f83e15dd73691f2fc87fceae871f0639d7cda032391de107" Jul 09 17:59:27.763922 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:27.763899 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q"] Jul 09 17:59:27.768479 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:27.768429 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-mt-aaf858ec-openshift-default-db5dd567-lh62q"] Jul 09 17:59:29.508459 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:29.508384 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="424e6a9c-dd1a-4281-9888-f2fbd6330e63" path="/var/lib/kubelet/pods/424e6a9c-dd1a-4281-9888-f2fbd6330e63/volumes" Jul 09 17:59:32.649929 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:32.649894 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 17:59:40.690639 ip-10-0-138-5 kubenswrapper[2565]: I0709 17:59:40.690591 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:00:52.474078 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:00:52.474046 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:01:29.860481 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:29.860381 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm"] Jul 09 18:01:29.861005 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:29.860775 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="424e6a9c-dd1a-4281-9888-f2fbd6330e63" containerName="istio-proxy" Jul 09 18:01:29.861005 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:29.860790 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="424e6a9c-dd1a-4281-9888-f2fbd6330e63" containerName="istio-proxy" Jul 09 18:01:29.861005 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:29.860802 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="424e6a9c-dd1a-4281-9888-f2fbd6330e63" containerName="istio-proxy" Jul 09 18:01:29.861005 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:29.860807 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="424e6a9c-dd1a-4281-9888-f2fbd6330e63" containerName="istio-proxy" Jul 09 18:01:29.861005 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:29.860877 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="424e6a9c-dd1a-4281-9888-f2fbd6330e63" containerName="istio-proxy" Jul 09 18:01:29.861005 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:29.860887 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3b08ba5b-440f-4ee9-b641-2892f9ac1f89" containerName="istio-proxy" Jul 09 18:01:29.861005 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:29.860893 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="424e6a9c-dd1a-4281-9888-f2fbd6330e63" containerName="istio-proxy" Jul 09 18:01:29.864657 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:29.864635 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:29.867564 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:29.867545 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-a-2fa6b6-openshift-default-dockercfg-pjz48\"" Jul 09 18:01:29.883842 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:29.883818 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm"] Jul 09 18:01:29.913038 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:29.913005 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-credential-socket\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:29.913200 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:29.913061 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-workload-socket\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:29.913200 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:29.913084 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-istio-data\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:29.913200 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:29.913130 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/131119b9-9641-40cc-84c5-7889f6d74f41-istio-token\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:29.913200 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:29.913160 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-workload-certs\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:29.913200 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:29.913188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/131119b9-9641-40cc-84c5-7889f6d74f41-istio-podinfo\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:29.913404 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:29.913239 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-istio-envoy\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:29.913404 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:29.913276 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/131119b9-9641-40cc-84c5-7889f6d74f41-istiod-ca-cert\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:29.913404 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:29.913295 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-585xv\" (UniqueName: \"kubernetes.io/projected/131119b9-9641-40cc-84c5-7889f6d74f41-kube-api-access-585xv\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:30.014844 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.014809 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-istio-envoy\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:30.014844 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.014844 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/131119b9-9641-40cc-84c5-7889f6d74f41-istiod-ca-cert\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:30.015059 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.014869 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-585xv\" (UniqueName: \"kubernetes.io/projected/131119b9-9641-40cc-84c5-7889f6d74f41-kube-api-access-585xv\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:30.015059 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.014905 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-credential-socket\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:30.015059 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.014960 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-workload-socket\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:30.015059 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.014987 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-istio-data\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:30.015059 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.015020 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/131119b9-9641-40cc-84c5-7889f6d74f41-istio-token\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:30.015059 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.015046 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-workload-certs\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:30.015347 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.015081 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/131119b9-9641-40cc-84c5-7889f6d74f41-istio-podinfo\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:30.015409 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.015358 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-credential-socket\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:30.015448 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.015407 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-workload-socket\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:30.015633 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.015609 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-istio-data\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:30.015702 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.015613 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/131119b9-9641-40cc-84c5-7889f6d74f41-istiod-ca-cert\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:30.015828 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.015810 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-workload-certs\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:30.017118 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.017096 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-istio-envoy\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:30.017649 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.017629 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/131119b9-9641-40cc-84c5-7889f6d74f41-istio-podinfo\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:30.030666 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.030642 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-585xv\" (UniqueName: \"kubernetes.io/projected/131119b9-9641-40cc-84c5-7889f6d74f41-kube-api-access-585xv\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:30.031594 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.031576 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/131119b9-9641-40cc-84c5-7889f6d74f41-istio-token\") pod \"e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:30.175120 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.175039 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:30.323533 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.323496 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm"] Jul 09 18:01:30.324795 ip-10-0-138-5 kubenswrapper[2565]: W0709 18:01:30.324774 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod131119b9_9641_40cc_84c5_7889f6d74f41.slice/crio-9e58dbe66c993b849f7e91a355531751aee10f1b392e3262305541f512249cab WatchSource:0}: Error finding container 9e58dbe66c993b849f7e91a355531751aee10f1b392e3262305541f512249cab: Status 404 returned error can't find the container with id 9e58dbe66c993b849f7e91a355531751aee10f1b392e3262305541f512249cab Jul 09 18:01:30.327388 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.327354 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:01:30.327491 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.327433 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:01:30.327491 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.327478 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:01:30.340672 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:30.340645 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" event={"ID":"131119b9-9641-40cc-84c5-7889f6d74f41","Type":"ContainerStarted","Data":"9e58dbe66c993b849f7e91a355531751aee10f1b392e3262305541f512249cab"} Jul 09 18:01:31.346968 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:31.346927 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" event={"ID":"131119b9-9641-40cc-84c5-7889f6d74f41","Type":"ContainerStarted","Data":"dea6b2c094ee7a89e89d789695a7a65fcf8ed3672b36a21ae9252ddc7a114ea5"} Jul 09 18:01:31.399886 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:31.399837 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" podStartSLOduration=2.399820746 podStartE2EDuration="2.399820746s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:01:29 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:01:31.399572685 +0000 UTC m=+2004.456041204" watchObservedRunningTime="2026-07-09 18:01:31.399820746 +0000 UTC m=+2004.456289246" Jul 09 18:01:32.176245 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:32.176208 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:32.181361 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:32.181334 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:32.352083 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:32.352054 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:32.353071 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:32.353052 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:38.779478 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.779448 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk"] Jul 09 18:01:38.783095 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.783078 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.786192 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.786171 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-inf-b-712c34-openshift-default-dockercfg-lwb2c\"" Jul 09 18:01:38.808198 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.808163 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk"] Jul 09 18:01:38.896962 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.896931 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-podinfo\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.897159 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.896977 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-envoy\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.897159 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.896999 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-data\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.897159 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.897064 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-credential-socket\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.897159 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.897119 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e972790-996a-43d4-bfe6-1bca20a5ce67-istiod-ca-cert\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.897323 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.897164 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-token\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.897323 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.897198 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-workload-certs\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.897323 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.897294 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-workload-socket\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.897323 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.897318 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-28rzb\" (UniqueName: \"kubernetes.io/projected/3e972790-996a-43d4-bfe6-1bca20a5ce67-kube-api-access-28rzb\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.998845 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.998807 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-credential-socket\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.999049 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.998848 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e972790-996a-43d4-bfe6-1bca20a5ce67-istiod-ca-cert\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.999049 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.998896 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-token\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.999049 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.998932 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-workload-certs\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.999049 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.999039 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-workload-socket\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.999275 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.999075 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-28rzb\" (UniqueName: \"kubernetes.io/projected/3e972790-996a-43d4-bfe6-1bca20a5ce67-kube-api-access-28rzb\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.999275 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.999119 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-podinfo\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.999275 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.999170 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-envoy\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.999275 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.999207 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-data\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.999482 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.999317 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-credential-socket\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.999482 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.999341 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-workload-certs\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.999482 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.999434 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-workload-socket\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.999638 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.999554 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-data\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:38.999638 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:38.999627 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e972790-996a-43d4-bfe6-1bca20a5ce67-istiod-ca-cert\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:39.001706 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:39.001681 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-envoy\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:39.001908 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:39.001890 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-podinfo\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:39.035179 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:39.035149 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-28rzb\" (UniqueName: \"kubernetes.io/projected/3e972790-996a-43d4-bfe6-1bca20a5ce67-kube-api-access-28rzb\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:39.036231 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:39.036206 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-token\") pod \"e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:39.093961 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:39.093925 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:39.249244 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:39.249217 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk"] Jul 09 18:01:39.251418 ip-10-0-138-5 kubenswrapper[2565]: W0709 18:01:39.251391 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3e972790_996a_43d4_bfe6_1bca20a5ce67.slice/crio-b014a609c2074746807b1572ee48e2b1d428b6683b596f6698744e3d24040348 WatchSource:0}: Error finding container b014a609c2074746807b1572ee48e2b1d428b6683b596f6698744e3d24040348: Status 404 returned error can't find the container with id b014a609c2074746807b1572ee48e2b1d428b6683b596f6698744e3d24040348 Jul 09 18:01:39.253493 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:39.253460 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:01:39.253578 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:39.253524 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:01:39.253578 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:39.253553 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:01:39.394749 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:39.394710 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" event={"ID":"3e972790-996a-43d4-bfe6-1bca20a5ce67","Type":"ContainerStarted","Data":"100850f20733f4ba618426984adc6ad5d7e948b4b1d761c638f062f101e9f00a"} Jul 09 18:01:39.394962 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:39.394801 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" event={"ID":"3e972790-996a-43d4-bfe6-1bca20a5ce67","Type":"ContainerStarted","Data":"b014a609c2074746807b1572ee48e2b1d428b6683b596f6698744e3d24040348"} Jul 09 18:01:40.094873 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:40.094784 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:40.099149 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:40.099127 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:40.172527 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:40.172474 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" podStartSLOduration=2.172458376 podStartE2EDuration="2.172458376s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:01:38 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:01:39.426229489 +0000 UTC m=+2012.482697990" watchObservedRunningTime="2026-07-09 18:01:40.172458376 +0000 UTC m=+2013.228926876" Jul 09 18:01:40.400109 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:40.400032 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:40.400875 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:40.400857 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:41.253527 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:41.253490 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:01:48.393924 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:48.393883 2565 patch_prober.go:28] interesting pod/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 18:01:48.394480 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:48.393944 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" podUID="131119b9-9641-40cc-84c5-7889f6d74f41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 18:01:49.452899 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:49.452825 2565 generic.go:356] "Generic (PLEG): container finished" podID="131119b9-9641-40cc-84c5-7889f6d74f41" containerID="dea6b2c094ee7a89e89d789695a7a65fcf8ed3672b36a21ae9252ddc7a114ea5" exitCode=0 Jul 09 18:01:49.453278 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:49.452899 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" event={"ID":"131119b9-9641-40cc-84c5-7889f6d74f41","Type":"ContainerDied","Data":"dea6b2c094ee7a89e89d789695a7a65fcf8ed3672b36a21ae9252ddc7a114ea5"} Jul 09 18:01:49.453323 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:49.453302 2565 scope.go:117] "RemoveContainer" containerID="dea6b2c094ee7a89e89d789695a7a65fcf8ed3672b36a21ae9252ddc7a114ea5" Jul 09 18:01:49.454285 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:49.454260 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:01:49.454361 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:49.454348 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:01:49.454399 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:49.454382 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:01:50.460442 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:50.460388 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" event={"ID":"131119b9-9641-40cc-84c5-7889f6d74f41","Type":"ContainerStarted","Data":"cd5dfbbf53a2cac3f0e61e947ff7528163e56763aff58fe70ee87cf9d8045a69"} Jul 09 18:01:51.175199 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:51.175159 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:51.175514 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:51.175488 2565 patch_prober.go:28] interesting pod/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 09 18:01:51.175603 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:51.175543 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" podUID="131119b9-9641-40cc-84c5-7889f6d74f41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 09 18:01:52.175634 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:52.175594 2565 patch_prober.go:28] interesting pod/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 09 18:01:52.176072 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:52.175651 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" podUID="131119b9-9641-40cc-84c5-7889f6d74f41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 09 18:01:53.175716 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:53.175675 2565 patch_prober.go:28] interesting pod/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 09 18:01:53.176227 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:53.175729 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" podUID="131119b9-9641-40cc-84c5-7889f6d74f41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 09 18:01:54.175546 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:54.175502 2565 patch_prober.go:28] interesting pod/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" start-of-body= Jul 09 18:01:54.175731 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:54.175578 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" podUID="131119b9-9641-40cc-84c5-7889f6d74f41" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.41:15021/healthz/ready\": dial tcp 10.134.0.41:15021: connect: connection refused" Jul 09 18:01:55.179270 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:55.179239 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:55.179736 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:55.179582 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:55.180245 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:55.180228 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:01:55.321158 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:55.320380 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:01:56.441925 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:56.441882 2565 patch_prober.go:28] interesting pod/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 18:01:56.442369 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:56.441950 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" podUID="3e972790-996a-43d4-bfe6-1bca20a5ce67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 18:01:57.503813 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:57.503700 2565 generic.go:356] "Generic (PLEG): container finished" podID="3e972790-996a-43d4-bfe6-1bca20a5ce67" containerID="100850f20733f4ba618426984adc6ad5d7e948b4b1d761c638f062f101e9f00a" exitCode=0 Jul 09 18:01:57.508288 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:57.508258 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" event={"ID":"3e972790-996a-43d4-bfe6-1bca20a5ce67","Type":"ContainerDied","Data":"100850f20733f4ba618426984adc6ad5d7e948b4b1d761c638f062f101e9f00a"} Jul 09 18:01:57.508618 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:57.508589 2565 scope.go:117] "RemoveContainer" containerID="100850f20733f4ba618426984adc6ad5d7e948b4b1d761c638f062f101e9f00a" Jul 09 18:01:57.509555 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:57.509528 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:01:57.509620 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:57.509603 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:01:57.509678 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:57.509663 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:01:58.513471 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:58.513429 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" event={"ID":"3e972790-996a-43d4-bfe6-1bca20a5ce67","Type":"ContainerStarted","Data":"fea415100f280fb47d7a87bdfb77bb34c8b6031f9f4e57abd351408ec7f2c914"} Jul 09 18:01:59.094364 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:59.094330 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:01:59.094638 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:59.094613 2565 patch_prober.go:28] interesting pod/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 09 18:01:59.094732 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:01:59.094672 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" podUID="3e972790-996a-43d4-bfe6-1bca20a5ce67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 09 18:02:00.094915 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:02:00.094880 2565 patch_prober.go:28] interesting pod/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 09 18:02:00.095354 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:02:00.094932 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" podUID="3e972790-996a-43d4-bfe6-1bca20a5ce67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 09 18:02:01.094886 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:02:01.094850 2565 patch_prober.go:28] interesting pod/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 09 18:02:01.095064 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:02:01.094913 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" podUID="3e972790-996a-43d4-bfe6-1bca20a5ce67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 09 18:02:02.095281 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:02:02.095246 2565 patch_prober.go:28] interesting pod/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" start-of-body= Jul 09 18:02:02.095661 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:02:02.095304 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" podUID="3e972790-996a-43d4-bfe6-1bca20a5ce67" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.42:15021/healthz/ready\": dial tcp 10.134.0.42:15021: connect: connection refused" Jul 09 18:02:03.097873 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:02:03.097843 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:02:03.098288 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:02:03.098221 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:02:03.098824 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:02:03.098808 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:02:09.982388 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:02:09.982351 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:02:52.878267 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:02:52.878233 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:03:07.576378 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:07.576346 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 18:03:07.581025 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:07.581007 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 18:03:10.375657 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.375583 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8"] Jul 09 18:03:10.379564 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.379542 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.385484 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.385465 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-reuse-27f074-openshift-default-dockercfg-9krj2\"" Jul 09 18:03:10.396235 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.396209 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8"] Jul 09 18:03:10.477047 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.477019 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-workload-socket\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.477047 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.477049 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-credential-socket\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.477262 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.477077 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-token\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.477262 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.477128 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istiod-ca-cert\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.477262 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.477188 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-6fdtq\" (UniqueName: \"kubernetes.io/projected/3a16a833-d54f-4cda-bd29-aadde54c0b1f-kube-api-access-6fdtq\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.477262 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.477226 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-envoy\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.477407 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.477264 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-workload-certs\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.477407 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.477311 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-data\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.477407 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.477352 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-podinfo\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.578501 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.578464 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-workload-certs\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.578703 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.578530 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-data\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.578703 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.578595 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-podinfo\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.578703 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.578630 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-workload-socket\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.578703 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.578653 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-credential-socket\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.578948 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.578794 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-token\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.578948 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.578840 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istiod-ca-cert\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.578948 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.578886 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-6fdtq\" (UniqueName: \"kubernetes.io/projected/3a16a833-d54f-4cda-bd29-aadde54c0b1f-kube-api-access-6fdtq\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.578948 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.578923 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-envoy\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.579144 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.578995 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-workload-certs\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.579144 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.579009 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-data\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.579144 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.579073 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-workload-socket\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.579144 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.579105 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-credential-socket\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.579609 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.579589 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istiod-ca-cert\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.581020 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.581001 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-envoy\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.581263 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.581245 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-podinfo\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.587529 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.587506 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-token\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.588066 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.588048 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-6fdtq\" (UniqueName: \"kubernetes.io/projected/3a16a833-d54f-4cda-bd29-aadde54c0b1f-kube-api-access-6fdtq\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-rwvj8\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.690144 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.690067 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:10.836995 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.836923 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8"] Jul 09 18:03:10.839647 ip-10-0-138-5 kubenswrapper[2565]: W0709 18:03:10.839619 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod3a16a833_d54f_4cda_bd29_aadde54c0b1f.slice/crio-0230efef8e6f9d1f4b45d0e6668c55317c14e446468698c3c533cdbddb000480 WatchSource:0}: Error finding container 0230efef8e6f9d1f4b45d0e6668c55317c14e446468698c3c533cdbddb000480: Status 404 returned error can't find the container with id 0230efef8e6f9d1f4b45d0e6668c55317c14e446468698c3c533cdbddb000480 Jul 09 18:03:10.842154 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.842103 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:03:10.842247 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.842201 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:03:10.842288 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.842249 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:03:10.875205 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:10.875161 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" event={"ID":"3a16a833-d54f-4cda-bd29-aadde54c0b1f","Type":"ContainerStarted","Data":"0230efef8e6f9d1f4b45d0e6668c55317c14e446468698c3c533cdbddb000480"} Jul 09 18:03:11.881858 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:11.881824 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" event={"ID":"3a16a833-d54f-4cda-bd29-aadde54c0b1f","Type":"ContainerStarted","Data":"c2b684228840cee120ec9e04206851693f2b52770aefad72ea07bf388ddeb337"} Jul 09 18:03:11.904715 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:11.904662 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" podStartSLOduration=1.9046446590000001 podStartE2EDuration="1.904644659s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:03:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:03:11.902163975 +0000 UTC m=+2104.958632475" watchObservedRunningTime="2026-07-09 18:03:11.904644659 +0000 UTC m=+2104.961113158" Jul 09 18:03:12.690721 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:12.690686 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:12.695791 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:12.695741 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:12.886866 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:12.886836 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:12.887797 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:12.887778 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:18.388562 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:18.388527 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:03:27.887794 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:27.887742 2565 patch_prober.go:28] interesting pod/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 09 18:03:27.888299 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:27.887818 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" podUID="3a16a833-d54f-4cda-bd29-aadde54c0b1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 09 18:03:27.979463 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:27.979416 2565 generic.go:356] "Generic (PLEG): container finished" podID="3a16a833-d54f-4cda-bd29-aadde54c0b1f" containerID="c2b684228840cee120ec9e04206851693f2b52770aefad72ea07bf388ddeb337" exitCode=0 Jul 09 18:03:27.979657 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:27.979486 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" event={"ID":"3a16a833-d54f-4cda-bd29-aadde54c0b1f","Type":"ContainerDied","Data":"c2b684228840cee120ec9e04206851693f2b52770aefad72ea07bf388ddeb337"} Jul 09 18:03:27.979941 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:27.979923 2565 scope.go:117] "RemoveContainer" containerID="c2b684228840cee120ec9e04206851693f2b52770aefad72ea07bf388ddeb337" Jul 09 18:03:27.981021 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:27.980993 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:03:27.981118 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:27.981061 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:03:27.981118 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:27.981094 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:03:28.986679 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:28.986638 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" event={"ID":"3a16a833-d54f-4cda-bd29-aadde54c0b1f","Type":"ContainerStarted","Data":"e7de48ab89dc14d07126d0c884d5c988a21248cabae60d41f6cb5527b25c1fb9"} Jul 09 18:03:29.690787 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:29.690738 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:29.690970 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:29.690929 2565 patch_prober.go:28] interesting pod/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 09 18:03:29.691016 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:29.690977 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" podUID="3a16a833-d54f-4cda-bd29-aadde54c0b1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 09 18:03:30.691207 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:30.691171 2565 patch_prober.go:28] interesting pod/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 09 18:03:30.691571 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:30.691224 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" podUID="3a16a833-d54f-4cda-bd29-aadde54c0b1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 09 18:03:31.690773 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:31.690715 2565 patch_prober.go:28] interesting pod/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 09 18:03:31.690959 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:31.690804 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" podUID="3a16a833-d54f-4cda-bd29-aadde54c0b1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 09 18:03:32.690478 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:32.690434 2565 patch_prober.go:28] interesting pod/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" start-of-body= Jul 09 18:03:32.690897 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:32.690502 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" podUID="3a16a833-d54f-4cda-bd29-aadde54c0b1f" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.43:15021/healthz/ready\": dial tcp 10.134.0.43:15021: connect: connection refused" Jul 09 18:03:33.694895 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:33.694865 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:33.695285 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:33.695262 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:33.695878 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:33.695859 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:03:45.086364 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:03:45.086328 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:04:35.884896 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:35.884811 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:04:36.819624 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:36.819586 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8"] Jul 09 18:04:36.819933 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:36.819878 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" podUID="3a16a833-d54f-4cda-bd29-aadde54c0b1f" containerName="istio-proxy" containerID="cri-o://e7de48ab89dc14d07126d0c884d5c988a21248cabae60d41f6cb5527b25c1fb9" gracePeriod=30 Jul 09 18:04:37.809078 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:37.809047 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5"] Jul 09 18:04:37.811606 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:37.811586 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:37.814752 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:37.814734 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-reuse-27f074-openshift-default-dockercfg-tm27s\"" Jul 09 18:04:37.826854 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:37.826834 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5"] Jul 09 18:04:38.009336 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.009293 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-envoy\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.009517 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.009357 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-workload-certs\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.009517 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.009382 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-workload-socket\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.009517 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.009434 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-token\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.009517 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.009468 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istiod-ca-cert\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.009517 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.009501 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-podinfo\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.009719 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.009539 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-data\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.009719 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.009587 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-credential-socket\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.009719 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.009634 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-74s6v\" (UniqueName: \"kubernetes.io/projected/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-kube-api-access-74s6v\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.110222 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.110130 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-74s6v\" (UniqueName: \"kubernetes.io/projected/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-kube-api-access-74s6v\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.110222 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.110177 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-envoy\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.110222 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.110202 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-workload-certs\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.110222 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.110221 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-workload-socket\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.110565 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.110242 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-token\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.110565 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.110268 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istiod-ca-cert\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.110565 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.110303 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-podinfo\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.110565 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.110502 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-data\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.110789 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.110629 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-credential-socket\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.110789 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.110659 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-workload-certs\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.110914 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.110835 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-workload-socket\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.111038 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.111018 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-data\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.111117 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.111060 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-credential-socket\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.111158 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.111114 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istiod-ca-cert\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.112484 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.112465 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-envoy\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.112724 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.112702 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-podinfo\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.118406 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.118377 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-74s6v\" (UniqueName: \"kubernetes.io/projected/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-kube-api-access-74s6v\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.118918 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.118896 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-token\") pod \"e2e-reuse-27f074-openshift-default-9d8476895-mg8d5\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.122889 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.122854 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:38.269547 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.269416 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5"] Jul 09 18:04:38.272407 ip-10-0-138-5 kubenswrapper[2565]: W0709 18:04:38.272377 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f15bbdc_a2bc_4884_9ce0_58232ffa3a1d.slice/crio-b979182fe31556b35076670620b69341a00489f5d66f79b4e9d68c4db0f57a6d WatchSource:0}: Error finding container b979182fe31556b35076670620b69341a00489f5d66f79b4e9d68c4db0f57a6d: Status 404 returned error can't find the container with id b979182fe31556b35076670620b69341a00489f5d66f79b4e9d68c4db0f57a6d Jul 09 18:04:38.274714 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.274682 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:04:38.274805 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.274741 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:04:38.274805 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.274788 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:04:38.339306 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.339276 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" event={"ID":"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d","Type":"ContainerStarted","Data":"232209842d61f1fe5c9f959cf58c5d5b3aac04bb4adb6f7860f894403bce3354"} Jul 09 18:04:38.339466 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.339330 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" event={"ID":"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d","Type":"ContainerStarted","Data":"b979182fe31556b35076670620b69341a00489f5d66f79b4e9d68c4db0f57a6d"} Jul 09 18:04:38.361329 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:38.361226 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" podStartSLOduration=1.361210145 podStartE2EDuration="1.361210145s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:04:37 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:04:38.35901635 +0000 UTC m=+2191.415484847" watchObservedRunningTime="2026-07-09 18:04:38.361210145 +0000 UTC m=+2191.417678645" Jul 09 18:04:39.124067 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:39.124037 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:39.125632 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:39.125611 2565 patch_prober.go:28] interesting pod/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 09 18:04:39.125717 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:39.125657 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" podUID="9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 09 18:04:40.128496 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:40.128404 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:40.349870 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:40.349836 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:40.350827 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:40.350808 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:42.079122 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.079101 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:04:42.151568 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.151490 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-6fdtq\" (UniqueName: \"kubernetes.io/projected/3a16a833-d54f-4cda-bd29-aadde54c0b1f-kube-api-access-6fdtq\") pod \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " Jul 09 18:04:42.151568 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.151524 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-credential-socket\") pod \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " Jul 09 18:04:42.151568 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.151543 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-envoy\") pod \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " Jul 09 18:04:42.151858 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.151580 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istiod-ca-cert\") pod \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " Jul 09 18:04:42.151858 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.151603 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-data\") pod \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " Jul 09 18:04:42.151858 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.151632 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-token\") pod \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " Jul 09 18:04:42.151858 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.151659 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-workload-socket\") pod \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " Jul 09 18:04:42.151858 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.151689 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-workload-certs\") pod \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " Jul 09 18:04:42.151858 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.151807 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-podinfo\") pod \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\" (UID: \"3a16a833-d54f-4cda-bd29-aadde54c0b1f\") " Jul 09 18:04:42.151858 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.151819 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3a16a833-d54f-4cda-bd29-aadde54c0b1f" (UID: "3a16a833-d54f-4cda-bd29-aadde54c0b1f"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:04:42.152207 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.152028 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3a16a833-d54f-4cda-bd29-aadde54c0b1f" (UID: "3a16a833-d54f-4cda-bd29-aadde54c0b1f"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:04:42.152207 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.152046 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3a16a833-d54f-4cda-bd29-aadde54c0b1f" (UID: "3a16a833-d54f-4cda-bd29-aadde54c0b1f"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:04:42.152320 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.152304 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3a16a833-d54f-4cda-bd29-aadde54c0b1f" (UID: "3a16a833-d54f-4cda-bd29-aadde54c0b1f"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:04:42.152377 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.152330 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-workload-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:04:42.152377 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.152350 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-credential-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:04:42.152377 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.152364 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istiod-ca-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:04:42.152547 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.152514 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-data" (OuterVolumeSpecName: "istio-data") pod "3a16a833-d54f-4cda-bd29-aadde54c0b1f" (UID: "3a16a833-d54f-4cda-bd29-aadde54c0b1f"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:04:42.153943 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.153911 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a16a833-d54f-4cda-bd29-aadde54c0b1f-kube-api-access-6fdtq" (OuterVolumeSpecName: "kube-api-access-6fdtq") pod "3a16a833-d54f-4cda-bd29-aadde54c0b1f" (UID: "3a16a833-d54f-4cda-bd29-aadde54c0b1f"). InnerVolumeSpecName "kube-api-access-6fdtq". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:04:42.153943 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.153924 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3a16a833-d54f-4cda-bd29-aadde54c0b1f" (UID: "3a16a833-d54f-4cda-bd29-aadde54c0b1f"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 18:04:42.154083 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.153969 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-token" (OuterVolumeSpecName: "istio-token") pod "3a16a833-d54f-4cda-bd29-aadde54c0b1f" (UID: "3a16a833-d54f-4cda-bd29-aadde54c0b1f"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:04:42.154083 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.153973 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3a16a833-d54f-4cda-bd29-aadde54c0b1f" (UID: "3a16a833-d54f-4cda-bd29-aadde54c0b1f"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:04:42.253131 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.253102 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-podinfo\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:04:42.253131 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.253128 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-6fdtq\" (UniqueName: \"kubernetes.io/projected/3a16a833-d54f-4cda-bd29-aadde54c0b1f-kube-api-access-6fdtq\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:04:42.253131 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.253137 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-envoy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:04:42.253349 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.253145 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:04:42.253349 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.253153 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3a16a833-d54f-4cda-bd29-aadde54c0b1f-istio-token\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:04:42.253349 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.253161 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3a16a833-d54f-4cda-bd29-aadde54c0b1f-workload-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:04:42.361092 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.361057 2565 generic.go:356] "Generic (PLEG): container finished" podID="3a16a833-d54f-4cda-bd29-aadde54c0b1f" containerID="e7de48ab89dc14d07126d0c884d5c988a21248cabae60d41f6cb5527b25c1fb9" exitCode=0 Jul 09 18:04:42.361276 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.361099 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" Jul 09 18:04:42.361276 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.361114 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" event={"ID":"3a16a833-d54f-4cda-bd29-aadde54c0b1f","Type":"ContainerDied","Data":"e7de48ab89dc14d07126d0c884d5c988a21248cabae60d41f6cb5527b25c1fb9"} Jul 09 18:04:42.361276 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.361178 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8" event={"ID":"3a16a833-d54f-4cda-bd29-aadde54c0b1f","Type":"ContainerDied","Data":"0230efef8e6f9d1f4b45d0e6668c55317c14e446468698c3c533cdbddb000480"} Jul 09 18:04:42.361276 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.361210 2565 scope.go:117] "RemoveContainer" containerID="e7de48ab89dc14d07126d0c884d5c988a21248cabae60d41f6cb5527b25c1fb9" Jul 09 18:04:42.370428 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.370408 2565 scope.go:117] "RemoveContainer" containerID="c2b684228840cee120ec9e04206851693f2b52770aefad72ea07bf388ddeb337" Jul 09 18:04:42.378179 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.378160 2565 scope.go:117] "RemoveContainer" containerID="e7de48ab89dc14d07126d0c884d5c988a21248cabae60d41f6cb5527b25c1fb9" Jul 09 18:04:42.378416 ip-10-0-138-5 kubenswrapper[2565]: E0709 18:04:42.378399 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"e7de48ab89dc14d07126d0c884d5c988a21248cabae60d41f6cb5527b25c1fb9\": container with ID starting with e7de48ab89dc14d07126d0c884d5c988a21248cabae60d41f6cb5527b25c1fb9 not found: ID does not exist" containerID="e7de48ab89dc14d07126d0c884d5c988a21248cabae60d41f6cb5527b25c1fb9" Jul 09 18:04:42.378484 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.378427 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"e7de48ab89dc14d07126d0c884d5c988a21248cabae60d41f6cb5527b25c1fb9"} err="failed to get container status \"e7de48ab89dc14d07126d0c884d5c988a21248cabae60d41f6cb5527b25c1fb9\": rpc error: code = NotFound desc = could not find container \"e7de48ab89dc14d07126d0c884d5c988a21248cabae60d41f6cb5527b25c1fb9\": container with ID starting with e7de48ab89dc14d07126d0c884d5c988a21248cabae60d41f6cb5527b25c1fb9 not found: ID does not exist" Jul 09 18:04:42.378484 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.378450 2565 scope.go:117] "RemoveContainer" containerID="c2b684228840cee120ec9e04206851693f2b52770aefad72ea07bf388ddeb337" Jul 09 18:04:42.378665 ip-10-0-138-5 kubenswrapper[2565]: E0709 18:04:42.378649 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"c2b684228840cee120ec9e04206851693f2b52770aefad72ea07bf388ddeb337\": container with ID starting with c2b684228840cee120ec9e04206851693f2b52770aefad72ea07bf388ddeb337 not found: ID does not exist" containerID="c2b684228840cee120ec9e04206851693f2b52770aefad72ea07bf388ddeb337" Jul 09 18:04:42.378708 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.378670 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"c2b684228840cee120ec9e04206851693f2b52770aefad72ea07bf388ddeb337"} err="failed to get container status \"c2b684228840cee120ec9e04206851693f2b52770aefad72ea07bf388ddeb337\": rpc error: code = NotFound desc = could not find container \"c2b684228840cee120ec9e04206851693f2b52770aefad72ea07bf388ddeb337\": container with ID starting with c2b684228840cee120ec9e04206851693f2b52770aefad72ea07bf388ddeb337 not found: ID does not exist" Jul 09 18:04:42.384173 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.384155 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8"] Jul 09 18:04:42.390197 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:42.390178 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-rwvj8"] Jul 09 18:04:43.509100 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:43.509070 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3a16a833-d54f-4cda-bd29-aadde54c0b1f" path="/var/lib/kubelet/pods/3a16a833-d54f-4cda-bd29-aadde54c0b1f/volumes" Jul 09 18:04:56.391916 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:56.391880 2565 patch_prober.go:28] interesting pod/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 18:04:56.392318 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:56.391950 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" podUID="9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 18:04:57.441479 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:57.441395 2565 generic.go:356] "Generic (PLEG): container finished" podID="9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" containerID="232209842d61f1fe5c9f959cf58c5d5b3aac04bb4adb6f7860f894403bce3354" exitCode=0 Jul 09 18:04:57.441877 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:57.441472 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" event={"ID":"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d","Type":"ContainerDied","Data":"232209842d61f1fe5c9f959cf58c5d5b3aac04bb4adb6f7860f894403bce3354"} Jul 09 18:04:57.441922 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:57.441892 2565 scope.go:117] "RemoveContainer" containerID="232209842d61f1fe5c9f959cf58c5d5b3aac04bb4adb6f7860f894403bce3354" Jul 09 18:04:57.442886 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:57.442860 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:04:57.442958 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:57.442924 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:04:57.442958 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:57.442954 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:04:58.449504 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:58.449470 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" event={"ID":"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d","Type":"ContainerStarted","Data":"d8323354fa12c6dacbc1f78ba337fe1335e7fb523f8f85f04bd93ff1ef961a75"} Jul 09 18:04:58.683888 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:58.683847 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:04:59.123482 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:59.123448 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:04:59.123727 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:59.123699 2565 patch_prober.go:28] interesting pod/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 09 18:04:59.123835 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:04:59.123781 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" podUID="9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 09 18:05:00.124070 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:05:00.124028 2565 patch_prober.go:28] interesting pod/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 09 18:05:00.124564 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:05:00.124092 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" podUID="9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 09 18:05:01.123322 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:05:01.123277 2565 patch_prober.go:28] interesting pod/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 09 18:05:01.123534 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:05:01.123352 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" podUID="9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 09 18:05:02.123919 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:05:02.123874 2565 patch_prober.go:28] interesting pod/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" start-of-body= Jul 09 18:05:02.124438 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:05:02.123952 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" podUID="9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.44:15021/healthz/ready\": dial tcp 10.134.0.44:15021: connect: connection refused" Jul 09 18:05:03.126750 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:05:03.126721 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:05:03.127212 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:05:03.126973 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:05:03.127732 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:05:03.127715 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:05:17.793027 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:05:17.792994 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:05:36.173804 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:05:36.173715 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:06:13.576773 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:13.576728 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:06:29.689988 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:29.689951 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5"] Jul 09 18:06:29.690583 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:29.690203 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" podUID="9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" containerName="istio-proxy" containerID="cri-o://d8323354fa12c6dacbc1f78ba337fe1335e7fb523f8f85f04bd93ff1ef961a75" gracePeriod=30 Jul 09 18:06:33.129562 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:33.129521 2565 patch_prober.go:28] interesting pod/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5 container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 18:06:33.130003 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:33.129589 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" podUID="9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 18:06:34.935777 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:34.935733 2565 generic.go:356] "Generic (PLEG): container finished" podID="9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" containerID="d8323354fa12c6dacbc1f78ba337fe1335e7fb523f8f85f04bd93ff1ef961a75" exitCode=0 Jul 09 18:06:34.936167 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:34.935796 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" event={"ID":"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d","Type":"ContainerDied","Data":"d8323354fa12c6dacbc1f78ba337fe1335e7fb523f8f85f04bd93ff1ef961a75"} Jul 09 18:06:34.936167 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:34.935848 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" event={"ID":"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d","Type":"ContainerDied","Data":"b979182fe31556b35076670620b69341a00489f5d66f79b4e9d68c4db0f57a6d"} Jul 09 18:06:34.936167 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:34.935864 2565 pod_container_deletor.go:80] "Container not found in pod's containers" containerID="b979182fe31556b35076670620b69341a00489f5d66f79b4e9d68c4db0f57a6d" Jul 09 18:06:34.936167 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:34.935879 2565 scope.go:117] "RemoveContainer" containerID="232209842d61f1fe5c9f959cf58c5d5b3aac04bb4adb6f7860f894403bce3354" Jul 09 18:06:34.946702 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:34.946687 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:06:35.058937 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.058909 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-workload-certs\") pod \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " Jul 09 18:06:35.059229 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.058957 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-token\") pod \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " Jul 09 18:06:35.059229 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.059002 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-74s6v\" (UniqueName: \"kubernetes.io/projected/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-kube-api-access-74s6v\") pod \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " Jul 09 18:06:35.059229 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.059107 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-envoy\") pod \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " Jul 09 18:06:35.059229 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.059135 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istiod-ca-cert\") pod \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " Jul 09 18:06:35.059229 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.059163 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" (UID: "9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:06:35.059229 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.059170 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-workload-socket\") pod \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " Jul 09 18:06:35.059229 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.059227 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-credential-socket\") pod \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " Jul 09 18:06:35.059615 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.059261 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-podinfo\") pod \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " Jul 09 18:06:35.059615 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.059305 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-data\") pod \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\" (UID: \"9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d\") " Jul 09 18:06:35.059615 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.059409 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" (UID: "9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:06:35.059615 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.059528 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" (UID: "9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:06:35.059919 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.059723 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-workload-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:06:35.059919 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.059742 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-workload-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:06:35.059919 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.059773 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istiod-ca-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:06:35.059919 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.059811 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" (UID: "9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:06:35.060287 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.060266 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-data" (OuterVolumeSpecName: "istio-data") pod "9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" (UID: "9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:06:35.061393 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.061355 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-kube-api-access-74s6v" (OuterVolumeSpecName: "kube-api-access-74s6v") pod "9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" (UID: "9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d"). InnerVolumeSpecName "kube-api-access-74s6v". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:06:35.061507 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.061446 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" (UID: "9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 18:06:35.061599 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.061581 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-token" (OuterVolumeSpecName: "istio-token") pod "9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" (UID: "9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:06:35.061672 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.061658 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" (UID: "9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:06:35.160469 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.160436 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:06:35.160469 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.160462 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-token\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:06:35.160469 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.160472 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-74s6v\" (UniqueName: \"kubernetes.io/projected/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-kube-api-access-74s6v\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:06:35.160683 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.160483 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-envoy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:06:35.160683 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.160492 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-credential-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:06:35.160683 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.160500 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d-istio-podinfo\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:06:35.381137 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.381056 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:06:35.943400 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.943331 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5" Jul 09 18:06:35.977056 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.977027 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5"] Jul 09 18:06:35.980904 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:35.980874 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-reuse-27f074-openshift-default-9d8476895-mg8d5"] Jul 09 18:06:37.508955 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:37.508921 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" path="/var/lib/kubelet/pods/9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d/volumes" Jul 09 18:06:48.774744 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:06:48.774706 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:07:14.566526 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:14.566446 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm"] Jul 09 18:07:14.567018 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:14.566789 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" podUID="131119b9-9641-40cc-84c5-7889f6d74f41" containerName="istio-proxy" containerID="cri-o://cd5dfbbf53a2cac3f0e61e947ff7528163e56763aff58fe70ee87cf9d8045a69" gracePeriod=30 Jul 09 18:07:17.673334 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:17.673300 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:07:19.821942 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.821918 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:07:19.884842 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.884740 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-585xv\" (UniqueName: \"kubernetes.io/projected/131119b9-9641-40cc-84c5-7889f6d74f41-kube-api-access-585xv\") pod \"131119b9-9641-40cc-84c5-7889f6d74f41\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " Jul 09 18:07:19.884994 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.884876 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/131119b9-9641-40cc-84c5-7889f6d74f41-istiod-ca-cert\") pod \"131119b9-9641-40cc-84c5-7889f6d74f41\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " Jul 09 18:07:19.884994 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.884914 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-credential-socket\") pod \"131119b9-9641-40cc-84c5-7889f6d74f41\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " Jul 09 18:07:19.884994 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.884972 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-istio-envoy\") pod \"131119b9-9641-40cc-84c5-7889f6d74f41\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " Jul 09 18:07:19.885132 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.885006 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-workload-socket\") pod \"131119b9-9641-40cc-84c5-7889f6d74f41\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " Jul 09 18:07:19.885132 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.885029 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/131119b9-9641-40cc-84c5-7889f6d74f41-istio-podinfo\") pod \"131119b9-9641-40cc-84c5-7889f6d74f41\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " Jul 09 18:07:19.885132 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.885084 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-istio-data\") pod \"131119b9-9641-40cc-84c5-7889f6d74f41\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " Jul 09 18:07:19.885132 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.885129 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-workload-certs\") pod \"131119b9-9641-40cc-84c5-7889f6d74f41\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " Jul 09 18:07:19.885305 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.885177 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/131119b9-9641-40cc-84c5-7889f6d74f41-istio-token\") pod \"131119b9-9641-40cc-84c5-7889f6d74f41\" (UID: \"131119b9-9641-40cc-84c5-7889f6d74f41\") " Jul 09 18:07:19.885305 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.885244 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "131119b9-9641-40cc-84c5-7889f6d74f41" (UID: "131119b9-9641-40cc-84c5-7889f6d74f41"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:07:19.885423 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.885323 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/131119b9-9641-40cc-84c5-7889f6d74f41-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "131119b9-9641-40cc-84c5-7889f6d74f41" (UID: "131119b9-9641-40cc-84c5-7889f6d74f41"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:07:19.885492 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.885445 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "131119b9-9641-40cc-84c5-7889f6d74f41" (UID: "131119b9-9641-40cc-84c5-7889f6d74f41"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:07:19.885588 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.885570 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-workload-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:19.885648 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.885594 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/131119b9-9641-40cc-84c5-7889f6d74f41-istiod-ca-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:19.885648 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.885607 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-credential-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:19.885815 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.885787 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "131119b9-9641-40cc-84c5-7889f6d74f41" (UID: "131119b9-9641-40cc-84c5-7889f6d74f41"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:07:19.886084 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.886061 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-istio-data" (OuterVolumeSpecName: "istio-data") pod "131119b9-9641-40cc-84c5-7889f6d74f41" (UID: "131119b9-9641-40cc-84c5-7889f6d74f41"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:07:19.887310 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.887288 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "131119b9-9641-40cc-84c5-7889f6d74f41" (UID: "131119b9-9641-40cc-84c5-7889f6d74f41"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:07:19.887410 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.887383 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/131119b9-9641-40cc-84c5-7889f6d74f41-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "131119b9-9641-40cc-84c5-7889f6d74f41" (UID: "131119b9-9641-40cc-84c5-7889f6d74f41"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 18:07:19.887573 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.887553 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/131119b9-9641-40cc-84c5-7889f6d74f41-kube-api-access-585xv" (OuterVolumeSpecName: "kube-api-access-585xv") pod "131119b9-9641-40cc-84c5-7889f6d74f41" (UID: "131119b9-9641-40cc-84c5-7889f6d74f41"). InnerVolumeSpecName "kube-api-access-585xv". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:07:19.887664 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.887571 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/131119b9-9641-40cc-84c5-7889f6d74f41-istio-token" (OuterVolumeSpecName: "istio-token") pod "131119b9-9641-40cc-84c5-7889f6d74f41" (UID: "131119b9-9641-40cc-84c5-7889f6d74f41"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:07:19.987036 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.987000 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-istio-envoy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:19.987036 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.987029 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-workload-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:19.987036 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.987038 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/131119b9-9641-40cc-84c5-7889f6d74f41-istio-podinfo\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:19.987036 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.987045 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/131119b9-9641-40cc-84c5-7889f6d74f41-istio-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:19.987305 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.987053 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/131119b9-9641-40cc-84c5-7889f6d74f41-istio-token\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:19.987305 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:19.987061 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-585xv\" (UniqueName: \"kubernetes.io/projected/131119b9-9641-40cc-84c5-7889f6d74f41-kube-api-access-585xv\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:20.163411 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:20.163328 2565 generic.go:356] "Generic (PLEG): container finished" podID="131119b9-9641-40cc-84c5-7889f6d74f41" containerID="cd5dfbbf53a2cac3f0e61e947ff7528163e56763aff58fe70ee87cf9d8045a69" exitCode=0 Jul 09 18:07:20.163411 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:20.163380 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" Jul 09 18:07:20.163597 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:20.163383 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" event={"ID":"131119b9-9641-40cc-84c5-7889f6d74f41","Type":"ContainerDied","Data":"cd5dfbbf53a2cac3f0e61e947ff7528163e56763aff58fe70ee87cf9d8045a69"} Jul 09 18:07:20.163597 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:20.163511 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm" event={"ID":"131119b9-9641-40cc-84c5-7889f6d74f41","Type":"ContainerDied","Data":"9e58dbe66c993b849f7e91a355531751aee10f1b392e3262305541f512249cab"} Jul 09 18:07:20.163597 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:20.163541 2565 scope.go:117] "RemoveContainer" containerID="cd5dfbbf53a2cac3f0e61e947ff7528163e56763aff58fe70ee87cf9d8045a69" Jul 09 18:07:20.177812 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:20.177785 2565 scope.go:117] "RemoveContainer" containerID="dea6b2c094ee7a89e89d789695a7a65fcf8ed3672b36a21ae9252ddc7a114ea5" Jul 09 18:07:20.185895 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:20.185862 2565 scope.go:117] "RemoveContainer" containerID="cd5dfbbf53a2cac3f0e61e947ff7528163e56763aff58fe70ee87cf9d8045a69" Jul 09 18:07:20.186139 ip-10-0-138-5 kubenswrapper[2565]: E0709 18:07:20.186122 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"cd5dfbbf53a2cac3f0e61e947ff7528163e56763aff58fe70ee87cf9d8045a69\": container with ID starting with cd5dfbbf53a2cac3f0e61e947ff7528163e56763aff58fe70ee87cf9d8045a69 not found: ID does not exist" containerID="cd5dfbbf53a2cac3f0e61e947ff7528163e56763aff58fe70ee87cf9d8045a69" Jul 09 18:07:20.186203 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:20.186146 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"cd5dfbbf53a2cac3f0e61e947ff7528163e56763aff58fe70ee87cf9d8045a69"} err="failed to get container status \"cd5dfbbf53a2cac3f0e61e947ff7528163e56763aff58fe70ee87cf9d8045a69\": rpc error: code = NotFound desc = could not find container \"cd5dfbbf53a2cac3f0e61e947ff7528163e56763aff58fe70ee87cf9d8045a69\": container with ID starting with cd5dfbbf53a2cac3f0e61e947ff7528163e56763aff58fe70ee87cf9d8045a69 not found: ID does not exist" Jul 09 18:07:20.186203 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:20.186162 2565 scope.go:117] "RemoveContainer" containerID="dea6b2c094ee7a89e89d789695a7a65fcf8ed3672b36a21ae9252ddc7a114ea5" Jul 09 18:07:20.186375 ip-10-0-138-5 kubenswrapper[2565]: E0709 18:07:20.186361 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"dea6b2c094ee7a89e89d789695a7a65fcf8ed3672b36a21ae9252ddc7a114ea5\": container with ID starting with dea6b2c094ee7a89e89d789695a7a65fcf8ed3672b36a21ae9252ddc7a114ea5 not found: ID does not exist" containerID="dea6b2c094ee7a89e89d789695a7a65fcf8ed3672b36a21ae9252ddc7a114ea5" Jul 09 18:07:20.186420 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:20.186378 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"dea6b2c094ee7a89e89d789695a7a65fcf8ed3672b36a21ae9252ddc7a114ea5"} err="failed to get container status \"dea6b2c094ee7a89e89d789695a7a65fcf8ed3672b36a21ae9252ddc7a114ea5\": rpc error: code = NotFound desc = could not find container \"dea6b2c094ee7a89e89d789695a7a65fcf8ed3672b36a21ae9252ddc7a114ea5\": container with ID starting with dea6b2c094ee7a89e89d789695a7a65fcf8ed3672b36a21ae9252ddc7a114ea5 not found: ID does not exist" Jul 09 18:07:20.194945 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:20.194922 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm"] Jul 09 18:07:20.200279 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:20.200258 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-a-2fa6b6-openshift-default-75c848f555-2b5rm"] Jul 09 18:07:21.511217 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:21.511176 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="131119b9-9641-40cc-84c5-7889f6d74f41" path="/var/lib/kubelet/pods/131119b9-9641-40cc-84c5-7889f6d74f41/volumes" Jul 09 18:07:21.679822 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:21.679785 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk"] Jul 09 18:07:21.680008 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:21.679969 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" podUID="3e972790-996a-43d4-bfe6-1bca20a5ce67" containerName="istio-proxy" containerID="cri-o://fea415100f280fb47d7a87bdfb77bb34c8b6031f9f4e57abd351408ec7f2c914" gracePeriod=30 Jul 09 18:07:22.609468 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.609438 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q"] Jul 09 18:07:22.609885 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.609870 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="131119b9-9641-40cc-84c5-7889f6d74f41" containerName="istio-proxy" Jul 09 18:07:22.609940 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.609886 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="131119b9-9641-40cc-84c5-7889f6d74f41" containerName="istio-proxy" Jul 09 18:07:22.609940 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.609895 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a16a833-d54f-4cda-bd29-aadde54c0b1f" containerName="istio-proxy" Jul 09 18:07:22.609940 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.609900 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a16a833-d54f-4cda-bd29-aadde54c0b1f" containerName="istio-proxy" Jul 09 18:07:22.609940 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.609908 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" containerName="istio-proxy" Jul 09 18:07:22.609940 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.609914 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" containerName="istio-proxy" Jul 09 18:07:22.609940 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.609922 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="131119b9-9641-40cc-84c5-7889f6d74f41" containerName="istio-proxy" Jul 09 18:07:22.609940 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.609927 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="131119b9-9641-40cc-84c5-7889f6d74f41" containerName="istio-proxy" Jul 09 18:07:22.609940 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.609939 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3a16a833-d54f-4cda-bd29-aadde54c0b1f" containerName="istio-proxy" Jul 09 18:07:22.610182 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.609945 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3a16a833-d54f-4cda-bd29-aadde54c0b1f" containerName="istio-proxy" Jul 09 18:07:22.610182 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.609998 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="131119b9-9641-40cc-84c5-7889f6d74f41" containerName="istio-proxy" Jul 09 18:07:22.610182 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.610004 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" containerName="istio-proxy" Jul 09 18:07:22.610182 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.610011 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a16a833-d54f-4cda-bd29-aadde54c0b1f" containerName="istio-proxy" Jul 09 18:07:22.610182 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.610017 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="131119b9-9641-40cc-84c5-7889f6d74f41" containerName="istio-proxy" Jul 09 18:07:22.610182 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.610027 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3a16a833-d54f-4cda-bd29-aadde54c0b1f" containerName="istio-proxy" Jul 09 18:07:22.612836 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.612817 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.615271 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.615256 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-a-fe7a7c-openshift-default-dockercfg-p648p\"" Jul 09 18:07:22.623065 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.623040 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q"] Jul 09 18:07:22.712611 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.712580 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-credential-socket\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.712611 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.712613 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-55lh4\" (UniqueName: \"kubernetes.io/projected/9f6a5387-30ec-420a-ab88-2acf6e69f22a-kube-api-access-55lh4\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.712895 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.712664 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-envoy\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.712895 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.712774 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istiod-ca-cert\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.712895 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.712815 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-token\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.712895 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.712847 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-data\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.712895 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.712892 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-workload-certs\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.713156 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.712952 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-podinfo\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.713156 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.712978 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-workload-socket\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.813779 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.813716 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-envoy\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.813959 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.813786 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istiod-ca-cert\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.813959 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.813824 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-token\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.813959 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.813858 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-data\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.813959 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.813903 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-workload-certs\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.813959 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.813950 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-podinfo\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.814279 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.813978 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-workload-socket\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.814279 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.814022 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-credential-socket\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.814279 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.814047 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-55lh4\" (UniqueName: \"kubernetes.io/projected/9f6a5387-30ec-420a-ab88-2acf6e69f22a-kube-api-access-55lh4\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.814456 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.814279 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-data\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.814456 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.814311 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-workload-certs\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.814456 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.814396 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-workload-socket\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.814623 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.814493 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-credential-socket\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.814679 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.814657 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istiod-ca-cert\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.816039 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.816018 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-envoy\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.816314 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.816297 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-podinfo\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.822170 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.822146 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-token\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.822840 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.822816 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-55lh4\" (UniqueName: \"kubernetes.io/projected/9f6a5387-30ec-420a-ab88-2acf6e69f22a-kube-api-access-55lh4\") pod \"e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:22.924425 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:22.924344 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:23.064571 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:23.064532 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q"] Jul 09 18:07:23.066844 ip-10-0-138-5 kubenswrapper[2565]: W0709 18:07:23.066818 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod9f6a5387_30ec_420a_ab88_2acf6e69f22a.slice/crio-7833ac8f634403fabcea3c96193cd071bc33bc7b0b37222b45d6e293f4bebe5e WatchSource:0}: Error finding container 7833ac8f634403fabcea3c96193cd071bc33bc7b0b37222b45d6e293f4bebe5e: Status 404 returned error can't find the container with id 7833ac8f634403fabcea3c96193cd071bc33bc7b0b37222b45d6e293f4bebe5e Jul 09 18:07:23.068949 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:23.068912 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:07:23.069070 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:23.069013 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:07:23.069070 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:23.069061 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:07:23.181300 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:23.181211 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" event={"ID":"9f6a5387-30ec-420a-ab88-2acf6e69f22a","Type":"ContainerStarted","Data":"f3b3f1f3ea30850dd7e755ebfee0f8507795ecac67686765f3f1d00902b9df65"} Jul 09 18:07:23.181300 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:23.181276 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" event={"ID":"9f6a5387-30ec-420a-ab88-2acf6e69f22a","Type":"ContainerStarted","Data":"7833ac8f634403fabcea3c96193cd071bc33bc7b0b37222b45d6e293f4bebe5e"} Jul 09 18:07:23.202564 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:23.202513 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" podStartSLOduration=1.202496931 podStartE2EDuration="1.202496931s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:07:22 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:07:23.20053572 +0000 UTC m=+2356.257004255" watchObservedRunningTime="2026-07-09 18:07:23.202496931 +0000 UTC m=+2356.258965495" Jul 09 18:07:23.924879 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:23.924834 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:24.929919 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:24.929887 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:25.190928 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:25.190849 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:25.191720 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:25.191704 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:26.935204 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:26.935181 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:07:27.060966 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.060936 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-token\") pod \"3e972790-996a-43d4-bfe6-1bca20a5ce67\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " Jul 09 18:07:27.061133 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.060991 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-envoy\") pod \"3e972790-996a-43d4-bfe6-1bca20a5ce67\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " Jul 09 18:07:27.061133 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.061080 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-workload-socket\") pod \"3e972790-996a-43d4-bfe6-1bca20a5ce67\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " Jul 09 18:07:27.061133 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.061114 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-podinfo\") pod \"3e972790-996a-43d4-bfe6-1bca20a5ce67\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " Jul 09 18:07:27.061292 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.061150 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-credential-socket\") pod \"3e972790-996a-43d4-bfe6-1bca20a5ce67\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " Jul 09 18:07:27.061292 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.061178 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-data\") pod \"3e972790-996a-43d4-bfe6-1bca20a5ce67\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " Jul 09 18:07:27.061292 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.061214 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e972790-996a-43d4-bfe6-1bca20a5ce67-istiod-ca-cert\") pod \"3e972790-996a-43d4-bfe6-1bca20a5ce67\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " Jul 09 18:07:27.061292 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.061239 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-28rzb\" (UniqueName: \"kubernetes.io/projected/3e972790-996a-43d4-bfe6-1bca20a5ce67-kube-api-access-28rzb\") pod \"3e972790-996a-43d4-bfe6-1bca20a5ce67\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " Jul 09 18:07:27.061292 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.061268 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-workload-certs\") pod \"3e972790-996a-43d4-bfe6-1bca20a5ce67\" (UID: \"3e972790-996a-43d4-bfe6-1bca20a5ce67\") " Jul 09 18:07:27.061538 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.061438 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "3e972790-996a-43d4-bfe6-1bca20a5ce67" (UID: "3e972790-996a-43d4-bfe6-1bca20a5ce67"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:07:27.061538 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.061465 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "3e972790-996a-43d4-bfe6-1bca20a5ce67" (UID: "3e972790-996a-43d4-bfe6-1bca20a5ce67"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:07:27.061901 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.061740 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-workload-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:27.061901 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.061829 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-credential-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:27.061901 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.061866 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "3e972790-996a-43d4-bfe6-1bca20a5ce67" (UID: "3e972790-996a-43d4-bfe6-1bca20a5ce67"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:07:27.061901 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.061886 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/3e972790-996a-43d4-bfe6-1bca20a5ce67-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "3e972790-996a-43d4-bfe6-1bca20a5ce67" (UID: "3e972790-996a-43d4-bfe6-1bca20a5ce67"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:07:27.062132 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.062113 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-data" (OuterVolumeSpecName: "istio-data") pod "3e972790-996a-43d4-bfe6-1bca20a5ce67" (UID: "3e972790-996a-43d4-bfe6-1bca20a5ce67"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:07:27.063847 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.063824 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-token" (OuterVolumeSpecName: "istio-token") pod "3e972790-996a-43d4-bfe6-1bca20a5ce67" (UID: "3e972790-996a-43d4-bfe6-1bca20a5ce67"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:07:27.063847 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.063840 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "3e972790-996a-43d4-bfe6-1bca20a5ce67" (UID: "3e972790-996a-43d4-bfe6-1bca20a5ce67"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:07:27.063943 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.063829 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/3e972790-996a-43d4-bfe6-1bca20a5ce67-kube-api-access-28rzb" (OuterVolumeSpecName: "kube-api-access-28rzb") pod "3e972790-996a-43d4-bfe6-1bca20a5ce67" (UID: "3e972790-996a-43d4-bfe6-1bca20a5ce67"). InnerVolumeSpecName "kube-api-access-28rzb". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:07:27.063943 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.063848 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "3e972790-996a-43d4-bfe6-1bca20a5ce67" (UID: "3e972790-996a-43d4-bfe6-1bca20a5ce67"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 18:07:27.163263 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.163230 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-token\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:27.163263 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.163258 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-envoy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:27.163263 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.163267 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-podinfo\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:27.163486 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.163277 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-istio-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:27.163486 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.163285 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/3e972790-996a-43d4-bfe6-1bca20a5ce67-istiod-ca-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:27.163486 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.163293 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-28rzb\" (UniqueName: \"kubernetes.io/projected/3e972790-996a-43d4-bfe6-1bca20a5ce67-kube-api-access-28rzb\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:27.163486 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.163304 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/3e972790-996a-43d4-bfe6-1bca20a5ce67-workload-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:27.202401 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.202374 2565 generic.go:356] "Generic (PLEG): container finished" podID="3e972790-996a-43d4-bfe6-1bca20a5ce67" containerID="fea415100f280fb47d7a87bdfb77bb34c8b6031f9f4e57abd351408ec7f2c914" exitCode=0 Jul 09 18:07:27.202520 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.202424 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" Jul 09 18:07:27.202520 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.202422 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" event={"ID":"3e972790-996a-43d4-bfe6-1bca20a5ce67","Type":"ContainerDied","Data":"fea415100f280fb47d7a87bdfb77bb34c8b6031f9f4e57abd351408ec7f2c914"} Jul 09 18:07:27.202520 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.202482 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk" event={"ID":"3e972790-996a-43d4-bfe6-1bca20a5ce67","Type":"ContainerDied","Data":"b014a609c2074746807b1572ee48e2b1d428b6683b596f6698744e3d24040348"} Jul 09 18:07:27.202520 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.202508 2565 scope.go:117] "RemoveContainer" containerID="fea415100f280fb47d7a87bdfb77bb34c8b6031f9f4e57abd351408ec7f2c914" Jul 09 18:07:27.212000 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.211971 2565 scope.go:117] "RemoveContainer" containerID="100850f20733f4ba618426984adc6ad5d7e948b4b1d761c638f062f101e9f00a" Jul 09 18:07:27.226895 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.226868 2565 scope.go:117] "RemoveContainer" containerID="fea415100f280fb47d7a87bdfb77bb34c8b6031f9f4e57abd351408ec7f2c914" Jul 09 18:07:27.227218 ip-10-0-138-5 kubenswrapper[2565]: E0709 18:07:27.227196 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"fea415100f280fb47d7a87bdfb77bb34c8b6031f9f4e57abd351408ec7f2c914\": container with ID starting with fea415100f280fb47d7a87bdfb77bb34c8b6031f9f4e57abd351408ec7f2c914 not found: ID does not exist" containerID="fea415100f280fb47d7a87bdfb77bb34c8b6031f9f4e57abd351408ec7f2c914" Jul 09 18:07:27.227302 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.227230 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"fea415100f280fb47d7a87bdfb77bb34c8b6031f9f4e57abd351408ec7f2c914"} err="failed to get container status \"fea415100f280fb47d7a87bdfb77bb34c8b6031f9f4e57abd351408ec7f2c914\": rpc error: code = NotFound desc = could not find container \"fea415100f280fb47d7a87bdfb77bb34c8b6031f9f4e57abd351408ec7f2c914\": container with ID starting with fea415100f280fb47d7a87bdfb77bb34c8b6031f9f4e57abd351408ec7f2c914 not found: ID does not exist" Jul 09 18:07:27.227302 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.227248 2565 scope.go:117] "RemoveContainer" containerID="100850f20733f4ba618426984adc6ad5d7e948b4b1d761c638f062f101e9f00a" Jul 09 18:07:27.227546 ip-10-0-138-5 kubenswrapper[2565]: E0709 18:07:27.227525 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"100850f20733f4ba618426984adc6ad5d7e948b4b1d761c638f062f101e9f00a\": container with ID starting with 100850f20733f4ba618426984adc6ad5d7e948b4b1d761c638f062f101e9f00a not found: ID does not exist" containerID="100850f20733f4ba618426984adc6ad5d7e948b4b1d761c638f062f101e9f00a" Jul 09 18:07:27.227597 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.227553 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"100850f20733f4ba618426984adc6ad5d7e948b4b1d761c638f062f101e9f00a"} err="failed to get container status \"100850f20733f4ba618426984adc6ad5d7e948b4b1d761c638f062f101e9f00a\": rpc error: code = NotFound desc = could not find container \"100850f20733f4ba618426984adc6ad5d7e948b4b1d761c638f062f101e9f00a\": container with ID starting with 100850f20733f4ba618426984adc6ad5d7e948b4b1d761c638f062f101e9f00a not found: ID does not exist" Jul 09 18:07:27.229717 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.229697 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk"] Jul 09 18:07:27.231405 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.231386 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-inf-b-712c34-openshift-default-b4587bf87-mkxdk"] Jul 09 18:07:27.508910 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:27.508834 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="3e972790-996a-43d4-bfe6-1bca20a5ce67" path="/var/lib/kubelet/pods/3e972790-996a-43d4-bfe6-1bca20a5ce67/volumes" Jul 09 18:07:30.453881 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.453852 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc"] Jul 09 18:07:30.454272 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.454259 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" containerName="istio-proxy" Jul 09 18:07:30.454272 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.454273 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" containerName="istio-proxy" Jul 09 18:07:30.454351 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.454287 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e972790-996a-43d4-bfe6-1bca20a5ce67" containerName="istio-proxy" Jul 09 18:07:30.454351 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.454293 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e972790-996a-43d4-bfe6-1bca20a5ce67" containerName="istio-proxy" Jul 09 18:07:30.454351 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.454310 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="3e972790-996a-43d4-bfe6-1bca20a5ce67" containerName="istio-proxy" Jul 09 18:07:30.454351 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.454316 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="3e972790-996a-43d4-bfe6-1bca20a5ce67" containerName="istio-proxy" Jul 09 18:07:30.454733 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.454377 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f15bbdc-a2bc-4884-9ce0-58232ffa3a1d" containerName="istio-proxy" Jul 09 18:07:30.454733 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.454387 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e972790-996a-43d4-bfe6-1bca20a5ce67" containerName="istio-proxy" Jul 09 18:07:30.454733 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.454393 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="3e972790-996a-43d4-bfe6-1bca20a5ce67" containerName="istio-proxy" Jul 09 18:07:30.457717 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.457695 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.460003 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.459984 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-api-b-589edb-openshift-default-dockercfg-8ts8k\"" Jul 09 18:07:30.471045 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.471020 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc"] Jul 09 18:07:30.597928 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.597893 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caac7ea7-56aa-4b5f-9de7-370d41e83363-istiod-ca-cert\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.598119 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.597935 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-token\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.598119 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.597966 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-podinfo\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.598119 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.597992 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-credential-socket\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.598119 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.598019 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-mbwwm\" (UniqueName: \"kubernetes.io/projected/caac7ea7-56aa-4b5f-9de7-370d41e83363-kube-api-access-mbwwm\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.598119 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.598084 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-workload-certs\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.598119 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.598112 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-data\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.598380 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.598140 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-envoy\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.598380 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.598219 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-workload-socket\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.699097 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.699064 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-envoy\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.699275 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.699119 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-workload-socket\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.699275 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.699170 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caac7ea7-56aa-4b5f-9de7-370d41e83363-istiod-ca-cert\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.699275 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.699190 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-token\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.699275 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.699209 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-podinfo\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.699445 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.699329 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-credential-socket\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.699445 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.699371 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-mbwwm\" (UniqueName: \"kubernetes.io/projected/caac7ea7-56aa-4b5f-9de7-370d41e83363-kube-api-access-mbwwm\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.699445 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.699421 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-workload-certs\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.699589 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.699456 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-data\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.699589 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.699581 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-workload-socket\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.699816 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.699794 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-data\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.699919 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.699868 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-credential-socket\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.699959 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.699934 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-workload-certs\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.700013 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.699996 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caac7ea7-56aa-4b5f-9de7-370d41e83363-istiod-ca-cert\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.701375 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.701353 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-envoy\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.701654 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.701636 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-podinfo\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.709508 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.709439 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-token\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.709725 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.709705 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-mbwwm\" (UniqueName: \"kubernetes.io/projected/caac7ea7-56aa-4b5f-9de7-370d41e83363-kube-api-access-mbwwm\") pod \"e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.768968 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.768940 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:30.905782 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.905747 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc"] Jul 09 18:07:30.907854 ip-10-0-138-5 kubenswrapper[2565]: W0709 18:07:30.907820 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podcaac7ea7_56aa_4b5f_9de7_370d41e83363.slice/crio-4594bc0ce563209b4a81a383aa27422a823effd2a2bfda2c8a4e31502ee64853 WatchSource:0}: Error finding container 4594bc0ce563209b4a81a383aa27422a823effd2a2bfda2c8a4e31502ee64853: Status 404 returned error can't find the container with id 4594bc0ce563209b4a81a383aa27422a823effd2a2bfda2c8a4e31502ee64853 Jul 09 18:07:30.910366 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.910335 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:07:30.910452 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.910397 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:07:30.910452 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:30.910444 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:07:31.224081 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:31.223989 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" event={"ID":"caac7ea7-56aa-4b5f-9de7-370d41e83363","Type":"ContainerStarted","Data":"caa14de30a6ff05d0fbd354e1b041d9d0613faefe52d9c226df2f6e978e870e4"} Jul 09 18:07:31.224081 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:31.224052 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" event={"ID":"caac7ea7-56aa-4b5f-9de7-370d41e83363","Type":"ContainerStarted","Data":"4594bc0ce563209b4a81a383aa27422a823effd2a2bfda2c8a4e31502ee64853"} Jul 09 18:07:31.245218 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:31.245168 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" podStartSLOduration=1.245152479 podStartE2EDuration="1.245152479s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:07:30 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:07:31.244356125 +0000 UTC m=+2364.300824618" watchObservedRunningTime="2026-07-09 18:07:31.245152479 +0000 UTC m=+2364.301620979" Jul 09 18:07:31.769082 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:31.769043 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:31.774056 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:31.774032 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:32.229796 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:32.229742 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:32.230577 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:32.230551 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:32.473975 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:32.473946 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:07:41.231954 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:41.231905 2565 patch_prober.go:28] interesting pod/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" start-of-body= Jul 09 18:07:41.232348 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:41.231977 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" podUID="9f6a5387-30ec-420a-ab88-2acf6e69f22a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": context deadline exceeded (Client.Timeout exceeded while awaiting headers)" Jul 09 18:07:42.282795 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:42.282740 2565 generic.go:356] "Generic (PLEG): container finished" podID="9f6a5387-30ec-420a-ab88-2acf6e69f22a" containerID="f3b3f1f3ea30850dd7e755ebfee0f8507795ecac67686765f3f1d00902b9df65" exitCode=0 Jul 09 18:07:42.283215 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:42.282813 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" event={"ID":"9f6a5387-30ec-420a-ab88-2acf6e69f22a","Type":"ContainerDied","Data":"f3b3f1f3ea30850dd7e755ebfee0f8507795ecac67686765f3f1d00902b9df65"} Jul 09 18:07:42.283260 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:42.283226 2565 scope.go:117] "RemoveContainer" containerID="f3b3f1f3ea30850dd7e755ebfee0f8507795ecac67686765f3f1d00902b9df65" Jul 09 18:07:42.284283 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:42.284254 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:07:42.284364 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:42.284349 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:07:42.284404 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:42.284388 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:07:43.290401 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:43.290367 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" event={"ID":"9f6a5387-30ec-420a-ab88-2acf6e69f22a","Type":"ContainerStarted","Data":"65d730c97eb9dfe8fbeafa99df64631cae7e48e004c81c64660707017eda698a"} Jul 09 18:07:43.925789 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:43.925737 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:43.926012 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:43.925885 2565 patch_prober.go:28] interesting pod/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 09 18:07:43.926012 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:43.925928 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" podUID="9f6a5387-30ec-420a-ab88-2acf6e69f22a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 09 18:07:44.925594 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:44.925110 2565 patch_prober.go:28] interesting pod/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 09 18:07:44.925594 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:44.925173 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" podUID="9f6a5387-30ec-420a-ab88-2acf6e69f22a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 09 18:07:45.924984 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:45.924934 2565 patch_prober.go:28] interesting pod/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 09 18:07:45.925179 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:45.925022 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" podUID="9f6a5387-30ec-420a-ab88-2acf6e69f22a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 09 18:07:46.925338 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:46.925289 2565 patch_prober.go:28] interesting pod/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" start-of-body= Jul 09 18:07:46.925849 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:46.925428 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" podUID="9f6a5387-30ec-420a-ab88-2acf6e69f22a" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.45:15021/healthz/ready\": dial tcp 10.134.0.45:15021: connect: connection refused" Jul 09 18:07:47.928544 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:47.928515 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:47.929001 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:47.928868 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:47.929661 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:47.929641 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:50.088917 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:50.088880 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:07:50.330184 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:50.330153 2565 generic.go:356] "Generic (PLEG): container finished" podID="caac7ea7-56aa-4b5f-9de7-370d41e83363" containerID="caa14de30a6ff05d0fbd354e1b041d9d0613faefe52d9c226df2f6e978e870e4" exitCode=0 Jul 09 18:07:50.330411 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:50.330222 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" event={"ID":"caac7ea7-56aa-4b5f-9de7-370d41e83363","Type":"ContainerDied","Data":"caa14de30a6ff05d0fbd354e1b041d9d0613faefe52d9c226df2f6e978e870e4"} Jul 09 18:07:50.330625 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:50.330611 2565 scope.go:117] "RemoveContainer" containerID="caa14de30a6ff05d0fbd354e1b041d9d0613faefe52d9c226df2f6e978e870e4" Jul 09 18:07:50.331617 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:50.331593 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:07:50.331671 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:50.331657 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:07:50.331710 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:50.331688 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:07:51.340871 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:51.340827 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" event={"ID":"caac7ea7-56aa-4b5f-9de7-370d41e83363","Type":"ContainerStarted","Data":"a50770c91f8ae109e5bdb901cda591af8e89488f2b20239db35f3ddc67ccd44b"} Jul 09 18:07:51.770207 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:51.770116 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:51.770361 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:51.770291 2565 patch_prober.go:28] interesting pod/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 09 18:07:51.770361 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:51.770339 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" podUID="caac7ea7-56aa-4b5f-9de7-370d41e83363" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 09 18:07:52.582627 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:52.582591 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q"] Jul 09 18:07:52.583068 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:52.582854 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" podUID="9f6a5387-30ec-420a-ab88-2acf6e69f22a" containerName="istio-proxy" containerID="cri-o://65d730c97eb9dfe8fbeafa99df64631cae7e48e004c81c64660707017eda698a" gracePeriod=30 Jul 09 18:07:52.769366 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:52.769329 2565 patch_prober.go:28] interesting pod/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 09 18:07:52.769542 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:52.769391 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" podUID="caac7ea7-56aa-4b5f-9de7-370d41e83363" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 09 18:07:53.769936 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:53.769899 2565 patch_prober.go:28] interesting pod/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 09 18:07:53.770339 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:53.769954 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" podUID="caac7ea7-56aa-4b5f-9de7-370d41e83363" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 09 18:07:54.770067 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:54.770031 2565 patch_prober.go:28] interesting pod/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" start-of-body= Jul 09 18:07:54.770461 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:54.770085 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" podUID="caac7ea7-56aa-4b5f-9de7-370d41e83363" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.46:15021/healthz/ready\": dial tcp 10.134.0.46:15021: connect: connection refused" Jul 09 18:07:55.773149 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:55.773120 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:55.773583 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:55.773358 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:55.774310 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:55.774293 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:07:57.838274 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.838240 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:57.988095 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.988014 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-credential-socket\") pod \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " Jul 09 18:07:57.988095 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.988059 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istiod-ca-cert\") pod \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " Jul 09 18:07:57.988095 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.988092 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-podinfo\") pod \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " Jul 09 18:07:57.988386 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.988121 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-token\") pod \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " Jul 09 18:07:57.988386 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.988147 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-55lh4\" (UniqueName: \"kubernetes.io/projected/9f6a5387-30ec-420a-ab88-2acf6e69f22a-kube-api-access-55lh4\") pod \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " Jul 09 18:07:57.988386 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.988172 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-data\") pod \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " Jul 09 18:07:57.988386 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.988245 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-workload-socket\") pod \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " Jul 09 18:07:57.988386 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.988275 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-envoy\") pod \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " Jul 09 18:07:57.988386 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.988293 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "9f6a5387-30ec-420a-ab88-2acf6e69f22a" (UID: "9f6a5387-30ec-420a-ab88-2acf6e69f22a"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:07:57.988386 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.988308 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-workload-certs\") pod \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\" (UID: \"9f6a5387-30ec-420a-ab88-2acf6e69f22a\") " Jul 09 18:07:57.988793 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.988408 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "9f6a5387-30ec-420a-ab88-2acf6e69f22a" (UID: "9f6a5387-30ec-420a-ab88-2acf6e69f22a"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:07:57.988793 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.988555 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "9f6a5387-30ec-420a-ab88-2acf6e69f22a" (UID: "9f6a5387-30ec-420a-ab88-2acf6e69f22a"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:07:57.988793 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.988566 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "9f6a5387-30ec-420a-ab88-2acf6e69f22a" (UID: "9f6a5387-30ec-420a-ab88-2acf6e69f22a"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:07:57.988971 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.988794 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-workload-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:57.988971 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.988813 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-workload-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:57.988971 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.988827 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-credential-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:57.988971 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.988841 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istiod-ca-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:57.989267 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.989246 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-data" (OuterVolumeSpecName: "istio-data") pod "9f6a5387-30ec-420a-ab88-2acf6e69f22a" (UID: "9f6a5387-30ec-420a-ab88-2acf6e69f22a"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:07:57.990927 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.990904 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "9f6a5387-30ec-420a-ab88-2acf6e69f22a" (UID: "9f6a5387-30ec-420a-ab88-2acf6e69f22a"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 18:07:57.990927 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.990910 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "9f6a5387-30ec-420a-ab88-2acf6e69f22a" (UID: "9f6a5387-30ec-420a-ab88-2acf6e69f22a"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:07:57.991055 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.990912 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f6a5387-30ec-420a-ab88-2acf6e69f22a-kube-api-access-55lh4" (OuterVolumeSpecName: "kube-api-access-55lh4") pod "9f6a5387-30ec-420a-ab88-2acf6e69f22a" (UID: "9f6a5387-30ec-420a-ab88-2acf6e69f22a"). InnerVolumeSpecName "kube-api-access-55lh4". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:07:57.991055 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:57.990927 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-token" (OuterVolumeSpecName: "istio-token") pod "9f6a5387-30ec-420a-ab88-2acf6e69f22a" (UID: "9f6a5387-30ec-420a-ab88-2acf6e69f22a"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:07:58.089946 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:58.089925 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:58.089946 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:58.089945 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-envoy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:58.090090 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:58.089953 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-podinfo\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:58.090090 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:58.089962 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/9f6a5387-30ec-420a-ab88-2acf6e69f22a-istio-token\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:58.090090 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:58.089970 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-55lh4\" (UniqueName: \"kubernetes.io/projected/9f6a5387-30ec-420a-ab88-2acf6e69f22a-kube-api-access-55lh4\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:07:58.379847 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:58.379817 2565 generic.go:356] "Generic (PLEG): container finished" podID="9f6a5387-30ec-420a-ab88-2acf6e69f22a" containerID="65d730c97eb9dfe8fbeafa99df64631cae7e48e004c81c64660707017eda698a" exitCode=0 Jul 09 18:07:58.380031 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:58.379869 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" Jul 09 18:07:58.380031 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:58.379871 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" event={"ID":"9f6a5387-30ec-420a-ab88-2acf6e69f22a","Type":"ContainerDied","Data":"65d730c97eb9dfe8fbeafa99df64631cae7e48e004c81c64660707017eda698a"} Jul 09 18:07:58.380031 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:58.380002 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q" event={"ID":"9f6a5387-30ec-420a-ab88-2acf6e69f22a","Type":"ContainerDied","Data":"7833ac8f634403fabcea3c96193cd071bc33bc7b0b37222b45d6e293f4bebe5e"} Jul 09 18:07:58.380277 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:58.380041 2565 scope.go:117] "RemoveContainer" containerID="65d730c97eb9dfe8fbeafa99df64631cae7e48e004c81c64660707017eda698a" Jul 09 18:07:58.389611 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:58.389593 2565 scope.go:117] "RemoveContainer" containerID="f3b3f1f3ea30850dd7e755ebfee0f8507795ecac67686765f3f1d00902b9df65" Jul 09 18:07:58.397240 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:58.397220 2565 scope.go:117] "RemoveContainer" containerID="65d730c97eb9dfe8fbeafa99df64631cae7e48e004c81c64660707017eda698a" Jul 09 18:07:58.397464 ip-10-0-138-5 kubenswrapper[2565]: E0709 18:07:58.397446 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"65d730c97eb9dfe8fbeafa99df64631cae7e48e004c81c64660707017eda698a\": container with ID starting with 65d730c97eb9dfe8fbeafa99df64631cae7e48e004c81c64660707017eda698a not found: ID does not exist" containerID="65d730c97eb9dfe8fbeafa99df64631cae7e48e004c81c64660707017eda698a" Jul 09 18:07:58.397512 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:58.397472 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"65d730c97eb9dfe8fbeafa99df64631cae7e48e004c81c64660707017eda698a"} err="failed to get container status \"65d730c97eb9dfe8fbeafa99df64631cae7e48e004c81c64660707017eda698a\": rpc error: code = NotFound desc = could not find container \"65d730c97eb9dfe8fbeafa99df64631cae7e48e004c81c64660707017eda698a\": container with ID starting with 65d730c97eb9dfe8fbeafa99df64631cae7e48e004c81c64660707017eda698a not found: ID does not exist" Jul 09 18:07:58.397512 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:58.397489 2565 scope.go:117] "RemoveContainer" containerID="f3b3f1f3ea30850dd7e755ebfee0f8507795ecac67686765f3f1d00902b9df65" Jul 09 18:07:58.397746 ip-10-0-138-5 kubenswrapper[2565]: E0709 18:07:58.397728 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"f3b3f1f3ea30850dd7e755ebfee0f8507795ecac67686765f3f1d00902b9df65\": container with ID starting with f3b3f1f3ea30850dd7e755ebfee0f8507795ecac67686765f3f1d00902b9df65 not found: ID does not exist" containerID="f3b3f1f3ea30850dd7e755ebfee0f8507795ecac67686765f3f1d00902b9df65" Jul 09 18:07:58.397818 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:58.397751 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"f3b3f1f3ea30850dd7e755ebfee0f8507795ecac67686765f3f1d00902b9df65"} err="failed to get container status \"f3b3f1f3ea30850dd7e755ebfee0f8507795ecac67686765f3f1d00902b9df65\": rpc error: code = NotFound desc = could not find container \"f3b3f1f3ea30850dd7e755ebfee0f8507795ecac67686765f3f1d00902b9df65\": container with ID starting with f3b3f1f3ea30850dd7e755ebfee0f8507795ecac67686765f3f1d00902b9df65 not found: ID does not exist" Jul 09 18:07:58.401216 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:58.401195 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q"] Jul 09 18:07:58.408738 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:58.408713 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-a-fe7a7c-openshift-default-6968b49cb9-5js9q"] Jul 09 18:07:59.508047 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:07:59.508019 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="9f6a5387-30ec-420a-ab88-2acf6e69f22a" path="/var/lib/kubelet/pods/9f6a5387-30ec-420a-ab88-2acf6e69f22a/volumes" Jul 09 18:08:07.471128 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:07.471089 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:08:07.606312 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:07.606280 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 18:08:07.611340 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:07.611321 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 18:08:09.987598 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:09.987560 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc"] Jul 09 18:08:09.988106 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:09.987822 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" podUID="caac7ea7-56aa-4b5f-9de7-370d41e83363" containerName="istio-proxy" containerID="cri-o://a50770c91f8ae109e5bdb901cda591af8e89488f2b20239db35f3ddc67ccd44b" gracePeriod=30 Jul 09 18:08:10.775680 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:10.775648 2565 patch_prober.go:28] interesting pod/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc container/istio-proxy namespace/openshift-ingress: Readiness probe status=failure output="HTTP probe failed with statuscode: 503" start-of-body= Jul 09 18:08:10.775856 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:10.775701 2565 prober.go:120] "Probe failed" probeType="Readiness" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" podUID="caac7ea7-56aa-4b5f-9de7-370d41e83363" containerName="istio-proxy" probeResult="failure" output="HTTP probe failed with statuscode: 503" Jul 09 18:08:10.905061 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:10.905022 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv"] Jul 09 18:08:10.905432 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:10.905418 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f6a5387-30ec-420a-ab88-2acf6e69f22a" containerName="istio-proxy" Jul 09 18:08:10.905432 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:10.905432 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f6a5387-30ec-420a-ab88-2acf6e69f22a" containerName="istio-proxy" Jul 09 18:08:10.905569 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:10.905449 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="9f6a5387-30ec-420a-ab88-2acf6e69f22a" containerName="istio-proxy" Jul 09 18:08:10.905569 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:10.905455 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="9f6a5387-30ec-420a-ab88-2acf6e69f22a" containerName="istio-proxy" Jul 09 18:08:10.905569 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:10.905516 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f6a5387-30ec-420a-ab88-2acf6e69f22a" containerName="istio-proxy" Jul 09 18:08:10.905569 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:10.905525 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="9f6a5387-30ec-420a-ab88-2acf6e69f22a" containerName="istio-proxy" Jul 09 18:08:10.908524 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:10.908505 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:10.910858 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:10.910835 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-a-09d279-openshift-default-dockercfg-d9tp2\"" Jul 09 18:08:10.918512 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:10.918483 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv"] Jul 09 18:08:11.006335 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.006296 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-workload-certs\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.006799 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.006390 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-podinfo\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.006799 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.006450 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-bpd7w\" (UniqueName: \"kubernetes.io/projected/c26fed51-5364-4225-a6da-e7b20365e2f4-kube-api-access-bpd7w\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.006799 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.006490 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-envoy\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.006799 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.006531 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-credential-socket\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.006799 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.006551 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c26fed51-5364-4225-a6da-e7b20365e2f4-istiod-ca-cert\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.006799 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.006596 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-token\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.006799 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.006610 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-data\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.006799 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.006642 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-workload-socket\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.107709 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.107675 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-podinfo\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.107919 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.107731 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-bpd7w\" (UniqueName: \"kubernetes.io/projected/c26fed51-5364-4225-a6da-e7b20365e2f4-kube-api-access-bpd7w\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.107919 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.107796 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-envoy\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.107919 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.107841 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-credential-socket\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.108086 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.108016 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c26fed51-5364-4225-a6da-e7b20365e2f4-istiod-ca-cert\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.108148 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.108081 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-token\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.108148 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.108109 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-data\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.108266 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.108146 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-workload-socket\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.108266 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.108217 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-workload-certs\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.108365 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.108312 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-credential-socket\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.108488 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.108463 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-data\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.108664 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.108639 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-workload-certs\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.108818 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.108683 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-workload-socket\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.108818 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.108802 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c26fed51-5364-4225-a6da-e7b20365e2f4-istiod-ca-cert\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.110193 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.110174 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-envoy\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.110417 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.110397 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-podinfo\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.115110 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.115089 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-token\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.115438 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.115422 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-bpd7w\" (UniqueName: \"kubernetes.io/projected/c26fed51-5364-4225-a6da-e7b20365e2f4-kube-api-access-bpd7w\") pod \"e2e-shared-a-09d279-openshift-default-8554b9495-trptv\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.221073 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.221044 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:11.355982 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.355958 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv"] Jul 09 18:08:11.358228 ip-10-0-138-5 kubenswrapper[2565]: W0709 18:08:11.358177 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-podc26fed51_5364_4225_a6da_e7b20365e2f4.slice/crio-c84c89541c3912c8f0892fc3a2c50b0adbd686cbc0e2c64578397ca547a32448 WatchSource:0}: Error finding container c84c89541c3912c8f0892fc3a2c50b0adbd686cbc0e2c64578397ca547a32448: Status 404 returned error can't find the container with id c84c89541c3912c8f0892fc3a2c50b0adbd686cbc0e2c64578397ca547a32448 Jul 09 18:08:11.360912 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.360877 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:08:11.361029 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.360954 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:08:11.361029 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.360999 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:08:11.462207 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.462170 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" event={"ID":"c26fed51-5364-4225-a6da-e7b20365e2f4","Type":"ContainerStarted","Data":"d9b9689dd3862a7dd5930ffc8d1e100a9e458e5da87f4ec52dbae6a08abd4fc7"} Jul 09 18:08:11.462394 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.462262 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" event={"ID":"c26fed51-5364-4225-a6da-e7b20365e2f4","Type":"ContainerStarted","Data":"c84c89541c3912c8f0892fc3a2c50b0adbd686cbc0e2c64578397ca547a32448"} Jul 09 18:08:11.483066 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:11.483019 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" podStartSLOduration=1.483003221 podStartE2EDuration="1.483003221s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:08:10 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:08:11.482042871 +0000 UTC m=+2404.538511398" watchObservedRunningTime="2026-07-09 18:08:11.483003221 +0000 UTC m=+2404.539471720" Jul 09 18:08:12.221540 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:12.221509 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:12.226240 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:12.226218 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:12.466774 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:12.466740 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:12.467800 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:12.467781 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:15.249772 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.249697 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:08:15.348130 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.348098 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-workload-certs\") pod \"caac7ea7-56aa-4b5f-9de7-370d41e83363\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " Jul 09 18:08:15.348130 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.348134 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-podinfo\") pod \"caac7ea7-56aa-4b5f-9de7-370d41e83363\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " Jul 09 18:08:15.348385 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.348159 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-credential-socket\") pod \"caac7ea7-56aa-4b5f-9de7-370d41e83363\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " Jul 09 18:08:15.348385 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.348182 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-token\") pod \"caac7ea7-56aa-4b5f-9de7-370d41e83363\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " Jul 09 18:08:15.348385 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.348198 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-data\") pod \"caac7ea7-56aa-4b5f-9de7-370d41e83363\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " Jul 09 18:08:15.348385 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.348245 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-mbwwm\" (UniqueName: \"kubernetes.io/projected/caac7ea7-56aa-4b5f-9de7-370d41e83363-kube-api-access-mbwwm\") pod \"caac7ea7-56aa-4b5f-9de7-370d41e83363\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " Jul 09 18:08:15.348385 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.348265 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-workload-socket\") pod \"caac7ea7-56aa-4b5f-9de7-370d41e83363\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " Jul 09 18:08:15.348385 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.348313 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caac7ea7-56aa-4b5f-9de7-370d41e83363-istiod-ca-cert\") pod \"caac7ea7-56aa-4b5f-9de7-370d41e83363\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " Jul 09 18:08:15.348385 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.348368 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-envoy\") pod \"caac7ea7-56aa-4b5f-9de7-370d41e83363\" (UID: \"caac7ea7-56aa-4b5f-9de7-370d41e83363\") " Jul 09 18:08:15.348723 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.348440 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "caac7ea7-56aa-4b5f-9de7-370d41e83363" (UID: "caac7ea7-56aa-4b5f-9de7-370d41e83363"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:08:15.348723 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.348449 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "caac7ea7-56aa-4b5f-9de7-370d41e83363" (UID: "caac7ea7-56aa-4b5f-9de7-370d41e83363"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:08:15.348723 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.348638 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "caac7ea7-56aa-4b5f-9de7-370d41e83363" (UID: "caac7ea7-56aa-4b5f-9de7-370d41e83363"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:08:15.348915 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.348806 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-workload-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:08:15.348915 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.348829 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-credential-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:08:15.348915 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.348844 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-workload-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:08:15.349159 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.349130 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/caac7ea7-56aa-4b5f-9de7-370d41e83363-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "caac7ea7-56aa-4b5f-9de7-370d41e83363" (UID: "caac7ea7-56aa-4b5f-9de7-370d41e83363"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:08:15.349280 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.349257 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-data" (OuterVolumeSpecName: "istio-data") pod "caac7ea7-56aa-4b5f-9de7-370d41e83363" (UID: "caac7ea7-56aa-4b5f-9de7-370d41e83363"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:08:15.350555 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.350521 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "caac7ea7-56aa-4b5f-9de7-370d41e83363" (UID: "caac7ea7-56aa-4b5f-9de7-370d41e83363"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:08:15.350555 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.350538 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-token" (OuterVolumeSpecName: "istio-token") pod "caac7ea7-56aa-4b5f-9de7-370d41e83363" (UID: "caac7ea7-56aa-4b5f-9de7-370d41e83363"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:08:15.350802 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.350778 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "caac7ea7-56aa-4b5f-9de7-370d41e83363" (UID: "caac7ea7-56aa-4b5f-9de7-370d41e83363"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 18:08:15.350802 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.350789 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/caac7ea7-56aa-4b5f-9de7-370d41e83363-kube-api-access-mbwwm" (OuterVolumeSpecName: "kube-api-access-mbwwm") pod "caac7ea7-56aa-4b5f-9de7-370d41e83363" (UID: "caac7ea7-56aa-4b5f-9de7-370d41e83363"). InnerVolumeSpecName "kube-api-access-mbwwm". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:08:15.449435 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.449397 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-envoy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:08:15.449435 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.449429 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-podinfo\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:08:15.449435 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.449441 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-token\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:08:15.449664 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.449452 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/caac7ea7-56aa-4b5f-9de7-370d41e83363-istio-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:08:15.449664 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.449464 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-mbwwm\" (UniqueName: \"kubernetes.io/projected/caac7ea7-56aa-4b5f-9de7-370d41e83363-kube-api-access-mbwwm\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:08:15.449664 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.449475 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/caac7ea7-56aa-4b5f-9de7-370d41e83363-istiod-ca-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:08:15.483359 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.483324 2565 generic.go:356] "Generic (PLEG): container finished" podID="caac7ea7-56aa-4b5f-9de7-370d41e83363" containerID="a50770c91f8ae109e5bdb901cda591af8e89488f2b20239db35f3ddc67ccd44b" exitCode=0 Jul 09 18:08:15.483515 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.483372 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" Jul 09 18:08:15.483515 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.483406 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" event={"ID":"caac7ea7-56aa-4b5f-9de7-370d41e83363","Type":"ContainerDied","Data":"a50770c91f8ae109e5bdb901cda591af8e89488f2b20239db35f3ddc67ccd44b"} Jul 09 18:08:15.483515 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.483456 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc" event={"ID":"caac7ea7-56aa-4b5f-9de7-370d41e83363","Type":"ContainerDied","Data":"4594bc0ce563209b4a81a383aa27422a823effd2a2bfda2c8a4e31502ee64853"} Jul 09 18:08:15.483515 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.483478 2565 scope.go:117] "RemoveContainer" containerID="a50770c91f8ae109e5bdb901cda591af8e89488f2b20239db35f3ddc67ccd44b" Jul 09 18:08:15.492362 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.492339 2565 scope.go:117] "RemoveContainer" containerID="caa14de30a6ff05d0fbd354e1b041d9d0613faefe52d9c226df2f6e978e870e4" Jul 09 18:08:15.500546 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.500529 2565 scope.go:117] "RemoveContainer" containerID="a50770c91f8ae109e5bdb901cda591af8e89488f2b20239db35f3ddc67ccd44b" Jul 09 18:08:15.500819 ip-10-0-138-5 kubenswrapper[2565]: E0709 18:08:15.500800 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"a50770c91f8ae109e5bdb901cda591af8e89488f2b20239db35f3ddc67ccd44b\": container with ID starting with a50770c91f8ae109e5bdb901cda591af8e89488f2b20239db35f3ddc67ccd44b not found: ID does not exist" containerID="a50770c91f8ae109e5bdb901cda591af8e89488f2b20239db35f3ddc67ccd44b" Jul 09 18:08:15.500876 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.500829 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"a50770c91f8ae109e5bdb901cda591af8e89488f2b20239db35f3ddc67ccd44b"} err="failed to get container status \"a50770c91f8ae109e5bdb901cda591af8e89488f2b20239db35f3ddc67ccd44b\": rpc error: code = NotFound desc = could not find container \"a50770c91f8ae109e5bdb901cda591af8e89488f2b20239db35f3ddc67ccd44b\": container with ID starting with a50770c91f8ae109e5bdb901cda591af8e89488f2b20239db35f3ddc67ccd44b not found: ID does not exist" Jul 09 18:08:15.500876 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.500846 2565 scope.go:117] "RemoveContainer" containerID="caa14de30a6ff05d0fbd354e1b041d9d0613faefe52d9c226df2f6e978e870e4" Jul 09 18:08:15.501073 ip-10-0-138-5 kubenswrapper[2565]: E0709 18:08:15.501055 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"caa14de30a6ff05d0fbd354e1b041d9d0613faefe52d9c226df2f6e978e870e4\": container with ID starting with caa14de30a6ff05d0fbd354e1b041d9d0613faefe52d9c226df2f6e978e870e4 not found: ID does not exist" containerID="caa14de30a6ff05d0fbd354e1b041d9d0613faefe52d9c226df2f6e978e870e4" Jul 09 18:08:15.501114 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.501078 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"caa14de30a6ff05d0fbd354e1b041d9d0613faefe52d9c226df2f6e978e870e4"} err="failed to get container status \"caa14de30a6ff05d0fbd354e1b041d9d0613faefe52d9c226df2f6e978e870e4\": rpc error: code = NotFound desc = could not find container \"caa14de30a6ff05d0fbd354e1b041d9d0613faefe52d9c226df2f6e978e870e4\": container with ID starting with caa14de30a6ff05d0fbd354e1b041d9d0613faefe52d9c226df2f6e978e870e4 not found: ID does not exist" Jul 09 18:08:15.524588 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.524549 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc"] Jul 09 18:08:15.530732 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:15.530706 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-api-b-589edb-openshift-default-57b6485c47-ghmxc"] Jul 09 18:08:17.509725 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:17.509686 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="caac7ea7-56aa-4b5f-9de7-370d41e83363" path="/var/lib/kubelet/pods/caac7ea7-56aa-4b5f-9de7-370d41e83363/volumes" Jul 09 18:08:18.587426 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.587391 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:08:18.684312 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.684278 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22"] Jul 09 18:08:18.684659 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.684646 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caac7ea7-56aa-4b5f-9de7-370d41e83363" containerName="istio-proxy" Jul 09 18:08:18.684712 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.684660 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="caac7ea7-56aa-4b5f-9de7-370d41e83363" containerName="istio-proxy" Jul 09 18:08:18.684712 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.684671 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="caac7ea7-56aa-4b5f-9de7-370d41e83363" containerName="istio-proxy" Jul 09 18:08:18.684712 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.684677 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="caac7ea7-56aa-4b5f-9de7-370d41e83363" containerName="istio-proxy" Jul 09 18:08:18.684852 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.684734 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="caac7ea7-56aa-4b5f-9de7-370d41e83363" containerName="istio-proxy" Jul 09 18:08:18.684852 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.684745 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="caac7ea7-56aa-4b5f-9de7-370d41e83363" containerName="istio-proxy" Jul 09 18:08:18.689246 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.689225 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.693862 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.693841 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-ingress\"/\"e2e-shared-b-e0b9f9-openshift-default-dockercfg-87r6s\"" Jul 09 18:08:18.730425 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.730398 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22"] Jul 09 18:08:18.782606 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.782573 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29899a23-83b1-4b6d-ae07-1806977a000c-istiod-ca-cert\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.782769 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.782625 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-htb4k\" (UniqueName: \"kubernetes.io/projected/29899a23-83b1-4b6d-ae07-1806977a000c-kube-api-access-htb4k\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.782769 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.782682 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-workload-socket\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.782769 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.782724 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29899a23-83b1-4b6d-ae07-1806977a000c-istio-token\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.782769 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.782739 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-credential-socket\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.782956 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.782787 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-istio-envoy\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.782956 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.782816 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-istio-data\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.782956 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.782834 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29899a23-83b1-4b6d-ae07-1806977a000c-istio-podinfo\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.782956 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.782863 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-workload-certs\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.883785 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.883685 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-workload-certs\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.883785 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.883731 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29899a23-83b1-4b6d-ae07-1806977a000c-istiod-ca-cert\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.883995 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.883834 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-htb4k\" (UniqueName: \"kubernetes.io/projected/29899a23-83b1-4b6d-ae07-1806977a000c-kube-api-access-htb4k\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.883995 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.883875 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-workload-socket\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.883995 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.883954 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29899a23-83b1-4b6d-ae07-1806977a000c-istio-token\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.884162 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.884082 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-credential-socket\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.884162 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.884143 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-workload-certs\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.884257 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.884150 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-istio-envoy\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.884257 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.884223 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-istio-data\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.884257 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.884244 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29899a23-83b1-4b6d-ae07-1806977a000c-istio-podinfo\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.884410 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.884285 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-workload-socket\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.884466 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.884419 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-credential-socket\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.884555 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.884531 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-istio-data\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.884672 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.884575 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29899a23-83b1-4b6d-ae07-1806977a000c-istiod-ca-cert\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.886319 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.886301 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-istio-envoy\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.886545 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.886528 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29899a23-83b1-4b6d-ae07-1806977a000c-istio-podinfo\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.900907 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.900881 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29899a23-83b1-4b6d-ae07-1806977a000c-istio-token\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.901008 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.900928 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-htb4k\" (UniqueName: \"kubernetes.io/projected/29899a23-83b1-4b6d-ae07-1806977a000c-kube-api-access-htb4k\") pod \"e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:18.998698 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:18.998669 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:19.140181 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:19.140151 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22"] Jul 09 18:08:19.141896 ip-10-0-138-5 kubenswrapper[2565]: W0709 18:08:19.141866 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-burstable.slice/kubepods-burstable-pod29899a23_83b1_4b6d_ae07_1806977a000c.slice/crio-29a7e6336630e9e0e850eecfad995ef0ca61b74e8faf7d028be6daf698f622aa WatchSource:0}: Error finding container 29a7e6336630e9e0e850eecfad995ef0ca61b74e8faf7d028be6daf698f622aa: Status 404 returned error can't find the container with id 29a7e6336630e9e0e850eecfad995ef0ca61b74e8faf7d028be6daf698f622aa Jul 09 18:08:19.144086 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:19.144050 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:08:19.144167 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:19.144121 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:08:19.144167 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:19.144156 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:08:19.509267 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:19.509186 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" event={"ID":"29899a23-83b1-4b6d-ae07-1806977a000c","Type":"ContainerStarted","Data":"1e0caa068f2a008c8f1aa8221fac80cea32b39f66a3500a68a70705875ecc583"} Jul 09 18:08:19.509267 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:19.509240 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" event={"ID":"29899a23-83b1-4b6d-ae07-1806977a000c","Type":"ContainerStarted","Data":"29a7e6336630e9e0e850eecfad995ef0ca61b74e8faf7d028be6daf698f622aa"} Jul 09 18:08:19.531005 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:19.530947 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" podStartSLOduration=1.53092396 podStartE2EDuration="1.53092396s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=false podCreationTimestamp="2026-07-09 18:08:18 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:08:19.528389187 +0000 UTC m=+2412.584857717" watchObservedRunningTime="2026-07-09 18:08:19.53092396 +0000 UTC m=+2412.587392463" Jul 09 18:08:19.999426 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:19.999394 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:21.005232 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:21.005196 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:21.520782 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:21.518470 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:21.526209 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:21.526187 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:26.549692 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:26.549648 2565 generic.go:356] "Generic (PLEG): container finished" podID="c26fed51-5364-4225-a6da-e7b20365e2f4" containerID="d9b9689dd3862a7dd5930ffc8d1e100a9e458e5da87f4ec52dbae6a08abd4fc7" exitCode=0 Jul 09 18:08:26.550287 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:26.549803 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" event={"ID":"c26fed51-5364-4225-a6da-e7b20365e2f4","Type":"ContainerDied","Data":"d9b9689dd3862a7dd5930ffc8d1e100a9e458e5da87f4ec52dbae6a08abd4fc7"} Jul 09 18:08:26.550354 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:26.550301 2565 scope.go:117] "RemoveContainer" containerID="d9b9689dd3862a7dd5930ffc8d1e100a9e458e5da87f4ec52dbae6a08abd4fc7" Jul 09 18:08:26.551981 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:26.551937 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:08:26.552100 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:26.552041 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:08:26.552100 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:26.552089 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:08:27.466860 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:27.466824 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:27.556805 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:27.556742 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" event={"ID":"c26fed51-5364-4225-a6da-e7b20365e2f4","Type":"ContainerStarted","Data":"bd4998927ddf854fb382aa94cc2bcccf3eeb202ced52c8c03aa41dee709b0d5b"} Jul 09 18:08:28.223190 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:28.223146 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:28.223406 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:28.223346 2565 patch_prober.go:28] interesting pod/e2e-shared-a-09d279-openshift-default-8554b9495-trptv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 09 18:08:28.223489 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:28.223399 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" podUID="c26fed51-5364-4225-a6da-e7b20365e2f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 09 18:08:29.221878 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:29.221750 2565 patch_prober.go:28] interesting pod/e2e-shared-a-09d279-openshift-default-8554b9495-trptv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 09 18:08:29.221878 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:29.221856 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" podUID="c26fed51-5364-4225-a6da-e7b20365e2f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 09 18:08:30.221616 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:30.221578 2565 patch_prober.go:28] interesting pod/e2e-shared-a-09d279-openshift-default-8554b9495-trptv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 09 18:08:30.221949 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:30.221906 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" podUID="c26fed51-5364-4225-a6da-e7b20365e2f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 09 18:08:31.221524 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:31.221488 2565 patch_prober.go:28] interesting pod/e2e-shared-a-09d279-openshift-default-8554b9495-trptv container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" start-of-body= Jul 09 18:08:31.222152 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:31.222121 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" podUID="c26fed51-5364-4225-a6da-e7b20365e2f4" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.47:15021/healthz/ready\": dial tcp 10.134.0.47:15021: connect: connection refused" Jul 09 18:08:32.227295 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:32.227258 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:32.227681 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:32.227543 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:32.228268 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:32.228250 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:08:33.591902 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:33.591871 2565 generic.go:356] "Generic (PLEG): container finished" podID="29899a23-83b1-4b6d-ae07-1806977a000c" containerID="1e0caa068f2a008c8f1aa8221fac80cea32b39f66a3500a68a70705875ecc583" exitCode=0 Jul 09 18:08:33.592342 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:33.591948 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" event={"ID":"29899a23-83b1-4b6d-ae07-1806977a000c","Type":"ContainerDied","Data":"1e0caa068f2a008c8f1aa8221fac80cea32b39f66a3500a68a70705875ecc583"} Jul 09 18:08:33.592492 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:33.592474 2565 scope.go:117] "RemoveContainer" containerID="1e0caa068f2a008c8f1aa8221fac80cea32b39f66a3500a68a70705875ecc583" Jul 09 18:08:33.593432 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:33.593404 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:08:33.593520 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:33.593482 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:08:33.593582 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:33.593530 2565 kubelet_resources.go:64] "Allocatable" allocatable={"cpu":"7500m","ephemeral-storage":"114345831029","hugepages-1Gi":"0","hugepages-2Mi":"0","memory":"31236232Ki","pods":"250"} Jul 09 18:08:34.289035 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:34.288998 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:08:34.599356 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:34.599272 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" event={"ID":"29899a23-83b1-4b6d-ae07-1806977a000c","Type":"ContainerStarted","Data":"304ba3725e7ab4a337458884b33071731997429954094ba859b2647fd0bd4ca0"} Jul 09 18:08:34.999855 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:34.999768 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="unhealthy" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:35.000586 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:35.000557 2565 patch_prober.go:28] interesting pod/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 09 18:08:35.000638 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:35.000606 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" podUID="29899a23-83b1-4b6d-ae07-1806977a000c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 09 18:08:35.999817 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:35.999788 2565 patch_prober.go:28] interesting pod/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 09 18:08:36.000182 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:35.999838 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" podUID="29899a23-83b1-4b6d-ae07-1806977a000c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 09 18:08:36.519324 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:36.519281 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:36.999389 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:36.999357 2565 patch_prober.go:28] interesting pod/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 09 18:08:36.999561 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:36.999406 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" podUID="29899a23-83b1-4b6d-ae07-1806977a000c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 09 18:08:37.999263 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:37.999232 2565 patch_prober.go:28] interesting pod/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22 container/istio-proxy namespace/openshift-ingress: Startup probe status=failure output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" start-of-body= Jul 09 18:08:37.999639 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:37.999292 2565 prober.go:120] "Probe failed" probeType="Startup" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" podUID="29899a23-83b1-4b6d-ae07-1806977a000c" containerName="istio-proxy" probeResult="failure" output="Get \"http://10.134.0.48:15021/healthz/ready\": dial tcp 10.134.0.48:15021: connect: connection refused" Jul 09 18:08:39.003790 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:39.003738 2565 kubelet.go:2654] "SyncLoop (probe)" probe="startup" status="started" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:39.004738 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:39.004720 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:08:52.783471 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:08:52.783434 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:09:30.275075 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:09:30.275040 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:09:51.276820 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:09:51.276784 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:10:09.474158 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:10:09.474069 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:10:23.294217 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:10:23.294176 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:10:40.675471 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:10:40.675439 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:10:57.479964 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:10:57.479929 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:11:07.723338 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:11:07.723304 2565 scope.go:117] "RemoveContainer" containerID="d8323354fa12c6dacbc1f78ba337fe1335e7fb523f8f85f04bd93ff1ef961a75" Jul 09 18:11:16.803585 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:11:16.803550 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:11:35.102988 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:11:35.102904 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:11:51.480559 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:11:51.480522 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:12:15.771633 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:12:15.771598 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:12:33.780091 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:12:33.780052 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:12:53.789127 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:12:53.789090 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:13:07.637500 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:13:07.637420 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 18:13:07.642968 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:13:07.642948 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ovn-kubernetes_ovnkube-node-8wn62_e1cded27-42c6-4394-b60f-57b5fef447b7/ovn-acl-logging/0.log" Jul 09 18:13:14.082123 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:13:14.082092 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:14:06.179187 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:14:06.179152 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:14:30.277704 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:14:30.277620 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:14:44.173334 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:14:44.173300 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:15:04.572722 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:04.572690 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:15:36.176349 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:36.176308 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:15:38.328523 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:38.328484 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv"] Jul 09 18:15:38.328972 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:38.328746 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" podUID="c26fed51-5364-4225-a6da-e7b20365e2f4" containerName="istio-proxy" containerID="cri-o://bd4998927ddf854fb382aa94cc2bcccf3eeb202ced52c8c03aa41dee709b0d5b" gracePeriod=30 Jul 09 18:15:43.580980 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.580958 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:15:43.686252 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.686175 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c26fed51-5364-4225-a6da-e7b20365e2f4-istiod-ca-cert\") pod \"c26fed51-5364-4225-a6da-e7b20365e2f4\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " Jul 09 18:15:43.686252 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.686209 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-workload-socket\") pod \"c26fed51-5364-4225-a6da-e7b20365e2f4\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " Jul 09 18:15:43.686252 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.686249 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-data\") pod \"c26fed51-5364-4225-a6da-e7b20365e2f4\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " Jul 09 18:15:43.686507 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.686267 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-envoy\") pod \"c26fed51-5364-4225-a6da-e7b20365e2f4\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " Jul 09 18:15:43.686507 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.686309 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-credential-socket\") pod \"c26fed51-5364-4225-a6da-e7b20365e2f4\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " Jul 09 18:15:43.686507 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.686324 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-token\") pod \"c26fed51-5364-4225-a6da-e7b20365e2f4\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " Jul 09 18:15:43.686507 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.686400 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-workload-certs\") pod \"c26fed51-5364-4225-a6da-e7b20365e2f4\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " Jul 09 18:15:43.686507 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.686428 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-podinfo\") pod \"c26fed51-5364-4225-a6da-e7b20365e2f4\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " Jul 09 18:15:43.686507 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.686458 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-bpd7w\" (UniqueName: \"kubernetes.io/projected/c26fed51-5364-4225-a6da-e7b20365e2f4-kube-api-access-bpd7w\") pod \"c26fed51-5364-4225-a6da-e7b20365e2f4\" (UID: \"c26fed51-5364-4225-a6da-e7b20365e2f4\") " Jul 09 18:15:43.686856 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.686631 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "c26fed51-5364-4225-a6da-e7b20365e2f4" (UID: "c26fed51-5364-4225-a6da-e7b20365e2f4"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:15:43.686856 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.686642 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "c26fed51-5364-4225-a6da-e7b20365e2f4" (UID: "c26fed51-5364-4225-a6da-e7b20365e2f4"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:15:43.686856 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.686677 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/c26fed51-5364-4225-a6da-e7b20365e2f4-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "c26fed51-5364-4225-a6da-e7b20365e2f4" (UID: "c26fed51-5364-4225-a6da-e7b20365e2f4"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:15:43.687010 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.686885 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "c26fed51-5364-4225-a6da-e7b20365e2f4" (UID: "c26fed51-5364-4225-a6da-e7b20365e2f4"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:15:43.687010 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.686932 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/c26fed51-5364-4225-a6da-e7b20365e2f4-istiod-ca-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:15:43.687010 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.686952 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-workload-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:15:43.687010 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.686966 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-credential-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:15:43.687406 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.687383 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-data" (OuterVolumeSpecName: "istio-data") pod "c26fed51-5364-4225-a6da-e7b20365e2f4" (UID: "c26fed51-5364-4225-a6da-e7b20365e2f4"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:15:43.688677 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.688658 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "c26fed51-5364-4225-a6da-e7b20365e2f4" (UID: "c26fed51-5364-4225-a6da-e7b20365e2f4"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 18:15:43.688782 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.688673 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c26fed51-5364-4225-a6da-e7b20365e2f4-kube-api-access-bpd7w" (OuterVolumeSpecName: "kube-api-access-bpd7w") pod "c26fed51-5364-4225-a6da-e7b20365e2f4" (UID: "c26fed51-5364-4225-a6da-e7b20365e2f4"). InnerVolumeSpecName "kube-api-access-bpd7w". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:15:43.688953 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.688933 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "c26fed51-5364-4225-a6da-e7b20365e2f4" (UID: "c26fed51-5364-4225-a6da-e7b20365e2f4"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:15:43.688953 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.688941 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-token" (OuterVolumeSpecName: "istio-token") pod "c26fed51-5364-4225-a6da-e7b20365e2f4" (UID: "c26fed51-5364-4225-a6da-e7b20365e2f4"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:15:43.723618 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.723584 2565 generic.go:356] "Generic (PLEG): container finished" podID="c26fed51-5364-4225-a6da-e7b20365e2f4" containerID="bd4998927ddf854fb382aa94cc2bcccf3eeb202ced52c8c03aa41dee709b0d5b" exitCode=0 Jul 09 18:15:43.723719 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.723635 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" Jul 09 18:15:43.723719 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.723626 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" event={"ID":"c26fed51-5364-4225-a6da-e7b20365e2f4","Type":"ContainerDied","Data":"bd4998927ddf854fb382aa94cc2bcccf3eeb202ced52c8c03aa41dee709b0d5b"} Jul 09 18:15:43.723828 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.723771 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv" event={"ID":"c26fed51-5364-4225-a6da-e7b20365e2f4","Type":"ContainerDied","Data":"c84c89541c3912c8f0892fc3a2c50b0adbd686cbc0e2c64578397ca547a32448"} Jul 09 18:15:43.723828 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.723795 2565 scope.go:117] "RemoveContainer" containerID="bd4998927ddf854fb382aa94cc2bcccf3eeb202ced52c8c03aa41dee709b0d5b" Jul 09 18:15:43.732838 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.732822 2565 scope.go:117] "RemoveContainer" containerID="d9b9689dd3862a7dd5930ffc8d1e100a9e458e5da87f4ec52dbae6a08abd4fc7" Jul 09 18:15:43.740316 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.740299 2565 scope.go:117] "RemoveContainer" containerID="bd4998927ddf854fb382aa94cc2bcccf3eeb202ced52c8c03aa41dee709b0d5b" Jul 09 18:15:43.740560 ip-10-0-138-5 kubenswrapper[2565]: E0709 18:15:43.740540 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"bd4998927ddf854fb382aa94cc2bcccf3eeb202ced52c8c03aa41dee709b0d5b\": container with ID starting with bd4998927ddf854fb382aa94cc2bcccf3eeb202ced52c8c03aa41dee709b0d5b not found: ID does not exist" containerID="bd4998927ddf854fb382aa94cc2bcccf3eeb202ced52c8c03aa41dee709b0d5b" Jul 09 18:15:43.740633 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.740572 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"bd4998927ddf854fb382aa94cc2bcccf3eeb202ced52c8c03aa41dee709b0d5b"} err="failed to get container status \"bd4998927ddf854fb382aa94cc2bcccf3eeb202ced52c8c03aa41dee709b0d5b\": rpc error: code = NotFound desc = could not find container \"bd4998927ddf854fb382aa94cc2bcccf3eeb202ced52c8c03aa41dee709b0d5b\": container with ID starting with bd4998927ddf854fb382aa94cc2bcccf3eeb202ced52c8c03aa41dee709b0d5b not found: ID does not exist" Jul 09 18:15:43.740633 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.740593 2565 scope.go:117] "RemoveContainer" containerID="d9b9689dd3862a7dd5930ffc8d1e100a9e458e5da87f4ec52dbae6a08abd4fc7" Jul 09 18:15:43.740918 ip-10-0-138-5 kubenswrapper[2565]: E0709 18:15:43.740898 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"d9b9689dd3862a7dd5930ffc8d1e100a9e458e5da87f4ec52dbae6a08abd4fc7\": container with ID starting with d9b9689dd3862a7dd5930ffc8d1e100a9e458e5da87f4ec52dbae6a08abd4fc7 not found: ID does not exist" containerID="d9b9689dd3862a7dd5930ffc8d1e100a9e458e5da87f4ec52dbae6a08abd4fc7" Jul 09 18:15:43.740984 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.740926 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"d9b9689dd3862a7dd5930ffc8d1e100a9e458e5da87f4ec52dbae6a08abd4fc7"} err="failed to get container status \"d9b9689dd3862a7dd5930ffc8d1e100a9e458e5da87f4ec52dbae6a08abd4fc7\": rpc error: code = NotFound desc = could not find container \"d9b9689dd3862a7dd5930ffc8d1e100a9e458e5da87f4ec52dbae6a08abd4fc7\": container with ID starting with d9b9689dd3862a7dd5930ffc8d1e100a9e458e5da87f4ec52dbae6a08abd4fc7 not found: ID does not exist" Jul 09 18:15:43.744992 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.744971 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv"] Jul 09 18:15:43.748663 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.748644 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-a-09d279-openshift-default-8554b9495-trptv"] Jul 09 18:15:43.788384 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.788363 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-workload-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:15:43.788384 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.788381 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-podinfo\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:15:43.788498 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.788390 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-bpd7w\" (UniqueName: \"kubernetes.io/projected/c26fed51-5364-4225-a6da-e7b20365e2f4-kube-api-access-bpd7w\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:15:43.788498 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.788400 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:15:43.788498 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.788409 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-envoy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:15:43.788498 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:43.788416 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/c26fed51-5364-4225-a6da-e7b20365e2f4-istio-token\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:15:45.509341 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:45.509306 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="c26fed51-5364-4225-a6da-e7b20365e2f4" path="/var/lib/kubelet/pods/c26fed51-5364-4225-a6da-e7b20365e2f4/volumes" Jul 09 18:15:45.695722 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:45.695692 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22"] Jul 09 18:15:45.695963 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:45.695917 2565 kuberuntime_container.go:873] "Killing container with a grace period" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" podUID="29899a23-83b1-4b6d-ae07-1806977a000c" containerName="istio-proxy" containerID="cri-o://304ba3725e7ab4a337458884b33071731997429954094ba859b2647fd0bd4ca0" gracePeriod=30 Jul 09 18:15:47.974316 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:47.974282 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["kuadrant-system/limitador-limitador-54d6d988d5-8s9dt"] Jul 09 18:15:50.943421 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:50.943401 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:15:50.954232 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:50.954212 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-istio-envoy\") pod \"29899a23-83b1-4b6d-ae07-1806977a000c\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " Jul 09 18:15:50.954337 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:50.954246 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"kube-api-access-htb4k\" (UniqueName: \"kubernetes.io/projected/29899a23-83b1-4b6d-ae07-1806977a000c-kube-api-access-htb4k\") pod \"29899a23-83b1-4b6d-ae07-1806977a000c\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " Jul 09 18:15:50.954337 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:50.954273 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-workload-socket\") pod \"29899a23-83b1-4b6d-ae07-1806977a000c\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " Jul 09 18:15:50.954337 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:50.954303 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29899a23-83b1-4b6d-ae07-1806977a000c-istio-token\") pod \"29899a23-83b1-4b6d-ae07-1806977a000c\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " Jul 09 18:15:50.954337 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:50.954336 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29899a23-83b1-4b6d-ae07-1806977a000c-istio-podinfo\") pod \"29899a23-83b1-4b6d-ae07-1806977a000c\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " Jul 09 18:15:50.954548 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:50.954359 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-istio-data\") pod \"29899a23-83b1-4b6d-ae07-1806977a000c\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " Jul 09 18:15:50.954548 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:50.954394 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-credential-socket\") pod \"29899a23-83b1-4b6d-ae07-1806977a000c\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " Jul 09 18:15:50.954548 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:50.954422 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29899a23-83b1-4b6d-ae07-1806977a000c-istiod-ca-cert\") pod \"29899a23-83b1-4b6d-ae07-1806977a000c\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " Jul 09 18:15:50.954548 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:50.954453 2565 reconciler_common.go:163] "operationExecutor.UnmountVolume started for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-workload-certs\") pod \"29899a23-83b1-4b6d-ae07-1806977a000c\" (UID: \"29899a23-83b1-4b6d-ae07-1806977a000c\") " Jul 09 18:15:50.954782 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:50.954608 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-workload-socket" (OuterVolumeSpecName: "workload-socket") pod "29899a23-83b1-4b6d-ae07-1806977a000c" (UID: "29899a23-83b1-4b6d-ae07-1806977a000c"). InnerVolumeSpecName "workload-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:15:50.954850 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:50.954791 2565 reconciler_common.go:299] "Volume detached for volume \"workload-socket\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-workload-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:15:50.954850 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:50.954798 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-workload-certs" (OuterVolumeSpecName: "workload-certs") pod "29899a23-83b1-4b6d-ae07-1806977a000c" (UID: "29899a23-83b1-4b6d-ae07-1806977a000c"). InnerVolumeSpecName "workload-certs". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:15:50.955002 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:50.954955 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-credential-socket" (OuterVolumeSpecName: "credential-socket") pod "29899a23-83b1-4b6d-ae07-1806977a000c" (UID: "29899a23-83b1-4b6d-ae07-1806977a000c"). InnerVolumeSpecName "credential-socket". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:15:50.955083 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:50.955061 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/configmap/29899a23-83b1-4b6d-ae07-1806977a000c-istiod-ca-cert" (OuterVolumeSpecName: "istiod-ca-cert") pod "29899a23-83b1-4b6d-ae07-1806977a000c" (UID: "29899a23-83b1-4b6d-ae07-1806977a000c"). InnerVolumeSpecName "istiod-ca-cert". PluginName "kubernetes.io/configmap", VolumeGIDValue "" Jul 09 18:15:50.955242 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:50.955222 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-istio-data" (OuterVolumeSpecName: "istio-data") pod "29899a23-83b1-4b6d-ae07-1806977a000c" (UID: "29899a23-83b1-4b6d-ae07-1806977a000c"). InnerVolumeSpecName "istio-data". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:15:50.956475 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:50.956450 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-istio-envoy" (OuterVolumeSpecName: "istio-envoy") pod "29899a23-83b1-4b6d-ae07-1806977a000c" (UID: "29899a23-83b1-4b6d-ae07-1806977a000c"). InnerVolumeSpecName "istio-envoy". PluginName "kubernetes.io/empty-dir", VolumeGIDValue "" Jul 09 18:15:50.956475 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:50.956468 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29899a23-83b1-4b6d-ae07-1806977a000c-istio-token" (OuterVolumeSpecName: "istio-token") pod "29899a23-83b1-4b6d-ae07-1806977a000c" (UID: "29899a23-83b1-4b6d-ae07-1806977a000c"). InnerVolumeSpecName "istio-token". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:15:50.956745 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:50.956727 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/projected/29899a23-83b1-4b6d-ae07-1806977a000c-kube-api-access-htb4k" (OuterVolumeSpecName: "kube-api-access-htb4k") pod "29899a23-83b1-4b6d-ae07-1806977a000c" (UID: "29899a23-83b1-4b6d-ae07-1806977a000c"). InnerVolumeSpecName "kube-api-access-htb4k". PluginName "kubernetes.io/projected", VolumeGIDValue "" Jul 09 18:15:50.956910 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:50.956729 2565 operation_generator.go:782] UnmountVolume.TearDown succeeded for volume "kubernetes.io/downward-api/29899a23-83b1-4b6d-ae07-1806977a000c-istio-podinfo" (OuterVolumeSpecName: "istio-podinfo") pod "29899a23-83b1-4b6d-ae07-1806977a000c" (UID: "29899a23-83b1-4b6d-ae07-1806977a000c"). InnerVolumeSpecName "istio-podinfo". PluginName "kubernetes.io/downward-api", VolumeGIDValue "" Jul 09 18:15:51.055920 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:51.055893 2565 reconciler_common.go:299] "Volume detached for volume \"istio-data\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-istio-data\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:15:51.055920 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:51.055919 2565 reconciler_common.go:299] "Volume detached for volume \"credential-socket\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-credential-socket\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:15:51.056094 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:51.055928 2565 reconciler_common.go:299] "Volume detached for volume \"istiod-ca-cert\" (UniqueName: \"kubernetes.io/configmap/29899a23-83b1-4b6d-ae07-1806977a000c-istiod-ca-cert\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:15:51.056094 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:51.055936 2565 reconciler_common.go:299] "Volume detached for volume \"workload-certs\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-workload-certs\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:15:51.056094 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:51.055944 2565 reconciler_common.go:299] "Volume detached for volume \"istio-envoy\" (UniqueName: \"kubernetes.io/empty-dir/29899a23-83b1-4b6d-ae07-1806977a000c-istio-envoy\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:15:51.056094 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:51.055951 2565 reconciler_common.go:299] "Volume detached for volume \"kube-api-access-htb4k\" (UniqueName: \"kubernetes.io/projected/29899a23-83b1-4b6d-ae07-1806977a000c-kube-api-access-htb4k\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:15:51.056094 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:51.055959 2565 reconciler_common.go:299] "Volume detached for volume \"istio-token\" (UniqueName: \"kubernetes.io/projected/29899a23-83b1-4b6d-ae07-1806977a000c-istio-token\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:15:51.056094 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:51.055967 2565 reconciler_common.go:299] "Volume detached for volume \"istio-podinfo\" (UniqueName: \"kubernetes.io/downward-api/29899a23-83b1-4b6d-ae07-1806977a000c-istio-podinfo\") on node \"ip-10-0-138-5.ec2.internal\" DevicePath \"\"" Jul 09 18:15:51.439492 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:51.439463 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bz4ns_b5ec1f1e-cf6c-4654-8c5b-ea2c45234ae2/manager/0.log" Jul 09 18:15:51.766480 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:51.766404 2565 generic.go:356] "Generic (PLEG): container finished" podID="29899a23-83b1-4b6d-ae07-1806977a000c" containerID="304ba3725e7ab4a337458884b33071731997429954094ba859b2647fd0bd4ca0" exitCode=0 Jul 09 18:15:51.766480 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:51.766464 2565 util.go:52] "No ready sandbox for pod can be found. Need to start a new one" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" Jul 09 18:15:51.766824 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:51.766475 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" event={"ID":"29899a23-83b1-4b6d-ae07-1806977a000c","Type":"ContainerDied","Data":"304ba3725e7ab4a337458884b33071731997429954094ba859b2647fd0bd4ca0"} Jul 09 18:15:51.766824 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:51.766535 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22" event={"ID":"29899a23-83b1-4b6d-ae07-1806977a000c","Type":"ContainerDied","Data":"29a7e6336630e9e0e850eecfad995ef0ca61b74e8faf7d028be6daf698f622aa"} Jul 09 18:15:51.766824 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:51.766559 2565 scope.go:117] "RemoveContainer" containerID="304ba3725e7ab4a337458884b33071731997429954094ba859b2647fd0bd4ca0" Jul 09 18:15:51.775241 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:51.775223 2565 scope.go:117] "RemoveContainer" containerID="1e0caa068f2a008c8f1aa8221fac80cea32b39f66a3500a68a70705875ecc583" Jul 09 18:15:51.783342 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:51.783314 2565 scope.go:117] "RemoveContainer" containerID="304ba3725e7ab4a337458884b33071731997429954094ba859b2647fd0bd4ca0" Jul 09 18:15:51.783629 ip-10-0-138-5 kubenswrapper[2565]: E0709 18:15:51.783610 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"304ba3725e7ab4a337458884b33071731997429954094ba859b2647fd0bd4ca0\": container with ID starting with 304ba3725e7ab4a337458884b33071731997429954094ba859b2647fd0bd4ca0 not found: ID does not exist" containerID="304ba3725e7ab4a337458884b33071731997429954094ba859b2647fd0bd4ca0" Jul 09 18:15:51.783690 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:51.783636 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"304ba3725e7ab4a337458884b33071731997429954094ba859b2647fd0bd4ca0"} err="failed to get container status \"304ba3725e7ab4a337458884b33071731997429954094ba859b2647fd0bd4ca0\": rpc error: code = NotFound desc = could not find container \"304ba3725e7ab4a337458884b33071731997429954094ba859b2647fd0bd4ca0\": container with ID starting with 304ba3725e7ab4a337458884b33071731997429954094ba859b2647fd0bd4ca0 not found: ID does not exist" Jul 09 18:15:51.783690 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:51.783653 2565 scope.go:117] "RemoveContainer" containerID="1e0caa068f2a008c8f1aa8221fac80cea32b39f66a3500a68a70705875ecc583" Jul 09 18:15:51.783956 ip-10-0-138-5 kubenswrapper[2565]: E0709 18:15:51.783935 2565 log.go:32] "ContainerStatus from runtime service failed" err="rpc error: code = NotFound desc = could not find container \"1e0caa068f2a008c8f1aa8221fac80cea32b39f66a3500a68a70705875ecc583\": container with ID starting with 1e0caa068f2a008c8f1aa8221fac80cea32b39f66a3500a68a70705875ecc583 not found: ID does not exist" containerID="1e0caa068f2a008c8f1aa8221fac80cea32b39f66a3500a68a70705875ecc583" Jul 09 18:15:51.784005 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:51.783965 2565 pod_container_deletor.go:53] "DeleteContainer returned error" containerID={"Type":"cri-o","ID":"1e0caa068f2a008c8f1aa8221fac80cea32b39f66a3500a68a70705875ecc583"} err="failed to get container status \"1e0caa068f2a008c8f1aa8221fac80cea32b39f66a3500a68a70705875ecc583\": rpc error: code = NotFound desc = could not find container \"1e0caa068f2a008c8f1aa8221fac80cea32b39f66a3500a68a70705875ecc583\": container with ID starting with 1e0caa068f2a008c8f1aa8221fac80cea32b39f66a3500a68a70705875ecc583 not found: ID does not exist" Jul 09 18:15:51.784993 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:51.784977 2565 kubelet.go:2551] "SyncLoop DELETE" source="api" pods=["openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22"] Jul 09 18:15:51.789662 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:51.789643 2565 kubelet.go:2545] "SyncLoop REMOVE" source="api" pods=["openshift-ingress/e2e-shared-b-e0b9f9-openshift-default-85dc8799d7-dsl22"] Jul 09 18:15:52.217257 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:52.217231 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c8444b686-nlkxv_ecfd8064-b01d-4f42-9614-75dac1f15c07/copy-manifests/0.log" Jul 09 18:15:52.230811 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:52.230782 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c8444b686-nlkxv_ecfd8064-b01d-4f42-9614-75dac1f15c07/manager/0.log" Jul 09 18:15:53.509042 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:53.509007 2565 kubelet_volumes.go:163] "Cleaned up orphaned pod volumes dir" podUID="29899a23-83b1-4b6d-ae07-1806977a000c" path="/var/lib/kubelet/pods/29899a23-83b1-4b6d-ae07-1806977a000c/volumes" Jul 09 18:15:54.718216 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:54.718187 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-t2k67_f644127f-5bfe-4d97-aad8-0a992e693ca3/manager/0.log" Jul 09 18:15:55.214912 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:55.214883 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hsq8d_466a5166-8738-478f-b949-1bdb6a3185d7/manager/0.log" Jul 09 18:15:55.365846 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:55.365821 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-8s9dt_b9f2ae2b-8c08-418e-9797-20cd9c91ba02/limitador/0.log" Jul 09 18:15:55.858250 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:55.858223 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4nb52m_d6cb1372-4b09-4426-b24a-031792f726fc/istio-proxy/0.log" Jul 09 18:15:55.980628 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:55.980601 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mrrp5_949e4acd-1c87-4284-8116-2479ded66416/discovery/0.log" Jul 09 18:15:56.102448 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:56.102425 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85cbbdb477-bgt89_0a95fb50-4b17-4436-a6cc-4a34f9a9be2d/kube-auth-proxy/0.log" Jul 09 18:15:56.345400 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:56.345373 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r96gv_8a60c117-56e9-4418-9344-e0b401b99772/istio-proxy/1.log" Jul 09 18:15:57.334400 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:15:57.334371 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/llm_e2e-trlp-test-simulated-kserve-598466548d-f6tlt_ebf9f88b-9611-412f-a931-1985caf223fb/main/0.log" Jul 09 18:16:04.475044 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:04.474968 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_global-pull-secret-syncer-gnf2w_50daa15b-9979-4a9f-a901-28e3d607c74e/global-pull-secret-syncer/0.log" Jul 09 18:16:04.608450 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:04.608419 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_konnectivity-agent-qdmzx_61cd09b0-79ba-4423-b79b-15b8281effa0/konnectivity-agent/0.log" Jul 09 18:16:04.684697 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:04.684669 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kube-system_kube-apiserver-proxy-ip-10-0-138-5.ec2.internal_27ecca423593db51774231555b49ec3d/haproxy/0.log" Jul 09 18:16:10.289304 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:10.289280 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_authorino-operator-75cc8d5cb7-t2k67_f644127f-5bfe-4d97-aad8-0a992e693ca3/manager/0.log" Jul 09 18:16:10.503792 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:10.503740 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_kuadrant-operator-controller-manager-86878c769f-hsq8d_466a5166-8738-478f-b949-1bdb6a3185d7/manager/0.log" Jul 09 18:16:10.535696 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:10.535673 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/kuadrant-system_limitador-limitador-54d6d988d5-8s9dt_b9f2ae2b-8c08-418e-9797-20cd9c91ba02/limitador/0.log" Jul 09 18:16:12.184896 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.184347 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_da348fce-887f-4e28-a04f-de03b4eab3bc/alertmanager/0.log" Jul 09 18:16:12.207262 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.207234 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_da348fce-887f-4e28-a04f-de03b4eab3bc/config-reloader/0.log" Jul 09 18:16:12.227481 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.227461 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_da348fce-887f-4e28-a04f-de03b4eab3bc/kube-rbac-proxy-web/0.log" Jul 09 18:16:12.250251 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.250233 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_da348fce-887f-4e28-a04f-de03b4eab3bc/kube-rbac-proxy/0.log" Jul 09 18:16:12.272887 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.272866 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_da348fce-887f-4e28-a04f-de03b4eab3bc/kube-rbac-proxy-metric/0.log" Jul 09 18:16:12.296467 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.296449 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_da348fce-887f-4e28-a04f-de03b4eab3bc/prom-label-proxy/0.log" Jul 09 18:16:12.318538 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.318520 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_alertmanager-main-0_da348fce-887f-4e28-a04f-de03b4eab3bc/init-config-reloader/0.log" Jul 09 18:16:12.401131 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.401111 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-kjwqv_7d06e450-a17b-43db-88d5-3e4097a0637c/kube-state-metrics/0.log" Jul 09 18:16:12.419529 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.419497 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-kjwqv_7d06e450-a17b-43db-88d5-3e4097a0637c/kube-rbac-proxy-main/0.log" Jul 09 18:16:12.441871 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.441816 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_kube-state-metrics-785778ff74-kjwqv_7d06e450-a17b-43db-88d5-3e4097a0637c/kube-rbac-proxy-self/0.log" Jul 09 18:16:12.501011 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.500988 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_monitoring-plugin-5f68df7f58-c9v69_3c629acc-33b4-419a-a35a-9c257ff60bce/monitoring-plugin/0.log" Jul 09 18:16:12.611625 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.611604 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jgbld_aae4cc98-4596-4b38-9472-0015fdc477ca/node-exporter/0.log" Jul 09 18:16:12.631481 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.631462 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jgbld_aae4cc98-4596-4b38-9472-0015fdc477ca/kube-rbac-proxy/0.log" Jul 09 18:16:12.653406 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.653390 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_node-exporter-jgbld_aae4cc98-4596-4b38-9472-0015fdc477ca/init-textfile/0.log" Jul 09 18:16:12.755555 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.755487 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-7p956_14f5c160-fa6f-4d39-930f-205e117ca850/kube-rbac-proxy-main/0.log" Jul 09 18:16:12.776323 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.776274 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-7p956_14f5c160-fa6f-4d39-930f-205e117ca850/kube-rbac-proxy-self/0.log" Jul 09 18:16:12.797483 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.797462 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_openshift-state-metrics-84bd68b896-7p956_14f5c160-fa6f-4d39-930f-205e117ca850/openshift-state-metrics/0.log" Jul 09 18:16:12.838319 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.838292 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e539b84f-c1a7-452f-9e6d-a025b4708d2d/prometheus/0.log" Jul 09 18:16:12.857376 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.857358 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e539b84f-c1a7-452f-9e6d-a025b4708d2d/config-reloader/0.log" Jul 09 18:16:12.878097 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.878075 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e539b84f-c1a7-452f-9e6d-a025b4708d2d/thanos-sidecar/0.log" Jul 09 18:16:12.898495 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.898476 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e539b84f-c1a7-452f-9e6d-a025b4708d2d/kube-rbac-proxy-web/0.log" Jul 09 18:16:12.918112 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.918094 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e539b84f-c1a7-452f-9e6d-a025b4708d2d/kube-rbac-proxy/0.log" Jul 09 18:16:12.938627 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.938607 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e539b84f-c1a7-452f-9e6d-a025b4708d2d/kube-rbac-proxy-thanos/0.log" Jul 09 18:16:12.960689 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.960673 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-k8s-0_e539b84f-c1a7-452f-9e6d-a025b4708d2d/init-config-reloader/0.log" Jul 09 18:16:12.986468 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:12.986447 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-kgb24_4bed4cd5-5ede-40bb-8640-fb41f2702e0a/prometheus-operator/0.log" Jul 09 18:16:13.010732 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:13.010678 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_prometheus-operator-64785b6675-kgb24_4bed4cd5-5ede-40bb-8640-fb41f2702e0a/kube-rbac-proxy/0.log" Jul 09 18:16:13.066492 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:13.066474 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-587c7d8fb7-kdzrr_59510e8c-3519-4fcf-9747-d4ea71255bcb/telemeter-client/0.log" Jul 09 18:16:13.086968 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:13.086950 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-587c7d8fb7-kdzrr_59510e8c-3519-4fcf-9747-d4ea71255bcb/reload/0.log" Jul 09 18:16:13.105918 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:13.105902 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-monitoring_telemeter-client-587c7d8fb7-kdzrr_59510e8c-3519-4fcf-9747-d4ea71255bcb/kube-rbac-proxy/0.log" Jul 09 18:16:14.655146 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.655107 2565 kubelet.go:2535] "SyncLoop ADD" source="api" pods=["openshift-must-gather-4w85k/perf-node-gather-daemonset-62547"] Jul 09 18:16:14.655672 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.655653 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c26fed51-5364-4225-a6da-e7b20365e2f4" containerName="istio-proxy" Jul 09 18:16:14.655790 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.655676 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c26fed51-5364-4225-a6da-e7b20365e2f4" containerName="istio-proxy" Jul 09 18:16:14.655790 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.655719 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="c26fed51-5364-4225-a6da-e7b20365e2f4" containerName="istio-proxy" Jul 09 18:16:14.655790 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.655728 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="c26fed51-5364-4225-a6da-e7b20365e2f4" containerName="istio-proxy" Jul 09 18:16:14.655790 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.655739 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29899a23-83b1-4b6d-ae07-1806977a000c" containerName="istio-proxy" Jul 09 18:16:14.655790 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.655749 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="29899a23-83b1-4b6d-ae07-1806977a000c" containerName="istio-proxy" Jul 09 18:16:14.655790 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.655778 2565 cpu_manager.go:401] "RemoveStaleState: containerMap: removing container" podUID="29899a23-83b1-4b6d-ae07-1806977a000c" containerName="istio-proxy" Jul 09 18:16:14.655790 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.655786 2565 state_mem.go:107] "Deleted CPUSet assignment" podUID="29899a23-83b1-4b6d-ae07-1806977a000c" containerName="istio-proxy" Jul 09 18:16:14.656138 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.655885 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="29899a23-83b1-4b6d-ae07-1806977a000c" containerName="istio-proxy" Jul 09 18:16:14.656138 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.655899 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="29899a23-83b1-4b6d-ae07-1806977a000c" containerName="istio-proxy" Jul 09 18:16:14.656138 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.655910 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c26fed51-5364-4225-a6da-e7b20365e2f4" containerName="istio-proxy" Jul 09 18:16:14.656138 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.655922 2565 memory_manager.go:368] "RemoveStaleState removing state" podUID="c26fed51-5364-4225-a6da-e7b20365e2f4" containerName="istio-proxy" Jul 09 18:16:14.660928 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.660905 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-62547" Jul 09 18:16:14.664225 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.664200 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4w85k\"/\"kube-root-ca.crt\"" Jul 09 18:16:14.664629 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.664610 2565 reflector.go:439] "Caches populated" type="*v1.ConfigMap" reflector="object-\"openshift-must-gather-4w85k\"/\"openshift-service-ca.crt\"" Jul 09 18:16:14.665726 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.665707 2565 reflector.go:439] "Caches populated" type="*v1.Secret" reflector="object-\"openshift-must-gather-4w85k\"/\"default-dockercfg-vct85\"" Jul 09 18:16:14.676793 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.676752 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4w85k/perf-node-gather-daemonset-62547"] Jul 09 18:16:14.766387 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.766354 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"kube-api-access-zrzwb\" (UniqueName: \"kubernetes.io/projected/e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d-kube-api-access-zrzwb\") pod \"perf-node-gather-daemonset-62547\" (UID: \"e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-62547" Jul 09 18:16:14.766566 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.766455 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d-podres\") pod \"perf-node-gather-daemonset-62547\" (UID: \"e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-62547" Jul 09 18:16:14.766566 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.766481 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d-sys\") pod \"perf-node-gather-daemonset-62547\" (UID: \"e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-62547" Jul 09 18:16:14.766566 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.766497 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d-proc\") pod \"perf-node-gather-daemonset-62547\" (UID: \"e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-62547" Jul 09 18:16:14.766682 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.766612 2565 reconciler_common.go:251] "operationExecutor.VerifyControllerAttachedVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d-lib-modules\") pod \"perf-node-gather-daemonset-62547\" (UID: \"e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-62547" Jul 09 18:16:14.867607 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.867581 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"kube-api-access-zrzwb\" (UniqueName: \"kubernetes.io/projected/e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d-kube-api-access-zrzwb\") pod \"perf-node-gather-daemonset-62547\" (UID: \"e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-62547" Jul 09 18:16:14.867794 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.867632 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d-podres\") pod \"perf-node-gather-daemonset-62547\" (UID: \"e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-62547" Jul 09 18:16:14.867794 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.867647 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d-sys\") pod \"perf-node-gather-daemonset-62547\" (UID: \"e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-62547" Jul 09 18:16:14.867794 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.867661 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d-proc\") pod \"perf-node-gather-daemonset-62547\" (UID: \"e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-62547" Jul 09 18:16:14.867794 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.867719 2565 reconciler_common.go:225] "operationExecutor.MountVolume started for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d-lib-modules\") pod \"perf-node-gather-daemonset-62547\" (UID: \"e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-62547" Jul 09 18:16:14.867794 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.867739 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"sys\" (UniqueName: \"kubernetes.io/host-path/e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d-sys\") pod \"perf-node-gather-daemonset-62547\" (UID: \"e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-62547" Jul 09 18:16:14.867794 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.867750 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"podres\" (UniqueName: \"kubernetes.io/host-path/e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d-podres\") pod \"perf-node-gather-daemonset-62547\" (UID: \"e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-62547" Jul 09 18:16:14.868099 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.867822 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"proc\" (UniqueName: \"kubernetes.io/host-path/e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d-proc\") pod \"perf-node-gather-daemonset-62547\" (UID: \"e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-62547" Jul 09 18:16:14.868099 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.867855 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"lib-modules\" (UniqueName: \"kubernetes.io/host-path/e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d-lib-modules\") pod \"perf-node-gather-daemonset-62547\" (UID: \"e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-62547" Jul 09 18:16:14.875406 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.875387 2565 operation_generator.go:616] "MountVolume.SetUp succeeded for volume \"kube-api-access-zrzwb\" (UniqueName: \"kubernetes.io/projected/e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d-kube-api-access-zrzwb\") pod \"perf-node-gather-daemonset-62547\" (UID: \"e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d\") " pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-62547" Jul 09 18:16:14.970676 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:14.970609 2565 util.go:34] "No sandbox for pod can be found. Need to start a new one" pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-62547" Jul 09 18:16:15.100432 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:15.100399 2565 kubelet.go:2542] "SyncLoop UPDATE" source="api" pods=["openshift-must-gather-4w85k/perf-node-gather-daemonset-62547"] Jul 09 18:16:15.103893 ip-10-0-138-5 kubenswrapper[2565]: W0709 18:16:15.103859 2565 manager.go:1169] Failed to process watch event {EventType:0 Name:/kubepods.slice/kubepods-pode5dc16fc_9d8f_4f6d_83ea_3d5258c1898d.slice/crio-c1b14a6e577bbdb18f02b2532cbbb77e8aa7018f40fd1be0f61acdf9d59106d6 WatchSource:0}: Error finding container c1b14a6e577bbdb18f02b2532cbbb77e8aa7018f40fd1be0f61acdf9d59106d6: Status 404 returned error can't find the container with id c1b14a6e577bbdb18f02b2532cbbb77e8aa7018f40fd1be0f61acdf9d59106d6 Jul 09 18:16:15.878897 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:15.878861 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-62547" event={"ID":"e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d","Type":"ContainerStarted","Data":"de200f003f65a96b7c54ee4b1e246fbedf1d557aa357a770d7b948262ec95f0d"} Jul 09 18:16:15.879265 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:15.878922 2565 kubelet.go:2566] "SyncLoop (PLEG): event for pod" pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-62547" event={"ID":"e5dc16fc-9d8f-4f6d-83ea-3d5258c1898d","Type":"ContainerStarted","Data":"c1b14a6e577bbdb18f02b2532cbbb77e8aa7018f40fd1be0f61acdf9d59106d6"} Jul 09 18:16:15.879265 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:15.878944 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="not ready" pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-62547" Jul 09 18:16:15.897095 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:15.897049 2565 pod_startup_latency_tracker.go:144] "Observed pod startup duration" pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-62547" podStartSLOduration=1.897032937 podStartE2EDuration="1.897032937s" totalImagesPullingTime="0s" totalInitContainerRuntime="0s" isStatefulPod=true podCreationTimestamp="2026-07-09 18:16:14 +0000 UTC" imagePullSessionsCount=0 imagePullSessionsStartsCount=0 observedRunningTime="2026-07-09 18:16:15.895010883 +0000 UTC m=+2888.951479384" watchObservedRunningTime="2026-07-09 18:16:15.897032937 +0000 UTC m=+2888.953501438" Jul 09 18:16:17.177004 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:17.176977 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xklhh_4b094006-edae-410b-8222-3443c350811c/dns/0.log" Jul 09 18:16:17.201287 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:17.201262 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_dns-default-xklhh_4b094006-edae-410b-8222-3443c350811c/kube-rbac-proxy/0.log" Jul 09 18:16:17.291838 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:17.291805 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-dns_node-resolver-w4fk8_837c9eb0-e736-47fc-a02e-daa26056d0fe/dns-node-resolver/0.log" Jul 09 18:16:17.846725 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:17.846692 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-image-registry_node-ca-86lxn_28f5e1b6-a011-45ca-827e-67a6eda59895/node-ca/0.log" Jul 09 18:16:18.782895 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:18.782862 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4nb52m_d6cb1372-4b09-4426-b24a-031792f726fc/istio-proxy/0.log" Jul 09 18:16:18.904646 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:18.904620 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mrrp5_949e4acd-1c87-4284-8116-2479ded66416/discovery/0.log" Jul 09 18:16:18.923373 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:18.923344 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85cbbdb477-bgt89_0a95fb50-4b17-4436-a6cc-4a34f9a9be2d/kube-auth-proxy/0.log" Jul 09 18:16:18.977807 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:18.977780 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r96gv_8a60c117-56e9-4418-9344-e0b401b99772/istio-proxy/0.log" Jul 09 18:16:19.005423 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:19.005399 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r96gv_8a60c117-56e9-4418-9344-e0b401b99772/istio-proxy/1.log" Jul 09 18:16:19.902910 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:19.902883 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress-canary_ingress-canary-xddcm_bec849b6-8fec-4321-814d-d6a49d54f927/serve-healthcheck-canary/0.log" Jul 09 18:16:20.442473 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:20.442445 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7xbrm_11b882e4-5a66-45f9-b3d5-a9d2b5831480/kube-rbac-proxy/0.log" Jul 09 18:16:20.466226 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:20.466200 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7xbrm_11b882e4-5a66-45f9-b3d5-a9d2b5831480/exporter/0.log" Jul 09 18:16:20.489872 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:20.489849 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-insights_insights-runtime-extractor-7xbrm_11b882e4-5a66-45f9-b3d5-a9d2b5831480/extractor/0.log" Jul 09 18:16:21.893662 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:21.893633 2565 kubelet.go:2654] "SyncLoop (probe)" probe="readiness" status="ready" pod="openshift-must-gather-4w85k/perf-node-gather-daemonset-62547" Jul 09 18:16:22.683088 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:22.683059 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_kserve-controller-manager-d6f4b65b8-bz4ns_b5ec1f1e-cf6c-4654-8c5b-ea2c45234ae2/manager/0.log" Jul 09 18:16:23.379539 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:23.379505 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c8444b686-nlkxv_ecfd8064-b01d-4f42-9614-75dac1f15c07/manager/0.log" Jul 09 18:16:23.399283 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:23.399259 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/opendatahub_opendatahub-operator-controller-manager-c8444b686-nlkxv_ecfd8064-b01d-4f42-9614-75dac1f15c07/copy-manifests/0.log" Jul 09 18:16:24.533522 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:24.533440 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4nb52m_d6cb1372-4b09-4426-b24a-031792f726fc/istio-proxy/0.log" Jul 09 18:16:24.655789 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:24.655743 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mrrp5_949e4acd-1c87-4284-8116-2479ded66416/discovery/0.log" Jul 09 18:16:24.676476 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:24.676448 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85cbbdb477-bgt89_0a95fb50-4b17-4436-a6cc-4a34f9a9be2d/kube-auth-proxy/0.log" Jul 09 18:16:24.710391 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:24.710372 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r96gv_8a60c117-56e9-4418-9344-e0b401b99772/istio-proxy/0.log" Jul 09 18:16:24.741844 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:24.741821 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r96gv_8a60c117-56e9-4418-9344-e0b401b99772/istio-proxy/1.log" Jul 09 18:16:24.918492 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:24.918463 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-lws-operator_openshift-lws-operator-fd8ccff4c-wts2g_fcd7ba59-531b-4e4f-828e-2e514c5b7cd0/openshift-lws-operator/0.log" Jul 09 18:16:26.013932 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:26.013902 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_data-science-gateway-data-science-gateway-class-6576859cf4nb52m_d6cb1372-4b09-4426-b24a-031792f726fc/istio-proxy/0.log" Jul 09 18:16:26.139256 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:26.139232 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_istiod-openshift-gateway-94bb8fbfd-mrrp5_949e4acd-1c87-4284-8116-2479ded66416/discovery/0.log" Jul 09 18:16:26.153385 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:26.153360 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_kube-auth-proxy-85cbbdb477-bgt89_0a95fb50-4b17-4436-a6cc-4a34f9a9be2d/kube-auth-proxy/0.log" Jul 09 18:16:26.191326 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:26.191288 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r96gv_8a60c117-56e9-4418-9344-e0b401b99772/istio-proxy/0.log" Jul 09 18:16:26.221072 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:26.221039 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-ingress_maas-default-gateway-openshift-default-56654dcf7-r96gv_8a60c117-56e9-4418-9344-e0b401b99772/istio-proxy/1.log" Jul 09 18:16:31.279985 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:31.279957 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l9l84_85ab2a66-354c-455f-969e-7d7a217ca9c1/kube-multus-additional-cni-plugins/0.log" Jul 09 18:16:31.300381 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:31.300354 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l9l84_85ab2a66-354c-455f-969e-7d7a217ca9c1/egress-router-binary-copy/0.log" Jul 09 18:16:31.322318 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:31.322293 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l9l84_85ab2a66-354c-455f-969e-7d7a217ca9c1/cni-plugins/0.log" Jul 09 18:16:31.342305 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:31.342280 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l9l84_85ab2a66-354c-455f-969e-7d7a217ca9c1/bond-cni-plugin/0.log" Jul 09 18:16:31.363513 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:31.363490 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l9l84_85ab2a66-354c-455f-969e-7d7a217ca9c1/routeoverride-cni/0.log" Jul 09 18:16:31.383272 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:31.383251 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l9l84_85ab2a66-354c-455f-969e-7d7a217ca9c1/whereabouts-cni-bincopy/0.log" Jul 09 18:16:31.402515 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:31.402498 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-additional-cni-plugins-l9l84_85ab2a66-354c-455f-969e-7d7a217ca9c1/whereabouts-cni/0.log" Jul 09 18:16:31.623410 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:31.623379 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_multus-lgw9p_53da2f80-8416-4455-b359-ebfaa5551fda/kube-multus/0.log" Jul 09 18:16:31.683741 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:31.683710 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ggmkn_8c6c5488-442d-41ea-b935-31c21f226a7c/network-metrics-daemon/0.log" Jul 09 18:16:31.704200 ip-10-0-138-5 kubenswrapper[2565]: I0709 18:16:31.704172 2565 log.go:25] "Finished parsing log file" path="/var/log/pods/openshift-multus_network-metrics-daemon-ggmkn_8c6c5488-442d-41ea-b935-31c21f226a7c/kube-rbac-proxy/0.log"